2025-11-21T21:40:15.836321

Comparative Analysis of Large Language Models for the Machine-Assisted Resolution of User Intentions

Flerlage, Acker, Kao

Large Language Models (LLMs) have emerged as transformative tools for natural language understanding and user intent resolution, enabling tasks such as translation, summarization, and, increasingly, the orchestration of complex workflows. This development signifies a paradigm shift from conventional, GUI-driven user interfaces toward intuitive, language-first interaction paradigms. Rather than manually navigating applications, users can articulate their objectives in natural language, enabling LLMs to orchestrate actions across multiple applications in a dynamic and contextual manner. However, extant implementations frequently rely on cloud-based proprietary models, which introduce limitations in terms of privacy, autonomy, and scalability. For language-first interaction to become a truly robust and trusted interface paradigm, local deployment is not merely a convenience; it is an imperative. This limitation underscores the importance of evaluating the feasibility of locally deployable, open-source, and open-access LLMs as foundational components for future intent-based operating systems. In this study, we examine the capabilities of several open-source and open-access models in facilitating user intention resolution through machine assistance. A comparative analysis is conducted against OpenAI's proprietary GPT-4-based systems to assess performance in generating workflows for various user intentions. The present study offers empirical insights into the practical viability, performance trade-offs, and potential of open LLMs as autonomous, locally operable components in next-generation operating systems. The results of this study inform the broader discussion on the decentralization and democratization of AI infrastructure and point toward a future where user-device interaction becomes more seamless, adaptive, and privacy-conscious through locally embedded intelligence.

academic

Comparative Analysis of Large Language Models for the Machine-Assisted Resolution of User Intentions

基本信息

论文ID: 2510.08576
标题: Comparative Analysis of Large Language Models for the Machine-Assisted Resolution of User Intentions
作者: Justus Flerlage (Technische Universität Berlin), Alexander Acker (logsight.ai GmbH), Odej Kao (Technische Universität Berlin)
分类: cs.SE cs.AI cs.CL cs.HC
发表会议: HAIC 2025: First International Workshop on Human-AI Collaborative Systems
论文链接: https://arxiv.org/abs/2510.08576

摘要

本研究探讨了大语言模型（LLMs）在自然语言理解和用户意图解析方面的变革性作用，特别是在编排复杂工作流程方面的能力。研究关注从传统GUI驱动界面向直观的语言优先交互范式的转变。然而，现有实现往往依赖基于云的专有模型，在隐私、自主性和可扩展性方面存在局限。本文通过比较分析开源和开放访问模型与OpenAI专有GPT-4系统的性能，评估了本地部署开源LLMs作为未来基于意图的操作系统基础组件的可行性。