Qwen-CUA:原生计算机使用,几乎适用于一切

Qwen-CUA: Native Computer Use for (almost) Everything

林俊旸 Junyang Lin · · 2026-08-03 · arXiv:2608.02352 ↗

打开互动全文版(逐段中英对照 + 图/公式 + 论文问答)→

摘要 · Abstract

原生计算机使用为智能体提供了一个通用接口,使其能够操作人们可用的几乎任何软件,但这需要长时间跨度的状态跟踪、大规模交互式体验以及从稀疏但可验证的结果中学习。我们推出了 Qwen-CUA,一个原生计算机使用智能体,基于 397B-A17B 参数的 Qwen 混合专家模型。它仅通过截图观察,并通过键盘和鼠标事件进行操作,不依赖 DOM 树、可访问性元数据或特定任务的 API。其脚手架维护最多 20 个活动截图,并将较旧的视觉历史折叠成固定大小的块,以保留近期证据并复用提示前缀。在训练方面,我们构建了一个云部署舰队,可访问近 10 万个 vCPU 和数万个并发环境,构建了约 4 万个可验证任务,并收集了涵盖日常和专业软件的个性化长时程工作流。我们通过可验证奖励和轨迹切片优化完整轨迹,同时迭代训练运行刷新监督数据并重新校准强化学习任务。在八个基准测试中,Qwen-CUA 超越了 Qwen3.7,并与领先的专有系统保持竞争力,在 OSWorld-Verified 上达到 86.2,在 OSWorld 2.0 上达到 18.5/48.4 的二元/部分完成率。将相同配方扩展到超过一万亿参数的模型,得到 Qwen-CUA-Max,将这些分数提升至 87.6 和 21.2/53.3。Qwen-CUA 还将 RedTeamCUA 攻击成功率从 36.6 降至 16.4(相对于 Qwen3.7)。效率分析、浏览器部署和 Bash 增强实验进一步刻画了实际行为。这些结果确立了原生计算机使用作为广泛能力的智能体基础,并突出了可验证交互和混合工具使用作为关键方向。

Native computer use offers a general interface for agents to operate almost any software available to people, but requires long-horizon state tracking, large-scale interactive experience, and learning from sparse yet verifiable outcomes. We introduce Qwen-CUA, a native computer-use agent with a 397B-A17B Qwen mixture-of-experts backbone. It observes only screenshots and acts through keyboard and mouse events, without DOM trees, accessibility metadata, or task-specific APIs. Its scaffold maintains up to 20 active screenshots and folds older visual history in fixed-size blocks to retain recent evidence while preserving reusable prompt prefixes. For training, we build a cloud rollout fleet with access to nearly 100,000 vCPUs and tens of thousands of concurrent environments, construct approximately 40,000 verifiable tasks, and collect personalized long-horizon workflows across everyday and professional software. We optimize complete trajectories with verifiable rewards and trajectory slicing, while iterative training runs refresh supervised data and recalibrate reinforcement-learning tasks. Across eight benchmarks, Qwen-CUA outperforms Qwen3.7 and remains competitive with leading proprietary systems, reaching 86.2 on OSWorld-Verified and 18.5/48.4 binary/partial completion on OSWorld 2.0. Scaling the same recipe to a model with over one trillion parameters yields Qwen-CUA-Max, improving these scores to 87.6 and 21.2/53.3. Qwen-CUA also reduces RedTeamCUA attack success from 36.6 to 16.4 relative to Qwen3.7. Efficiency analyses, a browser deployment, and Bash-augmented experiments further characterize practical behavior. These results establish native computer use as a broadly capable agent foundation and highlight scalable verifiable interaction and hybrid tool use as key directions.

核心贡献 · Key contributions

局限 · Limitations

论文章节 · Sections(共 21)

阅读逐段中英对照全文 →