Ovis2.5 技术报告

Ovis2.5 Technical Report

卢诗音 Shiyin Lu · Alibaba · 2025-08-15 · arXiv:2508.11737 ↗ · 被引 78

打开互动全文版(逐段中英对照 + 图/公式 + 论文问答)→

摘要 · Abstract

我们提出 Ovis2.5,它是 Ovis2 的升级版,专为原生分辨率视觉感知和强大多模态推理而设计。Ovis2.5 集成了一个原生分辨率视觉变换器,以图像原始的可变分辨率进行处理,避免了固定分辨率分块带来的质量下降,同时保留了精细细节和全局布局——这对于复杂图表等视觉密集内容至关重要。为了增强推理能力,我们训练模型超越线性思维链,进行反思——包括自我检查和修正。这一高级能力在推理时作为可选的“思考模式”暴露,允许用户在困难输入上以延迟换取更高准确性。该模型通过一个全面的五阶段课程进行训练,逐步构建其技能。过程从基础视觉和多模态预训练开始,经过大规模指令微调,最终使用 DPO 和 GRPO 进行对齐和推理增强。为了高效扩展这些升级,我们采用了多模态数据打包和混合并行,实现了显著的端到端加速。我们发布两个开源模型:Ovis2.5-9B 和 Ovis2.5-2B。后者延续了 Ovis2 的“小模型,大性能”理念,非常适合资源受限的设备端场景。在 OpenCompass 多模态排行榜上,Ovis2.5-9B 平均得分为 78.3,相比前代 Ovis2-8B 有显著提升,并在 40B 以下参数范围的开源多模态大语言模型中达到最先进水平;Ovis2.5-2B 得分为 73.9,在其规模上确立了 SOTA。除了总分,Ovis2.5 在 STEM 基准测试中取得领先结果,在定位和视频任务上表现出色,并在复杂图表分析上达到其规模的开源 SOTA。

We present Ovis2.5, a successor to Ovis2 designed for native-resolution visual perception and strong multimodal reasoning. Ovis2.5 integrates a native-resolution vision transformer that processes images at their native, variable resolutions, avoiding the degradation from fixed-resolution tiling and preserving both fine detail and global layout -- crucial for visually dense content like complex charts. To strengthen reasoning, we train the model to move beyond linear chain-of-thought and perform reflection -- including self-checking and revision. This advanced capability is exposed as an optional "thinking mode" at inference time, allowing users to trade latency for enhanced accuracy on difficult inputs. The model is trained via a comprehensive five-phase curriculum that progressively builds its skills. The process begins with foundational visual and multimodal pretraining, advances through large-scale instruction tuning, and culminates in alignment and reasoning enhancement using DPO and GRPO. To scale these upgrades efficiently, we employ multimodal data packing and hybrid parallelism, yielding a significant end-to-end speedup. We release two open-source models: Ovis2.5-9B and Ovis2.5-2B. The latter continues the "small model, big performance" philosophy of Ovis2, making it ideal for resource-constrained, on-device scenarios. On the OpenCompass multimodal leaderboard, Ovis2.5-9B averages 78.3, marking a substantial improvement over its predecessor, Ovis2-8B, and achieving state-of-the-art results among open-source MLLMs in the sub-40B parameter range; Ovis2.5-2B scores 73.9, establishing SOTA for its size. Beyond aggregate scores, Ovis2.5 achieves leading results on STEM benchmarks, exhibits strong capabilities on grounding and video tasks, and achieves open-source SOTA at its scale for complex chart analysis.

核心贡献 · Key contributions

局限 · Limitations

论文章节 · Sections(共 17)

阅读逐段中英对照全文 →