Inkling:我们的开放权重模型

Inkling: Our Open-Weights Model

Thinking Machines Lab Thinking Machines Lab · Thinking Machines Lab · 2026-07-15 · Thinking Machines Lab ↗

打开互动全文版(逐段中英对照 + 图/公式 + 论文问答)→

摘要 · Abstract

我们的使命是构建能够扩展人类意志和判断力的人工智能。我们开发了一个平台,让任何人都可以定制模型,预览了一个为交互式协作而构建的 AI 系统,并发表了新颖的研究。今天,我们通过发布一个从零开始训练的模型来推进我们的使命,该模型提供完整的权重,以便人们可以将其变为自己的模型。我们的模型名为 Inkling,是一个混合专家 Transformer,总参数 975B,激活参数 41B。它支持高达 1M token 的上下文窗口。它在 45 万亿个文本、图像、音频和视频 token 上进行了预训练。它是不同尺寸模型系列中的第一个:同时我们分享了 Inkling-Small 的预览,这是一个轻量级模型,激活参数 12B,采用类似配方训练,以更低的成本和延迟实现了强大的性能。Inkling 原生地对文本、图像和音频进行推理,并通过高效且可控的思考努力来平衡成本与性能。我们将其训练为一个广泛、均衡的基础模型:在多个领域表现强劲,足够灵活以适应变化。Inkling 并不是目前可用的最强整体模型,无论是开放还是封闭的。相反,它是一个……

Our mission is to build AI that extends human will and judgment. We have developed a platform that lets anyone customize models, previewed an AI system built for interactive collaboration, and published novel research. Today we are advancing our mission by releasing a model we trained from scratch with the full weights available, so that people can make it their own. Our model, called Inkling, is a Mixture-of-Experts transformer with 975B total parameters, 41B active. It supports a context window of up to 1M tokens. It was pretrained on 45 trillion tokens of text, images, audio and video. It is the first in a family of models of different sizes: alongside it we are sharing a preview of Inkling-Small, a lighter-weight model with 12B active parameters, trained with a similar recipe, that achieves strong performance with even lower cost and latency. Inkling reasons natively over text, images, and audio, and balances cost with performance through efficient and controllable thinking effort. We trained it to be a broad, balanced foundation model: strong across many domains, flexible enough to adapt. Inkling is not the strongest overall model available today, open or closed. Instead, a co

核心贡献 · Key contributions

局限 · Limitations

论文章节 · Sections(共 20)

阅读逐段中英对照全文 →