追踪大型语言模型的思维

Tracing the thoughts of a large language model

Anthropic Anthropic · Anthropic · 2025-03-27 · Anthropic Research ↗

打开互动全文版(逐段中英对照 + 图/公式 + 论文问答)→

摘要 · Abstract

像 Claude 这样的语言模型并非由人类直接编程,而是通过大量数据进行训练。在训练过程中,它们学会了解决问题的策略。这些策略被编码在模型为每个词所执行的数十亿次计算中,对我们(模型的开发者)来说难以理解。这意味着我们并不了解模型完成大多数任务的方式。了解 Claude 这样的模型如何“思考”,将使我们能够更好地理解它们的能力,并帮助确保它们按照我们的意图行事。例如:Claude 能说几十种语言。它在“头脑中”使用的是什么语言(如果有的话)?

Language models like Claude aren't programmed directly by humans—instead, they‘re trained on large amounts of data. During that training process, they learn their own strategies to solve problems. These strategies are encoded in the billions of computations a model performs for every word it writes. They arrive inscrutable to us, the model’s developers. This means that we don’t understand how models do most of the things they do. Knowing how models like Claude think would allow us to have a better understanding of their abilities, as well as help us ensure that they’re doing what we intend them to. For example: * Claude can speak dozens of languages.

核心贡献 · Key contributions

局限 · Limitations

论文章节 · Sections(共 9)

阅读逐段中英对照全文 →