Open letters about AI development
打开互动全文版(逐段中英对照 + 图/公式 + 论文问答)→我撰写了这份关于过去几周公开信的摘要,作为我仅限赞助人阅读的新闻通讯的一部分,但我决定也在此分享。由微软主导的《开放权重与美国 AI 领导力》信函,日期为 7 月 24 日,已有包括英伟达(见黄仁勋的首条推文)、亚马逊、Y Combinator、Linux 基金会以及(后来签署的)OpenAI 在内的 235 家 AI 相关公司签署。这显然是为了反驳当前美国政府因“安全”担忧而禁止或限制开放权重模型的任何倾向——考虑到 Claude Fable 5 的遭遇,这种担忧是合理的。
I wrote this summary of the past few weeks of open letters as a section of my sponsors-only newsletter, but I've decided to share it here as well. Open Weights and American AI Leadership was shepherded by Microsoft, dated July 24th, and signed by 235 AI-adjacent companies including NVIDIA (see Jensen's first ever tweet), Amazon, Y Combinator, The Linux Foundation, and (a later signer) OpenAI. It's clearly an argument designed to counter any instincts by the current US government to ban or limit open-weight models over "safety" concerns - a reasonable consideration given what happened to Claude Fable 5!
我把过去几周关于公开信的总结写成了我赞助者专属通讯的一个部分,但决定也在这里分享。
I wrote this summary of the past few weeks of open letters as a section of my sponsors-only newsletter, but I've decided to share it here as well.
《开放权重与美国 AI 领导力》由微软主导,日期为 7 月 24 日,共有 235 家 AI 相关公司签署,包括 NVIDIA(见 Jensen 有史以来的第一条推文)、亚马逊、Y Combinator、Linux 基金会,以及(后来签署的)OpenAI。
Open Weights and American AI Leadership was shepherded by Microsoft, dated July 24th, and signed by 235 AI-adjacent companies including NVIDIA (see Jensen's first ever tweet), Amazon, Y Combinator, The Linux Foundation, and (a later signer) OpenAI.
这显然是为了反驳当前美国政府因“安全”担忧而禁止或限制开放权重模型的任何倾向——考虑到 Claude Fable 5 的遭遇,这种担忧是合理的!
It's clearly an argument designed to counter any instincts by the current US government to ban or limit open-weight models over "safety" concerns - a reasonable consideration given what happened to Claude Fable 5!
信中令人惊讶的一点是,它支持蒸馏,即模型在其他模型的输出上进行训练:
The one surprising note in the letter is that it comes out in support of distillation, where models train on output from other models:
值得注意的是,Anthropic 缺席签署,并在三天后发布了他们自己的回应《我们对开放权重模型的立场》。CEO Dario Amodei 强调了威权政府构建“比美国更强大的 AI 模型”的风险,以及模型被“滥用于网络攻击或生物攻击”的风险,并呼吁“打击工业规模的蒸馏操作”,同时表示“Anthropic 从未主张禁止开放权重模型”。
Notably absent from the signatures: Anthropic, who published their own response, "Our position on open-weights models," three days later. CEO Dario Amodei doubled down on the risk of authoritarian governments building "AI models that are more powerful than those built by the US", and models being "misused to carry out cyberattacks or biological attacks", and called for "a crackdown on industrial-scale distillation operations", while also stating that "Anthropic has never advocated for a ban on open-weights models".
随后,7 月 28 日发布了《Pacing the Frontier》,其签名者包括“前沿 AI 公司的 1,324 名员工”——如 Jakub Pachocki(OpenAI 首席科学家)、Ilya Sutskever(Safe Superintelligence Inc,曾任 OpenAI)、Dario Amodei(Anthropic)、Jack Clark(Anthropic)等。他们的核心信息是:
Then on July 28th, 'Pacing the Frontier' was published, featuring signatures from '1,324 employees of frontier AI companies' - with names like Jakub Pachocki (Chief Scientist, OpenAI), Ilya Sutskever (Safe Superintelligence Inc, previously OpenAI), Dario Amodei (Anthropic), Jack Clark (Anthropic) and more. Their core message:
他们的担忧是,激烈的竞争压力加上由自动化 AI 研究引发的 AI 加速进步——考虑到 Anthropic 用 Claude Code 编写了 80%的代码,OpenAI 让 Sol 将端到端服务成本降低了 20%,以及 Kimi K3 设计了一款芯片来服务基于其自身架构构建的纳米模型,你就可以理解为什么人们现在更加认真地对待这一风险。
Their concern is intense competitive pressure combined with accelerated AI progress caused by automated AI research - and given that Anthropic produces 80% of their code with Claude Code, OpenAI had Sol reduce their end-to-end serving costs by 20%, and Kimi K3 designed a chip to serve a nano model built on its own architecture, you can see why people are taking that risk more seriously right now.