苦涩的教训

The Bitter Lesson

理查德·萨顿 Richard Sutton · U. Alberta · 2019-03-13 · Incomplete Ideas ↗

打开互动全文版(逐段中英对照 + 图/公式 + 论文问答)→

摘要 · Abstract

从 70 年人工智能研究中可以读出的最大教训是,利用计算的通用方法最终是最有效的,而且优势巨大。其根本原因是摩尔定律,或者说每单位计算成本持续指数级下降的普遍规律。大多数人工智能研究都是在假设智能体可用的计算量恒定不变的情况下进行的(在这种情况下,利用人类知识是提高性能的唯一途径之一),但比典型研究项目稍长的时间后,大量的计算不可避免地变得可用。为了在短期内寻求改进,研究人员试图利用他们对领域的人类知识,但从长远来看,唯一重要的是利用计算。这两者并不一定相互对立,但在实践中往往如此。花在一个方面的时间就是花在另一个方面的时间。对一种或另一种方法的投入存在心理承诺。而人类知识方法往往会使方法复杂化,从而使其不太适合利用计算的通用方法。

The biggest lesson that can be read from 70 years of AI research is that general methods that leverage computation are ultimately the most effective, and by a large margin. The ultimate reason for this is Moore's law, or rather its generalization of continued exponentially falling cost per unit of computation. Most AI research has been conducted as if the computation available to the agent were constant (in which case leveraging human knowledge would be one of the only ways to improve performance) but, over a slightly longer time than a typical research project, massively more computation inevitably becomes available. Seeking an improvement that makes a difference in the shorter term, researchers seek to leverage their human knowledge of the domain, but the only thing that matters in the long run is the leveraging of computation. These two need not run counter to each other, but in practice they tend to. Time spent on one is time not spent on the other. There are psychological commitments to investment in one approach or the other. And the human-knowledge approach tends to complicate methods in ways that make them less suited to taking advantage of general methods leveraging comput

核心贡献 · Key contributions

局限 · Limitations

论文章节 · Sections(共 1)

阅读逐段中英对照全文 →