The Library / Intelligence & systems

The Bitter Lesson

Richard S. Sutton

Why general methods that scale with computation tend to win in AI.

Read it ↗

Worth keeping

  1. 1

    Across several AI fields, general methods have overtaken approaches built around detailed human knowledge.

  2. 2

    The falling cost of computation changes which research approaches can keep improving.

  3. 3

    Sutton highlights search and learning as methods that can exploit much larger amounts of computation.

The two methods that seem to scale arbitrarily in this way are search and learning.

In Not Boring5 essays that cite it