Sutton clarifies the Bitter Lesson: brute compute alone is not enough
The non-obvious takeaway is that Sutton himself rejects the compute-only reading of his essay, giving ammunition to researchers arguing that architectural innovation remains essential alongside scaling. Builders choosing between pouring budget into compute versus exploring new learning mechanisms should find the hardcoding-versus-architecture distinction useful as a design lens. The thread also grounds the debate with concrete examples, from autonomous driving rule systems to the Transformer, making it a crisp reference in scaling-versus-algorithm arguments.
