Topics / AI infrastructure

Preview · Not reviewed for publication

Attributed viewpoint · Not a direct quote

Linear scaling of three ingredients

Amodei compares model scaling to a chemical reaction requiring three ingredients—bigger networks, longer training times, and more data—to be scaled linearly together. Scaling only one ingredient causes the process to stall because the other reagents run out.

Preview links work in this environment. The public card URL becomes available only after publication.

Behind the viewpoint

Translations are for reading; original excerpts remain the evidence.

Dario Amodei, Amanda Askell & Chris Olah on AI Development and Safety

Original excerpt

almost like a chemical reaction, you have three ingredients in the chemical reaction and you need to linearly scale up the three ingredients. If you scale up one, not the others, you run out of the other reagents and the reaction stops.
Context

Start time comes from the supplied transcript. Playback alignment is awaiting review.