Topics / AI infrastructurePreview · Not reviewed for publication
Attributed viewpoint · Not a direct quote
Linear scaling of three ingredients
Amodei compares model scaling to a chemical reaction requiring three ingredients—bigger networks, longer training times, and more data—to be scaled linearly together. Scaling only one ingredient causes the process to stall because the other reagents run out.
Behind the viewpoint
Translations are for reading; original excerpts remain the evidence.
Dario Amodei, Amanda Askell & Chris Olah on AI Development and Safety
Original excerpt
almost like a chemical reaction, you have three ingredients in the chemical reaction and you need to linearly scale up the three ingredients. If you scale up one, not the others, you run out of the other reagents and the reaction stops.
Context
Start time comes from the supplied transcript. Playback alignment is awaiting review.