Preview · Not reviewed for publication
Attributed viewpoint · Not a direct quote
Amodei acknowledges that running out of high-quality internet data is a possible scaling limit. While trillions of words exist online, much is repetitive, low-quality search engine optimization content, or potentially future AI-generated text, constraining useful training material.
Preview links work in this environment. The public card URL becomes available only after publication.
Translations are for reading; original excerpts remain the evidence.
Original excerpt
we simply run out of data. There’s only so much data on the internet, and there’s issues with the quality of the data. You can get hundreds of trillions of words on the internet, but a lot of it is repetitive or it’s search engine optimization drivel
Start time comes from the supplied transcript. Playback alignment is awaiting review.
nafyi.