No AI summary available for this article.
Why It Matters
Dwarkesh Podcast : Analysis: from 2019 to 2025, gains in pretraining compute efficiency came mostly from data improvements rather than model improvements — Breaking down 6 years of pretraining progress into data vs model improvements — How much of the rapid progress in AI that we've seen over the last few years 1 …
Provenance
Discovered via TechMeme and published by techmeme.com.
Original description
Dwarkesh Podcast : Analysis: from 2019 to 2025, gains in pretraining compute efficiency came mostly from data improvements rather than model improvements — Breaking down 6 years of pretraining progress into data vs model improvements — How much of the rapid progress in AI that we've seen over the last few years 1 …
Discovered via TechMeme
Headline clustering and publisher rollups from Techmeme.
Publisher: techmeme.com
ID: https://www.techmeme.com/260908/p49#a260908p49 · Indexed about 2 hours ago