The Compute Ceiling: Why AI Hit a Wall
The Compute Ceiling: Why AI Hit a Wall
In 2020, OpenAI trained GPT-3. It took approximately 1,287 megawatt-hours of electricity—enough to power 120 American homes for a year. The cost: somewhere between $4 million and $12 million, depending on how you count.
In 2023, GPT-4