Court Exhibit·12 JUL 2017
Compute Is the Constraint, Not Cleverness
If the bottleneck is hardware, the winner is whoever buys the most of it first.
Source document — Musk v. Altman (OpenAI) — Docket 351-41 · Musk v. Altman (OpenAI) · 4:24-cv-04722 (CAND), Doc. 379-77, filed 2026-01-06
Excerpt · In Ilya Sutskever's own words
We usually decide that problems are hard because smart people have worked on them unsuccessfully for a long time. It's easy to think that this is true about AI. However, the past five years of progress have shown that the earliest and simplest ideas about AI - neural networks - were right all along, and we needed modern hardware to get them working. Historically, AI breakthroughs have consistently happened with models that take between 7-10 days to train. This means that hardware defines the surface of potential AI breakthroughs. It's not so much that AI progress is a hardware game, any more than physics is a particle accelerator game. But if our computers are too slow, no amount of cleverness will result in AGI, just like if a particle accelerator is too small, we have no shot at figuring out how the universe works. Fast enough computers are a necessary ingredient, and all past failures may have been caused by computers being too slow for AGI. We estimate that Brain has around 100k GPUs, FAIR has around 15-20k, and DeepMind allocates 50 per researcher no questions asked. There is good reason to believe that deep learning hardware will speed up 10x each year for the next four to five years. The world is used to the comparatively leisurely pace of Moore's Law, and is not prepared for the drastic changes in capability this hardware acceleration will bring. Within the next three years, robotics should be completely solved, AI should solve a long-standing unproven theorem, and programming competitions should be won consistently by AIs.
The daily letter · Free
This edition is for members — but the daily letter is free.
One real corporate email, and the lesson it teaches, in your inbox every weekday morning. Free. Unsubscribe in one click.
How this surfaced
- Source type
- Court Exhibit
- Case / record
- Musk v. Altman (OpenAI)
- Citation
- 4:24-cv-04722 (CAND), Doc. 379-77, filed 2026-01-06
- Date authored
- July 12, 2017
- License
- Public domain
- Original
- View the primary source →
More from Elon Musk
Elon Musk & Ilya Sutskever ·OpenAI ·18 FEB 2016
When A Rival Leaps Ahead, Change Your Cadence
A single alarming data point should reset how often your leadership team talks, not just what they talk about.
Ilya Sutskever ·OpenAI ·12 JUL 2017
Turn A Research Problem Into A Capital Problem
When you can't invent the answer, buy the conditions under which the answer becomes findable.
Sam Altman ·OpenAI ·6 MAR 2019
Design The Structure Before You Need The Money
When your mission and your capital needs collide, invent the vehicle first — then go raise.
Elon Musk & Ilya Sutskever ·OpenAI ·18 FEB 2016
When A Rival Leaps Ahead, Change Your Cadence
A single alarming data point should reset how often your leadership team talks, not just what they talk about.
Ilya Sutskever ·OpenAI ·12 JUL 2017
Turn A Research Problem Into A Capital Problem
When you can't invent the answer, buy the conditions under which the answer becomes findable.
Sam Altman ·OpenAI ·6 MAR 2019
Design The Structure Before You Need The Money
When your mission and your capital needs collide, invent the vehicle first — then go raise.