Court Exhibit·12 JUL 2017
Compute Is the Constraint, Not Cleverness
If the bottleneck is hardware, the winner is whoever buys the most of it first.
Source document — Musk v. Altman (OpenAI) — Docket 351-41 · Musk v. Altman (OpenAI) · 4:24-cv-04722 (CAND), Doc. 379-77, filed 2026-01-06
Excerpt · In Ilya Sutskever's own words
We usually decide that problems are hard because smart people have worked on them unsuccessfully for a long time. It's easy to think that this is true about AI. However, the past five years of progress have shown that the earliest and simplest ideas about AI - neural networks - were right all along, and we needed modern hardware to get them working. Historically, AI breakthroughs have consistently happened with models that take between 7-10 days to train. This means that hardware defines the surface of potential AI breakthroughs. It's not so much that AI progress is a hardware game, any more than physics is a particle accelerator game. But if our computers are too slow, no amount of cleverness will result in AGI, just like if a particle accelerator is too small, we have no shot at figuring out how the universe works. Fast enough computers are a necessary ingredient, and all past failures may have been caused by computers being too slow for AGI. We estimate that Brain has around 100k GPUs, FAIR has around 15-20k, and DeepMind allocates 50 per researcher no questions asked. There is good reason to believe that deep learning hardware will speed up 10x each year for the next four to five years. The world is used to the comparatively leisurely pace of Moore's Law, and is not prepared for the drastic changes in capability this hardware acceleration will bring. Within the next three years, robotics should be completely solved, AI should solve a long-standing unproven theorem, and programming competitions should be won consistently by AIs.
1. Core Message
Ilya Sutskever argues that AI progress is not blocked by a lack of smart ideas. The simple, old idea — neural networks — was right. What changed is hardware. He notes that breakthroughs consistently come from models that take "between 7-10 days to train," meaning faster computers expand the frontier of what is even discoverable. He also names the GPU gap: Google Brain has ~100k GPUs, FAIR ~15-20k, DeepMind allocates "50 per researcher no questions asked." The implied conclusion: OpenAI is outgunned on compute, and compute is the game.
2. What the Executive Is Really Thinking
This reads as a resource argument dressed as a scientific one. Sutskever is making the case that whoever controls the most training hardware controls the pace of AI breakthroughs. He expects "deep learning hardware will speed up 10x each year for the next four to five years" — a pace the world is "not prepared for." He lists competitors' GPU counts to highlight the gap. The subtext: OpenAI needs a dramatic step-up in compute access, or it loses. The bold three-year predictions (robotics "completely solved," a long-standing theorem proved, programming competitions won) raise the urgency.
3. Key Management Lessons
Find the real bottleneck before throwing talent at a problem
What it means
Smart people had worked on AI for decades. The blocker turned out to be hardware speed, not ideas. As Sutskever puts it, "all past failures may have been caused by computers being too slow."
Why it matters
Misdiagnosing the constraint wastes years. You hire more researchers when you should be buying more GPUs — or vice versa.
MBA Perspective
Resource-Based View: the scarce, hard-to-copy input is the source of advantage. Here, that input is compute, not headcount.
Real-world application
Before the next hiring round, ask: if we doubled our team tomorrow, would output double? If not, the bottleneck is elsewhere — infrastructure, data, distribution, or capital.
Measure your competitors on the input that actually matters
What it means
Sutskever does not compare OpenAI to rivals on papers published or PhDs hired. He compares on GPUs: 100k vs 15-20k vs 50-per-researcher.
Why it matters
The metric you benchmark on shapes the budget you fight for. Picking the right one reframes the entire strategic conversation.
MBA Perspective
Competitive Moats: he is implicitly arguing compute is the moat. Whoever has it sets the pace; whoever lacks it cannot catch up by being clever.
Real-world application
If you run a startup, identify the single input your category leader has 5-10x more of. That is usually where the real fight is.
Plan for exponential change, not linear change
What it means
Sutskever warns the world is used to "the comparatively leisurely pace of Moore's Law" and is not ready for 10x annual hardware gains.
Why it matters
Plans built on linear extrapolation collapse when the curve bends. Capacity, hiring, and capital plans need to assume the new pace.
MBA Perspective
Disruptive Innovation: incumbents lose when they plan against the old rate of change while a new curve runs underneath them.
Real-world application
If your industry's underlying input cost or capability is compounding fast (compute, bandwidth, battery density, model quality), build budget scenarios that assume 5-10x shifts, not 10-20% ones.
Tie scientific claims to resource asks
What it means
The memo blends a technical thesis (hardware is the surface of breakthroughs) with a competitive accounting (rivals' GPU counts) and a bold timeline (robotics solved in three years).
Why it matters
Leaders raise resources by linking a credible mechanism to a credible deadline. Mechanism without urgency gets ignored. Urgency without mechanism sounds like hype.
MBA Perspective
No named framework fits cleanly. This is internal capital allocation: making the case for an outsized bet by tying it to a specific causal story.
Real-world application
When asking your board for a 10x budget line item, pair the ask with (a) the mechanism that makes it work and (b) a dated prediction you are willing to be judged on.
4. Strategic Analysis (MBA Style)
Competitive Strategy
The logic is simple: if breakthroughs require models trained in 7-10 days, and hardware is accelerating 10x per year, then the lab with the most GPUs explores the largest surface of possible models. Compute becomes the strategic high ground.
Risk Analysis
The risk Sutskever is pointing at is permanent second-place status. Google Brain at 100k GPUs and DeepMind's no-questions-asked allocation mean OpenAI could be locked out of the experiments that produce the next breakthroughs. Falling behind on compute compounds — you also fall behind on the learning that compute generates.
Build vs Buy Analysis
The document does not directly discuss building vs buying hardware. But the GPU-count framing implies OpenAI must either secure massive compute access (buy/rent at scale, likely through a deep-pocketed partner) or build its own. Doing neither means losing.
Market Dynamics
The AI frontier is being shaped less by ideas and more by capital expenditure. That tilts the industry toward players who can fund hardware at hyperscaler levels. It hints at consolidation: only a few organizations will be able to afford to play.
Long-Term Strategic Implications
If the thesis is right, frontier AI becomes a capital game like semiconductors or aerospace, not a software game. If wrong — if algorithmic ideas matter more than raw compute — then over-investing in hardware locks up capital that could have funded research breadth. The three-year predictions are the falsifiable test.
5. Hidden Insights
- Implicit ask for capital or a partner. Listing rivals' GPU counts is not neutral observation; it is a budget argument. The memo sets up a need that internal resources almost certainly cannot meet alone.
- Strategic urgency. The three-year predictions create a deadline that makes delay costly. If you believe him, you cannot wait two years to act on compute.
- Awareness of a closing window. "10x each year for the next four to five years" suggests a narrow period in which positioning is decided. Whoever scales compute first compounds the lead.
- Talent implication. If DeepMind hands every researcher 50 GPUs, OpenAI's ability to recruit and retain top researchers depends on matching that environment, not just salary.
- Reframing of the field. By comparing AI to particle physics ("if a particle accelerator is too small..."), Sutskever is quietly repositioning AI labs as capital-intensive scientific infrastructure, not software startups — which justifies very different funding norms.
How this surfaced
- Source type
- Court Exhibit
- Case / record
- Musk v. Altman (OpenAI)
- Citation
- 4:24-cv-04722 (CAND), Doc. 379-77, filed 2026-01-06
- Date authored
- July 12, 2017
- License
- Public domain
- Original
- View the primary source →
More from Elon Musk
Elon Musk & Andrej Karpathy ·OpenAI ·1 FEB 2018
If You Can't Win Open, Find a Cash Cow
Open research without a profit engine isn't idealism — it's free R&D for whoever has the bigger bank account.
Elon Musk ·OpenAI ·28 JUN 2017
How to Turn a Partner's Asset Into Your Competitive Weapon
The fastest way to build a moat is to make someone else's resources do the work — before your rivals think to ask.
Elon Musk & Ilya Sutskever ·OpenAI ·20 SEP 2017
When Funding Becomes Leverage, Trust Becomes the Real Asset
The moment your funder's leverage looks like a path to absolute control, your co-founders stop building and start negotiating their exit.
Andy Jassy ·Amazon ·11 APR 2024
How Amazon Turned a Loss Year Into a Cash Machine
When growth slows, the winners are the ones who quietly fix the cost base while everyone else is panicking.
Andy Jassy ·Amazon ·10 APR 2025
Asking 'Why Not?' as a Growth Engine
The biggest businesses don't start with answers — they start with a stubborn refusal to accept the current customer experience as final.
Andy Jassy ·Amazon ·9 APR 2026
Plan the Destination, Expect the Squiggly Path
Strategy isn't a straight line — it's a series of corrections that only look like a plan in hindsight.