The Leadership Letter

Real correspondence from the people running real companies — and what it reveals about leadership.

Compute Is the Constraint, Not Cleverness

If the bottleneck is hardware, the winner is whoever buys the most of it first.

We usually decide that problems are hard because smart people have worked on them unsuccessfully for a long time. It's easy to think that this is true about AI. However, the past five years of progress have shown that the earliest and simplest ideas about AI - neural networks - were right all along, and we needed modern hardware to get them working. Historically, AI breakthroughs have consistently happened with models that take between 7-10 days to train. This means that hardware defines the surface of potential AI breakthroughs. It's not so much that AI progress is a hardware game, any more than physics is a particle accelerator game. But if our computers are too slow, no amount of cleverness will result in AGI, just like if a particle accelerator is too small, we have no shot at figuring out how the universe works. Fast enough computers are a necessary ingredient, and all past failures may have been caused by computers being too slow for AGI. We estimate that Brain has around 100k GPUs, FAIR has around 15-20k, and DeepMind allocates 50 per researcher no questions asked. There is good reason to believe that deep learning hardware will speed up 10x each year for the next four to five years. The world is used to the comparatively leisurely pace of Moore's Law, and is not prepared for the drastic changes in capability this hardware acceleration will bring. Within the next three years, robotics should be completely solved, AI should solve a long-standing unproven theorem, and programming competitions should be won consistently by AIs.

1. Core Message

Ilya Sutskever argues that AI progress is not blocked by a lack of smart ideas. The simple, old idea — neural networks — was right. What changed is hardware. He notes that breakthroughs consistently come from models that take "between 7-10 days to train," meaning faster computers expand the frontier of what is even discoverable. He also names the GPU gap: Google Brain has ~100k GPUs, FAIR ~15-20k, DeepMind allocates "50 per researcher no questions asked." The implied conclusion: OpenAI is outgunned on compute, and compute is the game.

2. What the Executive Is Really Thinking

This reads as a resource argument dressed as a scientific one. Sutskever is making the case that whoever controls the most training hardware controls the pace of AI breakthroughs. He expects "deep learning hardware will speed up 10x each year for the next four to five years" — a pace the world is "not prepared for." He lists competitors' GPU counts to highlight the gap. The subtext: OpenAI needs a dramatic step-up in compute access, or it loses. The bold three-year predictions (robotics "completely solved," a long-standing theorem proved, programming competitions won) raise the urgency.

3. Key Management Lessons

Find the real bottleneck before throwing talent at a problem

What it means

Smart people had worked on AI for decades. The blocker turned out to be hardware speed, not ideas. As Sutskever puts it, "all past failures may have been caused by computers being too slow."

Why it matters

Misdiagnosing the constraint wastes years. You hire more researchers when you should be buying more GPUs — or vice versa.

MBA Perspective

Resource-Based View: the scarce, hard-to-copy input is the source of advantage. Here, that input is compute, not headcount.

Real-world application

Before the next hiring round, ask: if we doubled our team tomorrow, would output double? If not, the bottleneck is elsewhere — infrastructure, data, distribution, or capital.

Measure your competitors on the input that actually matters

What it means

Sutskever does not compare OpenAI to rivals on papers published or PhDs hired. He compares on GPUs: 100k vs 15-20k vs 50-per-researcher.

Why it matters

The metric you benchmark on shapes the budget you fight for. Picking the right one reframes the entire strategic conversation.

MBA Perspective

Competitive Moats: he is implicitly arguing compute is the moat. Whoever has it sets the pace; whoever lacks it cannot catch up by being clever.

Real-world application

If you run a startup, identify the single input your category leader has 5-10x more of. That is usually where the real fight is.

Plan for exponential change, not linear change

What it means

Sutskever warns the world is used to "the comparatively leisurely pace of Moore's Law" and is not ready for 10x annual hardware gains.

Why it matters

Plans built on linear extrapolation collapse when the curve bends. Capacity, hiring, and capital plans need to assume the new pace.

MBA Perspective

Disruptive Innovation: incumbents lose when they plan against the old rate of change while a new curve runs underneath them.

Real-world application

If your industry's underlying input cost or capability is compounding fast (compute, bandwidth, battery density, model quality), build budget scenarios that assume 5-10x shifts, not 10-20% ones.

Tie scientific claims to resource asks

What it means

The memo blends a technical thesis (hardware is the surface of breakthroughs) with a competitive accounting (rivals' GPU counts) and a bold timeline (robotics solved in three years).

Why it matters

Leaders raise resources by linking a credible mechanism to a credible deadline. Mechanism without urgency gets ignored. Urgency without mechanism sounds like hype.

MBA Perspective

No named framework fits cleanly. This is internal capital allocation: making the case for an outsized bet by tying it to a specific causal story.

Real-world application

When asking your board for a 10x budget line item, pair the ask with (a) the mechanism that makes it work and (b) a dated prediction you are willing to be judged on.

4. Strategic Analysis (MBA Style)

Competitive Strategy

The logic is simple: if breakthroughs require models trained in 7-10 days, and hardware is accelerating 10x per year, then the lab with the most GPUs explores the largest surface of possible models. Compute becomes the strategic high ground.

Risk Analysis

The risk Sutskever is pointing at is permanent second-place status. Google Brain at 100k GPUs and DeepMind's no-questions-asked allocation mean OpenAI could be locked out of the experiments that produce the next breakthroughs. Falling behind on compute compounds — you also fall behind on the learning that compute generates.

Build vs Buy Analysis

The document does not directly discuss building vs buying hardware. But the GPU-count framing implies OpenAI must either secure massive compute access (buy/rent at scale, likely through a deep-pocketed partner) or build its own. Doing neither means losing.

Market Dynamics

The AI frontier is being shaped less by ideas and more by capital expenditure. That tilts the industry toward players who can fund hardware at hyperscaler levels. It hints at consolidation: only a few organizations will be able to afford to play.

Long-Term Strategic Implications

If the thesis is right, frontier AI becomes a capital game like semiconductors or aerospace, not a software game. If wrong — if algorithmic ideas matter more than raw compute — then over-investing in hardware locks up capital that could have funded research breadth. The three-year predictions are the falsifiable test.

5. Hidden Insights

  • Implicit ask for capital or a partner. Listing rivals' GPU counts is not neutral observation; it is a budget argument. The memo sets up a need that internal resources almost certainly cannot meet alone.
  • Strategic urgency. The three-year predictions create a deadline that makes delay costly. If you believe him, you cannot wait two years to act on compute.
  • Awareness of a closing window. "10x each year for the next four to five years" suggests a narrow period in which positioning is decided. Whoever scales compute first compounds the lead.
  • Talent implication. If DeepMind hands every researcher 50 GPUs, OpenAI's ability to recruit and retain top researchers depends on matching that environment, not just salary.
  • Reframing of the field. By comparing AI to particle physics ("if a particle accelerator is too small..."), Sutskever is quietly repositioning AI labs as capital-intensive scientific infrastructure, not software startups — which justifies very different funding norms.
Court Exhibit
Musk v. Altman (OpenAI)
4:24-cv-04722 (CAND), Doc. 379-77, filed 2026-01-06
July 12, 2017
Public domain
View the primary source →