The Leadership Letter

Real correspondence from the people running real companies — and what it reveals about leadership.

Measure What Rivals Are Quietly Stealing From You

If a competitor might be eating your lunch one bite at a time, build the instruments to see the bites — don't settle for gut feel.

Thanks for the very helpful summary Cory. I would keep (somewhere in the stack) a couple of other items in mind. 1. I do believe we have a markedly better core search product than they do and we should both accentuate (through Marketing etc) this lead and increase the lead. (In my experience nobody articulates this better than Microsoft CTO - and former head of Bing, which still rolls up to him - Harry Shum.) The search world is in awe of what we do and we here take it for granted. 2. I know we run very detailed longitudinal studies - and this is best discussed offline - analogous to 'what impact is DOG having on our search volume?'. For instance, 'do Amazon Prime members perform fewer commercial queries over time on Google'? So I would hold us to a higher standard than 'it's got to be gut feeling, it's too hard to measure'.

1. Core Message

Prabhakar Raghavan replies to a colleague's summary about a Consumer Council discussion. He makes two points. First, Google has a "markedly better core search product" than rivals and should market that lead harder. Second, Google should measure — not guess — how adjacent products like Amazon Prime quietly erode Google's search volume over time. He pushes back on the idea that such effects are too hard to measure.

2. What the Executive Is Really Thinking

Raghavan is doing two things at once. He is reassuring the team that Google's product quality is real ("the search world is in awe of what we do and we here take it for granted") and he is warning them not to be complacent. The Amazon Prime example is the tell: he is worried about commercial queries — the most monetizable kind — drifting away from Google to vertical destinations. He references "DOG" as an existing internal longitudinal study, suggesting Google already knows how to measure cannibalization and should apply the same rigor to external threats. The deeper anxiety: search is being unbundled by category, and gut feel will miss it until it's too late.

3. Key Management Lessons

Don't take your own strengths for granted

What it means

Raghavan says insiders underrate the quality gap Google has built. He wants Marketing to push harder on it.

Why it matters

When a team lives inside a product, they stop noticing what's great about it. Competitors and customers don't. If you don't say it, nobody else will.

MBA Perspective

This is a Resource-Based View point: a durable advantage (search quality) only translates into market position if customers perceive it. A capability that isn't communicated is half-wasted.

Real-world application

If your product genuinely beats the competition on a specific dimension, run the A/B-style demos, publish the benchmarks, train your sales team on the comparison. Don't assume the market figures it out.

Replace gut feel with longitudinal measurement

What it means

Raghavan refuses to accept that the impact of Amazon Prime on Google's commercial queries is unmeasurable. He points to existing internal studies as proof Google can do this.

Why it matters

The slowest, most dangerous competitive threats are the ones that bleed you gradually. By the time they show up in a quarterly dashboard, the trend is years old.

MBA Perspective

This is about detecting Disruptive Innovation early. Disruption rarely arrives as a frontal assault; it shows up as small, hard-to-measure shifts in user behavior at the edges.

Real-world application

Pick the two or three competitors or substitutes that could plausibly steal your most valuable customer behavior. Build a cohort study that tracks those customers' usage over 12-24 months. Don't wait for the threat to be obvious.

Hold the team to a higher analytical standard

What it means

The line "I would hold us to a higher standard than 'it's got to be gut feeling, it's too hard to measure'" is a direct push against analytical laziness.

Why it matters

Senior leaders set the bar for what counts as a real answer. If "too hard to measure" is accepted, teams will use it as a shield.

MBA Perspective

Classic management discipline: the questions a leader refuses to drop shape what the organization eventually learns to measure.

Real-world application

When a team says something can't be measured, ask: what would a 70%-confidence proxy look like? Usually one exists.

Watch substitutes, not just direct competitors

What it means

Amazon is not a search engine in the traditional sense. But Prime members may run fewer commercial queries on Google because they start product searches on Amazon.

Why it matters

Companies often define their competitive set too narrowly. The real threat is whoever owns the user's starting point for a given intent.

MBA Perspective

Porter's Five Forces — specifically the threat of substitutes. Amazon doesn't have to beat Google at search to take Google's most valuable queries.

Real-world application

List the top five reasons a customer comes to you. For each, ask: who else could be the default starting point for that need? Track them.

4. Strategic Analysis (MBA Style)

Competitive Strategy

Two-pronged: widen the lead in core quality (offense) while instrumenting for category-by-category leakage to vertical players (defense). Marketing is asked to do the offense; analytics is asked to do the defense.

Risk Analysis

The specific risk named is commercial query loss to Amazon Prime. Commercial queries are the ones that monetize. Losing them quietly would degrade revenue without degrading top-line query counts in obvious ways.

Build vs Buy Analysis

The document does not discuss acquisitions. Not applicable here.

Market Dynamics

The note implies search is fragmenting by intent. General search still dominates, but verticals — shopping on Amazon being the cleanest example — can pull the most valuable slices away. Industry structure is shifting from one general engine to many intent-specific starting points.

Long-Term Strategic Implications

If Google measures the leakage early, it can respond — product changes, shopping features, partnerships. If it doesn't, the most lucrative queries erode slowly and the company learns about it from declining ad revenue rather than from leading indicators.

5. Hidden Insights

  • The mention of "DOG" as a known internal study suggests Google has long measured how its own products cannibalize each other; Raghavan wants that same lens turned outward.
  • The Harry Shum reference is pointed: a senior rival voluntarily praises Google's search lead. Raghavan uses an opponent's words as evidence because internal voices are discounted.
  • Naming Amazon — not Bing or DuckDuckGo (the email's stated topic) — as the example reveals where Raghavan thinks the real long-term threat sits. The Consumer Council was nominally about privacy-focused search; he is redirecting attention to commercial-intent leakage.
  • "Best discussed offline" signals the measurement work is sensitive — either competitively or legally — and not for broad email circulation.
Court Exhibit
United States v. Google LLC (Search)
1:20-cv-03010 (DCD), Trial Ex. UPX0500 — DOJ public archive
June 20, 2019
Public domain
View the primary source →