Court Exhibit·20 JUN 2019
Measure What Rivals Are Quietly Stealing From You
If a competitor might be eating your lunch one bite at a time, build the instruments to see the bites — don't settle for gut feel.
Source document — Email from Prabhakar Raghavan to Cory Ondrejka: Consumer Council Follow-Up — DuckDuckGo and Search Privacy Strategy · United States v. Google LLC (Search) · 1:20-cv-03010 (DCD), Trial Ex. UPX0500 — DOJ public archive
Excerpt · In Prabhakar Raghavan's own words
Thanks for the very helpful summary Cory. I would keep (somewhere in the stack) a couple of other items in mind. 1. I do believe we have a markedly better core search product than they do and we should both accentuate (through Marketing etc) this lead and increase the lead. (In my experience nobody articulates this better than Microsoft CTO - and former head of Bing, which still rolls up to him - Harry Shum.) The search world is in awe of what we do and we here take it for granted. 2. I know we run very detailed longitudinal studies - and this is best discussed offline - analogous to 'what impact is DOG having on our search volume?'. For instance, 'do Amazon Prime members perform fewer commercial queries over time on Google'? So I would hold us to a higher standard than 'it's got to be gut feeling, it's too hard to measure'.
1. Core Message
Prabhakar Raghavan replies to a colleague's summary about a Consumer Council discussion. He makes two points. First, Google has a "markedly better core search product" than rivals and should market that lead harder. Second, Google should measure — not guess — how adjacent products like Amazon Prime quietly erode Google's search volume over time. He pushes back on the idea that such effects are too hard to measure.
2. What the Executive Is Really Thinking
Raghavan is doing two things at once. He is reassuring the team that Google's product quality is real ("the search world is in awe of what we do and we here take it for granted") and he is warning them not to be complacent. The Amazon Prime example is the tell: he is worried about commercial queries — the most monetizable kind — drifting away from Google to vertical destinations. He references "DOG" as an existing internal longitudinal study, suggesting Google already knows how to measure cannibalization and should apply the same rigor to external threats. The deeper anxiety: search is being unbundled by category, and gut feel will miss it until it's too late.
3. Key Management Lessons
Don't take your own strengths for granted
What it means
Raghavan says insiders underrate the quality gap Google has built. He wants Marketing to push harder on it.
Why it matters
When a team lives inside a product, they stop noticing what's great about it. Competitors and customers don't. If you don't say it, nobody else will.
MBA Perspective
This is a Resource-Based View point: a durable advantage (search quality) only translates into market position if customers perceive it. A capability that isn't communicated is half-wasted.
Real-world application
If your product genuinely beats the competition on a specific dimension, run the A/B-style demos, publish the benchmarks, train your sales team on the comparison. Don't assume the market figures it out.
Replace gut feel with longitudinal measurement
What it means
Raghavan refuses to accept that the impact of Amazon Prime on Google's commercial queries is unmeasurable. He points to existing internal studies as proof Google can do this.
Why it matters
The slowest, most dangerous competitive threats are the ones that bleed you gradually. By the time they show up in a quarterly dashboard, the trend is years old.
MBA Perspective
This is about detecting Disruptive Innovation early. Disruption rarely arrives as a frontal assault; it shows up as small, hard-to-measure shifts in user behavior at the edges.
Real-world application
Pick the two or three competitors or substitutes that could plausibly steal your most valuable customer behavior. Build a cohort study that tracks those customers' usage over 12-24 months. Don't wait for the threat to be obvious.
Hold the team to a higher analytical standard
What it means
The line "I would hold us to a higher standard than 'it's got to be gut feeling, it's too hard to measure'" is a direct push against analytical laziness.
Why it matters
Senior leaders set the bar for what counts as a real answer. If "too hard to measure" is accepted, teams will use it as a shield.
MBA Perspective
Classic management discipline: the questions a leader refuses to drop shape what the organization eventually learns to measure.
Real-world application
When a team says something can't be measured, ask: what would a 70%-confidence proxy look like? Usually one exists.
Watch substitutes, not just direct competitors
What it means
Amazon is not a search engine in the traditional sense. But Prime members may run fewer commercial queries on Google because they start product searches on Amazon.
Why it matters
Companies often define their competitive set too narrowly. The real threat is whoever owns the user's starting point for a given intent.
MBA Perspective
Porter's Five Forces — specifically the threat of substitutes. Amazon doesn't have to beat Google at search to take Google's most valuable queries.
Real-world application
List the top five reasons a customer comes to you. For each, ask: who else could be the default starting point for that need? Track them.
4. Strategic Analysis (MBA Style)
Competitive Strategy
Two-pronged: widen the lead in core quality (offense) while instrumenting for category-by-category leakage to vertical players (defense). Marketing is asked to do the offense; analytics is asked to do the defense.
Risk Analysis
The specific risk named is commercial query loss to Amazon Prime. Commercial queries are the ones that monetize. Losing them quietly would degrade revenue without degrading top-line query counts in obvious ways.
Build vs Buy Analysis
The document does not discuss acquisitions. Not applicable here.
Market Dynamics
The note implies search is fragmenting by intent. General search still dominates, but verticals — shopping on Amazon being the cleanest example — can pull the most valuable slices away. Industry structure is shifting from one general engine to many intent-specific starting points.
Long-Term Strategic Implications
If Google measures the leakage early, it can respond — product changes, shopping features, partnerships. If it doesn't, the most lucrative queries erode slowly and the company learns about it from declining ad revenue rather than from leading indicators.
5. Hidden Insights
- The mention of "DOG" as a known internal study suggests Google has long measured how its own products cannibalize each other; Raghavan wants that same lens turned outward.
- The Harry Shum reference is pointed: a senior rival voluntarily praises Google's search lead. Raghavan uses an opponent's words as evidence because internal voices are discounted.
- Naming Amazon — not Bing or DuckDuckGo (the email's stated topic) — as the example reveals where Raghavan thinks the real long-term threat sits. The Consumer Council was nominally about privacy-focused search; he is redirecting attention to commercial-intent leakage.
- "Best discussed offline" signals the measurement work is sensitive — either competitively or legally — and not for broad email circulation.
How this surfaced
- Source type
- Court Exhibit
- Case / record
- United States v. Google LLC (Search)
- Citation
- 1:20-cv-03010 (DCD), Trial Ex. UPX0500 — DOJ public archive
- Date authored
- June 20, 2019
- License
- Public domain
- Original
- View the primary source →
Netflix Management ·Netflix ·21 APR 2014
Pick Your Fight: Beat Each Rival On A Different Edge
When you face two different types of competitors, you need two different weapons — not one slogan that pretends to work against both.
Reed Hastings & Netflix Management ·Netflix ·16 JUL 2020
Tell investors bad news before they ask for it
The best leaders don't hide a slowdown behind a great quarter — they name it, explain it, and move on to what comes next.
Ted Sarandos & Greg Peters & Spence Neumann & Spencer Wang ·Netflix ·18 OCT 2023
How Netflix Turned Content Spending Into a Profit Machine
When your cost structure and your competitive moat are the same thing, spending more is actually the safest move you can make.