
The Challenge
The client, an EU sports equipment start-up, relied on branded search to capture high-intent demand. Organic rankings were strong, and none of the obvious direct competitors appeared to be bidding on its brand terms.
Although brand search looked like having low incremental value, pausing it could hit revenue immediately. The client needed to understand the true incremental value of brand search before making a decision that could damage their bottom line.
The Solution
To measure the true value of brand search, we ran a geo holdout test with spend suppression across three key markets. Regions were split into treatment and control groups, balanced on historic revenue levels and dependence on branded search. In the treatment regions, branded search activity was paused for 6 weeks, while the control regions were left unchanged.
Because this was a holdout design, the goal was to measure the commercial loss caused by removing coverage in matched regions. Outcomes were assessed using sales and revenue deltas through a difference-in-differences approach, allowing us to estimate how much value branded search had really been protecting.
We paired the test with auction monitoring to see who filled the gap once branded coverage was withdrawn. That mattered because pressure in these auctions often comes not just from direct competitors, but also from affiliates, resellers, marketplaces, and smaller niche players.
The Impact
The holdout produced a clear commercial result. Treatment regions saw a -6.8% revenue delta versus control over the test window. Paid brand clicks fell by 88%, organic brand clicks rose by 29%, and overall brand-query sessions were down 21%, showing that paid coverage was protecting demand rather than simply replacing organic traffic.
Auction monitoring revealed that affiliates and smaller competitors were active throughout the test period. As branded coverage was reduced, the client’s top-of-page presence on brand queries fell from 96% to 54%, while non-brand impression share rose from 14% to 37%.
The client retained branded search as a protective channel and used the holdout result to tighten bids and coverage around the highest-leakage terms. Over the following month, incremental ROAS improved from 3.2 to 4.1.
Key Takeaways
Brand search incrementality is context-dependent – Even with strong organic rank and no obvious direct competitor bidding, branded search can still protect meaningful revenue when affiliates and smaller players are active.
Competitive pressure is often indirect – Resellers, marketplaces, affiliates, and niche retailers can all siphon demand when paid branded coverage is removed.
Holdout testing works best with auction monitoring – Pairing the two helps explain the mechanism behind any observed gain or loss and makes the result easier to act on.
Tools and Techniques
- Geo-based holdout testing with spend suppression
- Data & martech audit
- Auction and bidder monitoring
- SQL
- R
- Snowflake (Data warehousing)