How to Actually Analyze an Incrementality Test Result
Incrementality analysis turns lift test output into budget decisions. Learn to read iROAS, relative lift, confidence intervals, and delayed conversions with a worked example.
On this page
A finished incrementality test is not a decision. It is a table of numbers with uncertainty attached to every one of them. The analysis is where you decide whether the lift is real, whether it is precise enough to trust, and what it means for the next budget cycle. Plenty of teams run clean experiments and then misread the output, usually by fixating on the wrong metric or ignoring the confidence interval entirely.
This piece is about that reading step. If you need the concept first, start with what incrementality is and come back.
The four numbers that carry the analysis
Google's Conversion Lift reports several metrics, and each answers a different question. Per Google Ads, the core ones are:
- Incremental conversions (absolute lift): treatment conversions minus control conversions. The raw count of conversions that would not have happened without the ads.
- Relative lift: incremental conversions divided by control conversions, expressed as a percentage.
- Incremental cost per action (iCPA): total ad spend divided by incremental conversions.
- Incremental ROAS (iROAS): incremental conversion value divided by total ad spend.
The trap is treating relative lift as the headline. It scales between -1 and infinity, and Google itself warns that a brand with low control conversions can post a huge relative lift for a modest real effect. Two studies with 900% and 40% relative lift can describe the same underlying reality. Judge campaigns on absolute lift, iCPA, and iROAS, because those tie directly to money.
A worked example (hypothetical)
Assume a mid-size retailer runs a user-based Conversion Lift study on a Demand Gen campaign. Numbers are illustrative.
| Metric | Treatment | Control |
|---|---|---|
| Conversion value | $180,000 | $120,000 |
| Conversions | 3,000 | 2,400 |
| Ad spend | $30,000 | (held out) |
Work it through using the Google formulas:
- Incremental conversions = 3,000 - 2,400 = 600
- Incremental conversion value = $180,000 - $120,000 = $60,000
- iCPA = $30,000 / 600 = $50
- iROAS = $60,000 / $30,000 = 2.0
Now the standard Google Ads report for this campaign might show 2,200 attributed conversions and a reported ROAS near 6. The lift study says only 600 of those were caused by the ads. That gap is the whole point of running the analysis: attribution counts touchpoints, incrementality counts causes. If you want the mechanics of that difference, our attribution primer lays it out.
An iROAS of 2.0 clears break-even for most margins. So the campaign stays. If it had come back at 0.7, the honest read is that the platform was taking credit for demand that existed anyway.
The interval matters more than the point estimate
Every lift number is a midpoint inside a range. Google reports credible or confidence intervals precisely because the point estimate alone is misleading. In the 2025 measurement updates, Google noted advertisers can now choose a custom test size and view results at their preferred confidence level directly in the UI, per Google Ads.
Here is why it matters. Suppose that iROAS of 2.0 carries a 90% interval of 0.8 to 3.2. The midpoint says profitable. The lower bound says possibly underwater. Incremental conversion value tends to be more volatile than conversion counts, because a single bulk order can swing it, which widens intervals further. When the interval straddles your break-even line, you do not have an actionable result yet. You have a signal to extend the study, increase test size, or accept a lower confidence threshold with eyes open.
A disciplined analysis always reports the estimate and the interval together, then sizes the budget move to the pessimistic end of the range.
Delayed conversions and where you cut the clock
Some conversions land after the study window closes, even when the ad exposure happened inside it. Google's user-based Conversion Lift models these using observed conversion lag and, for Demand Gen studies, includes delayed incremental conversions by default, per Google Ads. For a product with a long consideration cycle, cutting analysis off at the study end date will understate true incremental value. Check whether your report includes projected conversions before you compare iROAS across channels with different sales cycles.
Reading a null result correctly
The hardest analysis is the one that comes back flat. A confidence interval that spans zero does not prove the channel does nothing. It means the test lacked the power to distinguish the effect from noise, or the effect is genuinely small. Amplitude points out that most user-level tests need adequate group sizes to detect a given lift, and undersized groups produce non-significant results even when the campaign works, per Amplitude.
So when you see a null, ask two questions before concluding anything. Was the minimum detectable effect smaller than the lift you could realistically expect? And was the control group large enough? If both answers are no, the correct read is inconclusive, and the fix is a bigger or longer test. Our guide to running a quarterly geo-holdout test covers the sizing math for the geo case.
Turning one result into a system
A single lift number is a snapshot at one point in time. The value compounds when you use it to correct your other models. Google frames incrementality, Marketing Mix Models, and attribution as a combined toolkit, where experimental results calibrate the models so their ongoing numbers track reality more closely, per Google Ads.
That calibration is the practical payoff. If your platform reports a ROAS of 6 and your lift study says the true incremental ROAS is 2, the ratio between them becomes a correction factor you apply to future platform numbers between tests. We walk through that arithmetic in the multiplier method, which keeps your dashboards honest without running a fresh experiment every week.
Google also lowered the entry point sharply. What once cost upward of $100,000 for a single experiment can now be run for around $5,000, and improved methodology returns conclusive results up to 50% more often, per Google Ads. That changes the cadence question. When a test is cheap and more likely to resolve, you can afford to re-measure your biggest channels quarterly and keep the correction factors current.
If your reported ROAS and your gut disagree, our Attribution Doctor can help pressure-test where the credit is leaking before you commit to a full study, and our data and analytics team runs the design and analysis end to end. The reading is where the money moves, so treat it with the same rigor you gave the test setup.