Ecommerce · Home & living
The agency’s ‘winning’ campaign was the biggest loser.
This marketing & margin audit identified $53k in wasted annual spend in a DTC / Ecommerce business — evidenced, senior-reviewed, and delivered in 7 days.
The business
A $14M home and living brand had scaled paid social aggressively over two years, and one campaign its agency had branded the "hero" was reported as the single biggest revenue driver in every monthly deck. Leadership trusted that number implicitly and kept feeding the campaign budget, treating it as the safest, most productive line in the entire media plan.
What triggered the audit
The founder asked a deceptively simple question the agency couldn’t answer cleanly: if we switched the hero campaign off tomorrow, how much revenue would we actually lose? The reporting had always assumed every attributed sale was caused by the ad. Nobody had ever tested that assumption, so the audit ran the experiment properly.
What the audit found
A matched-market geo-holdout test told a very different story from the dashboard. The "hero" campaign was almost entirely retargeting warm buyers who were already deep in the purchase journey and would have converted anyway; last-click attribution simply stood at the finish line and claimed the credit. When the campaign was switched off in test markets, sales barely moved, which meant its true incremental contribution was close to zero. Yet it was absorbing roughly $53k a year of budget and, because it always "won" on attributed revenue, it was first in line for every increase. The brand had been scaling its least incremental spend and starving the channels actually creating new demand.
What we changed
Redirected the budget into two prospecting channels that each passed a geo-holdout incrementality test before being scaled, so money follows proven cause and effect rather than attributed credit.
Rebuilt the agency’s reporting around incrementality rather than last-click, so “winning” now means demonstrably causing sales instead of standing at the finish line to claim them.
Established a standing quarterly holdout test, so no campaign can quietly drift back into harvesting demand it didn’t actually create.
Reset the budget-allocation rule to weight incremental contribution, ending the automatic reward that high attributed revenue used to guarantee.
The result
$53k a year moved from a campaign that caused almost nothing to channels that provably drive new customers — a 9× return on the $5,950 Audit + Sprint fee. The founder had trusted that “hero” number for two years; only a holdout test could expose it, because attribution will never disprove itself. If you cannot answer “what would we lose if we switched this off,” you may be funding demand you already own. That gap widens every month it goes untested — and a fixed-fee audit closes it in days, with a repeatable test you keep.
From kickoff to signed-off findings: 7 days — inside our fixed 5–7 day window.