Ecommerce · Home & living
The agency’s ‘winning’ campaign was the biggest loser.
This marketing & margin audit identified $53k in wasted annual spend in a DTC / Ecommerce business, evidenced, senior reviewed, and delivered in 7 days.
The business
A $14M home and living brand had scaled paid social aggressively over two years, and one campaign its agency had branded the "hero" was reported as the single biggest revenue driver in every monthly deck. Leadership trusted that number implicitly and kept feeding the campaign budget, treating it as the safest, most productive line in the entire media plan.
What triggered the audit
The founder asked a deceptively simple question the agency couldn’t answer cleanly: if we switched the hero campaign off tomorrow, how much revenue would we actually lose? The reporting had always assumed every attributed sale was caused by the ad. Nobody had ever tested that assumption, so the audit ran the experiment properly.
What the audit found
A matched market geo holdout test told a very different story from the dashboard. The "hero" campaign was almost entirely retargeting warm buyers who were already deep in the purchase journey and would have converted anyway; last click attribution simply stood at the finish line and claimed the credit. When the campaign was switched off in test markets, sales barely moved, which meant its true incremental contribution was close to zero. Yet it was absorbing roughly $53k a year of budget and, because it always "won" on attributed revenue, it was first in line for every increase. The brand had been scaling its least incremental spend and starving the channels actually creating new demand.
What we changed
Redirected the budget into two prospecting channels that each passed a geo holdout incrementality test before being scaled, so money follows proven cause and effect rather than attributed credit.
Rebuilt the agency’s reporting around incrementality rather than last click, so “winning” now means demonstrably causing sales instead of standing at the finish line to claim them.
Established a standing quarterly holdout test, so no campaign can quietly drift back into harvesting demand it didn’t actually create.
Reset the budget allocation rule to weight incremental contribution, ending the automatic reward that high attributed revenue used to guarantee.
The result
The revenue band describes the same $14M business. The ROAS comparison is between the original campaign and the replacement channels. $53k a year moved from a campaign that caused almost nothing to channels that provably drive new customers, an annual figure equal to 9× the $5,950 Audit + Sprint fee. The founder had trusted that “hero” number for two years; only a holdout test could expose it, because attribution will never disprove itself. If you cannot answer “what would we lose if we switched this off,” you may be funding demand you already own. That gap widens every month it goes untested, and a fixed fee audit closes it in days, with a repeatable test you keep.
From kickoff to signed off findings: 7 days.
What the client said
$53k a year of wasted spend cut in 7 days
Incremental ROAS: original campaign vs replacement channels: 0.2× → 2.1×
“Our agency's hero campaign was the biggest loser. Victoria ran a geo holdout and sales barely moved when it was off. Two years of attributed revenue, almost none of it caused by the ad. The budget now goes to channels that pass that test.”
Victoria MillerSenior Auditor · signed this audit off