How to tell if your mail drop actually worked

You run a mail drop. Orders come in. Sales tick up. Did the drop cause it, or would those orders have arrived anyway?

Most teams cannot answer that, so they call it a win and move on. There is a better way.

The problem with before and after

Comparing sales before and after a campaign feels like proof. It is not. Plenty of other things moved at the same time, the season, a promotion, a good week. Without a comparison group you are crediting the drop for things it never did.

You need to know what would have happened without it.

What a holdout does

A holdout is simple. Before the campaign, you set aside a group of similar markets and deliberately do not mail them. They become your control. After the campaign, you compare the markets you targeted against the ones you held back.

The difference is the lift. Not orders that might have come anyway, the extra growth your campaign actually caused. That is a number you can take to your CFO and defend.

Honest about the limits

A holdout is the closest thing to proof offline marketing has, and it still comes with a range, not a single magic figure. We report the lift with its confidence, and when a result sits inside the noise we say so rather than dress it up. We measure what your targeting drove. We do not guarantee a return, because the creative and the offer are yours.

The point

You do not have to guess whether offline worked. Hold a set of markets back, measure the gap, and let the number speak.