Your direct mail test is complete and the results are in. But how confident can you be that this result will hold true for a full roll-out?
With this calculator you can determine how reliable your test results are based on: the size of your test (volume), the measured response rate, the desired confidence level, and the acceptable margin.
This gives you insight into whether your test was large enough to make informed decisions about scaling up.
- Larger volume → higher reliability and smaller margin
- Higher response rate → higher reliability and smaller margin
- More certainty → larger margin (stricter)
Input
Enter the data from your completed test
Number of direct mail pieces sent during the test
The actual response percentage from the test
How certain do you want to be about the bandwidth? Higher certainty = wider margin.
Relative margin compared to the response rate
Reliability
Test reliability
85%
This is the probability that the actual response in a roll-out will fall within ±10% of your measured response.
Accuracy
Margin of error
± 0.27 pp
Minimum response on repeat
1.73%
Maximum response on repeat
2.27%
With 95% certainty, your actual response lies within this bandwidth.
Advice
Uncertain – consider additional testing
The result is usable, but extra certainty is wise for larger budgets.
This result provides a good indication. We do not give any guarantee — small deviations may occur. Always consult our DM experts for the final outcome.