A/B testing your emails
What to test first
By the wpdailylive editorial team · Part of Email marketing, step by step
Key takeaways
- One variable: Test subject line, offer or call to action, not all at once.
- Pick the metric first: Decide what “winning” means before you send.
- Big enough samples: Tiny tests produce random winners.
- Small list?: Under about 1,000 contacts, alternate styles across campaigns and compare averages.
- Record results: Keep a log so each test teaches you something.
A/B testing sends two versions of an email to small parts of your list, then sends the winner to everyone else. It replaces guesswork with evidence, as long as you test one thing at a time.
What to test first
- 1.Subject line — the biggest effect on whether anything else is seen
- 2.Call to action — button wording and placement
- 3.Offer — free shipping vs a percentage off
- 4.Send time — morning vs evening, weekday vs weekend
- 5.Length — short vs detailed
How to run a fair test
- 01Change one thingOtherwise you won't know what made the difference.
- 02Decide the winning metric firstClicks for content, revenue for offers.
- 03Use a big enough sampleSmall lists give unreliable results; test on at least a few hundred people per version.
- 04Record the resultKeep a simple log so you build on what you learn.
How big a sample you need
Small differences need large samples. As a rough guide, each version needs a few hundred people who take the action you’re measuring before the result is reliable. For a 3% click rate, that means thousands of recipients per version.
| LIST SIZE | WHAT YOU CAN TEST RELIABLY |
|---|---|
| Under 1,000 | Alternate styles across several campaigns and compare averages |
| 1,000–10,000 | Big differences: subject approach, offer, long vs short email |
| 10,000+ | Smaller details: button text, send time, images |
A test log template
| DATE | HYPOTHESIS | VERSION A | VERSION B | METRIC | RESULT | DECISION |
|---|---|---|---|---|---|---|
| 3 Mar | Questions get more clicks | “5 ways to cut costs” | “Paying too much for software?” | Click rate | A 2.9%, B 3.6% | Use questions more |
| 17 Mar | Short emails get more clicks | 450 words | 150 words | Click rate | A 3.1%, B 3.0% | No difference; keep testing |
Ideas to test, in order of impact
- 1.The offer itself (discount vs free shipping vs bonus)
- 2.Subject line approach (benefit vs curiosity vs question)
- 3.Email length
- 4.Call-to-action wording and placement
- 5.Send day and time
- 6.Sender name (company vs person)
Common mistakes to avoid
A/B testing your emails: what should a small business know?
A/B test one variable at a time, such as subject line, offer or call to action, on a large enough sample. Decide the winning metric before sending and roll the winner out to the rest of the list.
A/B testing your emails: why does it matter for a small business?
A/B testing sends two versions of an email to small parts of your list, then sends the winner to everyone else. It replaces guesswork with evidence, as long as you test one thing at a time.
A/B testing your emails: what is the most important tip?
Small list?: If your list is under about 1,000 contacts, test across several campaigns instead: alternate two styles and compare the averages.
Tools we recommend for this stage
Some links are partner links: we may earn a commission at no cost to you. It never changes what we recommend. How we make money
















