A/B Testing FAQs

Q. What happens when I delete an email variant?

When you delete a variant, three things occur:

1. The variant and its stats are permanently removed
2. Remaining variants get renamed (if you delete variant B, variant C becomes the new variant B)
3. Future prospects receive emails using only the remaining variants

Q. How are prospects distributed across variants?

Smartreach.io splits prospects as evenly as possible across all active variants. Each step randomizes independently, so a prospect getting variant A in step 1 might receive variant B in step 2.

Q. What should I test first?

Test multiple elements at a time for clearer results:

Subject lines - to improve open rates
Email body elements - to boost reply rates (headings, content, call-to-action, images, layout)

Q. Can I add variants after starting my campaign?

Yes, you can add new variants to existing campaigns. New prospects will be distributed across all active variants, including newly added ones.

Q. How long should I run an A/B test?

Run your test long enough to gather meaningful data. Wait until each variant has been sent to at least 50-100 prospects before making decisions about performance.

Q. What metrics can I track?

Monitor these key metrics for each variant:

Open rates - indicates subject line performance
Reply rates - shows email content effectiveness
Click-through rates - measures engagement with your call-to-action (Not recommended after recent google updates though tracking it can give you a fair idea on the variants performance)