A/B Testing

While composing your email step, you can add multiple email variants (up to 5 for each step: A, B, C, D, E variants). Each variant can have a different subject and email body. After starting your campaign, you will get detailed analytics via the Stats tab and will be able to see which of the test variants works better: more email opens stand for a better subject and more replies for a better email body.

When you add a new email variant, SmartReach.io will split the prospects in your campaign as evenly as possible, with each variant going out randomly to approximately 50% of the prospects. For example, if you have a list of 200, the system will automatically send variant A to 100 and variant B to the other 100.

Email steps are split up randomly according to the number of variants on the step. Each step is randomized independently from each other, so if [Day 1: Opening] Step variant was A, it doesn't mean this person gets A variant in the following steps as well.

Keep the following things in mind while setting up your A/B Tests:

1. Focus on the subject line: If you want to optimize open rates, and the email body if you want to optimize reply rates. Change one element at a time and test it. If you change multiple elements in the same A/B test, the results will be confusing and you will not be able to say which change affected the results.

These are the elements you can change depending on your goal:

a) Subject line.

b) Email body:

• Headings
• Body text
• Call to action/offers
• Images
• Layout

2. Setup the A/B test: In SmartReach.io, once you have added an email step to the campaign, you can click on 'Add variant for A/B testing' to add a new variant. You can add up to 4 variants for each step.

3. Check the results : You can see the detailed results for each step and its variants by selecting your campaign → Reports →Scroll down at the bottom.

What happens when I delete an email variant ?

i) The variant and its reporting stats will be deleted.

ii) The existing variants will be renamed. Let's say you had A, B and C variants, and you delete the B variant. Then the C variant will be renamed to B, so now you will have two variants: A and B (which was earlier C).

iii) On deleting a variant, prospects will continue receiving emails using the rest of the variants for the step.

For example: Let's say you have a campaign which has a Step-1 with two variants A and B. You have added 100 prospects to the campaign and started the campaign with the Campaign Soft-Start. Let's say that on the first day, 20 prospects each have received variants A and B (so 40 prospects have received the Step 1 till now). Now, you delete variant B from the Step-1.

Then the other 60 prospects in the campaign will receive variant A of Step-1.