Posted on

GetResponse Live Case Study – How to A/B Split-Test Email Marketing Newsletter

This is a pretty cool live case study of me using the GetResponse A/B split-test when sending out a newsletter to my subscribers. 

I’ll be split testing 5 subject lines, then have getresponse automatically email the rest of my subscribers based on the winning subject line with the most open rate. The newsletter message is about this very case study you are reading right now. In the email, you will click on the link to this post.

Here are the 5 subject lines:

  1. How to A/B Split Test When Sending to Your Email List
  2. Leon’s Case Study – How to A/B Split Test When Sending to Your Email List
  3. June 1 – How to A/B Split Test When Sending to Your Email List
  4. Are you Using A/B Split Test For Email Marketing?
  5. Here’s how to easily run an A/B split test with GetResponse

Here’s how to create a GetResponse A/B Split Test.

When you create a new newsletter, make sure to check turn on click-through and A/B test. 


After that, write your email message. Make sure you use HTML rather than sending a plain text email message.

Then GetResponse will ask you to select which A/B Split test you want to use. You can only choose one of the following: subject lines, from field, email content, or delivery time. 

I always choose to split test only the subject lines.


Finally you will select which subscriber lists you want to send to and then make some last A/B split test configuration.


I normally turn on the “send best message automatically”, this way I don’t have to manually log into GetResponse, view my split test, and then click the send button.

Choose the best message by, you can either use open rate or click-through rate. I like to use open rate. Which means that the best subject line that most subscribers click to open the email message, will be the winning subject line.

Test analysis duration upon each messages delivery. I normally leave this at 3 hours. So this means that after 3 hours, the split test will be completed and the winning subject line will be used to send to the rest of my subscribers.

So the each of the 5 subject lines will be sent to 10% of my subscribers list. So this means that 50% of my subscribers will receive emails with the 5 subject lines. After 3 hours, the remaining 50% will automatically be sent the email with the winning subject line. You can also choose the % of subscribers to receive the winning emails as well such as 60%, 30%, or whatever.

After 24 hours, the results of the split test will look something like this below: (I will update this with the real results once this campaign is completed)


For those not using GetResponse, I highly recommend this email marketing service.

Click here to get your 30 days GetResponse free trial

Leave a comment if you have any questions regarding the GetResponse A/b Split test.


  1. GetResponse is now a must have autoresponder for email marketers. Its interesting to know that one can actually do multiple split testing with this service. Thanks for sharing this case study. However, I would have preferred that the details of this case study is more detailed!

    This comment was left in – the content syndication and social bookmarking website for Internet Marketers where this post was shared.

    Sunday – contributor

  2. Leon, thank you for writing this article, to nudge me into taking further learning action. I have been a paid member of Getresponse for a long time. Sometimes, I must admit, I am slow to take up their new tools. I don't understand why, because this tool looks like a no-brainer, meaning there's no big learning curve. I must get started with A / B split testing. Every work at home mom or stay at home dad needs to lift their game online by using both A / B split testing for better conversions, and Google Analytics for even more customer behavior data. Thanks again, Leon.

  3. Hi Leon.

    You explained the A/B email testing in simple language. As of now, I use Mailchimp and I am happy as I have less subscribers but will definitely consider GetResponse if I needed to upgrade.


    The CTR is often relative to people, the open rate is something average people do in common. That was smart of you to choose the best headline based on open rate.


    Keep on bringing some more case studies like this, way to go. Anyway, I found this on kingged.

Leave a Reply

Your email address will not be published. Required fields are marked *