9 Tips on A/B Split Tests

It’s a challenge writing and laying out all the elements for an email campaign: articles, links, images, calls-to-action, subject line and landing pages. When all is brain-stormed and discussed, arranged and re-arranged, said and done – you’re most likely to send it out to your entire list, lock, stock and barrel.

Then, once your campaign is distributed, the assumptions float to the surface: Were the links prominent? Was the image appropriate? Was the call to action eye-catching? Did the subject line influence open rate?

A/B Split Testing will reveal many answers to these types of questions. With consistent testing and within time the cumulative results deliver a solid knowledge base that positively impacts the long-term success of your email campaigns.

Let’s take a look at some simple split test protocols.

Test 1: Subject Line Tests to Maximize Open Rates

At OpenMoves, Email is our Business. So, naturally we’ve seen every type of subject line there is; from the sales-driven to humorously absurd. Many clients ask us: What do we think makes a great subject line? But the real question is: What do your subscribers think? Here’s food for thought.

  • Personalized subject lines work well in general, but you won’t know until you try! Simple personalization uses the first name of the subscriber in the subject line. More advanced version can have dynamic content base on the offer or segment the subscriber belongs to.
  • Should you tease or sell via the subject line? In many instances a tease to open the email works well: Jane, we have a surprise for you. No kidding! Otherwise, try integrating the promo into the subject line: Jane, only three days left to get your 15% discount.
  • A utilitarian believes that everything serves a purpose or just does not belong. Is short and sweet better than any other approach?
  • Who are your subscribers? Consumers, distributors, constituents, prospects, proctologists? Each group speaks a slightly different version of the mother tongue. You speak their language!
  • Is there such a thing as over branding? If your newsletter subject line is an equivalent to name, rank and serial number, there’s an obvious element of recognition, but is it working in your favor?

Subject line A/B testing is undeniably the easiest split test to manage. Your campaign content remains unchanged while you split the distribution of your email into equal portions, randomly selected, and release with separate subject lines.

Test 2: Content Tests to Maximize Click-thru and Conversion

A good marketing manager will revamp content over time as a direct result of open rates and click thru metrics. What content resonates with your subscribers?

  • To learn which stories best target your readers, prepare similar but separate features or completely different content categories. Include read more links to help keep tabs on interest and watch the click-thru stats.
  • Which content resonates best with your readers? Your stats are key here, numbers rarely lie. If you see a downward slump in open rates, check back to the better performing campaigns. What made them tick? Test topics similar to previous frontrunners against new content. Again, include read more links to help keep tabs on your stats.
  • If you’re looking to improve e-commerce or goal conversions, review link placement and color, wording, and graphics. Too many calls-to-action dilute your strategy, so focus on the sort and order of your campaign action items and build two distinct versions.
  • Last word: don’t test subject lines and content simultaneously. It’s just too much information to digest.
  • Testing Protocols

    A test should include a control page and your best effort to optimize performance. If you are getting started with A/B testing, your control page will be your current editorial content.

    Establish your test goals and determine an amount of time sufficient enough to gather good data. The time period should allow you to identify unique visits and/or conversions. Collect your metrics and confidently declare a winner.

    A/B testing provides an opportunity to resolve problems, increase conversions and goals, and challenge assumptions. Over time, testing your content will provide demonstrable results and optimized practices.

    If you’d like more information on how you can turn your campaigns into winners, contact us for a free consultation!

    Please Share:

    Leave a Reply

    Your email address will not be published. Required fields are marked *