Skip to main content

How to Set Up A/B Testing for Your Email Campaigns in Stack

Hey there, email marketers! Looking to enhance your email campaigns and better connect with your audience? A/B testing in Stack allows you to experiment with up to six different versions of an email to see what works best. By testing various elements, you gain valuable insights that can help drive your audience to action. Ready to see the impact? Let's dive into setting up A/B testing in Stack.

Important Notes​

  • You need at least 10 contacts per variation, with a minimum of 40 contacts to run any A/B test.
  • A/B tests can only be executed using the "Send Now" or "Schedule" options. They won't work with "Batch Schedule" or "RSS Schedule".
  • If no results are obtained by the end of the test period, the initial variation will automatically be considered the winner.

Contents​

How A/B Test Email Campaigns Work​

  1. Choose an Element to Test: Decide whether you want to test the email subject line or the email content.
  2. Set the Number of Variations: You can test up to six variations.
  3. Determine the Test Duration: Choose a duration between 30 minutes and 24 hours.
  4. Select the Sample Size: Each variation will be sent to half of the sample size.
  5. Choose the Winning Metric: Decide whether to measure success by open rate or click rate.

How to Set Up an A/B Test Email Campaign​

Step 1: Enable A/B Testing​

  • Navigate to Marketing > Emails and select "Campaign" from the dropdown.
  • Create a new email campaign and enable the "A/B Testing" option.

Step 2: Choose Your Test Element​

  • Email Subject Line (Optimize Open Rates): Experiment with different lengths or add personalization to improve open rates. The subject line is the first thing recipients see, so make it count.
  • Email Content (Optimize Click Rates): Test various elements like section titles, article lengths, call-to-action buttons, images, and videos to see what drives conversions.

Step 3: Set the Test Duration​

  • Select a time frame for the test, considering how long it will take recipients to engage with your email. Duration can range from 30 minutes to 24 hours.
  • If no results are found within the set duration, the first variation will be sent out as the winner by default.

Step 4: Determine the Number of Variations​

  • Decide how many variations to test based on your strategy. Use the slider to set the percentage of contacts receiving each variation.
  • Remember, you need at least 10 contacts per variation, with a minimum of 40 contacts in total.

Step 5: Select the Winning Criteria​

  • Choose whether to measure success by Unique Open Rate or Unique Click Rate.

Step 6: Launch Your A/B Test​

  • Once your A/B test emails are ready, preview them by clicking on the three dots.
  • Choose your delivery method: either "Send Now" or "Schedule for Specific Date/Time".
  • After sending, you can review detailed statistics and reports on the performance of each variation and the overall campaign.

By following these steps, you'll be able to effectively use A/B testing in Stack to optimize your email campaigns and engage your audience more effectively. Happy testing!