[SMK] Social Media Knowledge


Do A/B Testing right: MailChimp

A/B testing has become an industry standard, but are you doing it right? The EDM experts at MailChimp have shared their secrets.

How long to run?

A/B testing aims to optimise your electronic mail-outs. By sending tweaked versions of an email, you can see which gets the best response.

To get reliable indicator that one variation is superior to another, MailChimp ran some broad tests. They found that different metrics require different wait times.

They report that the best variation can be accurately predicted 80% of the time by running the test:

  • For opens, wait two hours.
  • For clicks, wait one hour.
  • For revenue, wait twelve hours.

How long is your list?

MailChimp recommends a sample of 5000 subscribers for each tested variation.

For market researchers that don’t have that reach, they recommend testing with your entire list.

No, the results won’t be directly implementable for the campaign you’ve used for testing, but they will form a good basis for future campaign content decisions.

Worth the wait?

Yep. MailChimp research shows that A/B testing works.

A/B-tested campaigns get better open and click rates than untested campaigns, ultimately generating an average of around 20% extra revenue.

Of course, every list can have its own quirks: Does your EDM experience vary significantly from MailChimp’s recommendations?

Copy Transmission is a Melbourne-based agency :: Better Brands. Loud & Clear.

Learn with SMK through December

Start your SMK: Digital Excellence 30-day free trial today and unlock unlimited, on-demand access to hundreds of hours of digital masterclasses, training courses and hands-on tutorials.

Your risk-free trial offers the perfect opportunity to expand and upgrade your digital intellectual property.

Each month SMK releases 30 hours of new and updated social media and digital marketing educational course content, ensuring you never get left behind – be it on digital strategy, tactics or implementation.

Alongside this, SMK offers live help and support weekly within the SMK Working Group. It might be a quick fix or the root of a bigger problem; either way, a problem shared is a problem halved. On a day-to-day basis, SMK’s team gives you hands-on support and fresh ideas.

Not to mention a shoulder to cry on, occasionally.

December's Courses, Live Help & Support Options

Live Member Clinics every Monday & Tuesday from 1 pm – 2 pm AEST

  • Live help and support from SMK’s team of analysts.
  • Book in to request a personalised discussion for 15 or 30m via Zoom within the Facebook Working Group.

Weekly Technical Labs: Google Analytics 4 on Wednesdays from 1 pm – 2 pm AEST

  • Technical Labs explore the technological process and workflows related to key digital marketing activities.

Content Marketing Masterclass on Thursdays from 10 am – 12 pm AEST

  • Module 1: Content Marketing Strategy & Evaluation
  • Module 2: Social Media Organic & Paid Content Best Practices
  • Module 3: Optimising Content for Google Search Success
  • Module 4: Content Marketing Planning, Systems & Processes

Conversion Rate Optimisation (CRO) Masterclass on Fridays from 11 am – 1 pm AEST

  • Module 1: Conversion Rate Optimisation (CRO) Testing & UX Best Practices
  • Module 2: Tracking Conversions With Google Analytics, Meta Pixel & More
  • Module 3: Conversion Rate Optimisation Testing, Experimentation & Data Analysis
  • Module 4: Owned, Earned & Paid Media Conversion Rate Optimisation Strategies

Leave a Comment