A/B Testing Secrets Revealed!

Dr. Flint McGlaughlin and his crew at MarketingExperiments.com did a real nice job at providing an overview of split testing tactics today. You can listen to the audio portion here and view the visual materials that went along with it.

The webinar started off with an audience interactive "vote for the winner" comparison of three different landing page approaches. The vote was a bit tricky because there was little background given on the circumstances surrounding the page. I won't give it away here, but I will say that I guessed incorrectly which was the "winner."

I highly recommend if you are new to landing page testing, or want to pick up some tips on A/B testing, that you give this a listen. It runs just over an hour, and is packed with tips and real world experience. The only thing I would add is that you run your tests in 7 day blocks, especially if your test lasts more than 14 days. This provides an equal helping of weekdays vs. weekend days. Running a short test that does not balance the days adds a significant noise factor and can produce unreliable results, even if your sample size is large.