This is Only a Test

"A great way to capitalize on the democratic medium of email is to put your burning questions, late-night hunches, and out-of-the-box ideas to the test with an A/B split test," says Megan Walsh in a post at the Email Experience Council blog. Here's some of her advice for using split testing to try out new ideas and boost results:

Focus on one variable at a time. When testing subject lines, for instance, you want to know how many subscribers opened the message. Clicks and conversions, meanwhile, matter when you're testing calls to action. Remember that a change in one variable can have an impact on another. Always be clear about what you're trying to test/achieve, Walsh advises.

Use a random distribution for A and B audience groups. "The sizes of the segments don't need to be the same if the key metric you are looking to influence is expressed as a 'rate,'" she says, "but they do need to have the same general characteristics to be a fair test."

Take it to the next level. As you become a testing junkie, begin to explore how different segments behave. Williams-Sonoma knew that including a featured product's price on the hero image boosted clicks and conversions. The company recently discovered, however, that the customers driving this response were those who spent more than $100 on an average purchase; customers who spent less were more likely to click on an image without a price.

The Po!nt: Never stop testing. Something that works today won't necessarily work tomorrow: customer preferences constantly vary.

→ end article preview
Read the Full Article