Real-World Education for Modern Marketers

Join Over 600,000 Marketing Professionals

Start here!
Text:  A A

Programmatic Testing Helps You Turn Customers Into Real-Time Creative Focus Groups

by   |    |  1,414 views

The "right message to the right person at the right time" is the ideal that all marketers strive to achieve every day, with every campaign, media buy, email, and display ad.

Achieving that ideal becomes more difficult as consumers' digital media consumption patterns shift and new device and technologies emerge and fragment the market.

Advertisers have so many moving parts to adjust that by the time advertisers get one lever adjusted perfectly, another lever is off. You manage to hone in on a highly qualified target audience—but you can't get the message right. Or you get the message right—but you can't seem to find the right time to put it in front of your targets, so they never see it.

Have you ever seen an ad that made you cringe at how irrelevant it was or how inappropriate the timing was? That's the result of the inherent difficulty of getting all the levers just right. Even if just one is off, the entire ad comes off as irrelevant and intrusive.

Why Testing Matters

So, how do you know whether you have all the levers correct before you push the launch button on a campaign that costs hundreds of thousands or millions of dollars?

Multivariate testing used to be enough to address many of the above-mentioned concerns, particularly as they related to media sources, but variable and emergent ad formats and rich media have made that process far more complex. And multivariate testing doesn't tell the whole story.

Moreover, creative itself needs to be tested. It's that all-important "message" lever.

Testing the Creative

Not only do creative elements need to be tested within audience segments, creative elements also have to be simultaneously tested across screens and devices. When you're using a variety of ad formats to reach out to multi-screen consumers, you have to test not just a message's content, look, and feel but also viewability and functionality on various devices and how different ad units perform against the others.

Testing creative elements has always been a stumbling block for modern-day advertisers. In the old days of print and even broadcast, agencies and market researchers could gather a cross section of a particular audience or population in a room, show those audience members an ad, and then ask them questions about it.

Using a small sample size to inform large-scale campaigns is questionable anyway, but the sheer speed and scope of the digital space means that gaining personalized feedback on creative this way is not an option. It's too expensive and too time-consuming to create and run the various ad iterations necessary for the purposes of multivariate testing. Ultimately, the insight gained isn't worth all that effort because it can't scale.

With programmatic, all that can change.

Marketers are using automation more and more in online advertising. The trend, called "programmatic marketing," has been growing over the last two years. It is a holistic approach through which media buyers and sellers may align organizational processes with automation technology.

What's Programmatic Creative?

Smart marketers won't only look at the automation of ad serving as their solution, but they will even automate the process of making creative; this is called "programmatic creative."

Programmatic creative enables advertisers to use automation technology to generate, iterate, and optimize creative assets to promote high-touch engagement, regardless of digital strategy or budget.

Automating creative testing via programmatic platforms delivers superior insight to standard multivariate testing not only because it has the reach to return response indicators across entire campaigns and audiences, but it can do so in real time while a campaign is running.

Programmatic creative solutions give advertisers the opportunity to effectively create a focus group for every display ad, across channels, audiences, and screens.

Campaign optimization on the front end (before it goes live) is a vital element of development, but it's not enough. How much budget are you willing to waste before you get things just right? How much longer can you wait to get the results you want?

By testing creative elements in real time across targeted audiences, advertisers can immediately know exactly what's working and what isn't, then optimize on the fly—all while running an active campaign. Programmatic creative can help marketers test in far less time and for far less money, and deliver far better results than standard multivariate testing and optimization.

Join over 600,000 marketing professionals, and gain access to thousands of marketing resources! Don't worry ... it's FREE!


We will never sell or rent your email address to anyone. We value your privacy. (We hate spam as much as you do.) See our privacy policy.

Sign in with one of your preferred accounts below:


Jeff Hirsch is president of CPXI, a digital media holding company.

LinkedIn: Jeff Hirsch

Rate this  

Overall rating

  • This has a 4 star rating
  • This has a 4 star rating
  • This has a 4 star rating
  • This has a 4 star rating
  • This has a 4 star rating
2 rating(s)

Add a Comment


  • by Blair Symes Tue Oct 7, 2014 via web

    Great points. The key to testing creative is to be able to truly know what's working at what isn't. For programmatic (and really for all display ads that run on mobile) this is becoming far less about measuring CTR, since there are many accidental clicks from mobile users, and more about measuring engagements from online and offline conversions like form submissions and phone calls. We use Marketo to track our forms and Ifbyphone to track calls from our ads and landing pages.

  • by Sheryl Williams Tue Oct 7, 2014 via web

    This is a great article and spot on about getting the right message on the right device to the customer. TrustRadius just released a Buyer's Guide to A/B Testing that can help you navigate through which tools can help you elevate your testing tactics. This guide is a distillation of almost 200 in-depth reviews from real end-users of A/B testing tools. Those insights are augmented by interviews with highly regarded consultants, as well as executives from software vendors. You can get your copy here:

  • by Marie Huitsing Thu Oct 9, 2014 via web

    Marketing has made outstanding advances in the progression to 1:1 messaging. Can you advise which tools are best for programmatic creative implementation?

    Thanks, in advance.

  • by Jason Puckett Sun Jan 4, 2015 via web

    Hey Marie-- This is a great article and you've asked a great question. In terms of tools that provide programmatic ad testing, please take a look at my company, AdBasis, we are built for testing both Search and Display ads.

MarketingProfs uses single
sign-on with Facebook, Twitter, Google and others to make subscribing and signing in easier for you. That's it, and nothing more! Rest assured that MarketingProfs: Your data is secure with MarketingProfs SocialSafe!