Cloudinary Blog

The content dilemma – executing and scaling your campaigns

How to scale your content personalization & A/B testing
Robert Mosely is Cloudinary’s Senior Solutions Engineer, a technology and use-case expert with over a decade of experience in analytics, optimization, and personalization. Here he writes about his experience and reflections from the field. 
 
The concept of Content Personalization is to show a customized message to the right person with the hypothesis that this will lead to higher revenue/engagement/[Insert KPI here].  The idea is solid and has been proven out at small scale but very few, if any, organizations are successfully executing.  As marketers, we've bought the DMPs, CRMs, A/B Testing Tools, and Marketing Automation platforms so why can't we fully execute?  The primary reason is because it's really hard to execute many worthwhile tests/campaigns in parallel and even harder to maintain all of your test winners going forward.
 
To show what I mean, see the (messy, hastily made) illustration below showing how your site can diverge into multiple experiences after even only a handful of tests:
 
Test segmentation
 
Every experienced website optimization team adds segments to each A/B test they run to see if different segments behave differently.  You start with one website that everyone sees, "A".  You run an A/B test and find Segment1 responds well to version "B" but everyone else likes "A" so you push version "B" to Segment1 permanently because it performs better.  As you iterate and test more and more you end up with something that looks like the above illustration, probably even worse. 

The Elephant in the room

Clearly this is not scalable and at a certain point, you simply don't have enough resources to maintain all the different content you need to make every segment happy.  How do you full-scale the results after you've run 10 tests?  1 year's worth?  5 years' worth?  How do you support all this through site redesigns, creative updates, changes in brand standards, not to mention support responsive layouts and multiple device resolutions? 
 
Frankly, it's impossible. There is no way you can keep up with the amount of content that is needed.  So even if you want to have a personalized site, you're very limited in what can actually be done due a limited amount of content creation/management resources.  This, the content dilemma, has been the elephant in the room that most ignore in the website optimization community.  

So how about that elephant?

Up until now the focus on personalization has been on the data side of the equation.  Now that DMPs, CRMs, and Optimization tools have been almost universally adopted, has the promise of personalization been delivered?  Spoiler alert: no.
 
It's because the content side of the equation has been essentially ignored.  Personalization = Right Message/Content + Right Person.  DMPs and CRMs can help identify the right person but we're still missing half of what we need to successfully execute - the content.
 
"We'll just pass it off to the creative team."
 
Famous last words before a campaign gets sentenced to purgatory.  I've heard this said more times than I can count.  And don't get me wrong, it's not the creative team's fault, they only have so many resources available and a lot on their plates.  It's the optimization team's fault for thinking this is a viable strategy and doing a poor job of picking campaigns that are actually executable. 
 
Let's take a look at the reality of the current situation.  Here I'm plotting Revenue (or whatever your KPI you're measuring) vs Effort.  
 
Revenue vs. Effort
 
It follows a typical law of diminishing returns - as you put in more labor, you see less of a return on Revenue/etc. for each unit of labor added (Marginal Product of Labor for you economics buffs).  On the far right side of the graph has a vertical asymptote which represents your theoretical maximum revenue.  You'd have to put in infinite labor to get here which not even a startup fresh off their Series B has the budget for.  Like an object with mass trying to reach the speed of light, you will never get there.  But let's look at what's obtainable:
 
Obtainable revenue
 
Current Theoretical Max Revenue is where you'd be if you were spending your all your time only on those things which offer the most return for the input.  In reality, you're somewhere well below that (Current Actual Revenue).  Addressing this gap and moving the Actual Revenue closer to the Current Theoretical Max is exactly why A/B testing tools were invented in the first place. 
 
The problem is we oftentimes bite off more than we can chew and choose tests that are not only difficult to execute, but would be impossible to full-scale if the alternate experience won.  We invest in "personalization" tools which really only offer data and content delivery but no real way of actually building the required content.  These tools then go underutilized.
 
So personalization isn't possible?  What a total bummer, huh?  Things aren't so dire, you actually can do all of this, you just need to be like a farmer.
 
Be like a farmer
 
Farmer
(what marketers should strive to be)
 
The year is 1800 and you are a farmer.  You have an acre of land and while you're not wealthy you're doing just fine.  Then a salesman finds you on LinkedIn and sends you a really good pitch on a 10-acre plot.  It's expensive but look at the ROI!  It's hard to argue with his numbers, this will be great for your farming career.  So you buy the 10 acres and eagerly await the next planting season. 
 
Spring of 1801 comes and you start plowing your newly expanded fields.  Pretty soon you realize it'll be harvest before you get all this land plowed, you just simply don't have enough labor available to farm 11 acres.   You can hire more people but you're just a farmer, you don't have the budget and don't know any venture capitalists investing in farms right now.  What you really need is a way to increase your productivity. 
 
In reality, this is exactly what farmers have done throughout history:
 
Agricultural output input graph
From: “A Brief History of U.S. Agriculture”
http://www.springer.com/cda/content/document/cda_downloaddocument/9781441906571-c1.pdf?SGWID=0-0-45-838614-p173903552
 
It’s really quite amazing.  For the same labor input, output has increased dramatically.  So how can we be more like farmers?  By adopting new and innovative technology.

A Brave New World 

Looking back at this graph:
 
Obtainable revenue
 
Farmers are not simply moving the Current Actual Revenue closer to the Current Theoretical Max Revenue(output).  If this were the case we'd expect output increases to tail off over time. Instead, we see a steady linear, or perhaps even exponential increase in output.  What farmers are actually doing is moving their Current Theoretical Max Revenue(output) further to the right in addition to becoming more efficient in general. 
 
Think of it this way – pesticides, herbicides, and more robust strains of crops help squeeze the most out of every acre, but if you want to farm more acres you need technological innovations like Combines and Sowing Machines.  These technological innovations have actually changed the shape of the Labor/Revenue curve itself.  This is what it looks like graphically:
 
New obtainable revenue
 
So how can we be more like farmers?  Well, we need machines that allow us to "farm more acres", or in other words, we need to find and adopt innovative advances in technology to help us remove the limitations of manually creating and managing content for micro-segments and individual people.
 
One solution is to generate content (images/video/copy) that can create more personalized messages programmatically without relying on the creative team.  We need combines, not more farmhands.
 
For example, we could store in a visitor profile (sitting in a cookie, local storage, your optimization tool, or some other profile store) what marketing campaign brought them to the site, what product category they have been browsing, the last product they viewed, demographics etc.  Then we can use this information in Cloudinary to programmatically build content on the fly to match the message we want to show to each segment. 
 
See this previous blog post for a more detailed explanation of these capabilities and a detailed example.

Recent Blog Posts

Build the Back-End For Your Own Instagram-style App with Cloudinary

Github Repo

Managing media files (processing, storage and manipulation) is one of the biggest challenges we encounter as practical developers. These challenges include:

A great service called Cloudinary can help us overcome many of these challenges. Together with Cloudinary, let's work on solutions to these challenges and hopefully have a simpler mental model towards media management.

Read more

Build A Miniflix in 10 Minutes

By Prosper Otemuyiwa
Build A Miniflix in 10 Minutes

Developers are constantly faced with challenges of building complex products every single day. And there are constraints on the time needed to build out the features of these products.

Engineering and Product managers want to beat deadlines for projects daily. CEOs want to roll out new products as fast as possible. Entrepreneurs need their MVPs like yesterday. With this in mind, what should developers do?

Read more

Your Web Image is Unnecessarily Bloated

By Christian Nwamba
Your Web Image is Unnecessarily Bloated

As a developer, it seems inefficient to serve a 2000kb JPEG image when we could compress images to optimize the performance without degrading the visual quality.

We are not new to this kind of responsibility. But our productivity will end up being questioned if we do not deliver fast. In order to do so, the community has devised several patterns to help improve productivity. Let's review few of these patterns based on their categories:

Read more

Google For Nigeria: We saw it all…

By Christian Nwamba
Google For Nigeria: We saw it all…

Note from Cloudinary: Christian Nwamba, a frequent Cloudinary contributor, recently attended, and was a main speaker, at the Google Developer Group (GDG) Conference in Lagos, Nigeria. Christian led a session teaching more than 500 developers how to “Build Offline Apps for the Next Billion Users.” The stack he used included JS (Vue), Firebase, Service Workers and Cloudinary. Below is his account of the conference and his talk.

Read more
Viral Images: Securing Images and Video uploads to your systems

When was the last time you got paid $40,000 for a few days of work? That is what happened last year to Russian independent security researcher Andrey Leonov, who discovered that if you upload a specially constructed image file to Facebook, you can make Facebook's internal servers, nested deep within their firewalls, run arbitrary commands to expose sensitive internal files in a way that could easily lead to a data breach.

Read more