Optimizing the Wrong Metric may be the root of All Evil in Marketing
Posted by Bob Warfield on July 29, 2010
Bootstrappers have to figure out how to market via the web. It’s the lowest cost, lowest friction, highest leverage medium available to get the word out. And, it is the easiest place to collect metrics so your decision making can be informed rather than just seat of the pants. But there are many dangers with metrics. First and foremost is optimizing the wrong one.
John Pozadzides, CEO of the Web analytics company Woopra, has a great article in ReadWriteWeb about the leading sources of referral traffic. There really is some awesome stuff in there, and it is tempting to go through the article’s major conclusions and think you have a plan:
– Facebook trumps all the other Social Media by a large amount with 68% of referrals. Twitter only gets 25% and LinkedIn 4%. Translation: Bet hugely on Facebook, maybe experiment a little with Twitter and LinkedIn, but ignore the rest.
– Of the Social bookmarkers, Stumbleupon gets 51%, Digg 30%, YCombinator 12%, and the rest is noise. So, we need to bet on Stumbleupon with a little follow up on Digg.
– Google is delivering 92% of search referrals. Guess we won’t worry about anyone else there.
– Media site referrals are 84% YouTube. Hey, Larry, we better get going on some videos!
What’s wrong with that marketing plan? It’s backed up by well-researched numbers. The statistics are compelling. How can we lose?
The answer, as in so many similar cases, is we may have optimized the wrong variable. It’s reasonable to assume that you want to get new traffic to your site in order to sell more product. After all, if prospects don’t know your better mousetrap exists, its hard to beat a path to your door. And these various venues are only too happy to help. In fact, Google would love to send clicks your way for just a small fee. However, even if all visits were created equal, we have no idea what the relative sizes of each pool are. So what if YouTube is 84% of media referrals if media referrals turn out to only be 1% of overall referrals? Worse, all visits are not created equal.
Look at the YCombinator number as just one example. I don’t mean to pick on YCombinator, but go take a look at it. It’s a very specialized audience. Clearly they can swing that audience to go look at something in droves. But is your product really going to benefit from that audience’s interest? What will be the symptoms of making a mistake there? Well, you might successfully capture a bunch of referrals from YCombinator only to find that they bounce as soon as they hit your site. Yes, your content cleverly got them to click, but your product’s substance couldn’t cash the check you’d just written with your clever content.
I’ll give another hint. The article suggests Stumbleupon may be an awesome place to focus some attention. I get a fair amount of referrals from Stumbleupon, and I’m not even trying, so I’m not surprised they show up well in a study like this. It was the #7 source of referral traffic, in fact. There is just one problem with focusing on it. When I checked this morning, Google Analytics tells me that it had a 96.9% bounce rate. The traffic arrives, doesn’t like what it sees, and leaves immediately. Average time on site is 49 seconds, versus a site-wide average of nearly 4 minutes. Maybe, with some effort, I can redirect Stumbleupon to do a better job. But, if I’m just looking at the raw referral number, I have optimized the wrong metric. I need to look at something else that gets closer to what I am trying to achieve.
So what metric should we be optimizing? I’m a huge fan of closed loop marketing. I want to be able to track a lead, let’s call that lead a visit to my site, all the way through to a purchase. I want to understand that path as well as I can, from source all the way to revenue. I want to assign costs, volumes, and conversion rates to these sources and tie the effects of my changes in marketing back to their impact on these variables. It’s a lofty goal, but it’s the only way to know what’s working. If you optimize the wrong variable, you’re in for a potentially very expensive mistake either in opportunity cost for having worked on the wrong thing, or in real cash if you’re paying for clicks that didn’t translate into sales.
How do we get this kind of end to end analytics? The good news, is that it isn’t that hard even for a tiny bootstrap company to get a start on it because we have Google Analytics. It works like this:
Google Analytics will do a good job tracking where people who come to your site came from. It knows what pages they land on and where they go from there. Your job is to make the act of landing on a page correspond to the metric you want to measure. Let’s say you want to track people buying your software. Perhaps there is a page you could create that people only go to if they bought the software. It isn’t reachable in any other way. Maybe it is a Welcome page, or a page that activates their product, or better a page that confirms activation. Make that a Goal page and you’re ready to work backwards to analyze your funnel. You probably want to differentiate content that attracts people to your site and facilitates SEO from the actual page where you pitch your customers to buy the product. Perhaps there is a trial close along the way where customers sign up for a free trial. So on and so forth.
Once you start analyzing these patterns, you’ll come to understand what really works for your world. Tie up Google Analytics to Google Adwords and you get an even more powerful analytics combination. You start to understand the impact and interplay of keywords, ad copy, traffic sources, and even factors like time of day, geographic region, or languages. I’ll have more to say about how to use these and other tools over time as I write more about bootstrapping.
Some will argue that its impossible to get these metrics, so we shouldn’t worry about it. I couldn’t disagree more. The Internet makes it easier than ever before. Marketing is Tragically Knowable. I will always remember that phrase from my mentor, and co-founder of Netflix, Marc Randolph. Working through these kinds of metrics and conducting the A/B experiments to know what works better is all part of avoiding the “Tragic” part of “Tragically Knowable.” Tragic is when you think you know, whether by incomplete information, optimizing the wrong metric, or just going by gut, you make a big bet on it, and it turns out to be wrong. To avoid the Tragedy, make sure you understand how each factor you’re trying to optimize feeds your ultimate goal of selling product. Don’t optimize the wrong metric.
Software developers say that premature optimizing is the root of all evil in software. Optimizing the wrong metric may be the root of all evil in marketing.
Bootstrappa’s Resources
Links to the Bootstrappa’s Paradise blog series as well as other useful resources for Bootstrappers.
8 Responses to “Optimizing the Wrong Metric may be the root of All Evil in Marketing”
You must log in to post a comment.
The Bootstrappin’ Team: All Starters « SmoothSpan Blog said
[…] Optimizing the Wrong Metric May Be the Root of All Evil in Marketing: Closed Loop Marketing Analytics for the Bootstrap Possibly related posts: (automatically generated)ENTREPRENEUR : How to Bootstrap – Spencer FryShow your Ability to Execute Through Bootstrapping […]
It’s a Bootstrappa’s Paradise! « SmoothSpan Blog said
[…] « Is the Open Stack Cloud Announcement a Big Deal? Optimizing the Wrong Metric may be the root of All Evil in Marketing […]
Bootstrappin’ the Buzz « SmoothSpan Blog said
[…] found me. Not all things are knowable, but we sure do try to understand those things that are tragically knowable. This could be another form of Customer Referral, word of mouth or whatever. Think of it as […]
Bootstrappin’ the Buzz said
[…] found me. Not all things are knowable, but we sure do try to understand those things that are tragically knowable. This could be another form of Customer Referral, word of mouth or whatever. Think of it as […]
Small Businesses Need a Minimum Viable Marketing Strategy « SmoothSpan Blog said
[…] to leads, but that isn’t conversion to revenue. I have also remarked and believe that optimizing the wrong metric is the root of all marketing evil, so we may have been led down a primrose path on that one (though the $ money bags on the chart are […]
Why I’m Dropping InstantSlideup Like a Hot Potato « SmoothSpan Blog said
[…] In any event, I had it up and running on my CNC Machinist’s blog and all was well. That site is one I use both for my hobby/passion around machine tools, as well as to run a small microISV business, and just generally to test out various online marketing concepts. InstantSlideup is in the category of “nice to have”, but not “must have”. A must have for me would be SEOMoz (see, I gave them a link). My experience with InstantSlideup is that while it helped a lot more people to “discover” my product home page on the site, most of the new audience weren’t interested enough to convert. Net net I was ahead on conversions, but by a lot less than the traffic would imply–gotta analyze yer analytics carefully! […]
Why I’m Dropping InstantSlideup Like a Hot Potato : Enterprise Irregulars said
[…] In any event, I had it up and running on my CNC Machinist’s blog and all was well. That site is one I use both for my hobby/passion around machine tools, as well as to run a small microISV business, and just generally to test out various online marketing concepts. InstantSlideup is in the category of “nice to have”, but not “must have”. A must have for me would be SEOMoz (see, I gave them a link). My experience with InstantSlideup is that while it helped a lot more people to “discover” my product home page on the site, most of the new audience weren’t interested enough to convert. Net net I was ahead on conversions, but by a lot less than the traffic would imply–gotta analyze yer analytics carefully! […]
Why I’m Dropping InstantSlideup Like a Hot Potato | WikiCloud said
[…] In any event, I had it up and running on my CNC Machinist’s blog and all was well. That site is one I use both for my hobby/passion around machine tools, as well as to run a small microISV business, and just generally to test out various online marketing concepts. InstantSlideup is in the category of “nice to have”, but not “must have”. A must have for me would be SEOMoz (see, I gave them a link). My experience with InstantSlideup is that while it helped a lot more people to “discover” my product home page on the site, most of the new audience weren’t interested enough to convert. Net net I was ahead on conversions, but by a lot less than the traffic would imply–gotta analyze yer analytics carefully! […]