February 18, 2009

A Test ... Local Minima ... E-Commerce

Earlier this week, I executed a test.

You were my subjects!

This article, in my opinion, was well written, topical, and offers significant thought leadership. You were interested in it, you downloaded the white paper at an above-average rate. This is the "10" in the chart.

This article should have inspired thought, but was a complete snoozer. This is an "8" in the chart.

And then I wrote this one about Twitter --- almost no business value and not particularly well written. This one was the most popular article of the past two months, forwarded across the world in blogs and via Twitter. I received positive comments. I received hate mail. I received comments that were so inappropriate that they had to be deleted. The audience was "engaged". And I apologize if you were offended by the article --- I am speaking of Twitter from a marketing perspective, not from use of the tool for personal reasons. From a marketing perspective, we fail from time to time.

This article was a "4" in the chart.


I did this test, on purpose, to prove a point.

When we optimize on the basis of the wrong set of metrics, we evolve in a negative or mediocre direction. If my goal was to have the most subscribers and the highest level of engagement, I'd be writing satire about social media, because that riles-up the audience and gets people to read and interact.

Remember calculus? We used to talk about "local minimas". On this graph, the "catalog filter" article represents a local minima. This article is so much more important than pap about Twitter, but the metrics suggest otherwise.

Genius-level articles are few and far between. But the really good ones don't get much interaction, don't attract a lot of readers. The mediocre ones, those attract a huge audience.

This translates to e-commerce. We focus all the time on the average things, because the average things seem to work --- our metrics are calibrated to reward mediocrity. And when we try to do something excellent, the audience rebukes us. Try to innovate, try to do something wild and crazy with your homepage sometime --- watch your conversion rate plummet --- you won't make that mistake again! Our short-term metric, conversion rate, forces us toward mediocrity.

And yet, the local minima is where the excellence happens. We should all be so lucky to have a testing budget that allows us to detect strategy that can work on a long-term basis.

Now that I read this, I think I just re-invented Seth Godin's "The Dip". See, there's no original ideas left out there!

3 comments:

  1. Love the post. A lot of folk engaging in some of the new media need to think harder about exactly this issue. Just curious Kevin: how do you personally judge the success of your blog?

    ReplyDelete
  2. As always, I am intrigued by your thought process, and I know what you mean about what gets attention and what doesn't. I would suggest that one factor in this is also the medium itself. Blogs don't necessarily foster interaction when they are challenging and thought provoking (with the exception of great minds like Chris G). If I need to sit and think for a while about something then chances are that I will not post a comment on the blog about it, and won't Tweet it to my friends because I am not sure what I think. But at the same time I am thinking. A good example for me is Gary Angel's SEMPhonic blog. I almost never comment on his blog but it is probably the most influential web analytics blog that I read.

    And while we are talking about blogs, would you please consider moving this blog to Wordpress or similar so I dont have to navigate to a whole other page to comment?

    ReplyDelete
  3. Mark, I judge success by summing annual consulting dollars generated from blog subscribers, and then divide that number by the annual blog subscribers. I have a target number, and I try to make sure that I generate a metric that is always greater than that number.

    Michael --- thanks for your insightful comment. Sorry that you had to take a few extra steps to leave a comment via the Blogger platform. I'm at a point where the benefits from Google are too great to switch. If I move this blog to my regular URL, I'll consider a new platform.

    ReplyDelete