tag:blogger.com,1999:blog-32202893.post2518951646966626122..comments2023-10-18T08:32:17.510-07:00Comments on Kevin Hillstrom: MineThatData: Mail And Holdout Tests: SegmentationUnknownnoreply@blogger.comBlogger12125tag:blogger.com,1999:blog-32202893.post-58091242246726348072012-04-01T23:43:47.134-07:002012-04-01T23:43:47.134-07:00Excellent contract! There can under no circumstanc...Excellent contract! There can under no circumstances at any time take place to get plenty of articles these kinds of as this largely for the reason that any person should really understand what they will chat with source to…Superior Marketing Grouphttp://www.superiormarketinggroup.biz/noreply@blogger.comtag:blogger.com,1999:blog-32202893.post-8006612158820032192010-03-25T10:43:41.356-07:002010-03-25T10:43:41.356-07:00I agree, Mike, thanks!I agree, Mike, thanks!MineThatDatahttps://www.blogger.com/profile/14014200122021988374noreply@blogger.comtag:blogger.com,1999:blog-32202893.post-64427731633412379042010-03-25T09:08:50.822-07:002010-03-25T09:08:50.822-07:00In response to "I think in a tough economy, w...In response to "I think in a tough economy, when most are working hard just to hit a plan, holding out potential sales is tough to push through.", I feel it may be more important to execute these tests in tough economic times. <br /><br />Bad economy typically means weak sales, which translates to reductions in marketing spend.<br /><br />Recouping a significant portion of non incremental marketing spend would be huge! That said, it should be done in situations where you expect you're overspending... which can be challenging.Mikehttps://www.blogger.com/profile/02503728688528656064noreply@blogger.comtag:blogger.com,1999:blog-32202893.post-74305845143797594502010-03-24T19:53:48.994-07:002010-03-24T19:53:48.994-07:00Thank you, Satvik.Thank you, Satvik.MineThatDatahttps://www.blogger.com/profile/14014200122021988374noreply@blogger.comtag:blogger.com,1999:blog-32202893.post-24421413405306040142010-03-24T19:53:32.131-07:002010-03-24T19:53:32.131-07:00You're entitled to whatever opinion you think ...You're entitled to whatever opinion you think is right for your business, Derek. You're the expert for your business, so go with that!MineThatDatahttps://www.blogger.com/profile/14014200122021988374noreply@blogger.comtag:blogger.com,1999:blog-32202893.post-43210079584471312542010-03-24T07:17:38.224-07:002010-03-24T07:17:38.224-07:00No sure how to read into that response Kevin...
I...No sure how to read into that response Kevin...<br /><br />I guess I am confident the increase I have seen from email is large enough to fully offset the low cost of sending. Down the road it might be nice to run some holdouts and see what the real increase is, but that is way down on my priority list compared to things like catalog holdouts. Am I wrong in thinking this?Derekhttp://twitter.com/dawescottnoreply@blogger.comtag:blogger.com,1999:blog-32202893.post-58515817398750721802010-03-24T06:56:21.179-07:002010-03-24T06:56:21.179-07:00Jay,
One thing I've found to be effective is ...Jay,<br /><br />One thing I've found to be effective is calling a project "optimization" instead of "testing"-eg, "Advertising Optimization" instead of "Ad Testing". <br /><br />When you focus on the intended benefit instead of the process it's much easier for executives to see why the project is worthwhile.Satvikhttps://www.blogger.com/profile/00248796344873084638noreply@blogger.comtag:blogger.com,1999:blog-32202893.post-70597160926747938272010-03-23T17:12:34.398-07:002010-03-23T17:12:34.398-07:00Oh boy!Oh boy!MineThatDatahttps://www.blogger.com/profile/14014200122021988374noreply@blogger.comtag:blogger.com,1999:blog-32202893.post-53719587236064459602010-03-23T09:48:48.946-07:002010-03-23T09:48:48.946-07:00That makes sense, but based on historical informat...That makes sense, but based on historical information before/after emails, I know I am making more with a catalog and email than I would be with just a catalog. Exactly how much more? I don't know. But I know it is more than enough to offset the low cost of sending out emails.<br /><br />To judge email frequency I think it is more important to look at direct response (open rates, click-throughs, conversion, and, most importantly, unsubscribe rates).<br /><br />When it comes to holdout testing, I think it is much more important to be doing holdout testing on catalogs. We all know the limited life print has left, so we should learn how to mail smarter as we taper off catalog mailing and switch to a more e-com heavy business model.<br /><br />I see validity in doing email holdout testing... Just not for me, right now.Derekhttp://twitter.com/dawescottnoreply@blogger.comtag:blogger.com,1999:blog-32202893.post-71596740508559746512010-03-19T08:58:26.612-07:002010-03-19T08:58:26.612-07:00Derek,
Give this situation a try.
You send 12 ca...Derek,<br /><br />Give this situation a try.<br /><br />You send 12 catalogs and 52 e-mails a year. In total, you get $45,000,000 from catalog mailing activities and $5,000,000 from e-mail activities.<br /><br />Now, you test sending 26 e-mails a year instead of 52. In total, you get $46,000,000 from catalog mailing activities and $4,000,000 from e-mail activities.<br /><br />Finally, you test sending 0 e-mails a year instead of 52. In total, you get $50,000,000 from catalog mailing activities and $0 from e-mail activities.<br /><br />You think you don't want to know that your e-mail campaigns are completely cannibalizing your catalog activities, causing the company to generate $0 of true incremental volume?<br /><br />This happens all of the time. Of course, nobody knows this, because nobody tests. If you knew this, you might try harder to figure out the optimal strategy for e-mail marketing among your catlog audience, and among all other customers, right?<br /><br />Conversely, e-mail is often twice as productive as measured for retail brands, because of what e-mail drives to retail. You cannot see what you drive to retail unless you are willing to execute the holdout test.<br /><br />Now, if e-mail is twice as valuable as measured via open/click/convert metrics, wouldn't you want to know that? Wouldn't you consider increasing e-mail frequency? Wouldn't you consider adding staff so that you could execute more targeted strategies, with special versions targeted to customers with specific purchase history, a strategy that would increase performance of a strategy that is already working 2x as good as measured via open/clicks/convert? Now you'd have the metrics to prove that you can hire more staff.<br /><br />As Jay mentions above, most people think you're holding out e-mails and then reducing sales. Most people would actually benefit from testing, learning if e-mail actually works or if it just cannibalizes other channels.MineThatDatahttps://www.blogger.com/profile/14014200122021988374noreply@blogger.comtag:blogger.com,1999:blog-32202893.post-36740362848846727562010-03-19T07:59:32.558-07:002010-03-19T07:59:32.558-07:00As far as email holdout tests go, I wonder why cut...As far as email holdout tests go, I wonder why cut back unless you think it will increase sales (less contacts more purchases?). Email is sooo cheap, so the chance of potentially missing a purchase over saving a couple hundred bucks here and there just doesn't move right up my priority list. It's like the long tail of paid search, there is a small cost you could probably save, but the cost is so low all it takes is 1 order and you've got great ROI. I'd rather look for ways to optimize the emails I'm sending than cut costs by not sending them at all.Derekhttp://twitter.com/dawescottnoreply@blogger.comtag:blogger.com,1999:blog-32202893.post-64512857570972582992010-03-19T06:04:28.313-07:002010-03-19T06:04:28.313-07:00I think in a tough economy, when most are working ...I think in a tough economy, when most are working hard just to hit a plan, holding out potential sales is tough to push through. Most are more interested in the long term when the short term numbers are above expectations.<br /><br />I think if the economy keeps improving, more companies will start going in this direction.Jay Allenhttp://www.teavana.comnoreply@blogger.com