Catalog Marketers:
- Identify the audience that is likely to receive catalogs in the next three months.
- You'll need about ten percent of your audience to measure this well.
- Randomly sample 5% of your customer audience. This group can receive catalogs if they are eligible, if they do not meet your selection criteria, don't mail a catalog to this customer.
- Randomly sample 5% of your customer audience. This group is not allowed to receive catalogs, unless they choose to request a catalog.
- Keep customers in each of these two segments for a period of three months.
- At any time during the test period, you are free to analyze the test results. Subtract the difference between the mailed group and the holdout group. This is the incremental value of catalog mailings. Run a profit and loss statement on this incremental difference.
- Analyze the incremental difference in telephone demand, online demand, e-mail demand, paid search, natural search, affiliate marketing, banner ads, portal advertising, and shopping comparison sites. You may find that catalog marketing drives incremental business to some of these channels.
E-Mail Marketing:
- E-Mail marketing results are often over-stated by click-through and conversion rate analyses, except in retail instances, where e-mail marketing results are often under-stated.
- Use the same rules outlined above for catalog marketers. Sample 5% of your e-mail file, and treat these customers normally. Sample 5% of your e-mail file, and do not send e-mail marketing messages to this audience for a period of three months.
- Measure the incremental difference between the mailed group and the holdout group. This is the true value of e-mail marketing. You are likely to be very surprised by the outcome of the test!
Hi Kevin,
ReplyDeleteWould you mind explaining the purpose of the 5% control group? I don't understand why you couldn't just compare the results of the 5% holdout group to the remaining 95%, without specifying 5% as a control group. Is this to allow other experiments with the remaining 90% in the meantime?
Thanks,
Satvik
Yes, you execute 5% in each group, and you try your best to keep each group as clean as possible so that you can execute other tests.
ReplyDeleteI would also note that it is important to let your audience know what you're trying to do. That way, they would not treat your mail as irritating spam.
ReplyDeleteExcellent verify! There can under no circumstances actually come about to become enough content material these as this primarily due to the fact any one really should know what they will talk with source to…
ReplyDelete