Test Your E-Mail Marketing I.Q.
December 11th, 2004 by Bob Bly
Edith Roman Associates, a mailing list broker, uses e-mail marketing to promote their services.
In a recent e-mail offering free list recommendations and a free catalog of mailing lists, they split test two subject lines:
A. Free Direct Mail Encyclopedia.
B. Boost Sales, Increase Profits, and Expand Market Awareness.
Which do you think was the winner — and why?
Choose correctly, and you win a FREE special report on how to improve online marketing results (list price: $29).
(I’ll tell you how to get your free prize when I announce the correct answer.)
This entry was posted on Saturday, December 11th, 2004 at 10:46 am and is filed under Online Marketing. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.





December 11th, 2004 at 12:37 pm
I would think that B would be the winner. If you want to make money…I’d put my money on something that appeals to the viewers wallet. The A choice about the encyclopedia appeals more to a general brain interest. Money usually beats brainy stuff.
Joel
December 12th, 2004 at 1:45 am
I’m guessing A. First of all, because FREE is a magic word. Secondly, because A is specific. Do you need a free direct mail encyclopedia or don’t you? If you do, you’re liable to click through. B is more general and sounds like ordinary spam. Most spam promise the world. Big deal. We tune out and hit delete.
Brett
December 12th, 2004 at 2:22 am
It’s (B).
Put them on the Scales of Benefits. Which entices you more–sales, profits, and awareness–or an encyclopedia?
(B) comes out punching with three hard-hitting verbs. With (B) you’ll get to “boost”, “increase”, and “expand”.
Also, as handy as the word “free” may be, using it in the subject line of an e-mail gives your message the not-so-distinctive flavor of S*P*A*M.
On the other hand . . .
It’s got to be (A). (B)’s promises are empty. There’s nothing concrete backing them up. I wouldn’t open the e-mail with (B)’s subject unless I respected the name in the “from” field.
And I just might look at the message with (A)’s subject if I’m in the direct mail business. By specifically calling out who the message is for, and then clearly telling that audience they can get something they will want–for free–(A) seems to be the winner.
Perhaps the “from” field is more important than the “subject” field. If I received an e-mail from bly.com, I’d open it even if the subject line said “Buy our bodacious boobie balm because we’re #1″.
I dunno. This situation calls for either a Ouija board or a split run test.
December 12th, 2004 at 7:32 am
I go with B)
A) is a not very attractiv offer to DM people. Almost ervybody owns one Direct Mail Encyclopedia.
December 12th, 2004 at 10:57 am
I’d have to say B is the winner. Although FREE is considered a hot button word, there’s been extensive tests done on giving away free money and no one took the bait. B is wordy, but more attractive to the potential reader and it uses more of the hot-button words.
BUT - Then again…
The A subject line has it’s benefits too.
I give. Which one was the winner?
December 12th, 2004 at 5:06 pm
I vote for A: Free direct mail encyclopedia.
December 12th, 2004 at 5:11 pm
Gerold — Almost every DM pro may own a DM encyclopedia, but this crowd LOVES information. If you’re a dog trainer, and your income depends on knowledge and skills, wouldn’t you want to get your hands on all the dog training information available? Even at the risk of duplication?
December 12th, 2004 at 6:57 pm
There is a lot more than a subject to consider when doing any campaign — without knowing the audience we don’t know which message would be most relevant.
For now, let’s assume winning is getting the message opened.
If (A) went to a list of experience marketers already familiar with Edith Roman, then it would win.
But …
If (B) was delivered to first time contacts who haven’t used Edith Roman for list services, then it would win.
Subject (A) eludes to an added value that familiar customers would use to get more from what they already understand Edith Roman to provides. It doesn’t say anything to new customers who may not already know the benefit of using a mailing list broker.
Subject (B) helps new or infrequent customers understand what else Edith Roman can do for them. It shows them some benefits targeted mailing lists may bring their company.
There is an assumption that the receipt knows the message came from Edith Roman (i.e. From:) and they are familiar with their general services. Both subject lines are likely to be caught by spam filters for “free,” “sales,” and “profits.”
Of course, if winning is getting a response then (B) is more likely to get people to request free list recommendations. This subject says something to the value of the action requested in the message.
We could speculate for years, at least Edith Roman took the step to run the test because that is the only want to know the real results.
After a proverbial coin flip, let’s say (B) is the winner.
Sincerely,
Justin Hitt
Strategic Relations Consultant
December 12th, 2004 at 8:52 pm
I’m astonished at the amount of people choosing “B”. The benefits featured in that subject line are so general that they’re almost meaningless. The “A” subject line, however, offers a specific benefit.
December 13th, 2004 at 8:24 am
My vote is for B. It’s more expressive and direct. It induces me to think I’m getting something worthwhile. I can get a “Free” directory (of sorts) in lots of places.
December 13th, 2004 at 2:01 pm
I think A would win. The word Free is the key, as well as direct mail. I know the message is specifically for people like me. Plus, the encyclopedia could very well offer information to boost sales, increase profits and expand awareness.
December 13th, 2004 at 2:08 pm
I go along with those that said A. B is pretty general. I delete a dozen headlined like it ever day. B is specific and has the magic word “Free”.
December 13th, 2004 at 2:10 pm
Whoops! I meant A is specific and so forth.
December 13th, 2004 at 2:29 pm
I’ll go with B.
Although there’s a specific benefit in A of a free item, I don’t completely see how that item is going to make my life easier. Plus, if I already have a go-to resource that does what this encyclopedia does, I may just skip over it.
Sure, B’s benefits are more general but who in their right mind doesn’t want all of them…?
December 13th, 2004 at 4:16 pm
Well, Dec. 11th is my birthday… so I gotta win, right?! (Sorry, wasn’t online over the weekend so I didn’t see the contest.) And the answer is… A. Although neither subject line is very good. Here’s why: the word “free” always pulls but make it stronger by being more specific and tangible. “Download your free copy of our Direct Mail Encyclopedia” That’s assuming the From line indicates the message is from Edith Roman… which is a recognized name among list brokers… so the word “our” tells you this free guide has value. The second choice sounds good but it’s vague… doesn’t tell you *how* to boost sales. If I was running this split test, I would have used something like this for “B” - “Boost profits with your free copy of our Direct Mail Encyclopedia” I still think “A” (the way I’ve worded it) would win. No one (and I say this from experience as an e-newsletter publisher), absolutely no one, can resist the words “Free download” if it’s something relevant to their business needs/interests. And putting “Download your free… ” at the beginning of the Subject Line guarantees that everyone will see at least that much, no matter what their email client. Just my two (birthday) cents…
December 13th, 2004 at 5:15 pm
This is just a response to an earlier post of yours. You said that Fortune 1000 companies don’t do blogs. Well, Mark Cuban (multi-billionaire who hosted the show “The Benefactor”) has his own called http://www.blogmaverick.com/. So while the overwhelming majority do not, just a few of them do.
December 13th, 2004 at 6:34 pm
I’d say it has to be “B” because the benefits of responding are clearly laid out. That benefit-laden headline has more appeal to the target market than any free offering because that’s what that market segment values as businessfolk. They want to “Boost Sales, Increase Profits, and Expand (their) Market Awareness.”
December 13th, 2004 at 7:19 pm
Walter. I want to save time and make more money. Bit a subject line that says that will NOT get my attention. Why? Because those benefits are too general. They don’t cut through the clutter and engage me emotionally. (Or even logically, for that matter.)
December 13th, 2004 at 7:20 pm
Bit. But. You know what I mean!
December 14th, 2004 at 7:58 am
interesting…
December 14th, 2004 at 11:22 am
Debbie and Steve: Your opinions convinced me that A will win over B. (And of course the “hard proof” split-test data by Bob).
Very interessting discussion here.
January 2nd, 2005 at 12:06 am
I think A is the right answer because it is a concrete way to do everything that is mentioned in B which leaves a a person in limbo with no real direction.
February 2nd, 2005 at 12:13 pm
A wins. I know nothing is free, I will still check it to see what conditions apply and see if I want the ‘free’ item. B is someone else’s ideas of making money, marketing, methodology - I have to sort through all that, make choices, decide, weigh value……And all that in nanoseconds of Consumer Desire Marketing Response [Consumer Desire Marketing Response and CDMR ((C)) 2005 by conicsection@yahoo.com]. A will win every time.
September 13th, 2006 at 10:12 am
They call it spam. How’d you convince them?
May 18th, 2007 at 10:00 pm
work’s done the way it must be..! ^^
May 19th, 2007 at 12:39 am
L’information interessante que vous avez! I’am allant revenir bientot.
May 19th, 2007 at 3:16 am
Grand emplacement! La conception est merveilleuse!
May 19th, 2007 at 10:59 am
Was kann ich sagen? Wirklich gute Arbeit erledigt mit dem Aufstellungsort?
May 19th, 2007 at 4:08 pm
Interessieren. SEHR interessant!
May 19th, 2007 at 9:18 pm
pagine piuttosto informative, piacevoli =)
May 19th, 2007 at 11:55 pm
I’ll tell my colleagues about your page..!
May 20th, 2007 at 5:08 am
i’am really impressed!!
May 20th, 2007 at 12:49 pm
Lo trovo piuttosto impressionante. Lavoro grande fatto..)
May 20th, 2007 at 3:22 pm
work’s done the way it must be..! ^^
May 20th, 2007 at 8:29 pm
Lo trovo piuttosto impressionante. Lavoro grande fatto..)
May 20th, 2007 at 11:04 pm
Interessare, molto interessante. Come avete fatto questo?
May 21st, 2007 at 1:41 am
I’ll be BACK!

May 21st, 2007 at 4:57 pm
Grand emplacement! La conception est merveilleuse!
May 21st, 2007 at 7:29 pm
Nice site you have!
May 21st, 2007 at 10:00 pm
Dein Aufstellungsort verdient nur gute Woerter. Danke.
May 22nd, 2007 at 3:13 am
I’ll tell my colleagues about your page..!
May 22nd, 2007 at 8:45 pm
Interessieren. SEHR interessant!
May 22nd, 2007 at 11:17 pm
Very valuable information you have here. Thanks..
May 23rd, 2007 at 6:54 am
mmm.. nice design, I must say..
May 23rd, 2007 at 9:24 am
L’information interessante que vous avez! I’am allant revenir bientot.
May 23rd, 2007 at 11:53 am
The information I found here was rather helpful. Thank you for this.
May 23rd, 2007 at 2:21 pm
Was kann ich sagen? Wirklich gute Arbeit erledigt mit dem Aufstellungsort?
May 24th, 2007 at 5:25 am
La buona visione del senso!
May 24th, 2007 at 7:54 am
Interesting comments..
May 24th, 2007 at 12:46 pm
I’ll be BACK!

May 24th, 2007 at 8:02 pm
Ich fand gute und wichtige Informationen - dir zu danken.
May 25th, 2007 at 1:01 am
Interessare, molto interessante. Come avete fatto questo?
May 25th, 2007 at 3:29 am
ooo! it’s one of the best sites ever!
May 25th, 2007 at 3:32 pm
The information I found here was rather helpful. Thank you for this.
May 26th, 2007 at 1:19 am
ooo! it’s one of the best sites ever!
May 27th, 2007 at 8:27 am
Interfaccia comoda, colori piacevoli, buoni!
May 27th, 2007 at 12:02 pm
Guter Aufstellungsort, ja!
May 27th, 2007 at 3:37 pm
Interfaccia comoda, colori piacevoli, buoni!
May 27th, 2007 at 7:12 pm
Interesting comments..
May 28th, 2007 at 2:26 am
Was kann ich sagen? Wirklich gute Arbeit erledigt mit dem Aufstellungsort?
May 28th, 2007 at 8:13 pm
Guter Aufstellungsort, ja!
May 28th, 2007 at 11:48 pm
Was kann ich sagen? Wirklich gute Arbeit erledigt mit dem Aufstellungsort?
May 29th, 2007 at 7:06 am
Du musst ein Fachmann sein - wirklich guter Aufstellungsort, den du hast!
June 2nd, 2007 at 6:37 am
work’s done the way it must be..! ^^
June 3rd, 2007 at 6:27 pm
Nice site you have!
June 3rd, 2007 at 10:02 pm
i’am really impressed!!
June 4th, 2007 at 5:16 am
Great site! Good luck to it’s owner!
June 6th, 2007 at 2:57 am
I think this is not a real question. This is a hidden survey. Those who answered this question are all stupid.
June 18th, 2007 at 4:13 pm
Hello! Good Site! Thanks you! uyhtpcspcv
September 5th, 2007 at 9:11 pm
Thank you site!!!
1pofasgdmao
2dofasgdmao
2wofasgdmao
4fofasgdmao
5hofasgdmao
6yofasgdmao
Bye!!!
October 16th, 2007 at 10:20 pm
The answer is definitely B- A lot of people think that the word “free” appeals to people, but in my opinion, that word just lowers the perceived value. Even if you providing something that is free, you should still use a catchy title like in example B.
December 11th, 2007 at 4:44 pm
Sexy Ositions
Where programs: past, Fallon Sommers ships. Discuss, sexy ositions vincent arrive italian?
August 19th, 2008 at 2:15 pm
I think B is the winner. How do I get my free report?