Test Results: How to Quadruple Your Opt In Rate

If you’ve been doing email marketing for over a week, you’ve probably heard all about split testing: why you should, easy split tests you can implement today, split testing your web forms and calls to action, and so on.

If people liked email as much as they like cats, “test it!” would be our “I can has cheezburger?” (It practically is around AWeber.)

You’d think there’s no way we wouldn’t be testing everything possible around here, right?

Wrong.

I just got done running a test and it reminded me why we go back to this topic over and over.

If you’d like to build your list over 321% faster, take a couple minutes to read this post.

The Sad Story of a Neglected Landing Page

Thanks to loyal readers like you who read, comment and tell other people about the email marketing tips here (thanks!), this blog and its readership have grown steadily over the past 6 years.

We’ve done a number of things over the years to make it grow faster. One important thing that has made it easier to build our blog newsletter is our subscribe page, which we link up in our emails and also push people to from the signup form in the blog’s sidebar.

Below is a screenshot of what this page used to look like, before our test.

As you can see, it’s not amazing, but it’s an OK page. It encourages people to subscribe and gives them an idea of what they’ll get for doing so.

It meets the basic requirements of a subscribe page.

Which is probably why the page hadn’t been updated since 2008.

Holy Hypocrisy, Batman!

It was pretty embarrassing to realize how old that page was, especially when we talk about how big a deal testing is.

Clearly it was time for some changes – or at least, to test them.

We looked at our subscribe page and a bunch of other ones to see what changes might be worth testing.

One style that made a lot of sense to us was the “X Reasons to Subscribe” format that we found on a number of websites. (Career Realism and The 4 Hour Work Week are good examples; for a bunch more, just Google “reasons to subscribe” and you’ll have a ton to work with.)

So we created a version of our subscribe page that followed this format, and added a few wrinkles of our own that we thought might improve the opt-in rate.

The New Version: 7 Reasons to Subscribe

Here’s the page we created for the test.

This version is a complete change from what was there, so we were pretty confident that we’d get a large, statistically significant change fast… for better or worse.

Results: 321% Increase in Confirmed Opt-Ins

We ran the split test via Visual Website Optimizer, which is an easy-to-use website testing tool.

In less than a week, the outcome was clear: the new “7 Reasons to Subscribe” page was outperforming the old version by over 321%.

So that page, which had just been plugging along, is now getting over 4 times as many people to subscribe as it used to. To put it another way: for every 1000 people to that page, we’re now getting 114 of them to sign up, instead of just 27 of them.

Why Did The New Page Do So Much Better?

Looking at the pages side by side, it seems obvious that the 2nd one would do better.

The “X Reasons to Subscribe” format is powerful stuff. And if that’s all you need to take away from this to go test your own subscribe page, that’s fine by me.

But for those of you who want to see the “why” behind these results, let’s dig a little deeper.

Click on the screenshot to see the new subscribe page, annotated with my thoughts on why it worked:

A few points I want to underscore:

  • Testimonials make this page really rock. For each reason, we have a real testimonial from a reader so that visitors can see that the promises we’re making on this page are authentic.

    How’d we get those testimonials? We surveyed subscribers late last year and asked them this question:

    “Please share one way you’ve improved your email campaign results after reading this blog. What did you learn from the blog, what did you do, and how did it help your campaign?”

  • Focused copy that addresses why people read our blog. At the end of the day, improving your email campaigns is about making more money with them. So we speak directly to the profit motive in the introduction and with our choice of testimonials.
  • It’s easy to subscribe, with multiple chances to do so. We have a form at the end for people who need to read all 7 reasons before signing up. At the same time, we have an option to subscribe near the top for people who are sold after the first 1 or 2 reasons.

What Can Testing Do For Your Business?

Think about how much traffic your subscribe page (or your about or contact page) gets in a month.

What if you could turn a tenth (or more!) of them into subscribers? How many more people on your email list would that be?

Now, multiply that number by 12.

That’s how many people you’re losing by not testing your subscribe page.

Time to Go Test For Yourself

OK, now that you’ve seen what we did and how it has improved our results, I have 2 suggestions for you:

  1. Test it! :)
  2. When you do, come back and share your results.

One last thing: if you haven’t subscribed to this blog yet, and you want advice like this on how to make your email marketing more successful and profitable, you should subscribe today.

Why Hockey Strong’s Email Subscribers Keep Coming Back For More

Why Hockey Strong's Email Subscribers Keep Coming Back For More
“91% of email users subscribed to a company’s mailing list and then later decided they no longer wanted to be on that list,” an ExactTarget report stated. That’s bad news.

The same report also showed that 42% of subscribers say they’re more likely to buy from a company after they’ve signed up for the company’s emails. That’s good news, but if they unsubscribe early on, they won’t be getting your emails to buy from.

With this in mind, one AWeber customer has set up her email marketing campaign to encourage long-term relationships. Maria Mountain’s Hockey Strong campaign is gaining subscribers over 6 times faster than it’s losing them.

Hockey Strong’s Success

Subscriber growth is increasing on Maria’s list, mainly due to very few people unsubscribing. About 75% of her subscribers have been on her list for more than 3 months, and over half are still on after the 6 month mark.

Along with increasing subscriber growth, subscribers are also responding to her messages. Her email campaign looks like this:

How does she keep subscribers interested?

What’s Working: Follow Up Series

After signing up to the Hockey Strong list, subscribers start receiving the follow up messages. They get the free report promised at sign up, and part of the follow up series includes a 5 part training course.

In between each of the training course messages, subscribers get messages with Maria’s blog content. This combination of teaching and sharing other useful information works well. Subscribers get to know Maria as a person during this initial phase.

Using the follow up messages to introduce yourself and your email campaign to your subscribers will help start the relationship. You can send a follow up series to:

  • Talk about different problems subscribers may face in your industry, and offer solutions
  • Include common questions you get from subscribers along with your answers
  • Provide reviews for products or services that might benefit your subscribers

Maria didn’t always have this follow up series in place. Initially she just delivered the training, but didn’t think that was as effective as it could be:

“I felt like there was an ‘end-point’ to the relationship once the final training module was delivered, and I definitely did not want that. I wanted the member to feel like it was just the beginning.”

What’s Working: Friendly Messages

Now, Maria’s relationship with her subscribers doesn’t end when the subscriber finishes the follow up series. She carries on sending helpful information through broadcast messages.

She also makes a point to talk to her subscribers as friends:

“I use my genuine voice and project my sincere goal to help them play better hockey with fewer injuries. I think by providing useful, practical training tips and just being a good friend and resource for them, they will stay in my ‘tribe’.”

The blog post content in the follow up series gives subscribers a feel for her voice and lets them see that she has more to offer than just products to sell.

Maria doesn’t focus on the hard sell, but instead tries to connect with subscribers on a personal level.

She believes this approach has contributed to more sales:

“My subscribers have time to see that I am genuinely providing great info that helps them play a sport they love and they begin to trust me. I make it clear that I still love them even if they don’t buy from me. When I do send an email asking them to consider purchasing one of my training products I really believe they are more inclined to do so because they know, like and trust me.”

You can find ways to connect with your subscribers too:

  • Invite them to follow you via social media
  • Tell them personal stories relevant to your business
  • Provide links to other resources and events in your industry

What’s Working: Subscriber Involvement

While Maria’s messages are not designed to push the hard sell, they are designed to increase subscriber engagement.

Take a look at this broadcast message that asks for three actions, none of which are a purchase:

By continually giving subscribers something to do, you will help the relationship last longer.

Here are ways to keep your subscribers involved:

  • Hold contests
  • Start a conversation by asking them questions
  • Ask for their opinion on something

Advice From Maria

Maria didn’t get to where she’s at now overnight. She did a lot of research, and has advice for others starting out their email campaigns, or just looking for ways to improve:

“I think one of the best things you can do when starting out is to save emails that you receive from other Internet marketers that really resonate with you. Look at how the author crafted the subject line, the sentence structure, the location and format of the links. There is such a science to it that you can learn a ton from dissecting the emails of other successful Internet marketers.”

What Does Your Campaign Look Like?

We’ve talked about what’s working for Maria, so now it’s your turn!

Do you have a follow up series that’s working well? Do you send only broadcasts? Both? What has worked for you?

The Many Benefits of Engaging People’s Curiosity in Your Emails

BennyThis is a guest post by Benny Lewis of Fluent In 3 Months. We were talking about how he builds his list and keeps subscribers’ attention from email to email, and he offered to share some of his email marketing methods with you.

Take it away, Benny! -Justin Premick

My name is Benny Lewis, and I don’t have much experience in Internet marketing. I actually blog about rapid language learning.

But a year ago I started an email newsletter for my blog and have been getting an excellent return out of it.

How do I do it? I inject some personality into it, and I use people’s curiosity to get them on my list and keep them reading!

Satisfying People’s Curiosity as a List-Building Technique

For example, every couple of months I get a surge of sign-ups (usually about five times my normal rate) when I offer something much more valuable than a free e-book (which I do anyway); satisfying their curiosity!

BennyYou see, every few months I move to a new country and learn a new language. But the thing is, I keep the next language and destination a secret and only reveal it in advance to those in the email list. When I state on Twitter, Facebook and on the blog that I’m about to announce my new mission in the email list, so many new people jump on board!

The best thing is that the announcement is part of the email itself (not an attachment, or link) so this gets them used to the idea of appreciating opening and reading the email itself. This means that I have an incredibly low unsubscribe rate; especially as I make sure each weekly email is worthwhile content.

Ensuring Long Term Higher Open Rates

The problem with this of course is that it was only giving me the higher open rates in bursts every few months, and then they would start going down again. While people constantly give me feedback that they love the content of the emails (which are unique and not simple links to blog posts), I still wanted to engage their curiosity over several emails, making sure those already in the list would be motivated to read some more.

So I found a fun way to do that! Instead of giving them the answer at once, I dropped clues in each email. This helped not only with open rates, but with engagement. I got more replies from readers than I knew what to do with!

For example, here’s the dramatic change of almost 11% in open-rates when I revealed just the destination of a recent language learning “mission”:

Here are the contents of that email above with the big clue:

But of course, this didn’t actually reveal the answer of which language it was! (In a previous clue, I said that I needed to go to this destination in particular, so it wasn’t about distant-learning). People were emailing me with guesses all over the place, especially building on previous confusing but interesting clues.

Monetizing That Curiosity Without Unsubscribes or Spam Complaints

I put a lot of work into my emails; almost as much as into the blog itself! And there aren’t any sales pitches at all in my typical weekly broadcasts. But I do of course need to make this worth my while financially, so I take advantage of the peak open rate, and since the sales pitch is so rare, I actually get no complaints about it.

When I finally revealed the answer, I knew that a lot of people would be reading that email so it was a perfect time to announce an update to my Language Hacking Guide and a temporary price reduction:

… I continued to describe some other additions to the guide and details about how to take advantage of the temporary discount. And then of course, I followed it up with what they had all been waiting for!

and I went on to describe my objectives with this language.

Even though the email started with a sales pitch, the replies were immensely positive as I had given them the final answer that had been worth waiting for. It was quite a surprise of course, after my usual preference for spoken languages!

But here is the best part: Because this was all part of a long-term strategy, the results of this email, which started with a detailed sales pitch, were 0% complaints (nobody marked it as spam) and 0.3% unsubscribes, which is actually what it tends to be for any typical email I send! Even though I gave them the answer they had been waiting for, they still stuck around. ;)

And of course I got a huge surge of sales that week as I ran the special offer, the vast majority of which were coming from my email list.

While I can only engage in the curiosity of what my next language will be every few months, what I do now is give weekly mission updates that I never mention on the blog, to share my progress and struggles so that readers can relate to it in their own language learning challenge. I always follow it up with a weekly tip or a link to a very helpful website for language learners to make sure they get some real quality out of the email.

In this way I feel my personality is getting through and I am constantly satisfying readers’ curiosity about what is happening in my language learning mission. Because of this, readers know that they can always get something worthwhile when they open my emails.

How Can I Do This on My Email List?

I am subscribed to quite a lot of email lists, and I have to say that as a reader I don’t feel so much personal engagement in a lot of them. Competitions seem to be run on things you can win rather than simply testing people’s intelligence in a less superficial way. Sometimes “winning” doesn’t mean getting a free e-book, but satisfying their curiosity.

  • If you run a competition, try to make it one that plays with their curiosity and make sure to say that the answer is within the email! Sending an email that simply links to an ebook or blog post makes the email itself less valuable. People should be opening an email for the content within the email if ever possible.
  • If your company has any public announcements that readers would be curious about then tell them that subscribers to the email list will find out first! It makes them feel like part of a special club. I go as far as to call my newsletter a “league” (more precisely “The Language Hacking League”) that people sign up to, since I’m sharing things with them they wouldn’t be able to find out anywhere else.

This very week I have reached the climax of another announcement and price reduction promotion, which you’ll see a part of on my blog. Of course, if you are curious about what my next language will be in advance of it starting, you can still find out by joining the e-mail list and reading the welcome e-mail this week, and hearing about it in advance in upcoming missions. :)

Benny Lewis teaches people to learn languages quickly at Fluent in 3 Months.

Grow Your Email List 99% Faster: How One Site Did It


What would you do to increase your subscriber growth by 99%? What if it just required a quick addition to your website?

Michael McCarthy’s investor relations site QualityStocks has a large subscriber base with consistent growth, but Michael wanted to find ways to continue increasing those numbers. We talked with him about strategies aimed at increasing his subscriber growth, and after some testing and review, found just a small change can yield huge results.

This lesson can be applied to all email marketing campaigns. If you’re looking for an easy way to bring in more subscribers, read on to learn what Michael did and why.

 

How QualityStocks Built Its List

QualityStocks connects their email subscribers with companies that they evaluate and determine have huge potential to succeed in the short and long-term future. There is a form on the site where people can sign up to get daily updates:

They also have other pages on their site that talk about the mailing list and invite visitors to subscribe. The forms he’s using are called inline forms, as they are on the page itself. Michael does a great job explaining his mailing lists and what subscribers can expect, and this has created a great foundation for his campaign.

The Change That Increased Subscriber Growth

When you have a successful campaign with consistent growth, it makes it difficult to justify implementing any changes. However, some changes rarely disappoint, and can even lift a campaign to a higher level of success. Adding a pop-over or lightbox form is one of those changes, as other AWeber customers have discovered in the past.

Michael added a lightbox form on his site. His home page has a good section dedicated to information about the mailing list, so it was decided it would perform best on the “About Us” page, which gets a lot of visitors.

The “About Us” page contains important information about the company and what’s offered, but their invitation to join the mailing list is not as prominent as it is on some of their other pages. The lightbox now allows that invitation to stick out on the page, bringing in more subscribers:

Adding the form on that page was a good move; it caused a 158% increase in subscriber growth compared to the previous month without the lightobox:

This monthly new subscribers chart shows the six months before and after when the lightbox form was introduced. There is a temporary drop in new subscribers during the holiday months before rapid growth resumes.

In the six months since the lightbox form was added, Quality Stocks has seen a 99% increase in subscriber growth compared to the prior six months.

Other Changes to Increase Subscriber Growth

Already have a pop-over on your site? Make sure you’re utilizing these tips so you aren’t losing potential subscribers:

  • Make sure your form is accessible- You can place your form “above the fold” which means that it will be in the upper half of your page. Your subscribers will be able to see it upon landing on your page, so they won’t need to scroll through your page to reach the sign up form.
  • Put an inline form on every page- Visitors may click through to different pages on your website. You want to make sure that a form in on every page so that no matter where they are, they have the option to sign up to your mailing list.
  • Utilize social media- Facebook has become a very popular social media platform and a great source for collecting subscribers. You can add a link to your web form on your Facebook page so visitors can become subscribers.

Add a Pop-over On Your Site

You can easily see what results you get by adding a pop-over form to your site, and you can always remove it if it’s not something you want to keep up on your site. Most find a pop-over is a great addition to their web site.

What have you done to increase subscriber growth? Do you think pop-up forms are effective on your site? Have you tried putting your pop-ups on different pages?

When Should a Popover Form Appear?

Question: Would you ask a visitor to do something right away, or after they’ve had some time to get to know you?

Pop-up type forms make this something you need to consider. These forms can greatly increase your subscribers for your email marketing campaign. You can set how much time elapses before the form comes up, but the question is: how much time should that be?

Split testing allows you to set up a controlled experiment within your account to test and see when you should have your form come up. We had a couple volunteers try out this experiment, and we’ll be discussing their results and why it may or may not work for you.

Time to set up some tests

SA logo

Karen Baker runs the email campaign for this South Africa travel company. She has a pop-over form set up on the site to come up immediately:

She decided to set up a split test to see if this was optimal, so she also set up a form that would appear after a delay of 30 seconds.

After several weeks, we took a look at the results. The form that came up immediately had a 45% higher subscription rate than the other form, making it the winner. Satisfied with these results, this is the form that is on her site now.

ministry logo

Tony Kummer runs the email campaign for this site that has online resources for teaching kids about Christianity. He set up a pop-over form on Ministry-To-Children.com:

His pop-over comes up within 10 seconds of landing on the page. Like Karen, he decided to test how a form that comes up after a delay would perform in comparison, and he set up a form to come up after 40 seconds.

Again, we let the test run for several weeks before looking at the results. Tony ended up having similar results in that the form that comes up shortly after landing on the page was the winner with a 50% higher subscription rate.

What does this mean?

Having a shorter delay definitely brings in more subscribers for these examples. This may be because people don’t stay on a particular page that long, as they’ve found and clicked on a link they’re interested in before they’ve even seen the form. Another reason could be they are more likely to close out a form that comes up after they’re already looking at content, and don’t want to be taken away from that page.

It may also just be the visitors are prepared to fill out something that pops up shortly after they land on a page, especially if they’re already familiar with the company and know they want to be on the mailing list.

This is why it’s good to have an inline form as well. The inline form should be immediately visible upon landing on the page, and if possible, on all pages of your website.

When might this not work as well?

While having the form come up immediately works well for our examples, there are some situations it wouldn’t works as well.

  1. The page doesn’t have a lot of information. If the web page doesn’t have a lot of content on it, people aren’t going to be staying on the page long. They’ll be finished reading through the site before the form is scheduled to pop up.
  2. You’ve got some convincing to do. If you’re marketing a new idea or a new product, you may want to let visitors read over your information a bit asking them to commit to your mailing list.
  3. Required reading is your goal. Some businesses only want subscribers that have stayed on the site for a certain amount of time and read all the good stuff that’s up there. After enough time has elapsed, then they get the mailing list offer.

Do a split test to find what works for you!

Does your pop-up come up immediately or do you have a delay? Have you tested delays for your pop-ups? Why do you think your pop-up timing is important?

4 Tips For Using Frequent Email Deals To Sell More

Online retailers rejoiced at the news their email marketing campaigns are eagerly read by consumers. This report showed that nearly half of those surveyed said they look forward to finding the latest deals in their inbox.

The question is: are you creating compelling messages that make subscribers keep coming back for more?

Roller Warehouse has their aggressive skating crowd interacting with them regularly, thanks to their email campaign. Their biweekly deal approach has brought them a great return on investment, customers are interacting with their business like never before, and they were eager to share their results and strategies with fellow online marketers.

The Biweekly Deals from Roller Warehouse

Roller Warehouse sends out their deals on skating equipment and apparel every Tuesday and Friday.

The Tuesday email usually looks like this:

Tuesday’s email requires a phone call to order the sale item:

Roller Warehouse explains that the reason the deal can’t be done online is because their price is too low to publish. This is a great way to get customers on the phone and talking to you. That offer also gives a sense of urgency, since the deal has an expiration date.

The Friday deal the subscriber can order online:

This approach can appeal to subscribers that are interested in getting deals, but maybe don’t want to call in to order. Another consideration is that subscribers may have more time on the weekend to think about their hobby.

There is also the advantage that online orders can come in while offices are closed for the weekend.

This deal also has a sense of urgency, since it expires once the weekend is over.

Results from the Biweekly Deal Approach

Roller Warehouse is proud of the campaign’s performance so far. Since implementing this method they’ve had:

  • 8-10% increase in sales after each email deal is sent out
  • Facebook fans increase 32%
  • 30-35% increase in blog traffic

Why This Works and How To Apply it to Your Campaign

1. Consider the Audience

Roller Warehouse’s target market consists of kids and young adults. Roller Warehouse looked at reports of when subscribers were opening the messages, and that’s how they found Tuesday would be a good send day. Friday was picked as the second day because most of their audience doesn’t have school on the weekends.

Are you looking at when your subscribers are reading? Use your reports to find out what day your subscribers open messages, and send your emails keeping that information in mind.

2. Utilize Social Media

Roller Warehouse promotes sharing their deals with others by including a link to share with Facebook friends:

With one click the deal can be shared with friends, allowing even more people to interact with Roller Warehouse. You can do this by uploading the Facebook logo as an image in your email, then hyperlink that image using this:

http://www.facebook.com/share.php?u=<url>

Just replace the <url> with the link you want to share.

With social media becoming an increasingly more valuable tool for marketing, you want to make sure you’re using sites like Facebook and Twitter to promote your business

3. Build a relationship with subscribers

Roller Warehouse does not just go for the hard sell in their deals. They use a friendly tone and even create cool videos for the products they’re promoting:

You can click to view one of their videos below:

Roller Warehouse also keeps in mind that not everyone will be attracted to the featured deal, so they include other products that are on sale as well:

Along with that, Roller Warehouse includes news from their blog so subscribers will still interact with the site even if they aren’t interested in the current deals:

Take a look at your last email and make sure you’re working on building a relationship. Are you having a conversation with your subscribers or is it an advertisement? Are you asking for feedback? Do you provide materials your subscribers will find interesting?

Have a friend look over your messages and let you know if your personality comes out in it, or if it sounds like a salesperson.

4. Stay Consistent

If you don’t set expectations for valuable messages, subscribers won’t be reading. Roller Warehouse has set a consistent schedule for their campaign, which means subscribers know when to expect getting the deals. All their messages include either the phone deal for Tuesday or online deal for Friday, and they make sure to include product demos in all their messages.

Make sure you have set expectations for your campaign early on, and stick to the schedule and material you promised!

Have You Tried Frequent Email Deals With Your Campaign?

Roller Warehouse likes how their biweekly deals are performing, while companies like Groupon and LivingSocial have found daily email deals work great for them.

What results have you seen from email deals? What other tactics have you tried to increase sales?

Email Segmentation Lifts Sales Over $31,000

Segmentation PathsOver the past week or so, we’ve talked about email segmentation a few times.

While the three posts did show you how to segment your subscribers, they didn’t talk much about why you should do so, or what to say to different groups. Some of you asked about this.

Well, just the other day, AWeber user Yaro Starak talked about those very things on his blog, sharing how they helped him raise sales over $31,000.

A couple thoughts on his experience and results:

(If you haven’t done so already, go read Yaro’s post before continuing – it’ll put my comments below in much better context!)

  1. He started by communicating with all subscribers evenly – in other words, not segmenting.

    While it might seem counterintuitive, often sending a few emails without segmenting is the start of a good segmentation campaign.

    If you’re going to segment based on what different people are responding to… you have to give them a chance to respond first!

  2. Rather than just re-email the same message to non-openers, he tried different message content.

    In reading/listening to some marketers, I get the impression some people think the only or “best” segmenting tactic is to resend the same message to people who didn’t open it the first time.

    I’m all for exposing potential customers to a product multiple times, but this isn’t the only way to use segmentation (it’s one possible way, but you need to test it against different original content too!).

    Good on ya for testing, Yaro.

  3. He merged previously segmented groups back together, based on later actions.

    Segmentation doesn’t have to be complicated (though you can make it that way if you like… ;) ).

    Yaro sent the third message to people who clicked through on either of the first 2 messages.

    While this won’t always apply to your campaigns, if 2 different groups that you previously segmented start to show similarities, it may make sense to again treat them as one more uniform group.

Your Thoughts On Email Segmentation?

My notes certainly aren’t the only ideas you might take away from Yaro’s experience.

What approaches to email segmentation do you think you can take for your business?

Are there other ways you might have segmented in his example?

Share your thoughts below!


Note: segmenting based on opens and clicks is a feature of our Email Web Analytics tools.

If you signed up for AWeber on or after May 20, 2008 these tools are automatically included in your account; if you signed up before then, you can upgrade here.

Social Proof Tool Boosts Landing Page Conversion 32.4%

The recent release of a new subscriber count chicklet met a mixed response.

We’ve read plenty of positive comments on the blogs who covered this feature.

But there were definitely others (both in the release post’s comments and on other blogs) who doubted the usefulness of such a feature.

Of course, this is one of those cases where you should apply the best lesson in marketing — Test!

Fitness expert and AWeber user Carl Juneau did just that, setting up a split test on his landing page to see if the presence of the subscriber count chicklet affected opt-in rates.

He swung by our blog the other day to share his results.

Adding The Chicklet Increased His Opt-In Rate By 32.4%

In a comment, Carl shared his results:

Justin, Mark, other readers:

I implemented the the readers widget on my landing page the day it came out in an A/B split using Google Optimizer (services.google.com/websiteoptimizer).

Here are the results:

OVERALL
Visitors: 552
Conversions: 140
Conversion rate: 25.36%

PAGE A: NO WIDGET
59 conversions / 271 visitors
21.8% ± 3.5% conversion rate

PAGE B: WITH WIDGET
81 conversions / 281 visitors
28.8% ± 3.7% conversion rate

Page B chance to beat Page A: 97.2%
Improvement: 32.4%

Results impressed me and are significant at the a=5% level. I only have 2300 readers, so even (relatively) low numbers benefit conversion.

Key Takeaways

  • You don’t have to have a huge list for this to work.

I think a lot of people believe social proof is only effective when you’re talking about huge numbers of people, like the McDonald’s “Billions and Billions Served” signs.

Carl doesn’t have billions of subscribers. He has just over two thousand. And yet, the chicklet still made a big impact on his landing page conversions. Why?

Here’s what I think: the more homogeneous your audience is, the more powerful social proof is.

If McDonald’s said “2300 Served,” well… who cares? There are millions (billions?) of people who eat hamburgers. 2300 isn’t that many in the grand scheme of things.

But narrow your audience down to people actively interested in getting six-pack abs, and suddenly 2300 readers is a helpful cue that Carl knows what he’s talking about.1

  • Test. Then, test some more.

Carl’s not haphazardly adding and removing stuff from his page.

He’s using Google’s Website Optimizer to test and track, and he’s making sure to get statistically significant results.

As we’ve discussed before, split testing is a crucial element of a successful marketing campaign.

So start today! To help, here are some split test ideas you can use for your email campaigns.

More Split Test Results To Come Soon

I’m in touch with Carl directly to discuss some other possible tests we can do to raise his opt-in rates further (and share the results with you, of course!).

Want To Get The Results In Your Inbox?

Join our blog newsletter and we’ll email them to you when they come out.

We’ll also periodically send you other email marketing tips we publish here. The newsletter goes out 1-2 times per week.

Naturally, as a permission-based email marketing company, we respect your privacy.

1. For more on social proof, I strongly recommend Robert Cialdini’s Influence: The Psychology of Persuasion and his newer book Yes! 50 Scientifically Proven Ways to Be Persuasive. Both give numerous examples of how social proof affects decision-making.

AWeber User Gets 1000% Increase In Opt-Ins Using Popover Form

Over at MarketingSherpa there’s a great case study of how AWeber user Leo Notenboom of Ask-Leo.com increased his opt-in conversions by more than 1000%.

The part that might surprise a lot of our readers (but not us)? He did it using a popover form. As in, a simulated popup form.

Popover Forms? But Won’t They Annoy Visitors?

I can’t count the number of times I’ve heard someone say something to the effect of, “I just won’t use a popup. I don’t like them, and neither will my visitors.”

This makes me sad, because it shows an unwillingness to split test, which as I discussed recently is key to running effective email marketing campaigns.

This ‘annoyance factor’ is something Leo addresses in the case study — he found no negative effects of running the popover forms.

How’d He Do It?

While I don’t want to hijack MarketingSherpa’s article, I think we need to highlight one key element of his success:

Leo rigorously tested the time delay he used for his form — it didn’t display immediately when visitors landed on his site. He set the delay based on the average amount of time visitors spent on his site.

For more details on the study, go read the writeup on MarketingSherpa. It’s only available to the public until July 9th 2008 (after that it’s members-only), so act fast!


To see Leo’s popover form in action, swing by Ask-Leo.com and hang out a bit ;)

Email Newsletter Open Rates: April 2008

Think you know the best day and time to send your email marketing newsletter?

Ever wonder if your fellow email marketers are all sending at the same time you do?

Convinced your open rate is too low (or amazingly high)?

Some recent statistics pulled from all AWeber users may help you answer these questions:

What Kind of Open Rates Are People Getting?

If you’re sending HTML emails, you probably use your open rate to help gauge your success.

Even though it’s not a perfect measure of whether people are actually opening and reading your emails, it’s useful as a relative measure:

If it goes up over a short period of time, more people are probably reading
If it falls over a short period of time, it’s almost certain fewer people are reading.

Plus, all other things being equal, it can give you some motivation (if your open rates are lower than other senders’) or satisfaction (if your rates are higher).

So, here goes…

Average Open Rate Last Month: 13.6%

When Is/Was The Best Day To Send?

You’ll often hear (at least, I often hear) that Tuesday is the optimal day to send, because on Monday people are catching up from the weekend, and that on Tuesday morning you’ll have their undivided attention before they jump into their work for the upcoming week.

Do the numbers back up that theory? Let’s see.

The breakdown of open rates by day of the week:

Monday
13.67%
Tuesday
13.21%
Wednesday
14.07%
Thursday
14.52%
Friday
13.25%
Saturday
12.09%
Sunday
13.26%

Last month, Tuesday was actually the second-worst day to send, at least if you’re measuring by open rates.

(While we’re breaking assumptions, I should point out this, too: the hour of the day that got the best open rate was not 8-9AM, or 9-10AM, but in fact 2-3PM Eastern Time — email newsletters sent during that hour last month enjoyed a 19.1% open rate.)

Does This Mean I Should Switch My Campaigns To Thursdays?

In a word: No.

Don’t break with your readers’ expectations just to try to follow the latest day of the week stats. You might actually reduce your open rate by doing so.

In both March and February, Thursday newsletters got the 3rd-worst opens vs. the rest of the week.

I hesitated a little to publish these stats, because I’m concerned that people might flock to sending their newsletters at the day or time that happened to get the best results lately.

Please, don’t drastically change your sending times/days just because you see that the average last month, or any month, happened to be higher on a different day or time.

Yes, you might eventually be able to shift your sending schedule, or split test some broadcasts, but if you up and move everything, you may throw off subscribers who are used to hearing from you at the usual time.

“It’s So Busy, Nobody Goes There Anymore”

To get at the other reason for not shifting your sending based on these stats, let’s paraphrase Yogi Berra (see above).

If everyone switches their sending schedule to send on say, Thursday, then recipients will start getting a ton of email that day, and start paying less attention to each individual email.

One possible reason for Thursday’s success last month may be that it wasn’t as popular as say, Tuesday or Wednesday for sending email:

Percentage of Newsletters Sent by Day
Monday
16.0%
Tuesday
17.7%
Wednesday
16.9%
Thursday
16.6%
Friday
15.2%
Saturday
8.8%
Sunday
8.8%

Those higher-volume days mean more emails in readers’ inboxes, which might contribute to reduced open rates. Following that reasoning, some people may look at the low weekend volume (more email newsletters were sent on Tuesdays than on Saturdays and Sundays combined) and see an opportunity to get their audiences’ undivided attention.

My main point in showing these is to point out that our assumptions about what works are often quite wrong, and that you ultimately have to test for yourself to see what best suits your audience.

Some Inspiration… And Some Help

Are you getting better open rates than this?

If so, GREAT! Give yourself a pat on the back…

…but don’t get complacent. Open rates aren’t the be-all, end-all of email metrics. They don’t guarantee that people are reading your emails, only that they have images turned on and that they probably saw your email for at least a moment.

Plus, there’s always room for improvement, right?

Some ideas that can help you raise your open rates:

Ask people to add you to their address books. Some email programs will display images from senders who are in the recipient’s contact list.
If you are putting pictures in your emails, use the ALT text for those images to pique readers’ interest in what the picture is, so that they enable images. Or, just directly ask readers to turn on images!
Add a picture of yourself to your emails, near/next to your signature. People like seeing your smiling face, and if they see it in one of your emails, they may be more likely to turn on images to see it again later.

What statistics/benchmarks would you like to see and/or learn more about?

Share your requests below or email me your suggestions or drop me a line on Twitter!

9 visitors online now
3 guests, 6 bots, 0 members
Max visitors today: 27 at 12:45 pm EDT
This month: 35 at 05-16-2013 08:04 am EDT
This year: 112 at 04-11-2013 09:43 am EDT
All time: 112 at 04-11-2013 09:43 am EDT
Get Adobe Flash player