5 Best Practices for Subject Line Testing
Editor's note: We've just launched subject line split testing in Emma, so you can apply these tips today if you like. Watch a quick screencast to learn more, or see if you can spot a winning subject line over at our Split Test Showdown.
Email marketers who consistently conduct split tests know that the rewards are numerous—higher open rates, increased conversions and, perhaps most importantly, insights into subscriber behavior and preferences. But if you’re new to testing, how do you know you’re doing it right? Testing subject lines is a simple, effective way to start building a solid email testing program. These five tips will help you get started today:
As you probably remember from seventh grade science, any good scientific experiment follows structured steps. First, start with observation and research. For email marketing, this means analyzing data and reviewing current subject lines. Then, come up with a hypothesis based on your research. For example, your hypothesis might be, “A short subject line will lead to a higher open rate than a long subject line.” After you conduct the test, you’ll see if the results proved or disproved your hypothesis.
There are many ways to measure success—how will you measure yours? Determining your business goals at the outset will help ensure that your testing campaign will be worth your time. Figure out which metrics you’ll be looking at once the test deploys. Open rate may indicate reader interest, but your ultimate goal may be to increase the number of people who submit the form on your landing page. In that case, the email version that gets the most opens may not be the one that leads to the most conversions.
Conducting your test on a small sample of your subscriber list can be a smart way to maximize results. Use the winning subject line for the remainder of your subscriber list. Be aware, though, that batch testing only works when your results can reach statistical significance. The sample has to be large enough to draw sound conclusions; if your subscriber list is small, you won’t benefit from batch testing.
Effective testing leads to learnings about your audience. But learnings aren’t clear when you test more than one variable at a time, because you aren’t able to tell which one made a difference. For example, you may want to test personalization: Will your readers respond better to a subject line that includes their first name? In that case, make sure the two subject lines you’re testing, aside from the personalization, are completely identical. Additional variations—whether in messaging, tone, length or offer—will lead to inconclusive results. Likewise, testing subject lines means that all other content is the same, from the email to the landing page.
Contrary to what many email marketers believe, creating a compelling subject line isn’t hard. The real challenge is creating a compelling one that is consistent with your email and landing page. Otherwise, your awesome subject line could inspire a lot of opens, but very few clickthroughs. Worse, the email will likely end up in subscribers’ “deleted items” folder—and your subsequent emails will be regarded with suspicion. Take the long view when it comes to testing. Short-term wins are pointless if you’re not learning about your audience.
These five best practices are a good starting point for any email marketing campaign. But this is just the beginning. Testing is a mindset, not a tactic. Your results will help shape future tests, inspire additional testing ideas and form new research questions. After all, a testing expert’s work is never done.