A survey invitation that’s, well, inviting

I did some hypothesizing (thanks, 7th grade science teacher!) that the '5-minute' language would be more effective. After all, five minutes means five minutes, whereas 'brief' may just be marketing-speak for 'the longest survey of your life, sucker.' When you're asking for someone's time, there's little question that it's good to be as specific as possible.
The question was: does being more specific in the invitation really make a difference in how people engage with your survey?
Here's what we found. While the difference wasn't outrageous, the five-minute invitation gave us better click-through rates and survey participation rates. Between the 'brief' campaign and the 'five-minute' campaign, we saw:
* An 8% increase in click-through rates in the email campaign
* A 9% increase in people who started the survey once arriving on the page
* An 11% increase in people who completed the 18-question survey
And yes, there's more. In the email campaign, there were two places folks could click through – the top mention, which is where we tested the different language, and the bottom mention, which stayed the same between the two campaigns. What's interesting? The 8% increase showed up *exclusively* in the difference between the top-mention clicks. The clicks on the bottom-mention were statistically identical between the two versions.
Based on that fun little tidbit, I've been doing some rather unscientific speculating (sorry, 7th grade science teacher) that the boost in engagement doesn't come just from a subscriber *understanding* it's a five-minute survey and appreciating the specificity. Perhaps it's connected to the physical act of seeing (and then clicking) the language that's setting the expectation. If that weren't the case, I'd have expected a little more variation in clicks in the lower mention.
The moral of the story: While setting an expectation with a specific time isn't the silver bullet to boosting your survey participation numbers, the people who appreciate the specificity will be increasing likely to visit, start and complete your survey.
Are you using email marketing to promote your surveys and online forms? If so, tell us what's working for you.
Comments
.(JavaScript must be enabled to view this email address) | May 16, 2009
Seems so obvious but most survey requests never include how much time it will take the recipient to complete it. Thank you for sharing this seemingly simple piece of great advice.
.(JavaScript must be enabled to view this email address) | May 19, 2009
Informative, detail…
.(JavaScript must be enabled to view this email address) | May 19, 2009
Thanks for the comments, Bridget and Suneth. Keep us posted on how your *own* survey invitations go…