I've played around with subject lines in the past, trying to figure out what might garner the best response rates for surveys sent to students. I'm assuming your work with other populations would apply as well. So I'd like to know if anyone has tips that they feel move the needle on response rates.
During one test I used a subject line that was very polite, i.e. 'please help us... thank you...' compared to a subject line that was more of a command, i.e. 'Take this survey now...' and I was surprised. The 'polite' subject yielded far worse results than the commanding subject line. It may be that students felt like the command made the task sound somewhat like a requirement for their coursework, but I did no more testing on that project due to lack of time and a need to change directions... I'd like to do a similar test with more thorough analysis in the future, but for now, what have you found to impact response rates?
+10We've found that having a "call to action" subject line provides a much better response rate.
+2Any specific examples that you found especially impactful?
+10Really just using words of urgency. "Take the Campus Climate Survey Today!" "We need your opinion now!" "Final hours ...."
+2I try to be consistent in both the time and email subject so that participants can recognize the email as something that has a purpose and helps sorta establish expectations.
I think the language can be a little dependent on the sender/relationship with the participants. For example, I often speak to student-aged folks, but we aren't a school, so I can be a lot less formal and often start email subjects with a literal "Oh look! A ___ survey" it's both casual, but also gets their attention.
Having it feel personalized can also help, such as adding "for you," "calling all ___ students" "let [college] know what you think" could be potential options as well.
Within Qualtrics you can set up certain times for the surveys to launch, I would definitely suggest to do some A/B tests with different samples to see what the results are and let us know what you find!
I think the language can be a little dependent on the sender/relationship with the participants. For example, I often speak to student-aged folks, but we aren't a school, so I can be a lot less formal and often start email subjects with a literal "Oh look! A ___ survey" it's both casual, but also gets their attention.
Having it feel personalized can also help, such as adding "for you," "calling all ___ students" "let [college] know what you think" could be potential options as well.
Within Qualtrics you can set up certain times for the surveys to launch, I would definitely suggest to do some A/B tests with different samples to see what the results are and let us know what you find!
+7@KatC's point about launch times is very important, and highly dependant on target. For students I would actually imagine seeing the highest response during common class times.
1 person likes this
+2You know @AnthonyR , I've looked at response time of day for students and there are definitely some interesting things. I send out about 150K course eval emails each fall so I get a lot of data back each term... Peak response times are early morning, and mid afternoon. I typically send the Invite email at 6am on a Tuesday to avoid weekend/Monday email overload, but still get it in their hands early in the week. Then reminders every 3 to 4 days alternating between just before the two peak response times.
@KatC I've got another 150K+ distribution set for next Tuesday... Maybe I'll do a couple different tests on Subject Line again this semester. Would anyone on this thread want to get together offline later this week and hash out some ideas together?
@KatC I've got another 150K+ distribution set for next Tuesday... Maybe I'll do a couple different tests on Subject Line again this semester. Would anyone on this thread want to get together offline later this week and hash out some ideas together?
1 person likes this
+49@JakeW For faculty and staff I've used a subject line with the words "Action Required" followed by a more descriptive summary (e.g. Action Required: Faculty Satisfaction Survey). It seems to get their attention and make them realize that they need to do something more than just read the email. For students, the most commanding subject line I've used so far is "Final Day to complete Course Evaluations", but now you've got me thinking I may change it up!
@JakeW - we actually utilized the built-in A/B testing capabilities to test the very concept. We ran six different first-level variations, and did this on four different sites, and on both mobile and desktop variations as well.
For each of ours sites, with the results being consistent in mobile and desktop, the two highest response rates were what we labeled our casual language choices:
1) "Wait! Before you go, tell us about your visit."
2) "Got a few minutes to help us improve?"
These two winners were contrasted against more formal/boilerplate choices, such as "We need you help to improve HHS.gov."
I really love how easy it is to setup quick A/B tests in Site Intercept, and I'm glad to hear that others are running similar experiments.
For each of ours sites, with the results being consistent in mobile and desktop, the two highest response rates were what we labeled our casual language choices:
1) "Wait! Before you go, tell us about your visit."
2) "Got a few minutes to help us improve?"
These two winners were contrasted against more formal/boilerplate choices, such as "We need you help to improve HHS.gov."
I really love how easy it is to setup quick A/B tests in Site Intercept, and I'm glad to hear that others are running similar experiments.
+7
Some subject hooks that get my attention are:
How was (Subject name)? Take this quick survey to rate your experience!
Did you like (Subject name)? Let them know now!
Hurry, your response is needed! How did (Subject) fair?
We need your opinion! Rate your experience with (Subject name)!
I also think anything with urgency, or a "free" coupon or offer also helps.
How was (Subject name)? Take this quick survey to rate your experience!
Did you like (Subject name)? Let them know now!
Hurry, your response is needed! How did (Subject) fair?
We need your opinion! Rate your experience with (Subject name)!
I also think anything with urgency, or a "free" coupon or offer also helps.
+2@lillianc You're welcome! I wish I had the opportunity to run more tests, however I've taken a new job elsewhere. In my new role I do plan to run some subject line tests, but it may be a while until I have the opportunity. I'll keep this forum posted.
+7You can also check out this webinar by Jag Patel of MIT. It has great, research-based advice for boosting open rates on institutional surveys.
1 person likes this
+1I like to make them a little fun and unorthodox when appropriate. I've documented improvement with, "We don't normally send surveys, but when we do. . ." One respondent even commented in an open-end, "I don't normally take surveys, but the subject line was intriguing, kudos to whomever wrote it."
+1I've been using the following websites to test effective subject lines lately to lift response rates but don't have evidence yet (A/B tests), other than the 'score' the site assigns to a proposed script. The more you work at it the higher the score. And some of these give tips to improve as well. Good luck!
http://emailsubjectlinegrader.com/
https://coschedule.com/headline-analyzer
http://www.subjectline.com/
http://emailsubjectlinegrader.com/
https://coschedule.com/headline-analyzer
http://www.subjectline.com/
+1> @Emily said:
> You can also check out this webinar by Jag Patel of MIT. It has great, research-based advice for boosting open rates on institutional surveys.
This link does not seem to be working; it just went to the main Qualtrics site. Is the webinar still available somewhere?
> You can also check out this webinar by Jag Patel of MIT. It has great, research-based advice for boosting open rates on institutional surveys.
This link does not seem to be working; it just went to the main Qualtrics site. Is the webinar still available somewhere?
+7@Student_Affairs_AER Unfortunately, since that webinar is from February 2018, it is outdated and no longer available. You can find all of the webinars that we have available by going here!
+1Communications professional turned research analyst here - I just wanted to share some success I had regarding subject lines! Definitely consider your industry and the way your target demographic will behave. I work for a university, and I have found that very simple and direct subject lines (e.g. "Fall 2021 Registration", "1-Year Alumni Survey", etc.) are successful. They're concise, and they come up quickly in any searches the student may perform in their inbox.)
+25Based on our A/B Testing research with three email subject lines, we found that a simple "We'd love your feedback!" garnered the most responses for our Annual Relationship survey in the education field.
+23I stumbled across this older thread but it has some great information. I can say from my time in admissions that anything personalized helps tremendously. Students don’t always read their emails so my XM pro and I have been discussing QR codes as well. The timing of when the survey goes out can also be huge.
Pamela L. Beck
1 person likes this
Leave a Reply
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.