I have more than once observed a respondent seemingly reading a response scale backwards — they will provide effusive, positive comments, and then select "strongly disagree" to all of our positively worded items. The most obvious way I can think to prevent this would be to color code the response options, where the most negative response option is in red and the most positive in green. Are there any data quality issues to consider with this approach? The worst thing I can come up with is that red-green in particular is a bad combination for people with colorblindness, but I'm not sure that would have an effect on their responses. This is probably also not something I'd use if I were doing serious research like scale development, but we are mostly just doing small-scale program evaluation surveys.
Page 1 / 1
My first reaction to this was "No, don't do it" but after thinking it through, I don't see as much of a bias in this case.
Of course, color-coding should never be used with NPS because that's a whole other thing but it sounds like you're talking about a likert question that already has positive and negative language assigned to the choices. Because of that, I would personally be okay with approving this on one of my own surveys, especially if I was suffering from respondents who are not reading the choices well, as you seem to be.
Of course, color-coding should never be used with NPS because that's a whole other thing but it sounds like you're talking about a likert question that already has positive and negative language assigned to the choices. Because of that, I would personally be okay with approving this on one of my own surveys, especially if I was suffering from respondents who are not reading the choices well, as you seem to be.
Thanks, @JenCX ! You're correct that we would not be using this with NPS.
Leave a Reply
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.