Criteria for eliminating responses | XM Community
Skip to main content
Solved

Criteria for eliminating responses

  • July 18, 2018
  • 4 replies
  • 186 views

Hello. Thank you in advance for answering this. I am wondering if there is any rule of thumb for deleting responses based on the amount of time taken to complete the survey. I have a 36-item survey. I am done collecting responses, and I am now filtering them based on meeting the criteria for the survey. I also want to delete anyone who did not take the survey seriously. For example, I have several respondents who took less than 60 seconds on the survey. Clearly with 36-items this is not an appropriate response. But, I'm wondering if there is a rule of thumb for the time limit - should anything under 2 minutes be deleted? 3 minutes? I've looked online, and cannot find an answer to this. Thank you.

Best answer by PeeyushBansal

yes there is thumb rule called as Median LOI rule. Any record that spent less than 1/2 Median LOI you can reject. Calculate Median in excel from all duration and than devide it by 2. filter out records with their suration <(1/2*Median LOI)

4 replies

PeeyushBansal
Level 6 ●●●●●●
Forum|alt.badge.img+43
  • Level 6 ●●●●●●
  • Answer
  • July 18, 2018
yes there is thumb rule called as Median LOI rule. Any record that spent less than 1/2 Median LOI you can reject. Calculate Median in excel from all duration and than devide it by 2. filter out records with their suration <(1/2*Median LOI)

mcoverdale
Level 2 ●●
Forum|alt.badge.img+3
  • Level 2 ●●
  • July 18, 2018
Hi @kc71, This article might be useful/interesting to you: https://featuredcontent.psychonomic.org/automatic-detection-of-automatic-response-generators-how-to-improve-data-quality-in-online-research/

  • Author
  • July 18, 2018
Thank you both! These were really helpful answers.

https://community.qualtrics.com/XMcommunity/discussion/comment/3879#Comment_3879Do you maybe have any reference to this rule? I tried to find it online but can't seem to find it. Thanky you so much