Question about the data generated by simulated test responses | XM Community
Skip to main content
Solved

Question about the data generated by simulated test responses

  • April 23, 2020
  • 9 replies
  • 90 views
M

Hello Qualtrics community,
I'm building my survey and I'm generating some responses to observe the data generated for analysis.
My first question is a consent form, if they click "NO", the survey ends due to the skip logic.
image.png
When observing the data, I see that some tests where system selected "No" in the consent, are showing answers for the next questions when the logic says that there should not be any. Any idea why this happens?
Also, in some cases where the consent was marked as "yes", there is no data for the next questions. When looking in detail shows :This question was not displayed to the respondent.
image.pngHope anyone can help me, I'm looking forward for your thoughts!
Thank you
MR

Best answer by bstrahin

mauruge you may consider adding a branch with End of Survey element as a back up catch to get people who disagree to the Consent block question and terminate the survey that way. I like the stability of an End of Survey Element better than skip logic when possible.
Show Block: Consent
Branch IF Consent Question = Disagree
OR IF Consent Question Is Empty
-> END OF SURVEY ELEMENT (indented under the branch)
Show Block: Block 5....

    9 replies

    MatthewM
    Level 6 ●●●●●●
    Forum|alt.badge.img+30
    • MatthewM
    • Level 6 ●●●●●●
    • April 23, 2020

    Hi mauruge,
    Can you share a screen shot of the consent question and the skip logic?

    TomG
    M
    • mauruge
    • Author
    • April 23, 2020

    Hi Matthew,
    Here is the screenshot.
    image.pngThanks !
    MR

    bstrahin
    Level 6 ●●●●●●
    Forum|alt.badge.img+38
    • bstrahin
    • Level 6 ●●●●●●
    • April 23, 2020

    mauruge do you have anything in your survey flow or survey options?

    MatthewM
    Level 6 ●●●●●●
    Forum|alt.badge.img+30
    • MatthewM
    • Level 6 ●●●●●●
    • April 23, 2020

    Thanks. I think you don't need the second Skip option (Agree is Selected, Skip to End of Block). That's likely why there's no data for those who choose Agree.
    I can't tell from this why you are getting data for those who choose Disagree, however. Do you have those questions on the same page as the consent question, or is there a page break in between or different block?
    Also, as bstrahin suggested, there could be something in the Survey Flow or options causing this to happen.

    bstrahin
    M
    • mauruge
    • Author
    • April 23, 2020

    Hello Mathew
    I have removed the second skip logic and keeps happening the same in the new tests. It might be just a hypotheses, but is it maybe the system simulating people that agreed but immediately dropped down the survey?
    bstrahin the consent is in a different block from the other questions. I have not used flow features for this survey as you can see in the image down below:
    image.pngMau

    bstrahin
    Level 6 ●●●●●●
    Forum|alt.badge.img+38
    • bstrahin
    • Level 6 ●●●●●●
    • Answer
    • April 24, 2020

    mauruge you may consider adding a branch with End of Survey element as a back up catch to get people who disagree to the Consent block question and terminate the survey that way. I like the stability of an End of Survey Element better than skip logic when possible.
    Show Block: Consent
    Branch IF Consent Question = Disagree
    OR IF Consent Question Is Empty
    -> END OF SURVEY ELEMENT (indented under the branch)
    Show Block: Block 5....

    MatthewM
    M
    M
    • mauruge
    • Author
    • April 24, 2020

    Hello bstrahin , thank you, i will try it and let you know how comes up!

    MatthewM
    Level 6 ●●●●●●
    Forum|alt.badge.img+30
    • MatthewM
    • Level 6 ●●●●●●
    • April 24, 2020

    Good point, the Agrees with no data could represent drop-outs.
    Hope that the solution from bstrahin solves your problem!

    M
    • mauruge
    • Author
    • April 29, 2020

    Great news,
    Using the survey flow to show the route, solved the problem of the skip logic, now all the disagree answers end the survey! Thank you @matthewm and bstrahin, now I'm ready to rock!

    image.pngMau

    MatthewM
    bstrahin
    Terms & ConditionsAccessibility statement