How can I do an A/B test survey with two target groups which have to answer the same question? | XM Community
Skip to main content
Solved

How can I do an A/B test survey with two target groups which have to answer the same question?

  • October 29, 2018
  • 3 replies
  • 107 views

Hello, i need to make a survey investigating about the UX of a tool with A/B testing. - The survey should randomly be distributed between the participants group A and group B. - Group A is interacting with tool A - Group B is interacting with the manipulated tool which is tool B after interacting with those tools both groups should answer the same survey questions (which are on a 7 point Likert scale). So what I basically want to do is to send out ONE email to the participants. A participant will be randomly allocated to group A or to group B, interacting with the associated tool A or B, and then they have to answer the same questions. In my data i have to see which statistics belong to group A and which belong to group B. What is the best/smartest way to implement my idea? Thanks for your advice, Daniel

Best answer by Akdashboard

Hi @d_hartl Yes! This is super easy. Using the same structure of blocks in the image above add an additional embedded data field in both green blocks called "ChatBot_Link" and set it equal to the first link for Experience A and the second link for Experience B. Then in your survey, use Piped Text to pipe "ChatBot_Link" at the right point. Piped text is pretty straightforward, but you can learn more at the this link, if you aren't familiar with it yet. https://www.qualtrics.com/support/survey-platform/survey-module/editing-questions/piped-text/piped-text-overview/
View original

3 replies

Akdashboard
Level 4 ●●●●
Forum|alt.badge.img+6
  • Level 4 ●●●●
  • 488 replies
  • October 29, 2018
I am not sure how you are showing the 2 different tools or regulating that. Is it in Quatrics somehow? As far as randomly assigning A/B values to a participant in order to segment the results, this can be done in the survey flow using the randomizer block and embedded data blocks. !

  • Author
  • 1 reply
  • October 30, 2018
Thank you @Akdashboard for your answer! The Survey will investigate the interaction with a chatbot (focus on UX). Therefore i developed 2 chatbots, to which the participants will be directed with a link. Hence, i should somehow include the link for chatbot A to the survey for group A and the link for chatbot B into the survey B. Will this be possible with your solution? Best, Daniel

Akdashboard
Level 4 ●●●●
Forum|alt.badge.img+6
  • Level 4 ●●●●
  • 488 replies
  • Answer
  • October 30, 2018
Hi @d_hartl Yes! This is super easy. Using the same structure of blocks in the image above add an additional embedded data field in both green blocks called "ChatBot_Link" and set it equal to the first link for Experience A and the second link for Experience B. Then in your survey, use Piped Text to pipe "ChatBot_Link" at the right point. Piped text is pretty straightforward, but you can learn more at the this link, if you aren't familiar with it yet. https://www.qualtrics.com/support/survey-platform/survey-module/editing-questions/piped-text/piped-text-overview/

Leave a Reply