Evenly present scenarios, but also randomize them | XM Community
Skip to main content

Hi everyone!
I have a similar question to the one below, but I need the questions to be evenly distributed.
https://www.qualtrics.com/community/discussion/13110/three-version-a-and-three-version-b-in-random-order
Here's my problem: There are 12 scenarios that participants have to rate. From each scenario, there are two versions, let's call them either version A or version B. I want each participant to see each version 6 times, but in a randomized order. So one participant would rate AABBABABAABB, the other one BBBBABAAAABA , it doesn't matter, as long as each version is shown 6 times. I tried it with the method from the link above, but this doesn't guarantee that each version is shown 6 times.
Does anyone have an idea on how to solve this?

Thanks!

To clarify you have:
S1: v1 and v2
S2: v3 and v4
.
.
S12: v23 and v24
and you only want to the user to see 6 of the scenarios but both versions within each scenario?

Hi! Thanks for your answer, and sorry for the not so good explanation from my side.
No, I would like for each participant to see each scenario, so 12 scenarios in total, and they should see version A 6 times and version B 6 times. So for example, for the first scenario the participant sees version A, for the second one version B etc. It doesn't matter in which order they see the scenarios, but it is important that they always see 6 A versions and 6 B versions.
Maybe this example makes it clearer:
Scenario 1: They have to rate either a blue (version A) or red (version 😎 bicycle.
Scenario 2: They have to rate either a blue (version A) or red (version 😎 dress.
...
Scenario 12: They have to rate either a blue (version A) or red (version 😎 car.
So each participant should rate 6 blue items and 6 red items, but these combinations should be randomized across participants, so that in the end all of the versions were rated.
I hope i clarified it!

Leave a Reply


Terms & Conditions