Randomization | XM Community
Skip to main content

Hi there,
This is my first time using Qualtrics and I'm hoping someone can assist me with a query.

I'm creating a survey in which participants will be shown four vignette case studies, each with one question about that particular vignette. I want each participant to answer the questions for all four of the vignettes, but I want the order in which they are presented the vignettes to be randomised. 

Ideally I will be able to vary the “citizentype” in the vignettes. With this in mind, I'm intending to copy each of the four vignette blocks I currently have and change the “citizentype” presented in each vignette. So instead of the four blocks of vignettes I currently have, I will end up with eight blocks of vignettes: vignette 1 (easy citizen), vignette 1 (difficult citizen), vignette 2 (easy citizen), vignette 2 (difficult citizen), vignette 3 (easy citizen), vignette 3 (difficult citizen), vignette 4 (easy citizen), vignette 4 (difficult citizen).

However, I'm unsure how I can ensure that both of the following randomisations occur: 1) participants will be randomly presented with either easy citizen or difficult citizen across the vignettes, and 2) within that randomisation, the order in which participants are shown the four vignettes is randomised.

As an example, one participant might complete: vignette 2 (easy), vignette 1 (easy), then vignette 3 (difficult) vignette (difficult), whereas another participant might complete vignette 3 (easy), vignette 2 (difficult), then vignette 1 (diffucult), then vignette 4 (easy) ans so on.


Hopefully I've communicated this in a way that makes sense. Does anyone know how I can set this up?
Thanks so much!

 

@N_Ashrafi So you have 8 block V1-V4 to randomize order and 2 variance Easy-diff to show.

You can set a big randomizer that will present 4/4 smaller randomizer(1-4). Inside the small one, random only 1/2 variance (easy-difficult).

 

Thank you so much! It works! 

I can't figure out if there is a smart way to do it by using embedded data. In that way it result in having only four dependent variables instead of eight? In relation to later data processing and analysis, it would be nice to have four dependent variables instead of eight.

 

Beyond this, how do I get Qualtrics to provide me with variables for: what condition they have received, what order they have received it in, and how much time they spend on the entire questionnaire?

I think this can be achieved easily with just block randomization if you’re looking to randomize your questions by putting them into different blocks and then use Randomizer from survey flow. And if it’s choices just use question level randomization.

In another scenrio if you want to have predefined order before the survey starts then you can create different scenarios with multiple blocks (8 from your first example) and assign variables to find out which came first and the order with simple math operator!

Hope this helps.

Leave a Reply


Terms & Conditions