Random order not shown in results | XM Community
Skip to main content

Hello everyone, it must be possibly a silly question, but I cannot find the answer.
I have randomised two blocks in a survey: in one block respondents have to answer 23 "choice questions", call it block A; and in another block they have to answer 2 "colour group" questions out of 7 (in case it matters, these are branching out questions: first one asks to pick a colour group out of six, second asks to pick a colour within the chosen colour group), call it block B.
The randomisation is such that some respondents will see first Block A and then Block B, while some respondents will see first B and then A.
When I run the preview this works fine.
The problem I have is with the (test) data I download, with the "display order of randomisation" option ticked: while I have answers to questions in both blocks, i.e. for each (fictitious) respondent I get 25 answers, but I only get to see the order in which the questions where asked in block A, not in block B.
What am I doing wrong please? Picture of my survey's flow is enclosed. Thanks in advance!
Screenshot 2022-12-23 at 14.11.20.png

Are the questions in Block B (Colour choices) randomized?


Dear Tom, yes they are randomised too (and apologies, I wanted to answer "yes" and pressed on "accept answer" instead!)


If both Blocks are randomized then there should be a DO (display order) field for both in the response data file. There should also be a DO field for the randomizer.
I would double check to make sure you didn't miss the Block B DO field, then contact Qualtrics Support if it isn't there.


Leave a Reply