Random order not shown in results | XM Community
Skip to main content

Random order not shown in results

  • December 23, 2022
  • 3 replies
  • 232 views

Forum|alt.badge.img+4

Hello everyone, it must be possibly a silly question, but I cannot find the answer.
I have randomised two blocks in a survey: in one block respondents have to answer 23 "choice questions", call it block A; and in another block they have to answer 2 "colour group" questions out of 7 (in case it matters, these are branching out questions: first one asks to pick a colour group out of six, second asks to pick a colour within the chosen colour group), call it block B.
The randomisation is such that some respondents will see first Block A and then Block B, while some respondents will see first B and then A.
When I run the preview this works fine.
The problem I have is with the (test) data I download, with the "display order of randomisation" option ticked: while I have answers to questions in both blocks, i.e. for each (fictitious) respondent I get 25 answers, but I only get to see the order in which the questions where asked in block A, not in block B.
What am I doing wrong please? Picture of my survey's flow is enclosed. Thanks in advance!
Screenshot 2022-12-23 at 14.11.20.png

3 replies

TomG
Level 8 ●●●●●●●●
Forum|alt.badge.img+27
  • Level 8 ●●●●●●●●
  • 6083 replies
  • December 23, 2022

Are the questions in Block B (Colour choices) randomized?


Forum|alt.badge.img+4
  • Author
  • Level 2 ●●
  • 15 replies
  • December 23, 2022

Dear Tom, yes they are randomised too (and apologies, I wanted to answer "yes" and pressed on "accept answer" instead!)


TomG
Level 8 ●●●●●●●●
Forum|alt.badge.img+27
  • Level 8 ●●●●●●●●
  • 6083 replies
  • December 28, 2022

If both Blocks are randomized then there should be a DO (display order) field for both in the response data file. There should also be a DO field for the randomizer.
I would double check to make sure you didn't miss the Block B DO field, then contact Qualtrics Support if it isn't there.