Within subjects factorial design no repetition with only part of question randomized | XM Community
Skip to main content
Question

Within subjects factorial design no repetition with only part of question randomized


Forum|alt.badge.img+1

Hi there,

I am creating a survey for a 4x4x2 within-subjects design where

  • Each question is a different vignette. 
  • There are 32 vignettes total, since there are 32 possible combinations of the levels of the three variables.
  • Only one sentence in each vignette is systematically varied to display one of the 32 combinations. The rest of the vignette is regular text (this text is also different in each vignette, since each vignette is different, but it is not systematically varied or being looked at as a variable).
  • The vignettes themselves are not presented in random order. The systematically varied sentence in each vignette is displayed in random order.
  • Each participant needs to see each of the 32 possible combinations, and not see any of the same combinations twice (non-repetition).

I have been scouring the forum and have found similar posts but not exactly right for what I need. So far I have used embedded data and the survey randomizer for this design. Right now the vignettes are being generated perfectly (i.e., the embedded data is working) but the combinations are not being evenly presented across questions. I.e., across vignettes, the participant is seeing the same combination more than once and not seeing all 32 combinations overall. I imagine the solution involves a different way to use the randomizer and/or display logic? Here is what my survey flow currently looks like:

Each vignette is its own block. The randomizer is first in the flow for each block, with the 32 combinations included under embedded data. Right now the randomizer is set to present 1 of the 32 elements.

Any help is much appreciated.

3 replies

Forum|alt.badge.img+22
  • Level 7 ●●●●●●●
  • 2028 replies
  • February 5, 2025

I have a problem in understand what is being randomized here. If you want to present all 32 in a specific order - what do you want to randomize. Can you provide some examples?


Forum|alt.badge.img+1
  • Author
  • 2 replies
  • February 5, 2025

@ahmedA thanks for your reply. I am only randomizing one sentence in each vignette. Hopefully this helps:

Block 1

Question 1

[Randomized sentence with one of 32 combos]. [A few sentences describing vignette 1].

 

Block 2

Question 2

[Randomized sentence with one of 32 combos, not repeating the previous combo]. [A few sentences describing vignette 2].


Forum|alt.badge.img+22
  • Level 7 ●●●●●●●
  • 2028 replies
  • February 5, 2025

One possible solution:

Put all your vignettes in a loop and merge block. In your LM field add your statements and display them in random order. Pipe this field in your text. Add display logic based on the current loop number. So, vignette 1 displays when current loop is 1, vignette 2 when current loop is 2 etc.

 


Leave a Reply