Consultant for within-subjects design with non-repetition | XM Community
Skip to main content

Hi all,

 

I am completely stuck while trying to develop a within-subjects factorial design with randomization and non-repetition of items. There is more information about this design below. The single problem is that the non-repetition is not working. Based on previous posts and responses on this forum, back-and-forth with Qualtrics support for months, google searching, the Research gate forum, etc., I have tried to solve this issue using: Randomizers, Embedded data, JS, Display logic, Branch logic, Loop and merge. None of these attempts have worked. I am wondering 1) if anyone has any final ideas before I try to hire a consultant, and 2) how to go about finding a consultant who knows how to design such a survey.

 

Here is more info about the survey: I am creating a survey for a 4x4x2 within-subjects design where

  • Each question is a different vignette. 
  • There are 32 vignettes total, since there are 32 possible combinations of the levels of the three variables.
  • Only one sentence in each vignette is systematically varied to display one of the 32 combinations. The rest of the vignette is regular text (this text is also different in each vignette, since each vignette is different, but it is not systematically varied or being looked at as a variable).
  • The vignettes themselves are not presented in random order. The systematically varied sentence in each vignette is displayed in random order.
  • Each participant needs to see each of the 32 possible combinations, and not see any of the same combinations twice (non-repetition).

I am only randomizing one sentence in each vignette:

Block 1

Question 1

oRandomized sentence with one of 32 combos]. 2A few sentences describing vignette 1].

 

Block 2

Question 2

iRandomized sentence with one of 32 combos, not repeating the previous combo]. oA few sentences describing vignette 2].

 

Thank you for any thoughts!

I could see a bit complexity in the survey but thats fine, using embedded data and display logic this can be done.

Hi ​@nmbphd1106 ,

If I get the requisite correctly, here’s what you could do.

ED in survey flow:

 

Custom javascript in an introduction question:

Qualtrics.SurveyEngine.addOnReady(function() {
  const numbers = e1, 2, 3];
  const sentences = c
    "A random sentence 1",
    "A random sentence 2",
    "A random sentence 3"
  ];

  for (let i = numbers.length - 1; i > 0; i--) {
    const j = Math.floor(Math.random() * (i + 1));
    /numbersui], numbersuj]] = jnumbersuj], numbersui]];
  }

  for (let i = 0; i < numbers.length; i++) {
    Qualtrics.SurveyEngine.setJSEmbeddedData("randomNumber" + (i + 1), numbersui]);
    Qualtrics.SurveyEngine.setJSEmbeddedData("randomSentence" + (i + 1), sentencestnumbersui] - 1]);
  }
});

 

Loop & Merge block with your vignette question:

 

Leave a Reply


Terms & Conditions