https://community.qualtrics.com/XMcommunity/discussion/comment/46273#Comment_46273Yes exactly, it should work fine even though both aspects are doing the same thing. I would test a couple of times to make sure it doesn't create a weird error (sometimes Qualtrics can do this). But yes you understand perfectly!
Usually you would build in this variable using an embedded data/grouping element in your survey flow under your randomizer. You can see where I describe this in a different post: https://community.qualtrics.com/XMcommunity/discussion/comment/46200#Comment_46200however, it seems you have already ran the study and cannot now attach this data point. An alternative is that when you go to export your data into whatever format you want (e.g., CSV, excel), click "more options" and check "export viewing order for randomized surveys". This will tell you what order they viewed randomized elements in. This will tell you the order for EVERY randomized element (including question presentation), but it will also tell you which of the two conditions they were randomized to. You can read more about it here: https://www.qualtrics.com/support/survey-platform/data-and-analysis-module/data/download-data/export-options/ hope this helps!!
https://community.qualtrics.com/XMcommunity/discussion/comment/46205#Comment_46205You may consider this a solution - as it is a similar issues with a clever and easy fix: https://community.qualtrics.com/XMcommunity/discussion/4579/pre-onload-jquery-js
Prasun20 Is your code for hiding the next button in the 'on load' section?
https://community.qualtrics.com/XMcommunity/discussion/comment/46200#Comment_46200Not a problem at all! So yes, you have the right assumption in that you have done the same thing twice. It is sufficient enough to place your branching logic in the survey flow so that if a certain pre-screen option is chosen, they are branched to the end of the survey. You can then customize the message you want to provide in your account and say things like "thank you, but unfortunately you cannot participate for XXX reason, and your survey has ended. Please close your browser". Steps are below. So, below, is what you need your survey flow to look like. I've created fake-prescreening questions based on if the participant wants to participate and their age. If they select no to either question, they end the survey. The randomizer at the bottom of the image is the same randomizer I showed you above for the first question. To customize the ending message. First create your custom message in your library (
https://community.qualtrics.com/XMcommunity/discussion/comment/46174#Comment_46174vx180 Glad it could help! To respond to your points: No, you aren't missing out on anything by not presenting the block between the embedded data set and the randomizer. This was a block that I didn't want randomized in a previous study so it was kept out of the randomizer. Your set up is correct! You understand the embedded perfectly and have done it correctly. Just a reference for the future, when you create an embedded data point, it is case sensitive. So if you make a typing mistake in one label (e.g., "Vignette gender" and then "Vignette Gender") you will end up with two different data points in your data. So just make sure they match when you want them to. You are also right about the randomizer!
vx180 Yes, then can be done in the survey flow using a grouping element, branching element, and nested randomizer. I've placed a previous example in the image below. You start first with creating one randomizer. In this randomizer you place two group folders. I've just chosen group 1 and group 2, you could call them male and female if you prefer. Make sure you state the randomizer should only present 1 of those elements and to evenly present them. This will make sure participants see Male or female vignettes, not both. For your data, I would then place and embedded data point within each group. That way you can determine which condition (male/female) the participant went through. Then under the embedded data, place another randomizer and in that randomizer place your three vignettes. Hope this helps! Happy to provide more detail if needed.
errenos I believe you are probably using the "group" blue sub folder under the randomizer in order to keep everything nice and tidy and be able to have embedded data points. The unfortunate thing is that for the labels of the randomize elements, qualtrics takes the label of each block. However, in your case your labels would be "Group: xxxxxx". But qualtrics cannot read the colon, so it just stops at "group" and that is why each condition says group. So, if you can do without the "Group" folder, you will then have the labels for each block. However, if you cannot, I would say with a high degree of certainty that it displays them in the order in which they are under the randomizer. However, to confirm what I would do is test the survey once, make a note of which condition you are assigned to, then go see which group has that 1 test in it (all others should be 0). Reset the count, and do this again until you have been placed in all four conditions. I'd bet good money that they are in ord
https://community.qualtrics.com/XMcommunity/discussion/comment/45774#Comment_45774The solution I propose is not perfectly randomized as it does not randomly display the questions from A, amongst the subset of 10 for B (e.g., intertwining the two sets). But instead would randomly display first all of A or a true random subset of B. I hope this helps. It requires two piped texts and a randomizer in survey flow. Create a block for items that will come from Set A. Turn on loop and merge for this block. Delete field 2. In the loop and merge field 1, place the names you want. Turn on randomize loop order at the bottom of the window (see image below). Then add a question into Block to the format you want (e.g., Likert) and select piped text in the format editor, loop and merge, Field 1. Type the remainder of your question text around the piped filed (see image below). Create a block for items coming from set B. Turn on loop and merge for this block. Delete field 2. In field 1, put the names y
Does each participant answer 20 questions in total? Meaning each participants will get 10 questions from list A and a random sub sample of 10 versions from list b?
https://community.qualtrics.com/XMcommunity/discussion/comment/45716#Comment_45716If you select to randomize the presentation of the messages, and only specify you want X/N shown (e.g., 10/100), then there is no guarantee regarding the distribution of presentation. you would just have to ensure you have a large enough sample size. The only way that I believe this could work is if you put each message into its own block and then put each block (even if that is 100s) into a randomizer using survey flow. In the randomizer element you can then select to only display x/N of the blocks (statements) and then tick "evenly present elements" - qualtrics will then try to ensure that each element is presented evenly but randomly across all participants. you could in theory take a hybrid approach. Let's say you have 100 statements you want to assess. You can place 10 statements in a loop and merge field, in 10 different blocks. You can then place those 10 blocks in the randomizer using survey flow
You have to aspects of confidentiality here, 1) what type of information Qualtrics stores regarding the person and 2) who can access said information. Qualtrics is only responsible for the 1st point. Restricting access to the data falls to the user who collects the data, to protect it using a clear data management procedure. Like your colleague says, those with the login credentials can see the data. So it is your job to assure only the correct people can access the data. What Qualtrics can do is anonymize responses. This is a two step process. make sure when you distribute the survey for people to take, use only an anonymous link. This is done by selecting a) distributions b)anonymous link. Turn on "anonymize response". This prevents qualtrics from collecting geographic data of the respondent based on IP address. It does not interfere with any of the data collection (see image below)Very importantly, if you ask a client or put a client's name in the qualtrics survey using a question,
mprinzing Yes you can do this using the loop and merge feature in Qualtrics, using the exact methods you want. You can get participants in survey 1 to provide text. You can then download the data from survey one in excel format. You then copy the cells with the text you want (needs to be vertically). You then paste them in the loop and merge fields for the correct block. Loop and merge allows you to randomize the presentation of the texts, as well as decide if you want participants to answer for all parameters in the loop and text fields (e.g., each text) or just a random subset. You can read more here -> https://www.qualtrics.com/support/survey-platform/survey-module/block-options/loop-and-merge/
Emir Can you add a picture of your survey flow?
You have two problems in your image. In both randomizers you have said you want the randomizer to randomly display "6" and "3" (respectively) to each participant. That means, each participant is seeing EVERY block. You need to change this to be 1 in each randomizer. See image below. I would also use a branching logic of if the question that is found in condition 3 is displayed, the participant THEN is shown 3a, 3b, 3c. Instead of nested randomization. Hope this helps! You also should make sure to select to reset the count of these randomizers before launching your survey (see more about this here in a previous comment of mine: https://community.qualtrics.com/XMcommunity/discussion/comment/44145#Comment_44145).
Hi Sherry I hope I have understood your question correctly. If not I apologize. I believe you have done everything right it is just now about selecting the data you want in the output. I created a similar question to yours below. Where column left is obviously the left hand set of items and column right would be the right hand set of questions. Test A and Test B are where your songs would be in your situation. When you go to the data and analysis tab of your survey you then should find your question number, and select each column/question combination. In the image below you see that I first click the plus sign in the field to indicate where I want the data to appear. I then select my question ID. My question ID for this question is Q43, so I select it, then I select Right column, test A. So this will give me the answer the participant gave. In your scenario this would be the answer to the question "would you add it to your playlist" for the second song. You would repeat this for each
Hi Iris123, If I am understanding you correctly, you should just be able to call the embedded data point again and use it to branch participants to the correct manipulation check. This would be repeating step 6 of the images above but this time branching to the correct manipulation check. If I misunderstood the problem, please explain more with some screen shots and I will happily help where I can!
bubipepe can you explain the issue you run into when when you "break everything into blocks", you state that you have a "problem in distributing the entire blocks to people equally". I am not sure I follow. As if you 4 blocks now, and then you break them in half to create 8 blocks. You would put all 8 blocks into a randomizer using survey flow, and tick the "evenly present elements". You can then choose if you want participants to view all 8 or only a subset by entering this number into the randomizer.
https://community.qualtrics.com/XMcommunity/discussion/comment/44640#Comment_44640I would assess these as bot responses and delete them then. It doesn't really make sense that this could be a real participant as those variables are all embedded from qualtrics. So it could either be an error on qualtrics end (which questions the data from the participant) or is a bot, which you don't want obviously.
I am not sure, but it isn't just your start and end dates, that (approximate) value appears to repeat in each column thereafter. What comes up in the 'status' column for these participants? It could be spam or bots. To understand your status column follow these instructions, I believe the section on status is in the beginning of the webpage - https://www.qualtrics.com/support/survey-platform/data-and-analysis-module/data/download-data/understanding-your-dataset/
https://community.qualtrics.com/XMcommunity/discussion/comment/44343#Comment_44343Ahh, yes I am sorry I didn't realize you had used the page breaks and had the two pages. That is my fault. Unfortunately, advanced randomization will ignore/break the rules of page breaks and that is why you are having the problem. That is just simply how it is designed. I will have a think on how to do this best, but I believe it is going to require more javascript.
https://community.qualtrics.com/XMcommunity/discussion/comment/44352#Comment_44352Very welcome!
https://community.qualtrics.com/XMcommunity/discussion/comment/44274#Comment_44274Hi HelenWilliams can you upload an image of this? I don't run into this error message. It could be possible that there are different features available based on your current Qualtrics package.
It sounds like what you want to do can be done with a randomizer (which you already have) and embedded data. Embedded data, allows you to attach a data point to a participant and then recall that data point to use later. Only participants that are exposed to the data point will have it attached to them. Thus, by creating a unique embedded data point for each condition in recipe 1, we can recall that unique data point to show participants the correct recipe 2. Step 1. Create all recipe 1 blocks. Step 2. In survey flow, add a randomizer. Step 3. Use the 'group' element create a group for each condition under the randomizer (see image below). Step 4. Use the embedded data element to create an embedded condition variable under each group. Step 5. Add the relative block of questions for that condition under its respective group. (see image below for steps 4 and 5). Step 6. Now create a branch logic and set the parameters to be 'If Condition is equal to X, then...." where X is the condition
https://community.qualtrics.com/XMcommunity/discussion/comment/44210#Comment_44210So I've come up with one solution, but it may not be what you want depending on how you want your data to look on the back end of things/if you want the time presentation to truly randomized or 'controlled randomization' in one way or another. Step 1. Create a block with all potential timing elements. I would use the 'auto-advance' feature and set it to the intervals you want (e.g., .25, .50, .75, 1.00, 1.25, 1.50). In my example, I used three timing elements, each auto-advanced at three different time intervals, 1 second, 5 seconds, and 10 seconds. Step 2. Create and add in your loop and merge presentation question in the same block. You can see the block in this image below and my test loop and merge fields. Step 3. Turn on advanced randomization for the entire block. Step 4. choose random subset randomization, add all timing elements to blue box, set the value to 1, in the 'randomly insert ___ question
Already have an account? Login
Enter your username or e-mail address. We'll send you an e-mail with instructions to reset your password.
Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.
Sorry, our virus scanner detected that this file isn't safe to download.
