When using the choice randomization option "Present only ___ of total choices" with a multiple choice question, will all of the options in the pool of total choices be presented an approximately equal number of times as multiple respondents take the survey? Seemingly the alternative would be that the selection of which options to present is completely random each time a respondent completes a survey, which means that some choices could appear more times than others; if this is the case, does the system store the number of times a choice is presented in a question even if it is not selected (which would allow us to weight the results)? We know the "Evenly Present Elements" option can be used to help ensure equal representation of elements, but this question pertains to options within a specific multiple choice question.
---
For context, we are basically doing A/B testing by asking respondents to select the best option in a multiple choice question. There are ~50 options in the total pool, so we can't present respondents with that many choices to consider. As such, we want the system to select four options from the total pool for each respondent. By having many respondents complete the survey, the best choices should emerge; however, this is conditional on all choices being presented an approximately equal number of times.
Are all options in "Present only ___ of total choices" presented an ~equal number of times?
Best answer by Mishraji
copperdialect - Not sure about "Present only ___ of total choices" but you can surely use advanced randomization to evenly present the options and also check the number of times a choice is presented. 
Sign up
Already have an account? Login
Welcome! To join the Qualtrics Experience Community, log in with your existing Qualtrics credentials below.
Confirm your username, share a bit about yourself, Once your account has been approved by our admins then you're ready to explore and connect .
Free trial account? No problem. Log in with your trial credentials to join.
No free trial account? No problem! Register here
Already a member? Hi and welcome back! We're glad you're here 🙂
You will see the Qualtrics login page briefly before being taken to the Experience Community
Login with Qualtrics
Welcome! To join the Qualtrics Experience Community, log in with your existing Qualtrics credentials below.
Confirm your username, share a bit about yourself, Once your account has been approved by our admins then you're ready to explore and connect .
Free trial account? No problem. Log in with your trial credentials to join. No free trial account? No problem! Register here
Already a member? Hi and welcome back! We're glad you're here 🙂
You will see the Qualtrics login page briefly before being taken to the Experience Community
Login to the Community
Welcome! To join the Qualtrics Experience Community, log in with your existing Qualtrics credentials below.
Confirm your username, share a bit about yourself, Once your account has been approved by our admins then you're ready to explore and connect .
Free trial account? No problem. Log in with your trial credentials to join.
No free trial account? No problem! Register here
Already a member? Hi and welcome back! We're glad you're here 🙂
You will see the Qualtrics login page briefly before being taken to the Experience Community
Login with Qualtrics
Welcome! To join the Qualtrics Experience Community, log in with your existing Qualtrics credentials below.
Confirm your username, share a bit about yourself, Once your account has been approved by our admins then you're ready to explore and connect .
Free trial account? No problem. Log in with your trial credentials to join. No free trial account? No problem! Register here
Already a member? Hi and welcome back! We're glad you're here 🙂
You will see the Qualtrics login page briefly before being taken to the Experience Community
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.
