I’m planning to run a survey where 1 in 10 respondents will win a prize. My understanding is that I should add a randomizer to the survey flow with ten end of survey blocks under it. One of the end of survey blocks will have a message saying they won a prize. The other nine end of survey blocks will just thank the respondent for their participation. From the survey results the people who see the winning end of survey block first amongst all the end of survey blocks are the winners. So far so good, right?
I’ve set the randomizer to evenly present the elements. My issue is that when I generate test responses and check to see how often each end of survey block is presented first I don’t get even results. Instead of each end of survey block being first 10% of the time I see results between roughly 5%-15%. Is this expected? It’s fine if the percentage of winners isn’t exactly 10%, but if it’s 15%+ it’s going to hit my budget limit. Is there anything I’m missing here?