Tracking Time Spent on Randomized Blocks and Questions within a Block | XM Community
Skip to main content

Hi everyone,

I have a survey design with approximately 20 sets of blocks, and I have two questions regarding randomization and timing:

1. Tracking Time Spent on Randomized Blocks

In my survey flow, I’ve grouped certain subsets of blocks under a Randomizer to shuffle their presentation. I’d like to track the time each respondent spends on each randomized block individually, regardless of the order in which they appear.

I know that Q_TotalDuration can track the total time spent on a block when it’s shown in a fixed order. However, I’m unsure if it’s possible to accurately track time spent on each block when the blocks are randomized.

Is there a way to capture block-level timing data for each randomized block? Ideally, I’m looking for a solution that would give me a separate timing metric for each block, even though the blocks are presented in a random order.

 

2. Tracking Time Spent on Randomized Questions within a Block

In a given block, I’m also randomizing the order of the questions. Is it possible to track how much time respondents spend on each question within a randomized block?

I’ve come across some discussions on this topic, such as this thread, but there seem to be various opinions on the best approach.

Could someone clarify the most effective way to track question-level timing within a block where questions are randomized?

I appreciate any guidance you can offer, and I apologize if these questions have been asked before. I’ve searched the community but couldn’t find a definitive answer, which is why I’m posting here.

Thanks in advance for your help!

 

You can’t track time spent on block. The only options are time spent on the page and total survey duration. 

Considering you need time per question, here’s how I would approach it. For each question (Q1, Q2, Q3 etc.) , create a a complementary timing question (T1, T2, T3). Put each of these in a block (Q1T1, Q2T2, Q3T3). Let call them B1, B2, B3. 

In your survey flow, for each original block, where you want to randomize questions, create a group, have a randomizer in the group and now put each of the question-timer blocks (B1, B2, B3) inside the randomizer. 

This way, your question order will be randomized, but the timer question will still be paired. 

You can also put these groups in a randomizer to randomize their order.

Thanks a lot, ​@ahmedA!

 

Leave a Reply


Terms & Conditions