Hi,
Is anyone out there aware of data on the impact of high Click Counts per page on data quality for online studies?
I just analyzed the results of a study hosted on Qualtrics (with MTurk workers recruited through CloudResearch) and it turns out that the key expected finding, which is not quite significant when including everyone, is significant when excluding participants with exceptionally high Click Counts (on the study's main Directions page and the main Stimulus page). This makes me wonder if a very high click count may at times index unfocused or even anxious participants.
Interestingly, if "speeders" (who completed the whole study exceptionally fast) are excluded instead of high-clickers, the finding is also significant. And it's even more strongly significant (and with a higher N) if both speeders and high-clickers are excluded.
In short, there seems to be quite a bit of convergent evidence suggesting that, at least in this case, high-clickers and speeders were similarly unfocused and had a similar dampening impact on the study's finding.
When I searched the literature on Click Counts, however, I only found discussion of how very low Click Counts can be dubious (ie, if lower than the number of items on a page, it's indicative of software instead of a human).
In any case, I'm curious if anyone else has had a similar experience or is aware of studies on Click Counts that may shed light on this.
Thanks!
High Click Count, Poor Data Quality Relationship?
Sign up
Already have an account? Login
Welcome! To join the Qualtrics Experience Community, log in with your existing Qualtrics credentials below.
Confirm your username, share a bit about yourself, Once your account has been approved by our admins then you're ready to explore and connect .
Free trial account? No problem. Log in with your trial credentials to join.
No free trial account? No problem! Register here
Already a member? Hi and welcome back! We're glad you're here 🙂
You will see the Qualtrics login page briefly before being taken to the Experience Community
Login with Qualtrics
Welcome! To join the Qualtrics Experience Community, log in with your existing Qualtrics credentials below.
Confirm your username, share a bit about yourself, Once your account has been approved by our admins then you're ready to explore and connect .
Free trial account? No problem. Log in with your trial credentials to join. No free trial account? No problem! Register here
Already a member? Hi and welcome back! We're glad you're here 🙂
You will see the Qualtrics login page briefly before being taken to the Experience Community
Login to the Community
Welcome! To join the Qualtrics Experience Community, log in with your existing Qualtrics credentials below.
Confirm your username, share a bit about yourself, Once your account has been approved by our admins then you're ready to explore and connect .
Free trial account? No problem. Log in with your trial credentials to join.
No free trial account? No problem! Register here
Already a member? Hi and welcome back! We're glad you're here 🙂
You will see the Qualtrics login page briefly before being taken to the Experience Community
Login with Qualtrics
Welcome! To join the Qualtrics Experience Community, log in with your existing Qualtrics credentials below.
Confirm your username, share a bit about yourself, Once your account has been approved by our admins then you're ready to explore and connect .
Free trial account? No problem. Log in with your trial credentials to join. No free trial account? No problem! Register here
Already a member? Hi and welcome back! We're glad you're here 🙂
You will see the Qualtrics login page briefly before being taken to the Experience Community
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.
