Stats IQ: Inconsistent analysis results with pre-post | XM Community
Solved

Stats IQ: Inconsistent analysis results with pre-post

  • 24 August 2018
  • 1 reply
  • 7 views

Userlevel 6
Badge +5
I am trying to run a paired difference analysis between some pre and post items. This is a matrix question with 6 different fields, and therefore I need to run 6 different analysis pairs (Ex. Relate Pre Q1_1 to Post Q1_1, Relate Pre Q1_2 to Post Q1_2, etc).

This seems to work for most of them, and I am getting language at the top saying "There is no statistical difference between." However, for one of the items, when I run the exact same analysis it does not provide any information on statistical significance. Instead it just says X "tends to be slightly larger than" Y. Any idea why running the same analysis on items from the same matrix could produce differing results like this?
icon

Best answer by PeeyushBansal 28 August 2018, 11:01

View original

1 reply

Userlevel 7
Badge +33
Significance testing can differ on different variables. Like for comparison on pre_q1_1 and post_q1_1 , there will not be any significant differences in averages or the top2. while there can be slight difference for q1_2.

you can also run significance testing at different levels like 90% or 95%.

for relating data read this

https://www.qualtrics.com/support/stats-iq/analyses/relate-data/

Leave a Reply