Topics started by WilliamPeckUSNA | XM Community

Topics started by WilliamPeckUSNA

15 Topics

WilliamPeckUSNA
Level 2 ●●
WilliamPeckUSNALevel 2 ●●
asked in Survey Platform

Validating student id from a list but recording a different but associated id

We want to validate the student’s id prior to taking the survey but store a corresponding id.The student id is not the unique key to their record, but it is used for all kinds of student rosters, etc. so it’s easy to find someone if you had their “public” student id. But the actual record_id is something different, that no one would know, only the database administrator. So we’d like to validate the student id but record the record_id. So if you looked at the data in qualtrics, you wouldn’t be able to identify the person, unless you were the database administrator and looked up their student_id based on record_id. This is a means of making the survey not 100% anonymous, but it’s a strong measure to make it basically impossible to identify the respondent, with appropriate language at the beginning of the survey. So like thisStudent_id      Record_id-----------------       ----------------241234            87439The respondent enters 241234 and it’s validated but 87439 is recorded in Qual

4
WilliamPeckUSNA
Level 2 ●●
21 days ago
WilliamPeckUSNA
Level 2 ●●
WilliamPeckUSNALevel 2 ●●
asked in iQ Suite

Text iQ is pretty lame, but other than that, Qualtrics is great (Part 1)

This post discusses my experience with the natural language processing component of Qualtrics (Text iQ) (https://www.qualtrics.com/iq/text-iq/). This software is used to analyze open-text comments from surveys or other qualitative data.Part II is here - https://community.qualtrics.com/XMcommunity/discussion/18013/text-iq-sucks-but-we-love-qualtrics-part-ii/p1?new=1TeaserWe love everything about Qualtrics, except their natural language processor (Text iQ) Part I – My take Overall, we love QualtricsI can’t say enough about Qualtrics, other then Text iQ. Their support is fantastic, and they have tons of training resources which are very well organized and thorough. Here’s one example on relating data for statistical purposes - https://www.qualtrics.com/support/stats-iq/analyses/relate-data/ It's been excellent for building surveys and doing various statistical analysis. Just not for Text iQ.The Bottom Line – I find the model cumbersome, even at scaleAfter wrestling with Text iQ for 2 year

5
S
Level 1 ●
1 month ago
WilliamPeckUSNA
Level 2 ●●
WilliamPeckUSNALevel 2 ●●
asked in Survey Platform

Where should I cut-off "effect size" when reporting questions of Statistical Significance?

I’m doing a basic relate series of tests in Stats iQ. My setting is “Order by results of “Relate” analyses by statistical significance and effect size. I noticed today that it’s really “effect size” by which questions are ordered. So a question with a “strong statistically significant relationship” might come AFTER a question with simply a  “statistically significant relationship”, based on the effect size. All the tests are Chi-Squared (which I know nothing about ...) 🙄. The very first question has effect size .575, then it goes all the way to .311 which is also a “strong statistically significant relationship”. I noticed that p values are < 0.00001 for all “strong statistically significant” questions, but still, the effect size determines the ordering of the questions. My main question is - is there an effect size below which I can cut off when reporting to the user? All of my 17 questions have some statistical significance or some sort, so it doesn’t make sense to me to report a

6
WilliamPeckUSNA
Level 2 ●●
7 months ago
WilliamPeckUSNA
Level 2 ●●
WilliamPeckUSNALevel 2 ●●
asked in Survey Platform

Can you embed the retake link in the survey response?

I’m trying to determine if / how we can embed a retake link to the respondent.In this support article, it sure seems like you can … Email Task (qualtrics.com). (2nd example)In order to email the retake link, we’d have to build the email address from the entered student id, but logically that’s easy (tips welcome ...)So it’s a simple (to understand) use case - send an email to the respondent, based on their entered student id (from which we build their email address), then send their full response along with the retake URL (and some instructions on what to do).Is this possible?Thank you.

4
WilliamPeckUSNA
Level 2 ●●
8 months ago
WilliamPeckUSNA
Level 2 ●●
WilliamPeckUSNALevel 2 ●●
asked in Survey Platform

How to best capture user id?

I’m looking for ways to capture student id better. 1) Can we scrape their user id from their device, assuming they’ve logged in to email?2) Can we store a list of all student id’s/names so they can pick from a list? thank you.

6
WilliamPeckUSNA
Level 2 ●●
8 months ago
WilliamPeckUSNA
Level 2 ●●
WilliamPeckUSNALevel 2 ●●
asked in Survey Platform

Must I create a variable in the Data tab AND Stats iQ?

I created a variable in the Data tab but it’s not showing up in Stats iQ - is that right? If so, why?

6
WilliamPeckUSNA
Level 2 ●●
1 year ago
WilliamPeckUSNA
Level 2 ●●
WilliamPeckUSNALevel 2 ●●
posted in Survey Platform

Moving from laborious data analysis to automated solutions

We've been using Qualtrics for just over 3 years (4-year college). I'd like to move to a more automated solution of producing results. Currently, I create .pdf reports and download comments to Excel, we don't have Dashboards.I do the Data Analysis, and I typically produce a .pdf document after building a custom report, this is pretty straightforward. I might then create a 2nd report to breakout the data by race or gender ... with these additional breakouts it obviously adds to the elbow grease needed to provide the results.If there are comments, I download to a spreadsheet and format it nicely, along with demographics of the respondent. Not too difficult, but it also adds to the amount of effort.For a relatively simple solution, it's easy 2-3 days to produce.Is there any way we can automate this? All the data is right there ... I suppose we could create dashboards, but is this the only way? Is dashboards also a custom effort for each survey?I'm also concerned about what the User Exper

5
InessaG
Level 5 ●●●●●
1 year ago
WilliamPeckUSNA
Level 2 ●●
WilliamPeckUSNALevel 2 ●●
asked in iQ Suite

Giving Text iQ another try, has it changed in the past year?

About a year ago, I wrote a long post about Text iQ, as I didn’t find Text iQ helpful (at all).I’m going to give it another try, but I’m wondering if it has improved much? any?I spent a fair amount of time giving a good faith effort to learn it and use it, but I always came to the same conclusion - - - the bubbles / sentiment / etc. isn’t really working for me. Even if it’s minimally helpful, I always told the stakeholder - “You still have to read all the comments carefully to best understand what the respondents are saying.”I’m at a 4 year college, typically we get no more than 2,000 comments. That’s really not all that many, but still it’s like a weeks worth of work to give a close reading of the comments and do some amount of categorization.An example of a text question we have is “What did you like least about your college experience?” Then they spill their guts, as it’s a loaded question. So both the computer and manual review is hard to try and categorize 500+ words. Another key

2
WilliamPeckUSNA
Level 2 ●●
1 year ago
WilliamPeckUSNA
Level 2 ●●
WilliamPeckUSNALevel 2 ●●
posted in iQ Suite

Text iQ is pretty lame, but we love Qualtrics (Part II)

Part II – What exactly is Text iQ?Part I is here: https://community.qualtrics.com/XMcommunity/discussion/18012/text-iq-sucks-but-other-than-that-qualtrics-is-great-part-1/p1?new=1Qualtrics’ Bread and Butter is retail The core market for Qualtrics is retail (although there is much more). Even in their video about Text iQ (https://www.qualtrics.com/iq/text-iq/), they're mostly talking about retail. In a retail environment, survey questions remain stable (for long-term trends), and customer feedback is typically short and sweet, and easy to "topic'ize" and identify the sentiment.The natural language model is clunky in my opinionThe model of the industry typically is to categorize comments into topics and sub-topics, with associated sentiment (positive, negative, neutral, mixed). Specifically with Text iQ you get a score for the intensity of the sentiment (-10 to 10), and even the polarity of the comment (how mixed is the sentiment, from 0 to 10), for both the overall topic as well as the

4
WilliamPeckUSNA
Level 2 ●●
1 year ago
WilliamPeckUSNA
Level 2 ●●
WilliamPeckUSNALevel 2 ●●
posted in Survey Platform

Can you limit the number of choices in a multi-response question?

I'd like to limit the number of choices that can be selected for a multi-response question.For example, "What are the top 5 programs that helped your development?", and I don't want them to rank order them.

0
WilliamPeckUSNA
Level 2 ●●
1 year ago
WilliamPeckUSNA
Level 2 ●●
WilliamPeckUSNALevel 2 ●●
asked in Survey Platform

can you capture network id when user is connected to network or vpn?

Can the user idea be captured in the background? Thus eliminating the need of asking the user for their id on surveys. Most of the time we require this data point anyway.

0
WilliamPeckUSNA
Level 2 ●●
2 years ago
WilliamPeckUSNA
Level 2 ●●
WilliamPeckUSNALevel 2 ●●
asked in iQ Suite

How to best produce a polished report for a user, with a 175 question survey

Trying to produce a professional report that the user can consume easily.My overall question is how to analyze survey data efficientlyproducing a professional reportUsing a specific example here:My goals for this 175 question survey, to producedescriptives for each of 175 questionscrosstabs for the same survey (broken out by gender)a polished report that the from which the user can create their own Exec Summary and Key Findingsand to do so efficientlyPreviously, this was done in SPSS Statistics, but that's way overkill (and ugly), and there is no reason to use this powerhouse software - we're not doing any statistical analysis!I have found Reporting / Stats iQ to be less than impressive for producing a polished report. For example, I could "press the button" and do a DESCRIBE on 175 questions, but it exports to Excel in 175 tabs, and UGLY. I wouldn't give that to a user. Then I need to do crosstabs (by gender), so this would be ANOTHER 175 tabs if exported to Excel, so again not accept

0
WilliamPeckUSNA
Level 2 ●●
4 years ago
WilliamPeckUSNA
Level 2 ●●
WilliamPeckUSNALevel 2 ●●
asked in iQ Suite

Basic Stats iQ questions: 1) can I reorder the cards, 2) can I eliminate the graph from Describe?

just getting started with Stats iQ, after doing my Basecamp Training ... :) and excited to get 'er done ... o:) I have loaded up a dataset from a previous Survey, and trying to replicate my findings from that in Qualtrics. I did Describe on a couple of variables, basically looks fine. But each Describe goes to the top of the Workspace ... can I re-order the cards? I couldn't see how. I thought also I could position my cursor to below the last card, but the new Describe always goes to the top ... So the graph and data looks fine, but sometimes the graph is a little overkill, is there anyway to eliminate that? !

0
WilliamPeckUSNA
Level 2 ●●
4 years ago
WilliamPeckUSNA
Level 2 ●●
WilliamPeckUSNALevel 2 ●●
posted in iQ Suite

Learning resources for Stats iQ, looking for recommendations

Hi, I'm one week into digging into Stats iQ, so far so good. I found some nice resourses from Qualtrics, but wanted to see if a live person has some additional suggestions. Hopefully we'll have Text iQ shortly, so I'll post on that separately. For the most part I'm good on understanding statistical analysis, having wrestled with SPSS for a year, and being a Business Intelligence person by trade. Here are the links I'm working through, so any suggestions are most welcome! - Basecamp: Using Stats iQ to Analyze Data - Stats iQ Basics - Data and Analysis Overview - Communicating Findings Effectively Anything outside the box is great too, just not TOO crazy ... :D

0
AdamK12
Level 5 ●●●●●
4 years ago
WilliamPeckUSNA
Level 2 ●●
WilliamPeckUSNALevel 2 ●●
posted in iQ Suite

How best to present / distribute results to users?

Our current practice is to present results in either a Word or Excel document (usually with several tabs). Results come from either SPSS or Business Objects Web Intelligence (your basic reporting tool, for charts, Pivot tables, etc.). I'm really liking what I see in Stats iQ, but I'm not seeing how to "package things up" ... What is the best practice for Qualtrics? I am going through all the Stats iQ training modules/videos, and one of my main questions is how is this "packaged up" to present to the user? Or can we skip the Word/Excel model altogether and provide results to the user online via a dashboard or something like that? We have user users and then we'll eventually have actual researchers who know what they are doing and want to use the tool as they see fit. I'm thinking about regular users, and the goal is to make a nice presentation, either in Excel or online.

0
WilliamPeckUSNA
Level 2 ●●
4 years ago

Productivity playlist

Terms & Conditions