Formatting qualtrics Results .csv in format for GenAI (ChatGPT, Claude, etc.) analysis | XM Community
Skip to main content

Formatting qualtrics Results .csv in format for GenAI (ChatGPT, Claude, etc.) analysis

  • December 30, 2024
  • 3 replies
  • 73 views

Forum|alt.badge.img+1

** update:  the below applies to data exported in .csv from the Results tab -  It just occurred to me that exporting raw .csv data from the data & analysis tab may be more GenAI friendly, but I don’t know **. 

 

Starting a conversation  here about  experiences with GenAI analysis of qualtrics results data, what worked / did not work, etc. Scripts to translate into GenAI readable formats, any tips or tricks, learnings, suggestions for Qualtrics, etc.  If there is already a thread on this, I couldn’t find it.

 

GenAI is very useful when doing an analysis of survey data to highlight key points in more complex surveys where using StatsIQ and TextIQ would take a ton of time and expertise, including translating in to English language statements / paragraphs, etc.  Very sophisticated analysis, surfacing really impactful insights that would be hard to find otherwise

 

I have had varying results having ChatGPT or Anthropic’s Claude do an analysis of survey data downloaded in .csv format from the Qualtrics Results tab.   If you can provide the data in a format GenAI can easily read the results are fantastic,  As of right now Claude Anthropic pretty goed,  ChatGPT not so much.

 

It would be great to do as little reformatting as possible, and LLMs would have a consistent interpertaton of the uploaded file, or even if one specific LLM would

.  Anthropic Claude can read the .csv output with just a few formatting changes, ChatGPT a lot more complicated.   It would be great if Qualtrics could output the .csv file in a way a GenAI provider could readily understand without a lot of reformatting.   

 

 

3 replies

Aggarwal
Level 4 ●●●●
Forum|alt.badge.img+15
  • Level 4 ●●●●
  • 134 replies
  • January 4, 2025

For any AI tool, I think we need to define good data structure and clear instructions, like for example:-

 

a. Input Structure

 

Use a format GenAI understands well, such as:

Tabular Descriptions: Clearly labeled rows and columns.

Questions and Responses: Include the question as context in each row.

 

 

 

b. Provide Instructions

When uploading or pasting data, include a clear preamble:

Example: "This CSV contains survey responses. Each row represents a respondent, and each column corresponds to a survey question. Please analyze the data for key trends, common themes, and insights."


Forum|alt.badge.img+1
  • Author
  • 2 replies
  • January 6, 2025

Thank you Aggarwal.  At first I was trying to use the .csv outputted in the Results tab, adding delimiters, etc.  It worked, but it was a lot of work.  Then (duh!) I tried the standard raw data export from the data & analysis tab and it worked perfectly.  

I found Anthropic’s Claude 3.5 Sonnet was far better suited for survey data analysis then GpatGPT’s latest model.  

Your prompt is a great starting point, and alone produces great results, sufficient for producing an insightful report / stakeholder presentation. Basically everything you said was 100% right on and very much appreciated. 

.I used a variety of follow-on prompts and found that if you ask it to look for interesting correlations which produced additional valuable insights, and some overlap as could be expected.  What I really like about GenAI for survey analysis is it’s ability to mine text response questions which was a tremendous pain b4 GenAI. 

 

 


Aggarwal
Level 4 ●●●●
Forum|alt.badge.img+15
  • Level 4 ●●●●
  • 134 replies
  • January 6, 2025

Agreed, for open end you can also try Qualtrics insight explorer if your brand have access for same. 


Leave a Reply