Integrate AI Chatbot into survey | XM Community
Skip to main content

Has anyone successfully integrated an AI-powered chatbot, such as ChatGPT, Google Bard, or Microsoft Copilot (formerly known as Bing), into a survey?

 

My survey involves participants interacting with an AI-powered chatbot before answering a question.

Could someone guide me on how I can achieve this? I would greatly appreciate it.

Yes we can integrate Chat GPT using API in Qualtrics. Please check the demo here.


Hey @P.Jinda

Can you share a bit more about your use case? We recently also ran a survey where we evaluated user interactions after having them take a test using various chatbots. We did this by hosting the chatbots ourselves and sending the user to the bot and back to the survey using custom parameters in links. 

Hope this helps. 


Hi @Tino_p

Mine is looking to have the participant to read a case and then answer a set of questions using ChatGPT. Can you explain how you did yours? 


@P.Jinda  Ahh, we had a similar use case, but we did not integrate ChatGPT directly into the survey. All we did was provide a link and login credentials to our own service we specifically set up for this. Not sure if this is best practice, but we had analytics running on the service and were, therefore, able to track who came from the survey and how they interacted with the LLM. 

If the participant will only use ChatGPT does it really need to be integrated into the survey? Or might it be enough just to refer the participant to the tool?

If your goal is to keep track of how the participant interacts with the ChatGPT while trying to answer survey questions, this will require a tiny bit of development work. In that case, I would suggest creating your own ChatGPT site using OpenAI’s API and Streamlit. To track participant interactions you could either use Langsmith or Posthog. I think there is even a prebuilt Github repo you could just fork and add some interaction logging, too. 


@P.Jinda on second thought, if you really want it integrated into the survey, you could probably just use an iframe. Participants would still have to authenticate via the OpenAI website if they want to use ChatGPT, but I'm sure some startup out there is offering a free no-auth version on GPT-4 just for leadgen purposes. Or, as I previously mentioned, put it together in Streamlit and embed that into the iframe. 

If you’re not married to ChatGPT, check Huggingface for some cool open-source models. I think they allow you to deploy a chatbot in an iframe no-code using Gradio


@Tino_p  I just need to make sure the participants use ChatGPT.  I’ll look into Langsmith and Posthog and see what they can do. Thank you so much. 


You can follow this protocol to integrate interaction with an LLM via your Qualtrics survey: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4791512. Please remember to cite the work.


Absolutely! Integrating an AI-powered chatbot into your survey can enhance participant engagement and provide valuable insights. Here’s a guide to help you achieve this:

  1. Choose the Right Chatbot: Consider using one of the best AI chatbots like ChatGPT, Google Bard, or Microsoft Copilot. Each has its strengths, so choose one that aligns with your survey goals.

  2. Define the Interaction: Decide what kind of interaction participants will have with the chatbot. Will it provide information, ask questions, or engage in a dialogue? Clear objectives will help shape the chatbot’s responses.

  3. Use an API: Most advanced chatbots offer APIs. For instance, ChatGPT has an API you can integrate into your survey platform. This allows for real-time interaction with participants.

  4. Design the Survey Flow: Structure your survey so that participants engage with the chatbot first. For example, after a brief introduction, the chatbot can ask a preliminary question or provide context related to the survey topic.

  5. Test Thoroughly: Before launching, test the integration to ensure smooth interaction and that the chatbot responds appropriately to participants.

  6. Gather Feedback: After the survey, consider asking participants for feedback on their chatbot experience. This can help you improve future surveys.

Feel free to reach out if you have more questions or need specific technical guidance!


Yes! To reiterate some of the suggestions above, how I have done this is by using java to embed an iframe into a text/graphic question type.

If you have created your chatbot using an app like streamlit, here are instructions for adding the query parameters: https://docs.streamlit.io/deploy/streamlit-community-cloud/share-your-app/embed-your-app


Leave a Reply