How do you measure the experience in the making? | XM Community
Skip to main content

How do you measure the experience in the making?


SteveBelgraver
Level 5 ●●●●●
Forum|alt.badge.img+55

Although the bulk of our effort usually focusses on the 3rd phase through the use of surveys and metrics like CSAT, NPS and the like, I'm curious if and how the customer sentiment is measured (and managed) during the 2nd phase which arguably when the most intense emotions and memories are created. 

experience intensity along the customer journey

I see our experiences categorized into roughly 3 categories or phases: 

  1. before - prior to buying or consuming a product or service there is the period where the potential customer discovers and orients themselves on it. From the provider's perspective this covers first the marketing and then sales cycles. It is during this phase that the customer expectations are generated
  2. during - is the period or moment where the product or service is actually acquired or consumed and experienced. The emotions and sentiments usually run highest in this phase and are when the core of the customer experience is created
  3. after - arguably the longest phase of the broader experience which in the case of a product represents its lifetime use or in the case of a (consumable) service becomes a memory. In either case the sentiment intensity or its emotive ability usualy fades over time.   

4 replies

Nam Nguyen
QPN Level 8 ●●●●●●●●
Forum|alt.badge.img+29
  • QPN Level 8 ●●●●●●●●
  • 1091 replies
  • February 15, 2025

In my opinion, we can't interrupt the "during" phase to collect feedback, that phase is their FOCUS time on the task, on the experience. Asking for feedback too early means they haven’t fully experience yet and it’s not a natural interaction anymore.

Instead, I always aim to capture feedback immediately after the experience, before it goes “stale”. This is why we use survey expiration, intercept surveys, and simplified feedback survey that embedded into the touchpoint to make sure we only collect the fresh one.

On the other hand, in "during" phase, if the experience is digital, there are many solutions that allow us to observe customer interactions/behaviors without disrupting them— "being a fly on the wall." Tools like Qualtrics DXA enable us to monitor how customers navigate website app, give us behavioral insights without direct question.


SteveBelgraver
Level 5 ●●●●●
Forum|alt.badge.img+55
  • Author
  • Level 5 ●●●●●
  • 106 replies
  • February 16, 2025

I could not agree more ​@Nam Nguyen  and I'm certainly not advocating interrupting the customer experience while it is in the making 😉 Rather than interrupting the experience in the during phase I'd posit it as an opportunity to course correct and improve the chances for better outcomes. The Observer Effect is an illustrative corollary that postulates that the very act of observing influences the unfolding of an event and thereby affects the outcome. Much like your fly on the wall approach, technology offers us ways to monitor the service experience while it is in the making. Although I'm not familiar with the finer workings of Qualtrics DXA I recently came across SupportLogic which enables our enterprise helpdesk to monitor customer sentiment during their support experience. I look forward to better understanding how this will produce improvements across the board.


Forum|alt.badge.img+32
  • Level 6 ●●●●●●
  • 241 replies
  • February 17, 2025

Your right, the way I consider when we survey is as early to the customer need being met, unless customer has not finished the journey in the expected timeframe or other measure indicates fallout - but typically these are different surveys/triggers.

 

The only exception I think of is for new product/process launches , I have found previously that it can be beneficial to survey in the ‘During’ phase - just being transparent that it’s a new process and trying to get feedback to improve it.  Usually best when survey comes from an ‘Individual’ related to the new process/product, and being upfront its ‘new’  etc. I’d only do this where the successful launch/experience of new process/product has higher value than what the individual customer journey is worth - which usually no-brainer but interrupting the journey longer term isn’t worth it.  As technology and tracking improves, and a lot of these experiences become more digital - the need to survey for this has lowered over the years.  

Other useful tools I have seen for ‘during’ phase, is platforms which use real time sentiment analysis over calls to contact centre agents - but adoption/use cases of this is more limited than I expected a few years ago. 

 


SteveBelgraver
Level 5 ●●●●●
Forum|alt.badge.img+55
  • Author
  • Level 5 ●●●●●
  • 106 replies
  • February 23, 2025

Salient point ​@ScottG! You include a key caveat - the crucial need for transparency. Totally agree that managing expectations by informing our clients up front is a vital ingredient not only for a good relationship but also an important enabler for success. 

On your point on improvement, to further increase client participation they can be incentivised by giving them skin in the game. Offering clients the possibility to influence and shape the service as it develops for instance. PoCs (Proof of Concept) can become true collaborative ventures this way of cocreation.   

We've just started using a real time sentiment analysis tool which looks very promising. However, the real proof will be in the eating of the pudding. We will have to see if the client experience improves structurally by for example comparing future transactional scores with a baseline before we stared using this tool🤞


Leave a Reply