How can we measure 
the user experience?

To begin measuring the experience we need to understand how users are feeling when they’re using the product, and what they’re doing when they use it. The two main areas of “User behaviour” and “User emotion”. The initial part of this process involved benchmark scoring all aspects of the product.

A combined score

We track a series of metrics from our users behavioural and emotional experience, and combine the results to generate a single score for each feature.

User Emotion

What users say & feel

To understand how users are perceiving the experience, we track emotional metrics. The user flow may be performing well, but if users are frustrated or don’t trust it, they will be more likely to stop using it.

User behaviour

What users do

We need to measure how users behave with the application to understand how effectively they are performing tasks within the app.

Scoring with goals

Setting and measuring

To be able to create a score for some of the metrics such as time, we needed to set goals in these areas to understand how far away we are from the goal, and score based on the difference from reaching the set goal.

This process was really useful for us as it helped to generate a lot of internal discussion within product teams about what the goal should be, and how they could improve the product to reach it.

Aggregating the scores

An overall UX score

By combining the overall behavioural and emotional scores, we can get a single score for each key feature/user story, and understand how the score has changed over time.

When can we then feed this feature score into a matrix of all the features we’ve tested across the product, and understand how it compares to other experiences.

How it’s used

Comparing scores

When we compare at all of the features we’ve tested across the overall product, we can get a sense of which parts of the experience are less or more positive than others.

With this exerience score overview of the full product, we can then make decisions on which experiences to improve, based on their overall score, how frequently they’re used, and their impact on other key business metrics such as ARPU and retention.

We’ve found this process to also help build more of an internal focus on the customer experience, sparking more discussion while we research, analyse and look for solutions to improve our UX.

Next

Monese Product Design