The UX Toolbox - Usability Testing

8 January 2018 - Stephen Denning

Tools on a bench demonstrating the UX toolbox

Insight through observation

To create truly user-centred designs and great user experiences, we need to involve the people who will use our products or services at the end of the day. Usability testing is a key method that allows design team to capture users’ input throughout the design and development process.

Usability testing is one of the most important and long-established techniques in the UX toolbox (the first mention of this type of testing dates back to the 1960’s). It involves capturing a current or potential customer’s interaction with a digital solution, allowing for the identification of potential problems before they become part of the project’s final design.

Unlike techniques such as surveys and market research which gather opinions, usability testing is a systematic approach that uses observation and questioning to understand how users behave and react in a realistic situation.

What is involved

A collage of photos showing a user testing studio set up with monitors with front facing cameras and one way mirror and the observing room behind itUser Vision User Experience Lab

Usability testing involves recruiting real target users and running one-on-one sessions with them. Realistic scenarios are devised for the participant to complete, based on business objectives and typical usage of similar systems. The moderator then observes as the participant undertakes the tasks while describing their experience and strategies as they go. Throughout the process, the moderator observes their behaviour and where necessary asks questions to better understand the person’s experience.

Other tools such as eyetracking and emotional response can also be integrated into the testing for additional insights.

The moderator records each session and takes notes throughout, using this information to describe the findings and make recommendations for improvement at the conclusion of the study.

The number of participants required for effective usability testing depends on many factors (what is being tested, when it is being tested, how many user groups there are), but useful insight can usually be gathered with relatively small numbers and many tests are performed with 5-15 participants.

Where should testing happen?

Testing can be undertaken in a specialised usability testing lab (like our Edinburgh lab), or a more informal setting such as an office or a café, depending on the situation. Tests can also be conducted remotely, using video conferencing and screen sharing tools. This can be advantageous if your target user group are geographically dispersed.

Steve Denning conducting user testing

What can be tested?

Anything! Usability testing can be performed on digital or physical products; on sketches, prototypes or finished products; on laptops, mobiles and tablets. At User Vision we have conducted usability testing on everything from websites and apps, to paper bank statements, baby car seats and tourist information centres, as shown in our project work. As long as there is something that a user can use to demonstrate how they would complete a task, it can be tested.

Early ideas can also be tested, using sketches or early prototypes. People are very good at what is known as “suspension of disbelief”, that is, the ability to imagine that a sketch of a website is actually a website and to interact with it as such. Which brings us on to…

When should testing happen?

Usability testing should ideally happen early and often. The earlier in the process that the testing process begins, these easier and cheaper it is to implement changes (see diagram below). Often testing is left until a product is close to completion. By this point it is both difficult, and expensive, to make changes based on the feedback.

Graph showing ability to make changes versus cost to make changes

Testing can begin with early sketches and progress through iterations of prototyping and development. At each stage new lessons are learned and course corrections can be made to ensure that the final product delivers an excellent user experience.

As a general rule, if you think you are ready to test, then you are probably starting too late. Better to test with something, no matter how incomplete or imperfect, than to run out of time and not test at all!

Whether you are developing a new product or digital solution, usability testing delivers essential empirical insights at any stage of the process. The direct feedback from users builds their needs into the design, helping you to create a truly compelling and successful user experience.

To find out more about how usability testing can help you to understand your users’ experience and rectify issues early, send us an email - we'd love to help!

Join our Accessibility Research Panel!

8 July 2024

Do you or someone you know have a disability? If so, we’re welcoming participants to join our research panel of users with disabilities which helps us to gather insights into the disabled user experience. We conduct usability tests and other research with individuals with disabilities to gain clear, first-hand evidence to understand the barriers they face and to develop effective solutions. Find out more and help grow our research panel.

Read the article: Join our Accessibility Research Panel!

User Vision: Your Partner for Delivering Outstanding FCA Consumer Duty Customer Outcomes

14 June 2024

With the July 2024 FCA Consumer Duty deadline approaching, financial services firms must deliver good outcomes for customers. User Vision, experts in user experience and accessibility, offers solutions to ensure compliance. From product design to customer support, our services help firms meet regulatory requirements and enhance customer satisfaction.

Read the article: User Vision: Your Partner for Delivering Outstanding FCA Consumer Duty Customer Outcomes

Revolutionising User Experience Research in the UK

3 June 2024

Discover how User Vision and MeasuringU's collaboration brings the innovative MUiQ platform to the UK, delivering unparalleled user insights with advanced analytics and comprehensive research methodologies. Elevate your UX research with our cutting-edge solutions.

Read the article: Revolutionising User Experience Research in the UK

Explore all thoughts

Do you have a project in mind? Let’s chat about what we can do for you. Get in touch