Usability Testing

Usability Testing is a type of software testing where, a small set of target end-users, of a software system, “use” it to expose usability defects. This testing mainly focuses on the user’s ease to use the application, flexibility in handling controls and ability of the system to meet its objectives. It is also called User Experience Testing.

This testing is recommended during the initial design phase of SDLC, which gives more visibility to the expectations of the users.

Need for Usability Testing

Aesthetics and design are important. How well a product looks usually determines how well it works.

There are many software applications/websites, which miserably fail, once launched, due to following reasons –

  • Where do I click next?
  • Which page needs to be navigated?
  • Which Icon or Jargon represents what?
  • Error messages are not consistent or effectively displayed
  • Session time not sufficient.

Usability Testing identifies usability errors in the system early in the development cycle and can save a product from failure.

Goals of Usability Testing

The goal of this testing is to satisfy users and it mainly concentrates on the following parameters of a system:

The effectiveness of the system

  • Is the system is easy to learn?
  • Is the system useful and adds value to the target audience?
  • Is Content, Color, Icons, Images used are aesthetically pleasing?

Efficiency

  • Navigation required to reach the desired screen/webpage should be very less. Scroll bars shouldn’t be used frequently.
  • Uniformity in the format of screen/pages in your application/website.
  • Provision to search within your software application or website

Accuracy

  • No outdated or incorrect data like contact information/address should be present.
  • No broken links should be present.

User Friendliness

  • Controls used should be self-explanatory and must not require training to operate
  • Help should be provided for the users to understand the application/website
  • Alignment with the above goals helps in effective usability testing

Usability Testing Process

Usability testing process consists of the following phases.

Planning:

During this phase the goals of usability test are determined. Having volunteers sit in front of your application and recording their actions is not a goal. You need to determine the critical functionalities and objectives of the system. You need to assign tasks to your testers, which exercise these critical functionalities. During this phase, usability testing method, number & demographics of usability testers, test report formats are also determined

Recruiting:

During this phase, you recruit the desired number of testers as per your usability test plan. Finding testers who match your demographic (age, sex etc.) and professional (education, job etc.) profile can take time.

Usability Testing:

During this phase, usability tests are actually executed.

Data Analysis:

Data from usability tests are thoroughly analyzed to derive meaningful inferences and give actionable recommendations to improve the overall usability of your product.

Reporting:

Findings of the usability test are shared with all concerned stakeholders which can include designer, developer, client, and CEO.

Methods of Usability Testing

There are two methods available to do usability testing –

  1. Laboratory Usability Testing
  2. Remote Usability Testing

Laboratory Usability Testing:

This testing is conducted in a separate lab room in the presence of the observers. The testers are assigned tasks to execute. The role of the observer is to monitor the behavior of the testers and report the outcome of testing. The observer remains silent during the course of testing. In this testing, both observers and testers are present in the same physical location.

Remote Usability Testing:

Under this testing observers and testers are remotely located. Testers access the System under Test, remotely and perform assigned tasks. Tester’s voice, screen activity, testers facial expressions are recorded by automated software. Observers analyze this data and report the findings of the test.

How many users do you need?

Research (Virzi, 1992 and Neilsen & Landauer, 1993) indicates that 5 users are enough to uncover 80% of usability problems. Some researchers suggest other numbers.

The truth is, the actual number of the user required depends on the complexity of the given application and your usability goals. Increase in usability participant’s results in increased cost planning, participant management, and data analysis.

But as a general guideline, if you on a small budget and interested in DIY usability testing 5 is a good number to start with. If budget is not a constraint its best consult experienced professionals to determine the number of users.

Best Practices- Usability testing

The primary goal of this testing is to find crucial usability problems before the product is launched. Following things have to be considered to make a testing success:

Start the testing during the early stage of design and development.

It’s a good practice to conduct usability testing on your competitor’s product before you begin development. This will help you determine usability standards for your target audience.

Select the appropriate users to test the system(Can be experts/non-experts users/50-50 of Experts and Non-Experts users)

Use a bandwidth shaper. For instance, your target audience has poor network connectivity, limit network bandwidth to say 56 Kbps for your usability testers.

Testers need to concentrate on critical & frequently used functionalities of the system.

Assign a single observer to each tester. This helps the observer to accurately note tester’s behavior. If an observer is assigned to multiple testers, results may be compromised

Educate Designers and Developers that this testing outcome is not a sign of failure but it’s a sign of Improvement.

Pros and Cons of Usability testing:

As with anything in life, usability testing has its merits and demerits. Let’s look at them

Pros:

  • It helps uncover usability issues before the product is marketed.
  • It helps improve end-user satisfaction
  • It makes your system highly effective and efficient
  • It helps gather true feedback from your target audience who actually use your system during a usability test. You do not need to rely on “opinions” from random people.

Cons:

  • Cost is a major consideration in usability testing. It takes lots of resources to set up a Usability Test Lab. Recruiting and management of usability testers can also be expensive

Was this article helpful?

Related Articles