10 Checklists For Buying A Remote User Testing Software

CX & UX Content Collection

Simplify Your Decision Making Process

People who work in User Experience, Usability or User Testing know that it is key to choose a research software for Remote Usability Testing tailored to your own and your company’s research needs to make your projects successful.

Whether you need to conduct remote user tests and UX design projects or are looking for a solution to complement your in-lab usability studies. Using the right UX testing tool can save a lot of time and effort.

Checklist #1 Research Techniques

ux research techniques

Every company has different necessities when it comes to conducting UX & usability projects. Make sure the solution you are interested in lets you use and combine the research tools most important to you. For your own convenience a software which offers you all the tools you need in one platform could be an interesting solution.

What kind of research can you perform?

  • Remote Usability Testing
  • Card Sorting
  • Tree Testing
  • Screenshot Click Testing
  • Online Surveys
  • Voice of the Customer Studies

Checklist #2 Result Types

ux research results

Depending on your goals, you may need to obtain quantitative UX metrics and behavioural data like task success rates and clickstreams or qualitative user data like video feedback. Focus on the results the tool of your choice offers. If you want to use a remote user testing software to gather quantitative and qualitative data and have a need for combining, filtering, quickly analysing and sharing these results ask about the tool’s data analysing capacities.

What results do you get?

  • Qualitative Data like user videos
  • Quantitative Data like UX metrics such as task success rates and time on task

Checklist #3 Data Capturing Options

There are different options for capturing user data while participants browse on a website:

  1. Implementing a JavaScript code on your website
  2. Using a proxi server which shows a copy of the website to study participants or
  3. Asking users who participate in a study to download a browser plugin.

Each approach has its’ testing advantages and disadvantages. To choose the most appropriate option which best serves your research objectives don’t forget to ask about the user tracking technology supported by the software.

Checklist #4 Device Testing Options

multi device usability testing

Most users search for information on their mobile or tablet, but complete a purchase on their desktop computer. Multi-device usage calls for user tests on different devices. If you need to conduct tests with desktop, mobile or app users, make sure the remote user testing software also allows you to run mobile usability tests.

Can you run tests on different devices?

  • Offers integrated Mobile Testing Solution
  • Webcam for mobile devices which is sent to participants
  • App for mobile devices which can be downloaded to capture video feedback

Checklist #5 Advanced Features

advanced question types

Experienced UX researchers need to work with features tailored to advanced needs. If the tool allows you to filter UX metrics by task success rates or time per task and lets you automatically analyse and combine them with user videos or sites tested, you save time when creating usability reports.

How sophisticated is the software?

  • Survey Tool with a variety of question types
  • Filters to detect and exclude cheaters
  • Automatically filters results by variables
  • Editable URLs for clickstream analysis
  • Look & Feel adaptable to your brand
  • Options to run studies on secure HTTPS sites

Checklist #6 Recruitment Options

online usability testing

When inviting users you can either intercept visitors on your website or use a segment of your user base or target audience as a panel to run tests. Whatever your necessities, make sure the remote user testing software you are interested in offers the right approach for your organisation.

How can you invite participants?

  • From your data base
  • Through Social Media
  • Intercept web or app users
  • Using the feedback tab on your site
  • Using a QR code on ads or products
  • Use a panel: The tool’s own panel, a panel provider, integrate your own private panel

Checklist #7 Study Requirements

international usability testing

Maybe you work in the UK, but are in charge of user tests in other European countries. Or you are based in London, but work with UX colleagues in New York and Brisbane. A testing software needs to enable you to build and run international studies and easily share within your organisation.

How international is the software provider?

  • How many languages does the tool support
  • Does the software provider operate worldwide (headquarters, locations)
  • Do they offer multilingual technical support

Checklist #8 Your Own Resources

ux reasearch support

No matter how sophisticated the research solution, there comes a point where you need technical support. Make sure that you not only obtain personalised answers, but also an in-depth training at the beginning. If you need additional support to build studies or to analyse results, find out how much the company knows about UX and if you can count on their UX researchers for help.

How much support does the company provide?

  • In-depth tool training sessions
  • Online help center
  • Support: Operating hours, email, chat, phone
  • Own Account or Client Success Manager
  • UX Researchers available for project support

Checklist #9 Data Security

data security usability test

Especially banks and insurances have a need for running user tests on HTTPS secure sites. They need to be sure that their data is save on a provider’s server and that all data is backed up accordingly. Some UX software providers are certified members of Data Privacy Management (DPM) companies like TRUSTe. Ask about the company’s data security policy to ensure all your data is taken care of.

How secure is your data?

  • What data security options are you offered?
  • Do you know the vendor’s privacy policy?
  • Is the software provider certified?

Checklist #10 Your UX Roadmap

ux roadmap planning

When you look back on how user behaviour and devices have changed over the last couple of years, you will notice that it is necessary to work with an UX software which grows with your research needs. Find out how innovative the software provider is: Do they constantly update their software and release new features and tools the market demands. If they haven’t updated their tool in the last 18 months, you may want to give it a second thought.

What are your research plans?

  • How long will the software be used for?
  • How often does the provider release new features?
  • Do new features meet your need to conduct innovative UX research?
  • What tools should the solution offer in the future?


10 Checklists For Buying A Remote User Testing Software

10 Checklists to simplify your decision making process when buying a remote user testing software.

Interested in Remote Usability Testing?