Accessibility testing tools – Updated 10th February 2019

Posted on Monday, 11 February 2019 by Steve Faulkner

Here at The Paciello Group (TPG) we have a technical accessibility testing process which does not involve the use of automated tools. The technical audit results we provide to our clients are based solely on manual testing of a web site, web application, mobile or desktop application.


Typically, but not solely, we conduct technical testing in reference to the following accessibility standards:

To aid us in our manual testing process we use a number of tools and assistive technologies, the following is not a complete list of the tools we use, but these are the tools I currently use on a daily basis:

Tools

Assistive Technology

  • JAWS (Screen Reader for windows, demo version available)
  • NVDA (Free open source Screen Reader for windows)
  • VoiceOver (Built in Screen Reader, Mac desktop and iPhone/iPod)
  • ChromeVox (screen reader for Chrome and Chrome OS)
  • Talkback (screen reader for Android)
  • Zoomtext (Screen Magnifier for windows, demo version available)
  • Dragon (speech recognition software)

More Tools

I asked around the TPG virtual office (Skype group chat) and people recommended some more notable and useful tools:

Notes:

  1. We do not use assistive technology in our technical testing to carry out user testing, we leave that up to actual users of assistive technology, who we work with as part of our user research and usability testing services. But as technical testers we do use assistive technology to evaluate the data we gather. Assistive technology is an essential part of the process for understanding how the accessibility information provided in user interfaces is conveyed to users.
  2. The tools listed above are only the tools I use regularly, other accessibility engineers at TPG may use other tools.

About Steve Faulkner

Steve is the Technical Director at TPG. He joined The Paciello Group in 2006 and was previously a Senior Web Accessibility Consultant at vision australia. He is the creator and lead developer of the Web Accessibility Toolbar accessibility testing tool. Steve is a member of several groups, including the W3C Web Platforms Working Group and the W3C ARIA Working Group. He is an editor of several specifications at the W3C including HTML 5.1, ARIA in HTML, Notes on Using ARIA in HTML and HTML5: Techniques for providing useful text alternatives. He also develops and maintains HTML5accessibility.

Comments

  1. Nice overview, thanks for sharing. In addition, I’ve been finding that a speech input application such as NaturallySpeaking is also very valuable for testing accessibility — it is relevant to a large number of users who are often overlooked and sometimes exposes accessibility problems that are overlooked when using screen reading/magnification apps.

  2. Good list. There are some new tools on there I’ll definitely check out.

    I’m sure you’re aware of this and your copy is licensed, but just for clarity you can’t use the demo of JAWS for accessibility testing. Freedom Scientific license the demo purely for evaluation of the software, not for development purposes.

    From their EULA:

    “For example, these demonstration or evaluation licenses are not permitted for purposes of development and testing of JAWS scripts, applications, HTML coding, or other Web Based code.”

  3. Hi Karl, yes I am aware, I am lucky enough to have a fully licensed copy. I am not advocating using JAWS against the EULA, if people do so, it is at their own risk.

  4. The Web Developer Toolbar is also available for Chrome: chrispederick.com/work/web-developer

    I am also a fan of writing my own bookmarklets for testing, this way I can add focus in styles I want, reveal alt text on tweets, etc. There are many great options out there, but if you want to write your own I have a base model you can use to add your own selectors and styles: adrianroselli.com/2015/01/css-bookmarklets-for-testing-and-fixing.html

  5. @Steve Walker, you wrote:

    “I noticed you left off Narrator in Windows 10. Is there a reason? The new version seems much improved. ”

    I think @Steve (Faulkner) left Narrator out in this list because it’s not a testing tool. See his comment:

    “We do not use assistive technology in our technical testing to carry out user testing, we leave that up to actual users of assistive technology.”

    I agree you don’t need the help of AT when performing a (WCAG) compliance test. However, when doing an accessibility expert reviews / walkthroughs, I think it’s high recommended to test using commonly used AT. That’s how we usually approach accessibility testing in our lab.

    (And, yes, I agree that Narrator has come a long way, and can be considered a worthy alternative to Jaws or NVDA for Windows users.)

  6. Hi Steve, we don’t generally use narrator as our clients don’t ask for it (as yet). I have used narrator when doing testing/research I suspect when Edge changes to the blink rendering engine and narrator picks up its support game for IA2 then it will be more worthwhile.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.