WebAIM - Web Accessibility In Mind

E-mail List Archives

Re: Web application testing

for

From: Bourne, Sarah (MASSIT)
Date: Aug 16, 2016 7:00AM

Dylan Barrell covers coming up with a "sparse testing matrix" in his talk, Taming the Beast: Agile and the Automated Testing of Accessibility. (On Vimeo with captions: https://vimeo.com/151658306 ) Starting at 11:45, Dylan discusses the huge range of technologies that need to be considered, and the ridiculous number of OS/browser/AT combinations that results in. At 15:05, he shows the matrix he uses to figure out the combinations you actually need to use to find the most problems with the fewest tests.

Dylan presents this in terms of agile development, where there's a LOT of testing done frequently, so you may find his sample matrix too sparse in other situations. For example, you would want to expand it for an audit test or as part of usability testing. But at some point, all you're going to turn up is browser or AT specific bugs, rather than bugs in what you're testing. You may need to know about them, but there's not much you can do about them.

sb
Sarah E. Bourne
Director of IT Accessibility, MassIT
Commonwealth of Massachusetts
1 Ashburton Pl. rm 811 Boston MA 02108
617-626-4502
<EMAIL REMOVED>
http://www.mass.gov/MassIT