WebAIM - Web Accessibility In Mind

E-mail List Archives

Re: Web application testing

for

From: _mallory
Date: Aug 16, 2016 9:15AM

There was a similar talk at CSUN but unfortunately no video, just
http://www.csun.edu/cod/conference/2016/sessions/index.php/public/presentations/view/246
the abstract and
http://www.slideshare.net/MarkStimson1/transforming-novices-into-skilled-accessibility-testers-csun-2016-60188894
the slides

Mark Stimson at Kaiser Permanente. When about to launch a large
mobile-based version of all their everything, wanted to let QA
also be able to flag accessibility errors instead of relying on
their small number of a11y experts.

His talk was about how they did that: QA was often contractors who
may be gone after 8 months, so it had to be something they could
learn to do quickly. They devised a few-hours-long training program
for every QA person to learn VoiceOver, and then using a 3 x 3 grid,
QA could find some 90% of issues (which hit both mobile and desktop)
and the accessibility specialists found the remaining ones.

_mallory

On Tue, Aug 16, 2016 at 01:00:49PM +0000, Bourne, Sarah (MASSIT) wrote:
> Dylan Barrell covers coming up with a "sparse testing matrix" in his talk, Taming the Beast: Agile and the Automated Testing of Accessibility. (On Vimeo with captions: https://vimeo.com/151658306 ) Starting at 11:45, Dylan discusses the huge range of technologies that need to be considered, and the ridiculous number of OS/browser/AT combinations that results in. At 15:05, he shows the matrix he uses to figure out the combinations you actually need to use to find the most problems with the fewest tests.
>
> Dylan presents this in terms of agile development, where there's a LOT of testing done frequently, so you may find his sample matrix too sparse in other situations. For example, you would want to expand it for an audit test or as part of usability testing. But at some point, all you're going to turn up is browser or AT specific bugs, rather than bugs in what you're testing. You may need to know about them, but there's not much you can do about them.
>
> sb
> Sarah E. Bourne
> Director of IT Accessibility, MassIT
> Commonwealth of Massachusetts
> 1 Ashburton Pl. rm 811 Boston MA 02108
> 617-626-4502
> <EMAIL REMOVED>
> http://www.mass.gov/MassIT
>
> > > >