WebAIM - Web Accessibility In Mind

E-mail List Archives

Thread: automated tests of multimedia

for

Number of posts in this thread: 5 (In chronological order)

From: deborah.kaplan@suberic.net
Date: Mon, Jul 27 2015 8:41AM
Subject: automated tests of multimedia
No previous message | Next message →

I've been looking at many of the automated test suites, trying to find
one that can do automated tests of multimedia: are the controls in this
HTML 5 media player accessible; are there captions on this video; there
appears to be an audio so a human should manually check for transcript.
That kind of thing. I haven't found any of the automated tools that
have that functionality. Am I missing some? Ideally I want something I
can integrate into unittests, although I understand that a lot of
accessibility testing is on the order of "hey developer, go check this
and make sure it works!"


Deborah Kaplan
--

From: Karl Groves
Date: Mon, Jul 27 2015 1:59PM
Subject: Re: automated tests of multimedia
← Previous message | Next message →

One of the challenges with testing multimedia is that most of it can't
(couldn't) be reliably tested. Up until recently most players were
Flash based. That's changed thanks to HTML5 and I'm betting you'll
see multimedia testing soon. ;-)



On Mon, Jul 27, 2015 at 10:41 AM, < = EMAIL ADDRESS REMOVED = > wrote:
> I've been looking at many of the automated test suites, trying to find
> one that can do automated tests of multimedia: are the controls in this
> HTML 5 media player accessible; are there captions on this video; there
> appears to be an audio so a human should manually check for transcript.
> That kind of thing. I haven't found any of the automated tools that
> have that functionality. Am I missing some? Ideally I want something I
> can integrate into unittests, although I understand that a lot of
> accessibility testing is on the order of "hey developer, go check this
> and make sure it works!"
>
>
> Deborah Kaplan
> --
> > > > --

Karl Groves
www.karlgroves.com
@karlgroves
http://www.linkedin.com/in/karlgroves
Phone: +1 410.541.6829

Modern Web Toolsets and Accessibility
https://www.youtube.com/watch?v=_uq6Db47-Ks

www.tenon.io

From: Morin, Gary (NIH/OD) [E]
Date: Wed, Jul 29 2015 7:20AM
Subject: Re: automated tests of multimedia
← Previous message | Next message →

Just as so many automated tools might tell us if an image on a website or in a document has an alt-text, I've yet to see such a tool tell us how *good* or meaningful the alt-text is. The same goes here with both captioning and audio-description. Even if the presence of either could be tested for, by an automated tool, how good the quality of the captioning or the audio-description could really only be done manually, by viewing and listening to the video or multimedia. At least, it seems to me.

Gary

-----Original Message-----
From: Karl Groves [mailto: = EMAIL ADDRESS REMOVED = ]
Sent: Monday, July 27, 2015 3:59 PM
To: WebAIM Discussion List < = EMAIL ADDRESS REMOVED = >
Subject: Re: [WebAIM] automated tests of multimedia

One of the challenges with testing multimedia is that most of it can't
(couldn't) be reliably tested. Up until recently most players were Flash based. That's changed thanks to HTML5 and I'm betting you'll see multimedia testing soon. ;-)



On Mon, Jul 27, 2015 at 10:41 AM, < = EMAIL ADDRESS REMOVED = > wrote:
> I've been looking at many of the automated test suites, trying to find
> one that can do automated tests of multimedia: are the controls in
> this HTML 5 media player accessible; are there captions on this
> video; there appears to be an audio so a human should manually check for transcript.
> That kind of thing. I haven't found any of the automated tools that
> have that functionality. Am I missing some? Ideally I want something I
> can integrate into unittests, although I understand that a lot of
> accessibility testing is on the order of "hey developer, go check this
> and make sure it works!"
>
>
> Deborah Kaplan
> --
> > > archives at http://webaim.org/discussion/archives
> --

Karl Groves
www.karlgroves.com
@karlgroves
http://www.linkedin.com/in/karlgroves
Phone: +1 410.541.6829

Modern Web Toolsets and Accessibility
https://www.youtube.com/watch?v=_uq6Db47-Ks

www.tenon.io

From: deborah.kaplan@suberic.net
Date: Wed, Jul 29 2015 7:34AM
Subject: Re: automated tests of multimedia
← Previous message | Next message →

On Wed, 29 Jul 2015, Morin, Gary (NIH/OD) [E] wrote:

> Just as so many automated tools might tell us if an image on a website or in a document has an alt-text, I've yet to see such a tool tell us how *good* or meaningful the alt-text is. The same goes here with both captioning and audio-description. Even if the presence of either could be tested for, by an automated tool, how good the quality of the captioning or the audio-description could really only be done manually, by viewing and listening to the video or multimedia. At least, it seems to me.

Oh, absolutely. And the same goes for the labels of controls, actually. One of the automated tests I'm going to have to write myself no matter what is one which has a list of what the control names should be for play, pause, volume, etc. How many times have we looked at players where every control technically has a label, but the label for volume control is "100%" and the label for play/pause is "GFFDSFDFS-id-control"?

From: Karl Groves [mailto: = EMAIL ADDRESS REMOVED = ]

> One of the challenges with testing multimedia is that most of it can't
> (couldn't) be reliably tested. Up until recently most players were Flash based. That's changed thanks to HTML5 and I'm betting you'll see multimedia testing soon. ;-)

HTML 5 media players are my happy place. :)

Deborah Kaplan

From: _mallory
Date: Wed, Jul 29 2015 9:21AM
Subject: Re: automated tests of multimedia
← Previous message | No next message

On Wed, Jul 29, 2015 at 01:20:57PM +0000, Morin, Gary (NIH/OD) [E] wrote:
> Just as so many automated tools might tell us if an image on a website or in a document has an alt-text, I've yet to see such a tool tell us how *good* or meaningful the alt-text is. The same goes here with both captioning and audio-description. Even if the presence of either could be tested for, by an automated tool, how good the quality of the captioning or the audio-description could really only be done manually, by viewing and listening to the video or multimedia. At least, it seems to me.

Sure, but the point here of the automated testing tool is at the very
least to alert to absense, and such a tool could also simply list all
the places where there should be captions for example, this is still
handy esp if you're working on such a large site that no dev knows
where they all are.

_mallory