WebAIM - Web Accessibility In Mind

E-mail List Archives

Thread: Recommendation -A11y Automation tool for CI/CD Pipeline

for

Number of posts in this thread: 6 (In chronological order)

From: Radhika Soni
Date: Tue, Apr 12 2022 2:03PM
Subject: Recommendation -A11y Automation tool for CI/CD Pipeline
No previous message | Next message →

Hi All,

Looking for accessibility automation tool recommendations in CI/CD pipeline
for both Dev and QA team.
Do you have any kind of analysis among various tools available in the
market today?

Looking forward to hearing from you!

Have a great week ahead.

Regards,
-Radhika

From: Chris O'Brien
Date: Tue, Apr 12 2022 2:10PM
Subject: Re: Recommendation -A11y Automation tool for CI/CD Pipeline
← Previous message | Next message →

Deque DevTools is something to take a look at: https://www.deque.com/axe/devtools/

Chris O'Brien
Director of Accessibility
Legal and Litigation


OLG Internal

-----Original Message-----
From: WebAIM-Forum < = EMAIL ADDRESS REMOVED = > On Behalf Of Radhika Soni
Sent: Tuesday, April 12, 2022 4:04 PM
To: WebAIM Discussion List < = EMAIL ADDRESS REMOVED = >
Subject: [WebAIM] Recommendation -A11y Automation tool for CI/CD Pipeline

This email originated outside of OLG. Do not open attachments or click links unless you recognize the sender and know the content is safe.

Hi All,

Looking for accessibility automation tool recommendations in CI/CD pipeline for both Dev and QA team.
Do you have any kind of analysis among various tools available in the market today?

Looking forward to hearing from you!

Have a great week ahead.

Regards,
-Radhika

From: Jared Smith
Date: Tue, Apr 12 2022 2:20PM
Subject: Re: [EXT] Recommendation -A11y Automation tool for CI/CD Pipeline
← Previous message | Next message →

The WAVE Stand-alone API and Testing Engine can readily be integrated into most CI/CD processes. Details at https://wave.webaim.org/standalone.

Jared Smith
WebAIM

From: Sailesh Panchang
Date: Wed, Apr 13 2022 10:37AM
Subject: Re: [EXT] Recommendation -A11y Automation tool for CI/CD Pipeline
← Previous message | Next message →

A good place to start is perhaps from the listing of tools at
http://www.w3.org/WAI/ER/tools/complete
One can research them, read about them, contact the vendors etc.
Thanks,
--
Sailesh Panchang
Customer Success Strategist and Principal Accessibility Consultant
Deque Systems Inc
381 Elden Street, Suite 2000, Herndon,
VA 20170
Mobile: 571-344-1765

On 4/12/22, Jared Smith < = EMAIL ADDRESS REMOVED = > wrote:
> The WAVE Stand-alone API and Testing Engine can readily be integrated into
> most CI/CD processes. Details at https://wave.webaim.org/standalone.
>
> Jared Smith
> WebAIM
> > > > >

From: Birkir R. Gunnarsson
Date: Thu, Apr 21 2022 8:14PM
Subject: Re: [EXT] Recommendation -A11y Automation tool for CI/CD Pipeline
← Previous message | Next message →

For accuracy and experience you can definitely trust tools like Axe,
Wave, ARC and Tenon.
I did some testing with Evinced and I was pretty satisfied.
All the tools have a lot of integrations and a comprehensive and
reliable set of accessibility checks, though slightly different
(trading no false positive and coverage and other minor things of that
nature).
Figure out what your environment is/which integrations you need.
Think about what you want in terms of accuracy vs. coverage.
Run the browser add-ons on your content to get a feel for what issues
they report and how it compares with what you wanted.
Look at pricing options (all the automation tools are a great investment).

I'm not saying that other tools on the market are no good, only
reporting on tools I know and I have used in the past, personally or
as part of my job.


On 4/13/22, Sailesh Panchang < = EMAIL ADDRESS REMOVED = > wrote:
> A good place to start is perhaps from the listing of tools at
> http://www.w3.org/WAI/ER/tools/complete
> One can research them, read about them, contact the vendors etc.
> Thanks,
> --
> Sailesh Panchang
> Customer Success Strategist and Principal Accessibility Consultant
> Deque Systems Inc
> 381 Elden Street, Suite 2000, Herndon,
> VA 20170
> Mobile: 571-344-1765
>
> On 4/12/22, Jared Smith < = EMAIL ADDRESS REMOVED = > wrote:
>> The WAVE Stand-alone API and Testing Engine can readily be integrated into
>> most CI/CD processes. Details at https://wave.webaim.org/standalone.
>>
>> Jared Smith
>> WebAIM
>> >> >> >> >>
> > > > >


--
Work hard. Have fun. Make history.

From: Benjamin.Hofer@telekom.de
Date: Thu, Apr 21 2022 11:10PM
Subject: Re: [EXT] Recommendation -A11y Automation tool for CI/CDPipeline
← Previous message | No next message

Hi,
this thread seems particularly interesting for me as I'm a blind DevOps Engineer working a lot with CI/CD tools and techniques. I've never worked with these tools, do they analyze code or are they mainly based on browser automation like Selenium?
Are there also some known tools to automatically test screenreader interaction? With NVDA and UI automation this should be - with extra effort - also possible within a (Windows) CI/CD runner.

Best
Benjamin


Mit freundlichen Grüßen / Best regards
Benjamin Hofer

DEUTSCHE TELEKOM IT GMBH
DevOps Engineer
Gutenbergstraße 13, 96050 Bamberg
+49 951 1336-7029 (Tel.)
+49 170 5429383 (Mobil)
E-Mail: = EMAIL ADDRESS REMOVED =
www.telekom.de

ERLEBEN, WAS VERBINDET.

Die gesetzlichen Pflichtangaben finden Sie unter: https://www.telekom.com/pflichtangaben-dtit
GROSSE VERÄNDERUNGEN FANGEN KLEIN AN – RESSOURCEN SCHONEN UND NICHT JEDE E-MAIL DRUCKEN.

-----Ursprüngliche Nachricht-----
Von: WebAIM-Forum < = EMAIL ADDRESS REMOVED = > Im Auftrag von Birkir R. Gunnarsson
Gesendet: Freitag, 22. April 2022 04:15
An: WebAIM Discussion List < = EMAIL ADDRESS REMOVED = >
Betreff: Re: [WebAIM] [EXT] Recommendation -A11y Automation tool for CI/CD Pipeline

For accuracy and experience you can definitely trust tools like Axe, Wave, ARC and Tenon.
I did some testing with Evinced and I was pretty satisfied.
All the tools have a lot of integrations and a comprehensive and reliable set of accessibility checks, though slightly different (trading no false positive and coverage and other minor things of that nature).
Figure out what your environment is/which integrations you need.
Think about what you want in terms of accuracy vs. coverage.
Run the browser add-ons on your content to get a feel for what issues they report and how it compares with what you wanted.
Look at pricing options (all the automation tools are a great investment).

I'm not saying that other tools on the market are no good, only reporting on tools I know and I have used in the past, personally or as part of my job.


On 4/13/22, Sailesh Panchang < = EMAIL ADDRESS REMOVED = > wrote:
> A good place to start is perhaps from the listing of tools at
> http://www.w3.org/WAI/ER/tools/complete
> One can research them, read about them, contact the vendors etc.
> Thanks,
> --
> Sailesh Panchang
> Customer Success Strategist and Principal Accessibility Consultant
> Deque Systems Inc
> 381 Elden Street, Suite 2000, Herndon, VA 20170
> Mobile: 571-344-1765
>
> On 4/12/22, Jared Smith < = EMAIL ADDRESS REMOVED = > wrote:
>> The WAVE Stand-alone API and Testing Engine can readily be integrated
>> into most CI/CD processes. Details at https://wave.webaim.org/standalone.
>>
>> Jared Smith
>> WebAIM
>> >> >> archives at http://webaim.org/discussion/archives
>> >>
> > > archives at http://webaim.org/discussion/archives
> >


--
Work hard. Have fun. Make history.