WebAIM - Web Accessibility In Mind

E-mail List Archives

Re: How Useful is Gemini/Bard?

for

From: Léonie Watson
Date: Mar 5, 2024 2:27PM

David,

The short answer is that you cannot entirely trust the responses you get
from any generative AI tool, including Gemini or ChatGPT.

The longer answer is that these tools have been trained on the data that
has been amassing on the web for the past 30 years. So they've learned
all the nonsense, all the good stuff, all the right ways to do things,
as well as all the wrong ways.

You need a measure of knowledge of the subject you're querying to be
able to verify the usefulness of the response you get. I wrote this post
recently that touches on one aspect of this:
https://tetralogical.com/blog/2024/02/12/can-generative-ai-help-write-accessible-code/

That said, sometimes that isn't possible. I use these tools to describe
images (that I can't see and have no way of verifying), but I'm aware of
the limitations of these tools, their habit of hallucinating, and can
take that into account when judging whether or how much I trust the
description I've been given. A somewhat light-hearted look at this is here:
https://tink.uk/adventures-with-bemyai/

It sounds like you've verified the trustworthiness of the responses
you've received by measuring the gains you've made (or not) by following
the advice given.

HTH

On 05/03/2024 21:04, David Russell wrote:
> Hello WebAIM forum,
>
> I am an NVDA screen reader user, and to preserve some of the "how to"
> I have grown to rely on, I have begun asking the Google A.I.
> assistant, Gemini, how to do specific tasks with my screen reader?
> I am experiencing something of concern in that directions given do not
> always equal experience gained.
> Most recent, trying to link my "pay account" to Fiverr. Their
> accessibility for the vision impaired in my opinion is a joke.
> There is a definite disconnect between what the tutorials intend with
> what experience provides.
> Is this occurrence on the minds of those who produce, administrate,
> and roll out products for general use by the public?
>
> Input appreciated!
>

--
Léonie Watson (she/her)
Director
https://tetralogical.com