WebAIM - Web Accessibility In Mind

E-mail List Archives

Re: How Useful is Gemini/Bard?

for

From: Jeremy Echols
Date: Mar 5, 2024 3:32PM

I've found that ChatGPT Plus is often useful, as it will search the web for information that might not be built into the AI. I don't know if Gemini does this as well. But even so, ChatGPT Plus absolutely still makes mistakes.

There are three scenarios where I find that it's particularly bad:

1. Asking about something niche, like a tool that is only in use by university libraries, and/or is just sparsely documented.
2. Asking Something that changes a lot, but has vast articles and documentation for all its versions. Drupal can be a major source of conflicting information online.
3. Asking about something controversial in any way - even if the AI is amazing, it can have trouble deciding who is telling the truth online.

While I've found ChatGPT Plus to be really useful at times, I always double-check its responses when it's an important situation, and in any of the above three scenarios I expect that I'll have to ask a few follow-up questions in addition to double-checking the information.