E-mail List Archives
Thread: Usability Testing
Number of posts in this thread: 4 (In chronological order)
From: Dan_Chamberlain@Dom.com
Date: Thu, Jan 18 2007 7:40AM
Subject: Usability Testing
No previous message | Next message →
I am conducting a study on usability testing within companies that regard
their web presence as critical. I am looking for comments and information
on how usability is weaved into the development process (includes IA), what
kind of resources and applications are necessary and is there an advantage
to using an external vendor. If you have experience with any of these
subjects your thoughts and comments would be appreciated.
Thanks
Dan Chamberlain
Dominion Resources
EWG.UXE
701 East Cary Street
Richmond, Virginia 23219
804.771.4629
8.736.4629
-----------------------------------------
CONFIDENTIALITY NOTICE: This electronic message contains
information which may be legally confidential and/or privileged and
does not in any case represent a firm ENERGY COMMODITY bid or offer
relating thereto which binds the sender without an additional
express written confirmation to that effect. The information is
intended solely for the individual or entity named above and access
by anyone else is unauthorized. If you are not the intended
recipient, any disclosure, copying, distribution, or use of the
contents of this information is prohibited and may be unlawful. If
you have received this electronic transmission in error, please
reply immediately to the sender that you have received the message
in error, and delete it. Thank you.
From: Karl Groves
Date: Thu, Jan 18 2007 10:00AM
Subject: Re: Usability Testing
← Previous message | Next message →
Dan -
The WebAIM list might not be the most ideal audience for this question. You
may be better off posing it to the list for the STC Usability SIG -
www.stcsig.org/usability/
You're likely to get a wide range of answers. There are companies who have
major in-house usability teams. There are other companies who hire outside
experts. And, there are companies who have teams AND hire outside experts.
There is little difference here between large and big companies. While small
companies almost always hire outside help, so do many large companies. We've
done work for Sprint/Nextel, AOL, US Airways and other multinationals.
As for "how usability is weaved into the development process", that depends
on whether you want to know how it *should* be done, or how it is done. How
it should be done is (briefly) that a qualified Human Factors Engineer
should be present throughout the process all the way from initial
interaction design & IA all the way through to implementation and QA
testing. Unfortunately, it rarely goes that way. Instead, we often find
that most (if not all) of the product has been designed & developed and then
we're asked to come in to do testing on it. The problem in such a situation
is that most of changes we recommend are no longer possible (without
seriously delaying product launch and blowing apart budgets) and any changes
that are made are of such a piecemeal nature that they aren't of much
consequence.
Last, about whether there is "an advantage of using an external vendor": I
say what matters most is the qualifications of the person doing the
usability work, whether they're internal or external. This is not work for
someone whose whole educational in usability is that they read a book or two
from Jakob Nielsen. Unlike Doctors, Lawyers, and Psychiatrists, there is no
external licensing requirement for someone to hang a sign on their door and
call themselves a usability consultant. Therefore you really need to look
closely at their qualifications. First, what is their educational
background? Usability is just another word for Applied Psychology, IMO.
Therefore, you want to find a person with an educational background in
psychology. Look for someone with a graduate degree, particularly if it
involves Human-Computer Interaction and/ or (depending on what the work
entails) ergonomics. Last, look for someone who holds a CHFP certification
from BCPE.
Hope this helps.
Karl L. Groves
User-Centered Design, Inc.
Office: 703-729-0998
Mobile: 443-889-8763
E-Mail: = EMAIL ADDRESS REMOVED =
Web: http://www.user-centereddesign.com
> -----Original Message-----
> From: = EMAIL ADDRESS REMOVED =
> [mailto: = EMAIL ADDRESS REMOVED = ] On Behalf Of
> = EMAIL ADDRESS REMOVED =
> Sent: Thursday, January 18, 2007 9:35 AM
> To: = EMAIL ADDRESS REMOVED =
> Subject: [WebAIM] Usability Testing
>
>
> I am conducting a study on usability testing within companies
> that regard their web presence as critical. I am looking for
> comments and information on how usability is weaved into the
> development process (includes IA), what kind of resources and
> applications are necessary and is there an advantage to using
> an external vendor. If you have experience with any of these
> subjects your thoughts and comments would be appreciated.
>
> Thanks
>
> Dan Chamberlain
> Dominion Resources
> EWG.UXE
> 701 East Cary Street
> Richmond, Virginia 23219
> 804.771.4629
> 8.736.4629
>
>
> -----------------------------------------
> CONFIDENTIALITY NOTICE: This electronic message contains
> information which may be legally confidential and/or
> privileged and does not in any case represent a firm ENERGY
> COMMODITY bid or offer relating thereto which binds the
> sender without an additional express written confirmation to
> that effect. The information is intended solely for the
> individual or entity named above and access by anyone else is
> unauthorized. If you are not the intended recipient, any
> disclosure, copying, distribution, or use of the contents of
> this information is prohibited and may be unlawful. If you
> have received this electronic transmission in error, please
> reply immediately to the sender that you have received the
> message in error, and delete it. Thank you.
>
>
From: Peter Krantz
Date: Thu, Jan 18 2007 10:20AM
Subject: Re: Usability Testing
← Previous message | Next message →
On 1/18/07, = EMAIL ADDRESS REMOVED = < = EMAIL ADDRESS REMOVED = > wrote:
> I am looking for comments and information
> on how usability is weaved into the development process (includes IA), what
> kind of resources and applications are necessary and is there an advantage
> to using an external vendor. If you have experience with any of these
> subjects your thoughts and comments would be appreciated.
>
I have experience from integrating basic accessibility testing in the
automated testing framework in the software development process. In my
experience this is of great help to developers when developing a web
based app. For a brief intro how this can be done in Ruby on Rails see
[1]. Having it as part of the normal automated testing framework
quickly brings inexperienced developers on board.
This of course only covers the basics and there are a lot of things
that you can not test until you have proper content in your
application. However, it does remove all basic errors so that the
final accessibility evaluation can be done more quickly.
When doing a final accessibility evaluation (e.g. as part of
acceptance testing at the end of an iteration) I have found it useful
to use an external company (preferably a specialist) to do the
evaluation. They tend to find more stuff and usually they can work
remotely.
Regards,
Peter Krantz
http://www.standards-schmandards.com/
[1]: See http://www.standards-schmandards.com/2006/accessibility-in-ruby-on-rails/
and http://www.peterkrantz.com/2006/accessibility-in-rails-with-raakt/
RAAKT can of course be used with other software frameworks.
From: Peter Krantz
Date: Thu, Jan 18 2007 10:30AM
Subject: Re: Usability Testing
← Previous message | No next message
On 1/18/07, Karl Groves < = EMAIL ADDRESS REMOVED = > wrote:
> Dan -
>
> The WebAIM list might not be the most ideal audience for this question. You
> may be better off posing it to the list for the STC Usability SIG -
> www.stcsig.org/usability/
>
Ah, and even I read "accessibility" when Dan wrote "usability". Sorry
for my previous reply Dan. It was probably not what you were looking
for.
Regards,
Peter