[Sigia-l] Straw Poll: User Test Follow-up

[Bill Killam]

You can't do either if you're trying to get the performance data to speak
for itself.  If you use the same users, their knowledge of the previous
design would bias any results.  If you use new users, your numbers are too
small to make any claims with reasonable confidence.   So, no matter how you
approach it you're doing qualitative testing not quantitative testing.  

But, since it is qualitative, use whatever 10 are available.  Then, rely on
your judgment, not the numbers.

Bill
-------------------------------------------------------
Bill Killam, MA CHFP
President, User-Centered Design, Inc.
20548 Deerwatch Place
Ashburn, VA 20147
email: bkillam at user-centereddesign.com
Work/Fax: (703) 729-0998
Mobile: (703) 626-6318
Web: www.user-centereddesign.com


-----Original Message-----
From: sigia-l-bounces at asis.org [mailto:sigia-l-bounces at asis.org] On Behalf
Of Billie Mandel
Sent: Wednesday, September 27, 2006 6:14 PM
To: sigia-l at asis.org
Subject: [Sigia-l] Straw Poll: User Test Follow-up


Hey folks - 

So I did a round of benchmark user testing to see how long it took a
group of users to do a set of tasks using an existing application.  Then
I designed and deployed that application's replacement.  Now I'm going
to re-run the tests and see how I did. 

I was intending to run the second set of tests with the same ten users.
Only problem is, four out of the six are no longer with the company.  

Straw poll of the day: 
Would you a) run the follow-up test with the six users from the first
round and supplement that with four new ones, or b) get ten new users? 

Thanks!
- Billie

**********
Billie Mandel
Principal Information Architect
Openwave Systems Inc.
tel: (650) 480-6759
e: billie.mandel at openwave.com

------------
When replying, please *trim your post* as much as possible.
*Plain text, please; NO Attachments

Searchable Archive at http://www.info-arch.org/lists/sigia-l/

Most presentations/papers and posters have been loaded to the IA Summit 06
website:

http://iasummit.org/2006/conferencedescrip.htm
http://iasummit.org/2006/posters.htm



________________________________________
Sigia-l mailing list -- post to: Sigia-l at asis.org
Changes to subscription: http://mail.asis.org/mailman/listinfo/sigia-l