[Sigia-l] Where Can You Rent User Testing Labs

[Amy Kahn]

I agree with you here; on-site testing is generally best. However, in
the interest of budget and time, this is a reliable, tested method of
off-site testing. Different animal altogether.

One more thing - using a tool like IRC provides realtime feedback. As a
user is completing a task, he is encouraged to comment then and there,
rather than waiting for an exit interview. I see this as a huge
advantage.

On Thu, 2003-04-24 at 10:35, Todd R. Warfel wrote:
> Does this rise any concerns about the reliability of the test data? 
> What about the inability to actually observe user behavior via this 
> method? How does the data from this differ from giving the user a 
> survey after they've completed a task.
> 
> I can see a major difference between this method on the traditional 
> method of on-site with video-taping. One of the biggest differences is 
> that the IRC method simply doesn't allow you to observe what the user 
> is doing reliably. You're relying on their interpretation of what's 
> going on, vs. actually observing what they're doing.
> 
> I think you can get some useful data from the IRC data, but I don't 
> think you can get near the amount, nor as reliable data as using a 
> traditional method of observation plus an exit interview afterwards.
> 
> Thoughts?
> 
> On Thursday, April 24, 2003, at 10:22 AM, Amy Kahn wrote:
> 
> > I'm surprised that no one has mentioned a free solution to 
> > accomplishing
> > the communication needs of such a task. Rather than using voice
> > conferencing, I use a text tool like IRC (Internet Relay Chat) in order
> > to communicate steps to users and get feedback. For years I've used 
> > this
> > tool for remote usability testing, and it has worked out beautifully.
> 
> Cheers!
> 
> Todd R. Warfel
> 
> _//message first [method second]
> -=========================-
> User Experience Consultant
> message first
> [P] (607) 339-9640
> [E] twarfel at messagefirst.com
> [w] http://messagefirst.com
> -=========================-
> 
> In theory, theory and practice are the same,
> but in practice, they're not.
Amy Kahn
home: (617) 879-0064
1572 Beacon St, Apt 2
cell: (646) 234-8109
Brookline, MA 02446

http://www.amykahn.com/

"Things should be made
as simple as possible,
but not any simpler."
-Albert Einstein