[Sigia-l] Where Can You Rent User Testing Labs

[Todd R.Warfel]

Does this rise any concerns about the reliability of the test data? 
What about the inability to actually observe user behavior via this 
method? How does the data from this differ from giving the user a 
survey after they've completed a task.

I can see a major difference between this method on the traditional 
method of on-site with video-taping. One of the biggest differences is 
that the IRC method simply doesn't allow you to observe what the user 
is doing reliably. You're relying on their interpretation of what's 
going on, vs. actually observing what they're doing.

I think you can get some useful data from the IRC data, but I don't 
think you can get near the amount, nor as reliable data as using a 
traditional method of observation plus an exit interview afterwards.

Thoughts?

On Thursday, April 24, 2003, at 10:22 AM, Amy Kahn wrote:

> I'm surprised that no one has mentioned a free solution to 
> accomplishing
> the communication needs of such a task. Rather than using voice
> conferencing, I use a text tool like IRC (Internet Relay Chat) in order
> to communicate steps to users and get feedback. For years I've used 
> this
> tool for remote usability testing, and it has worked out beautifully.

Cheers!

Todd R. Warfel

_//message first [method second]
-=========================-
User Experience Consultant
message first
[P] (607) 339-9640
[E] twarfel at messagefirst.com
[w] http://messagefirst.com
-=========================-

In theory, theory and practice are the same,
but in practice, they're not.