I’m in the middle of planning both some mobile test sessions (to test both installed mobile apps and SMS-based apps) and some ethnographic research in the mobile “space”, and so I have some ideas on how to do these projects that may be of some use to you, dear reader. Here they are…
First, prescreen your test participants. You need to know that they actually are capable of using the mobile devices that they own before you test. If you don’t do this for your test subjects, you may get a participant who has no clue as to how they can use their device beyond the basic function they do every day. If you don’t prequalify, you will get some “noise” in your test data that may make the whole session with that person worthless.
Second, test participants with the devices they are accustomed to. You don’t want to test an iPhone app with someone who is currently using a flip-phone… nor do you want to test an SMS-based application with someone who has never done any text messaging. Again, you want to make sure the results and feedback received are accurate and appropriate.
Third, capture EVERYTHING. I’m a big fan of Morae from TechSmith, an app designed to record and analyze usability tests, and the latest version supports two video sources. The setup is simple: Use two cameras, one that is on a mounted tripod pointed down at the device, and the second monitoring the participant. Morae captures both video signals and records them, as well as transmitting the video of the session to a notetaker via your work network.
Fourth, get a sense of how people actually use their mobile devices. Asking them what they do with their phones allows you to get a better sense of the priorities and features the user needs and provides valuable context as to your product or design goals.
Finally, when in doubt, consult the experts. A UX peer of mine Barbara Ballard runs Little Springs Design, a company that specializes in the mobile space. If you think you need help, she’s a good person to call.
Follow Joseph Dickerson on Twitter.
{ 2 comments… read them below or add one }
I also use Morae to capture this type of setup. What types of cameras do you use? Also, have you found a way to increase the video size in Morae Observer when you are using a camera as the main screen capture?
I use a mini-DV camcorder that is setup through a Firewire PCMCIA card on the laptop I use. I always capture the video from the camcorder as the primary screen, so I don’t need to resize it…
You must log in to post a comment.
{ 1 trackback }