Need to do some mobile testing? Here are some ideas…
I’m in the middle of planning both some mobile test sessions (to test both installed mobile apps and SMS-based apps) and some ethnographic research in the mobile “space”, and so I have some ideas on how to do these projects that may be of some use to you, dear reader. Here they are…
First, prescreen your test participants. You need to know that they actually are capable of using the mobile devices that they own before you test. If you don’t do this for your test subjects, you may get a participant who has no clue as to how they can use their device beyond the basic function they do every day. If you don’t prequalify, you will get some “noise” in your test data that may make the whole session with that person worthless.
Second, test participants with the devices they are accustomed to. You don’t want to test an iPhone app with someone who is currently using a flip-phone… nor do you want to test an SMS-based application with someone who has never done any text messaging. Again, you want to make sure the results and feedback received are accurate and appropriate.
Third, capture EVERYTHING. I’m a big fan of Morae from TechSmith, an app designed to record and analyze usability tests, and the latest version supports two video sources. The setup is simple: Use two cameras, one that is on a mounted tripod pointed down at the device, and the second monitoring the participant. Morae captures both video signals and records them, as well as transmitting the video of the session to a notetaker via your work network.
Fourth, get a sense of how people actually use their mobile devices. Asking them what they do with their phones allows you to get a better sense of the priorities and features the user needs and provides valuable context as to your product or design goals.
Finally, when in doubt, consult the experts. A UX peer of mine Barbara Ballard runs Little Springs Design, a company that specializes in the mobile space. If you think you need help, she’s a good person to call.
