Decapod v5 Prototype User Testing Protocol

Owned by Jonathan Hung
Last updated: Jun 15, 2011Version comment
3 min read

Before you start

1. Greeting script

User Testing Greeting Script

Hi [user's name]. I'm [your name(s)] with the [project name]. The [project name] is [project description]. Today we are looking for ways to improve the user experience of [name of item being tested ]. This is a test of the component; we are not testing you. If you find something difficult to use, chances are that others will as well, so your feedback helps everyone. This test of the component is simply a means of evaluating the component's design and to discover any issues we need to address.

If you feel uncomfortable you can stop at any time during the study.

Please speak all your thoughts aloud as you go through the tasks. This helps us better understand why you are making certain choices. The study will take about [XX] minutes. We will answer any questions you have at the end of the study.

First we'll need you to sign this Consent Form. [If doing video or audio recording you will want to mention this ]. Information gathered today will only be used for research purposes, and will be kept secure. Published results of this study will be compiled with other participants and any specific references to participants will be done anonymously. Your privacy is our priority.

Do you have any questions?

Let's get started!

Encourage the participant to:

  1. Think out loud.
  2. Reinforce the idea they are help testing the design, rather than us testing them. There is no right or wrong way.

2. User Testing Demographic Questionnaire & Consent

Set up Test Area

Set up the test area with the Camera test area on one side and the Prototype test area next to it.

3. Scenario: Capture Images

Script: "You have discovered old postcards belonging to a lost, but well-traveled relative. You would like to share the postcards with family members around the world, but sending around the originals would be impossible because the paper is old and fragile.

You heard about the "Image Capture System" and would like to use it create an electronic copy that you can email.

You install Image Capture System onto your computer, and attach the cameras to your system as stated in the instructions. You gather the postcards, launch the program, and settle in to do work."

Tasks

Script: "For these tasks assume the cameras are attached to your computer and that the software understands how to use them. The camera is sitting on a tripod and would be standing in this area (indicate the area marked for the camera)."

For each task:

  1. Ask participant to describe what they think they should do before actually doing it.
  2. Then ask them to step-through their approach.
  3. Then ask them to give their impressions of how they found the experience of completing that task.
  • Task 1 Photograph a postcard.
  • Task 2 Examine the photograph to determine that the level of detail is good enough.
  • Task 3 Photograph 15 more postcards.
  • Task 4 Examine the photographs to determine that the level of detail is good enough.
  • Task 5 You realize that your hand is covering part of the 12th photograph. Replace that photo with a better one.
  • Task 6 You are done taking photos of the postcards. Now you would like to create an electronic copy that you can email.

Notes for Test Coordinator

Offering help during the test

Don't offer help; let the user attempt to perform the task themselves. If they ask for help reply with:

  • "What do you think you/that would do?"
  • "What do you think that means?"
  • "What do you think should happen?"

You want to observe:

  • How the user identifies how they begin capturing images
  • How they discover the collapsing and expanding the interface areas
  • Find out how they discovered this functionality:
    • If they use any of the options for thumbnails or capturing
    • If they use the automatic capture option for capturing 15 images in Task 3.
    • If they use the Zoom All option for examining the images in Task 4.
  • Do they use any of the keyboard shortcuts?
  • Do they have any problems deleting, recapturing, zooming, or inserting images?

5. Post-test questions (ask these verbally)

  1. Was it obvious how to begin your tasks?
  2. Was it clear how to add images into the program?
  3. Did you find the available options helpful? If you did not use the options, why not?
  4. Was the expanding/collapsing screen useful or not?
  5. Was there anything the program did that was unexpected?

References:

Results