(Floe) UI Options user testing protocol (March 2011)

Owned by Emily Servais
Last updated: Jun 28, 2012 by James YoonVersion comment
3 min read

Methodology

Session structure

The session is composed of three parts:

1. User testing
   a. Undirected, "reality" testing
   b. Task-based testing
2. Post-test interview
3. Post-test questionnaire

Data gathering

Data for user testing will be gathered using the following tools:

Data for the post-test interview will be gathered using the following tools:

0. Protocol Introduction

General things to keep in mind for the test

  • Reassure the user that we are not testing the user--we are testing the designs, and there are no wrong answers.
  • Ask the user to think aloud.
  • Don't offer help; let the user attempt to perform the task themselves. If they ask for help reply with:
    • "What do you think you/that would do?"
    • "What do you think that means?"

Greeting script

1. User Testing

Part A: Reality Testing

Part B: Directed Tasks

Instructions for user (script)

Now we'll be asking you to complete a few tasks using the prototype application. As before, please speak your thoughts aloud. Let us know what pops out at you first, what you're looking at, what you're reading, what you think the different parts of the panel do, what you're expecting to happen, what options you're thinking of and how you come to your decision. Let us know if anything seems awkward or doesn't seem to flow the way you'd expect or want it to.

Instructions for moderator

From the full task list, ask user to complete tasks that weren't completed during the reality testing step. You may also want to repeat a task you missed observing during reality testing.

Task List

Find the UI options panel.
You would like to modify the appearance of the page you are viewing. Where would you do this?

Open the UI options panel.
Go ahead and open the display preferences.

Find and change the text size.
You would like to increase the size of the text. How would you do this?

Find and change the text style.
How would you change the font?

Find and change the line spacing.
How would you double-space the page?

Find and change the contrast.
You would like to increase the contrast of the text against the background. How would you do this?

Convert the page to a simple layout.
How would you change the page to display as a single column?

Show the table of contents.
How would you modify the page to include a table of contents at the top?

Emphasize the links.
How would you make the links on the page more prominent?

Make the buttons and other inputs larger.
How would you increase the size / visibility of the buttons on the page?
How would you increase the size of the drop-down menus on the page?
How would you make the text larger?

Reset all.
How would you return the page display options to their default settings?

Preview window.
Change the font and then view it in the preview window.

Hide user interface options panel.
How would you collapse the display preferences panel?

Close user interface panel.
How would you close the display preferences panel and apply the changes you made to the page you came from?

Close user interface panel without saving.
How would you close the display preferences panel without applying the changes you made?

2. Post-Test Interview

  1. Did you have any difficulty finding the display preferences panel?
  2. Did you find the preview window useful?
  3. Did you find any of the terminology confusing or misleading?
  4. What did you think of the layout of the display preferences panel?
  5. What can we do to improve the display preferences panel?
  6. Are there any options missing that you feel should be included?

3. Post-Test Questionnaire (Demographics)

Finishing Up

Ask the user if he/she has any questions, thank the user for participating, and give an honorarium if we have one.