User Interface Options - Round 1 protocol

User Interface Options - Round 1 protocol

Supporting Materials:

Greeting script

User Testing Greeting Script

User Testing Demographic Questionnaire

Scenarios

Persona/Role

You're an English professor at the University of Toronto. The university community has just launched a new online dashboard that you use to access the university's services. Today you received an email from IT services telling you to log on to the dashboard, and inviting you to personalize its look and feel. 

Tasks

0. The Webpage you are looking it is called a dashboard. Please take a minute to familiarize yourself with the dashboard.

1. When you are ready, please show me how you would change the way your dashboard looks.

2. [When the user has customized the appearance] Now that you've made these changes, please imagine you no longer like the way your dashboard looks. How would you go about changing this?

3. [If the task hasn't been done] Show me how you would change the font sizes.

4. [If the task hasn't been done] How would you make the textfields bigger?

5. Go ahead and make any other changes you'd like to the appearance of the page.

Notes for Test Coordinator

Offering help during the test

Don't offer help; let the user attempt to perform the task themselves. If they ask for help reply with:

  • "What do you think you/that would do?"

  • "What do you think that means?"

You want to observe whether the user has trouble:

  • Previewing changes they make to the UI

  • Saving changes they make to the UI

  • Locating the "edit appearance"

  • Using both the "Easier to see" and "Easier to find" options

Post-test questions

  1. How easy or difficult was it for you to determine how you could edit the look and feel of the dashboard?

  2. [if relevant] How easy or difficult was it for you to change the font size, style, and contrast of the dashboard?

  3. Did you notice a way that you could preview your changes? 

  4. How easy or difficult was it for you to save changes you made?

  5. Where there any preferences you would have liked to change, but couldn't find?

  6. What UI options were helpful to you?

  7. Did you enjoy using UI Options? Is there anything you would like to improve?