PCP-MM test protocol for third pilots

Specific questions and prompts for each page would be the following (these may need some refinement):

Auto-Configuration (pages 1-3):

  1. Ask the user what they would expect each option would do (undo all, help, close)
    1.     (if they miss any of the options, make note of this)
    2.     What would they do if they didn't like the way their preferences had been applied?
  2. Ask the user what they would expect selecting the i icon would do
  3. (i icon is selected)
    1.     Ask the user what they expect selecting each option would do (try different, feedback, help, close)
    2.     (if they miss any of the options, make note of this)
    3.     What would they do if they didn't like this setting?

      Recommendations (pages 4-6):
  4. Context: this message would appear automatically when the environment becomes dark
    1.     Ask the user what they would expect each option would do (try it out, help, cancel)
    2.     (if they miss any of the options, make note of this)
  5. (try it out is selected)
    1.     Ask the user what they would expect selecting the i icon would do
    2.     What would they do if they decided they didn't like this setting?
  6. (i icon is selected)
    1.     Ask the user what they expect selecting each option would do (always do this/never do this/not right now, help, feedback, close)
    2.     (if they miss any of the options, make note of this)
    3.     What would they do if they decided they didn't like this setting?    
    4.     What would they do if they really liked this setting?

In general:

  • would they recommend different text labels for any of the buttons or links?
  • was there anything that was confusing?
  • what did they like about the interface? which parts were clear to them?
  • do they think there is any missing functionality? (anything they might want to do but couldn't)?