PCP-MM test protocol for third pilots
Specific questions and prompts for each page would be the following (these may need some refinement):
Auto-Configuration (pages 1-3):
- Ask the user what they would expect each option would do (undo all, help, close)
- (if they miss any of the options, make note of this)
- What would they do if they didn't like the way their preferences had been applied?
- Ask the user what they would expect selecting the i icon would do
- (i icon is selected)
- Ask the user what they expect selecting each option would do (try different, feedback, help, close)
- (if they miss any of the options, make note of this)
- What would they do if they didn't like this setting?
Recommendations (pages 4-6):
- Context: this message would appear automatically when the environment becomes dark
- Ask the user what they would expect each option would do (try it out, help, cancel)
- (if they miss any of the options, make note of this)
- (try it out is selected)
- Ask the user what they would expect selecting the i icon would do
- What would they do if they decided they didn't like this setting?
- (i icon is selected)
- Ask the user what they expect selecting each option would do (always do this/never do this/not right now, help, feedback, close)
- (if they miss any of the options, make note of this)
- What would they do if they decided they didn't like this setting?
- What would they do if they really liked this setting?
In general:
- would they recommend different text labels for any of the buttons or links?
- was there anything that was confusing?
- what did they like about the interface? which parts were clear to them?
- do they think there is any missing functionality? (anything they might want to do but couldn't)?