Decapod v1 Prototype User Testing Results
Summary
5 of 6 users had no problems starting their initial capture task of getting 5 images. The one user who had problems assumed that she had already taken images of her stamps and was looking for an "Import" function, and not "Capture".
5 of 6 users used the Zoom and Delete functions.
6 of 6 users did not understand what Recapture does. Only 2 users used Recapture to retake the photo but motivation for doing so wasn't based on clear understanding of the function.
5 of 6 users understood "Insert Before/After" for reordering items.
0 of 6 users used Insert Before / After
6 of 6 users had no problems saving. 2 users expected a "Save As" type dialog. 2 users either wanted to see a format option or disclosure of how the file was being saved.
6 of 6 exported to PDF without problems, though 3 users wanted to see how it would look. 1 user wondered where it would be saved or if they would be given a download prompt.
Demographics
User Number | Location | Gender | Age | Job Title | Tech Comfort Lvl | Do you own a personal computer? |
|---|---|---|---|---|---|---|
DR1 | Toronto | Female | 31-35 | Project Engineer | Comfortable | Compaq laptop |
DR2 | Toronto | Male | 25-30 | Software developer / designer | Very comfortable | Desktop |
DR3 | Toronto | Female | 41-50 | Occupational Therapist | n/a | n/a |
PG1 | Toronto | Female | 25-30 | Accessible Software Engineer | Very comfortable | iMac & MacBook |
PG2 |
|
|
|
|
|
|
PG3 | Markham | Female | 25-30 | Order Operation Specialist | Comfortable | Toshiba Tecra |
Do you do any of the following and if so how often?
User | Checking email | Instant message | Shop online | Online banking | Internet research | Take class online | Social networking |
|---|---|---|---|---|---|---|---|
DR1 | All the time | Never | Hardly ever | All the time | Hardly Ever | Hardly Ever | All the time |
DR2 | All the time | All the time | Hardly ever | All the time | All the time | Hardly Ever | All the time |
DR3 | All the time | All the time | All the time | All the time | All the time | A few times a week | All the time |
PG1 | All the time | All the time | Hardly ever | A few times a month | All the time | Never | A few times a week |
PG2 |
|
|
|
|
|
|
|
PG3 | All the time | Never | Hardly Ever | Hardly Ever | A few times a week | Hardly ever | A few times a month |
Do you upload files on the web and if so how often?
User | Picture Sharing | Media | Docs to course site | Docs to soc. ntwkg | File to email |
|---|---|---|---|---|---|
DR1 | A few times a month | Hardly ever | Never | Never | A few times a month |
DR2 | Hardly ever | Hardly ever | Never | Never | All the time |
DR3 | A few times a week | A few times a week | n/a | n/a | n/a |
PG1 | A few times a month | All the time | n/a | Hardly Ever | All the time |
PG2 |
|
| n/a |
|
|
PG3 | A few times a week | Hardly ever | n/a | A few times a month | All the time |
Notes
DR1 was given Academic version of user demographic questionnaire. All other users were given non-Academic version.
DR1 should be considered as a pre-test subject used to refine this protocol.
PG1 assumed that all images were already captured and all you had was to connect a camera to the system.
Interaction Notes
First Impressions / Starting First Task
DR1
Sees blank window area and expects something to show up there.
Clicks Capture button.
DR2
No problem capturing 5 images
DR3
No problems starting tasks and capturing
PG1
Assuming that camera already had the images you want, it wasn't clear how to get those into the software.
"Capture" sounds like an active verb that does something, but it doesn't make sense if images already captured on the camera before getting to software.
Was looking for an "import" scent, but nothing matched that on the interface.
Capture sounds like it should launch something like Apple Photobooth.
Says it would help if there was a starting area
PG2
No problem capturing 5 images from a hypothetical camera, but had a hard time imagining how it would be set up.
Capturing Images
DR1
After capturing first image, remarks that the thumbnail size implies that can capture multiple images.
After initial capture, not sure to click "Recapture" or "Insert".
When asked what she thinks "Insert after" does, user thinks that a thumbnail placeholder is created and a live preview of the capture is displayed in that thumbnail. Then would click "Capture" to freeze the frame.
Clicks "Insert After" to capture all remaining images.
Not clear what "Insert Before/After" and "Recapture" all do.
Does not see a purpose to the big capture button since it seems to be only used at the beginning.
Not clear what Capture button does - no clear indication on where the image goes after clicking it.
DR2
When asked to verify quality of the image, uses "Recapture" to replace the version instead.
Thinks Insert Left and Insert Right reorders items.
Thinks Recapture button replaces the image in the program's cache.
DR3
Said it would be nice to be able to insert new captures to where you specify. (See comments)
clear what buttons do (properly identified them all)
however said it'd be confusing if Insert Before/after were by themslves.
didn't notice Recapture because the Capture button was so big.
Recapture:
Not sure what it does and not sure why you need it if you already have photos imported from your camera.
Not sure if recapture will reimport everything and make duplicates or just 1 set of images.
PG1
Assuming that camera already contains the images you want, clicking a button like "Import" would import all 5 images. Assumes that "Capture" would do this
Surprised when only 1 image appeared.
"Capture" button not clear how it would import images - does it do 1 or more? How do you do more than 1 image?
Assuming that the image quality is not good, she doesn't think that "Recapture" will do anything different than "Capture" unless there are other options that will change how the capturing is done.
If image quality is not good, then would either live with it (if the software can't make it better) or take it to photoshop and reimport it.
If you fix your image elsewhere, how would you import that?
"Insert Before / After" - doesn't understand why it's needed because it's easier to delete, capture, and reorder.
Thinking some more, says maybe "Insert Before / After" means to add another page to this document?
PG2
Understood what Recapture meant, but didn't use it because it's easier to capture and reorder.
PG3
Had no problems doing initial 5 captures, but was confused when asked to add a capture. Wasn't sure if the clicking Capture would clear the current workspace and start a new project with just that image.
Said that the "Capture" button did most of the work for her.
Recapture
When asked to add a new image to the workspace, she examined Recapture but not sure what it does.
Then she said she wasn't sure if she should click "Capture" either because it sounded like it would start a new workspace and lose her work.
Said that she wasn't sure how the program would know where to insert the new capture. Hope it would add it to the current workspace, but worried that it would insert it into a new document.
Eventually clicked Recapture instead of Capture because she wanted to retake the last image and it sounded like what she wanted, and didn't want to risk clicking Capture and have her work lost.
But was baffled how image quality could be better just by recapturing without any adjustments
Insert Before
Interpreted this as a reordering function. Selected the image she wanted to move to a different spot, but didn't understand how "Insert Before" would know where to move it.
After some thought realized that you can Drag and Drop.
Deleting Images
DR1
N/A
DR2
Deleted and clicked Capture instead of recapture.
DR3
Deleted and clicked Capture instead of recapture.
PG2
Confirmation dialog states "Delete Images" even though one is selected. Said would probably click Delete anyway assuming the program would only delete one.
Said would have missed the Delete button if it wasn't constantly visible because there is always an image selected.
Zoom Images
DR1
N/A
DR2
did not notice this function. did not complete task.
PG1
Used Zoom to examine the image quality and then closed it.
Asked if you would be able to zoom in and out, and pan.
PG2
Said would have missed the Zoom button if it wasn't constantly visible because there is always an image selected.
Moving and Navigating Images
DR1
N/A
DR2
Uses a combination of mouse Drag and keyboard stroke to move an image.
Used keyboard instead of "insert before/after" buttons because the tooltip prompted him to do it that way.
Uses Insert Before and Insert After to move objects. Confused when the system doesn't respond in the way he was expecting (i.e. duplicates of last image was being put to left/right of the selected image, instead of moving the item)
Did not complete the reorder task because Insert Before/After confusion.
DR3
Quickly reordered items using mouse into chronological order even before prompting.
PG1
Had not problems moving images around.
PG3
Interpreted "Insert Before" as a reordering function. Selected the image she wanted to move to a different spot, but didn't understand how "Insert Before" would know where to move it.
After some thought realized that you can Drag and Drop.
Saving, Exporting, Quiting
DR1
Exporting to PDF - not sure why it's there but assumes someone would find it useful.