Decapod v1 Prototype User Testing Results

Summary

• 5 of 6 users had no problems starting their initial capture task of getting 5 images. The one user who had problems assumed that she had already taken images of her stamps and was looking for an "Import" function, and not "Capture".
• 5 of 6 users used the Zoom and Delete functions.
• 6 of 6 users did not understand what Recapture does. Only 2 users used Recapture to retake the photo but motivation for doing so wasn't based on clear understanding of the function.
• 5 of 6 users understood "Insert Before/After" for reordering items.
• 0 of 6 users used Insert Before / After
• 6 of 6 users had no problems saving. 2 users expected a "Save As" type dialog. 2 users either wanted to see a format option or disclosure of how the file was being saved.
• 6 of 6 exported to PDF without problems, though 3 users wanted to see how it would look. 1 user wondered where it would be saved or if they would be given a download prompt.

Demographics

Do you do any of the following and if so how often?

Do you upload files on the web and if so how often?

Notes

• DR1 was given Academic version of user demographic questionnaire. All other users were given non-Academic version.
• DR1 should be considered as a pre-test subject used to refine this protocol.
• PG1 assumed that all images were already captured and all you had was to connect a camera to the system.

Interaction Notes

First Impressions / Starting First Task

DR1

• Sees blank window area and expects something to show up there.
• Clicks Capture button.

DR2

• No problem capturing 5 images

DR3

• No problems starting tasks and capturing

PG1

• Assuming that camera already had the images you want, it wasn't clear how to get those into the software.
• "Capture" sounds like an active verb that does something, but it doesn't make sense if images already captured on the camera before getting to software.
• Was looking for an "import" scent, but nothing matched that on the interface.
• Capture sounds like it should launch something like Apple Photobooth.
• Says it would help if there was a starting area

PG2

• No problem capturing 5 images from a hypothetical camera, but had a hard time imagining how it would be set up.

Capturing Images

DR1

• After capturing first image, remarks that the thumbnail size implies that can capture multiple images.
• After initial capture, not sure to click "Recapture" or "Insert".
• When asked what she thinks "Insert after" does, user thinks that a thumbnail placeholder is created and a live preview of the capture is displayed in that thumbnail. Then would click "Capture" to freeze the frame.
• Clicks "Insert After" to capture all remaining images.
• Not clear what "Insert Before/After" and "Recapture" all do.
• Does not see a purpose to the big capture button since it seems to be only used at the beginning.
• Not clear what Capture button does - no clear indication on where the image goes after clicking it.

DR2

• When asked to verify quality of the image, uses "Recapture" to replace the version instead.
• Thinks Insert Left and Insert Right reorders items.
• Thinks Recapture button replaces the image in the program's cache.

DR3

• Said it would be nice to be able to insert new captures to where you specify. (See comments)
• clear what buttons do (properly identified them all)
  • however said it'd be confusing if Insert Before/after were by themslves.
• didn't notice Recapture because the Capture button was so big.

• Recapture:
  • Not sure what it does and not sure why you need it if you already have photos imported from your camera.
  • Not sure if recapture will reimport everything and make duplicates or just 1 set of images.

PG1

• Assuming that camera already contains the images you want, clicking a button like "Import" would import all 5 images. Assumes that "Capture" would do this
  • Surprised when only 1 image appeared.
• "Capture" button not clear how it would import images - does it do 1 or more? How do you do more than 1 image?

• Assuming that the image quality is not good, she doesn't think that "Recapture" will do anything different than "Capture" unless there are other options that will change how the capturing is done.
• If image quality is not good, then would either live with it (if the software can't make it better) or take it to photoshop and reimport it.
  • If you fix your image elsewhere, how would you import that?
• "Insert Before / After" - doesn't understand why it's needed because it's easier to delete, capture, and reorder.
  • Thinking some more, says maybe "Insert Before / After" means to add another page to this document?

PG2

• Understood what Recapture meant, but didn't use it because it's easier to capture and reorder.

PG3

• Had no problems doing initial 5 captures, but was confused when asked to add a capture. Wasn't sure if the clicking Capture would clear the current workspace and start a new project with just that image.
• Said that the "Capture" button did most of the work for her.

Recapture

• When asked to add a new image to the workspace, she examined Recapture but not sure what it does.
• Then she said she wasn't sure if she should click "Capture" either because it sounded like it would start a new workspace and lose her work.
• Said that she wasn't sure how the program would know where to insert the new capture. Hope it would add it to the current workspace, but worried that it would insert it into a new document.
• Eventually clicked Recapture instead of Capture because she wanted to retake the last image and it sounded like what she wanted, and didn't want to risk clicking Capture and have her work lost.
• But was baffled how image quality could be better just by recapturing without any adjustments

Insert Before

• Interpreted this as a reordering function. Selected the image she wanted to move to a different spot, but didn't understand how "Insert Before" would know where to move it.
• After some thought realized that you can Drag and Drop.

Deleting Images

DR1

• N/A

DR2

• Deleted and clicked Capture instead of recapture.

DR3

• Deleted and clicked Capture instead of recapture.

PG2

• Confirmation dialog states "Delete Images" even though one is selected. Said would probably click Delete anyway assuming the program would only delete one.
• Said would have missed the Delete button if it wasn't constantly visible because there is always an image selected.

Zoom Images

DR1

• N/A

DR2

• did not notice this function. did not complete task.

PG1

• Used Zoom to examine the image quality and then closed it.
• Asked if you would be able to zoom in and out, and pan.

PG2

• Said would have missed the Zoom button if it wasn't constantly visible because there is always an image selected.

Moving and Navigating Images

DR1

• N/A

DR2

• Uses a combination of mouse Drag and keyboard stroke to move an image.
• Used keyboard instead of "insert before/after" buttons because the tooltip prompted him to do it that way.
• Uses Insert Before and Insert After to move objects. Confused when the system doesn't respond in the way he was expecting (i.e. duplicates of last image was being put to left/right of the selected image, instead of moving the item)
• Did not complete the reorder task because Insert Before/After confusion.

DR3

• Quickly reordered items using mouse into chronological order even before prompting.

PG1

• Had not problems moving images around.

PG3

• Interpreted "Insert Before" as a reordering function. Selected the image she wanted to move to a different spot, but didn't understand how "Insert Before" would know where to move it.
• After some thought realized that you can Drag and Drop.

Saving, Exporting, Quiting

DR1

• Exporting to PDF - not sure why it's there but assumes someone would find it useful.

DR2

• N/A

DR3

• Questions what the PDF will look like. "I would prefer to have 3 across instead of 4".
• Thinks layout on screen is how it will look in the PDF.

PG1

• Seeing that there is an Export to PDF and "Save Project", thinks there should be a way to rearrange the layout of the images on the screen or use a template.
• "Save Project" - not sure what it does at first glance.
  • Does it save to HTML? Does it give you a download?
• "Export PDF" - expects to see a download confirmation.
• Not sure what exported file will look like.

PG3
Save Project

• Expected to be asked where to save the file

Export to PDF

• Expected another screen showing the exported PDF, but said that she could use Acrobat to view it.
• Thinks you can do a selective export. Select 5 of 10 images and export those 5 to PDF.
• Made the anology to Microsoft Word's "Save As" function - specify format and location, and have it just work and show the results.
• For task 5, Wasn't sure if Export to PDF was what she wanted. But decided to use that because Acrobat seemed to be on everyone's computer.

Comments

DR2

• labels on buttons are confusing. Feels that trial and error is the only way to figure out what Insert Before/After does.

DR3

• would like the ability to add labels to images to describe them.
• would like to be able to insert images wherever the mouse cursor is.

PG1

• After seeing the Export to PDF, states that she expects to see extra fields in which you can enter information.
• Saving project without a name was unexpected. Then assumes that somehow you're logged in and it keeps track of it somehow?
• Would like to know how the PDF would look like before exporting.
• Would like to see a dedicated Importing section to dump in images from camera or storage.

PG3

• Was put off by the lack of buttons. Can't explore functionality and discover the right choice for her task.
• Like to see options for fixing an image - brightness/contrast etc.

Issues for Design Improvements (based on testing)

• Main canvas area to have a prompt at start indicating how to begin.
• Clarify the functionality of Insert Before, Insert After.
• Possibly unclear where Capture inserts images.
• Recapture largely ignored. 0 of 3 users used it.
• Recapture functionality is not clear, especially when the Capture button appears to do what they want.
• Unclear what the PDF will look like based on the layout of images on the grid.
• Insert before and after confusing - is it for reordering or capturing? Some users found it easier to DnD instead of using the button. Most users clicked Delete, Capture, then reordered.

User Requests:

• Ability to insert where the cursor is.
• A photobooth type screen for capturing
• Basic photo editing
• View exported PDF before / after exporting
• A "Save As" dialog for saving options.
• "Import" function