Mobile user testing, Draft 8, User 4 McCord (December 3, 2009)

Demographic info

Gender

F

Age

30-39

Occupation

Museum staff - Project Manager, Exhibitions

Comfort level with technology

Somewhat comfortable

Museum experience - frequency of visits

Regularly (at least once a month)

Has used a museum mobile app?

No

If yes, which museum? How was your experience?

n/a

Owns an internet-enabled mobile device?

No

Mobile device - frequency of use (all purposes)

n/a

Mobile device - frequency of use (internet app)

n/a

Pre-visit scenario

Task: Deciding whether or not to go to the museum that week
 - Home page > News > Today Event
 - Home page > Exhibitions > Simply Montreal
User comments about this task:
 - Confused by the text in the language selection interface : "Your language selection can be changed at any time by going to 'More' on the bottom..." i don't see the more button.
- "I don't like having to go back to home to get to language selection; would like to be able to switch language directly on each page"
- Clicks on 'event today' label in the exhibit list, nothing happens : "There must be a problem with the application"

Task: What do you do to learn about the exhibitions that are on right now?
- Home page > Exhibitions > Exhibits
User comments about this task :
 - "Are there links to other web resources? (links to external sites, museum site)"
 - Gets lost when view viewing the About exhibit page :  "This page feels like a dead-end. Not good" (does not understand why the other panels have disappeared) Description text should be expanded in same interface instead of a different page (About exhibit).
 - Not sure about "Catalogue" as a choice of label. Evoques a book, not an entry point to the exhibit. Does not feel like the point of entry to the exhibit. Does not feel important enough (put in first position? - In Catalogue : "No description for sections? Just Headings?"

Task: Find out more about an exhibition you're interested in
 - Home page > Exhibitions > Simply Montreal

Task: How much will it cost you to see the exhibition?
 - Home page > Visitor Information

Task: What sorts of artifacts, objects, or works are in that exhibition?
 - Exhibition > Catalogue > Sections > Section > Artifacts
User comments about this task:
- "The mosaic display mode of the exhibit sections is much clearer than list mode"

Task: Suppose you find a few artifacts that are really interesting that you want to make sure you see when you get there. How would you remember to do this?
 - Artifact page : Collect
User comments about this page
 - "Oh, I see, it's like a shopping cart"
 - "Does My Collection stay on the device?"
 - After being explained that My Collection is sent by email : "So, before i leave the museum (and returning the device), i have to make sure to save My Collection?"

Task: Can you find out what others thought about the exhibition?
 - Exhibit page > Guestbook
 - Exhibit page > What other visitors enjoyed
User comments about this task:
 -  "What's 'M.E.'?" (Next to a comment)
 - "I really like the 'also enjoyed' feature"
 -  Looking at artifacts other visitors also enjoyed : "Are all these objects currently on display? Or from the collection?"

Task:  What events are coming up related to that exhibition?
 - Exhibit page > Events

Task: How do you find out more about the museum? e.g., where it is, and what time it opens and closes, and how much it costs.
 - Home page > Visitor Information

In-museum scenario

Task: Suppose you want to see whether there are any events happening today. How do you go about doing this?

Task: How do you go about finding the artifacts you bookmarked from your pre-visit?
 - Home page > My Collection

Task: You are walking through one of the exhibitions, and find a particularly interesting object that captures your attention. Intrigued by the object, how do you go about learning more about it?

Task: How would you go about finding more about the object using the mobile device?
 - No idea. After hint : Home page : Enter Object Code
User comments about this task:
 - "I don't understand what 'Enter Object Code' is / does"
 - "Enter Object Code interface is missing the back / home buttons"
 - "Don't like the label (Enter Object code)...not clear. Should indicate link to artifacts in galleries,since it can only be used to lookup artifacts in galleries"

Task: Now that you've found the object and have read a bit more about it, you want to mark it somehow so you can come back to it in the, maybe at home. How would you do this?
 - Artifact page > collect
user comments about this task:
 - "How do i uncollect an object? Should be able to do it from My Collection without the extra click."

Task: The object reminds you of something, and you decide to share a note about it for other visitors or potential visitors to read. How would you do this?
 - Artifact page > Guestbook : Add Comment
User comment about this task:
 - "The 'Add comment' button is easy to miss (gray on gray). You should repeat  it at the bottom of the list of comments"

Task: You're really interested in this object, and would like to see other objects related to it. How do you go about doing this?
 - Artifact page > related object

Task: Is there anything you can listen to or watch about this artifact? How would you go about doing that?
 - Artifact page > Audio / Video >  Clip

Task: Is there more than one image you can look at on this artifact? How would you go about doing?
 - Artifact page > left / right arrow
User comments about this task:
 - At first glance, not sure if left/right arrows are used to navigate to previous / next object in list or alternate views of current object
- "There are no indication on the number of alternate views available"
- "What about including thumbnails of the view (à la Youtube), or show that there are images under the image currently displayed (stacked images effect)"

Task: Suppose you the image is too small. How would you go about seeing this artifact, but bigger?
  - No idea.
User comments about this task:
  - "I can't tell if the image is zoomable or not - no idea how I would go about to zoom the image"

Task: This object is really exciting, and you want to somehow share the experience with your friends. What do you do?
 - Artifact page > send

Post-visit scenario

Task: How would you go about finding the objects you collected?
- Home page > My Collection

Exit questionnaire

How was your overall experience using this application?

  • Didn't like it - needs improvements

What would *you* use this application for? Choose as many as are appropriate.

  • Plan a visit
  • Research
  • Entertainment
  • Education/Learning

What sorts of features or functionality would you have liked to see in a mobile app like this? (e.g., what's missing?)
 - An exhibit map showing where the sections are physically

What would you have changed in this app? (e.g., what can be improved? What would make it more fun or engaging?)
 - Add an entry point to podcasts directly from home page
 - Include predefined 'tours' (ex: by theme)

How useful do you think it is to "collect" artifacts, objects, and paintings?

  • Useful

How useful do you think it is to see artifacts, objects, and paintings other people "collected"?

  • Not Very Useful

How useful do you think it is to tag artifacts, objects, and paintings?

  • Not Very Useful

How useful do you think it is to see the tags of artifacts, objects, and paintings?

  • Not Very Useful

How useful do you think it is to comment on exhibits?

  • Useful

How useful do you think it is to read comments other visitors left for exhibits?

  • Not Very Useful

How useful do you think it is to comment on artifacts, objects, and paintings?

  • Useful

How useful do you think it is to read comments other visitors left for artifacts, objects, and paintings?

  • Useful