Layout Reorderer User Testing - Round 3 Results
Summary
4 of 4 users were able to drag and drop portlets. The one user who took a longer time to realize she could do this (and she did eventually do it) was confused by the task.
1 user suggested that when mousing over a movable portlet it might be helpful for it to say "click & drag to move."
4 of 4 users understood what a locked portlet was
Performance was markedly improved
Demographics
User Number | Location | Gender | Age | Role | Tech-savvy | Do you own a personal computer? |
|---|---|---|---|---|---|---|
User 1 (BF) | Berkeley | Female | 41-50 | Staff | Medium | Yes, Macbook |
User 2 (AL) | Berkeley | Male | 19-24 | Student | Medium-high | Yes, Toshiba laptop (PC) |
User 3 (JV) | Berkeley | Female | 19-24 | Student | Medium | laptop, windows XP |
User 4 (DB) | Berkeley | Female | 51-60 | Staff | Medium-low | Yes, a PC |
User 5 | | | | | | |
User 6 | | | | | | |
User 7 | | | | | | |
Do you do any of the following and if so how often?
User | Checking email | Instant message | Shop online | Online banking | Internet research | Take class online | Social networking |
|---|---|---|---|---|---|---|---|
User 1 | All the time | All the time | All the time | All the time | N/A | A few times a month (webinar) | No answer |
User 2 | All the time | A few times a month | A few times a month | A few times a month | A few times a week | Hardly ever | A few times a week |
User 3 | All the time | A few times a month | Hardly ever | A few times a month | A few times a week | Never | A few times a week |
User 4 | All the time | Hardly ever | A few times a month | All the time | A few times a month | A few times a month | A few times a week |
User 4 | | | | | | | |
User 5 | | | | | | | |
User 6 | | | | | | | |
User 7 | | | | | | | |
Do you upload files on the web and if so how often?
User | Pictures | Media | Docs to course site | Docs to soc. ntwkg | File to email |
|---|---|---|---|---|---|
User 1 | Hardly Ever | Never | Never | Hardly Ever | All the time |
User 2 | A few times a month | Hardly Ever | Never | Hardly Ever | A few times a week |
User 3 | A few times a week | A few times a month | Hardly ever | Never | All the time |
User 4 | A few times a week | Hardly ever | Never | Hardly Ever | All the time |
User 5 | | | | | |
User 6 | | | | | |
User 7 | | | | | |
Interaction Notes
User Number | Previous LMS Experience | Task 1 - Move a particular box/portlet | Task 2 - Change the placement of other boxes/portlets | Task 3 - Deal with a Locked box | Task 4 (if not done already) - drag and drop a portlet | General comments |
|---|---|---|---|---|---|---|
User 1 | | The Announcements portlet wasn't there as it should have been, so we had the user move the Weather portlet. User seems to have thought we wanted her to move it to another tab, as she said "I never customize the tabs." Daphne had to explain that we wanted her to "move that box" to make it clear what we wanted. She had no problem dragging and dropping the box, but still didn't think that's what we wanted. She didn't understand at first that when you moved a box to a new spot, the box underneath it moved down--she was looking for this box for a bit and couldn't find it. | She had no trouble dragging and dropping portlets, but she still wanted to interact with the tabs. She tried "Add content" and "Add tab." She said "I would put my bookmarks under a tab; I wouldn't put them up front." | She dragged the portlet way up to the upper left and read the pop-up message. Then she said, "What's considered a locked box?" She realizes "Welcome" is locked when she sees the lock icon and quickly realizes she can't move the Bookmarks portlet up any higher because of it. | She had no problem moving the image lightbox down. | |
User 2 | | Scrolls down to Weather and drags and drops it with no problem. Says it's similar to the Facebook interface. | Tries to drag Weather up. Moves Bookmarks to the left. Moves Image Gallery to the right and there's a little weirdness when he tries to move it to a space where there is no portlet - he can't drop it. | Tries to drag there two times, then quickly sees that it's locked. Tries to click on the word "Welcome" in the portlet header to unlock it. | Easily performs this task. | |
User 3 | | Easily drags and drops the portlet right away. Tries to put it on a locked portlet and fails so moves it to upper right. Says right away, "I didn't see this lock so I tried to put this on top of it. Now the lock makes sense." | Calendar drags a little jerkily as she moves it up, but she still has no problem moving it. |