Uploader User Testing - Round 2 Results

Summary

4 of 5 users found uploading a single file very easy. (DO - included Erin's users in my numbers, AB added mine)
3 of 5 users weren't sure which keys would allow them to select multiple files. (DO - included Erin's users in my numbers, AB added mine)
- A user added files individually and said that's what she did in email too because she "didn't know what controls or things to use"
4 of 5 users did not use the Pause / Remove workflow when told they really didn't want to upload 2 of the files in a big upload. They waited for the files to be uploaded and then removed them from the aTutor interface.
Users are generally quick to recognize multiple files can be uploaded. EY
Users easily recognized the Remove buttons and felt free to use them to remove files (often without pausing), but one user thought they meant "upload didn't work." EY
One user could not initially find the "Browse files" link AB
One user never noticed any confirmation/error messages, and instead confirmed that the files were uploaded in the application's File Manager. AB
3 of 3 users found Uploading a single file very easy JC
3 of 3 users were immediately able to select multiple files and without asking for instructions. JC
2 of 3 users did not use the Pause / remove workflow when attempting to correct file selection task. JC
All users recognized and employed the Remove buttons. JC
- Two users immediately employed the Remove buttons to delete files as the uploads occurred.
- One user initially decided to wait for uploading to finish but when asked to explain why she reconsidered and looked for avenues to remove the files; she immediately employed the Remove button.

Demographics

User Number	Location	Gender	Age	Role	Tech-savvy	Do you own a personal computer?
User 1	Toronto	Female		Undergraduate	Low	Mac
User 2	Toronto	Female		Graduate	Low to medium	PC
User 3	Toronto	Male		Undergraduate	Low to medium	PC
User 4 (RL)	Berkeley	Female	51-60	Staff	N/A	Mac
User 5 (MS)	Berkeley	Male	35-40	Staff	medium	Customized PC
User 6 (JH)	Berkeley	Male	35 - 40	Staff	high	Mac laptop
User 7	Vancouver	Male	19-24	Student	High	PC
User 8	Vancouver	Male	19-24	Student	High	PC
User 9	Vancouver	Female	19-24	Staff	Medium	PC

Do you do any of the following and if so how often?

User	Checking email	Instant message	Shop online	online banking	Internet research	Take class online	Social networking
User 1
User 2
User 3
User 4 (RL)	all the time	hardly ever	a few times a month	all the time	all the time	hardly ever	hardly ever
User 5 (MS)	all the time	hardly ever	a few times a month	never	N/A (Never)	a few times a month	a few times a week
User 6 (JH)	all the time	all the time	a few times a week	a few times a week	all the time	hardly ever	all the time
User 7	all the time	all the time	a few times a month	a few times a month	a few times a month	all the time	all the time
User 8	a few times a week	a few times a week	hardly ever	a few times a month	all the time	a few times a month	hardly ever
User 9	all the time	all the time	a few times a month	a few times a month	never	hardly ever	all the time

Do you upload files on the web and if so how often?

User	Pictures	Media	Documents to course site	Documents to social networking site	Attach a file in email
User 1
User 2
User 3
User 4 (RL)	hardly ever	a few times a week	a few times a month	hardly ever	all the time
User 5 (MS)	a few times a month	a few times a month	N/A (never)	hardly ever	all the time
User 6 (JH)	a few times a month	a few times a month	all the time	a few times a week	all the time
User 7	hardly ever	hardly ever	hardly ever	hardly ever	a few times a month
User 8	a few times a month	a few times a month	a few times a month	hardly ever	all the time
User 9	hardly ever	hardly ever	never	a few times a month	all the time

Interaction Notes

User Number	Previous LMS Experience	Uploading a file	Uploading multiple files	Removing files from queue
User 1	Blackboard	Selected a file > pressed Select > pressed Upload	"I don't know. I would do it one by one" I showed user how to select multiple files. User selected files and clicked Select "And then... none of them worked," looking at the red x's. She quickly realized, "Oh, do I need to press Upload?" "Ones with checkmarks are uploaded."	Pressed the remove buttons to remove files "I wouldn't know how to do it with the check marks or the yellow ones" meaning she wouldn't know how to remove files that are already uploaded or that have failed to upload.
User 2	-	Selected a file > pressed Select > pressed Upload	Clicked Browse Files and selected multiple by pressing shift Pressed Select > Pressed Upload	Pressed remove buttons to remove
User 3	-	"That's it?" User found it extremely straight forward.	With a mouse, clicked and dragged cursor to select multiple files Pressed enter key to select "Oh, that one didn't work," pointing to a yellow warning icon amonst green checkmarks "Pretty easy. Pretty straight forward."	Pressed Pause "Kill the ones I don't want" Pressed Resume "Oh, you can skip ahead and kill the other ones." While the upload was in progress, user scrolled down and removed files in the queue.

NOTE: We changed the tasks after user 3 so we've created a new table for the remainder of testers. See the protocol for the most recent version of tasks.

User	Task 1 - Upload single file	Task 2 - Upload 4 files	Task 3 - Upload/pause/remove	Task 4 - Upload 3 more	Other general comments