Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Aside:

  • The original design was to only fire alerts when certain thresholds were passed. In the dev version alerts are being fired regardless whether a threshold was transitioned
  • Pauses between text alert messages makes people think that's all there is.

...

  • 3:00 - appears to be having problems figuring out that focusing on the magnet is where you begin.
    • looking through the PDOM multiple times, and the Control Area, but can't find where to begin.
  • 4:10 - comments about missing something
  • 5:30
    • Asked what she was looking for, and was told to switch modes from Browse to Forms mode
    • (question) How often does this situation come up? Should instructions be put somewhere (i.e. in the Help or scene summary?)
  • 7:30
    • "I'm very confused" - can't seem to figure out how to get to magnet and move it
  •  9:40
    • Still very confused. Was manipulating the coils and not getting what she wanted. Instructed to go and find the magnet.
  • 9:48
    • Managed to find the magnet
    • (question) Is the text cue not strong enough? Just says: "Bar magnet, move in 4 directions"
  • 9:50
    • was moving magnet around, got it into the coil, bumped the coil
    • (question) Is the bump sound enough?
  • 14:20
    • Moved magnet around a lot. Bumped it along the edges a lot
    • Edge bump alert can be better.
  • 16:02
    • User slides the magnet
    • No other audio cues because far from coil
  • 18:02
    • Previously asked to turn on field lines
    • Now turns them off. Did not explore the PDOM to hear the updated description.
  • 18:40
    • Asked to describe the sim
    • Describes the sim as having a coil, a circuit, magnet, and a voltmeter (although not sure what that is)
    • Not sure what the lightbulb is for
  • 19:13
    • Knows the magnet can go in the coil because it's open on both ends
  • 19:40
    • Asked how they navigated through the sim
    • Was using the arrow keys and getting no where
      • (question) Possible the text description did not help either. The description says to use arrow keys but didn't say the context in which to use them.
    • Eventually was able to move magnet with WASD keys
  • 20:10
    • Asked if used any other keys to move the magnet
    • Said used the 1 2 3 keys and it slid the magnet, but didn't give any additional description.
  • 20:50
    • Asked about the descriptions from the screen reader
    • Said the descriptions were very specific
    • Also said didn't realize that the 1 2 3 keys wasn't sliding just inside the coil
  • 21:40
    • Asked about the amount of time spent using Browse Mode
    • Didn't know they were in Browse mode. Thought they were interacting with the sim.
  • 22:25
    • Asked what happens to the description as you move the magnet through the coil.
    • Says the descriptions tells the position relative to the coil
    • But still doesn't know what the voltmeter is for.
  • 23:00
    • Asked which coil can generate the highest voltage
    • Was confused. Didn't really recall there were two coils.
    • Thought it was very confusing
  • 24:00
    • Playing w sim again to try to better understand the two coils
    • Moving magnet around.
    • Hears the prompt for "coil to left / right" and was able to navigate to it properly.
  • 25:15
    • Hits the coil and realizes it makes a different sound.
  • 25:35
    • Asked again which coil generates more voltage
    • correctly identifies 4 loop coil generates more because it has a bigger and deeper sound.
  • 26:00
    • Asked about the polarity
    • Responded by saying the magnet goes toward the coils different
    • Says the poles repel each other.
    • User is not clear about its purpose
  • 26:30
    • Asked about the sliding
    • But said they couldn't tell the difference.
  • 28:37
    • After playing some more, still couldn't answer the question
    • Couldn't tell a difference between the movement at different speeds.
    • (question) Instructions for sliding isn't clear.
    • (question) doesn't sound like the ticking sounds for magnet movement happens during a slide.
  • 29:19
    • Asked about the sounds and what they mean.
    • Said that when the magnet is inside the coil, there's a "hitting a spring" sound.
  • 30:10
    • ASked what the clicking sound means
    • just says that the magnet is moving
  • 31:46
    • Has a strong association with the "spring hitting the table" sound.
  • 33:10
    • associates the "humming sound" with the magnet interacting with the coils.
  • 33:35
    • Asked what happens when you move the magnet through the coil
    • Says there's a "spring" sound.
  • 35:51
    • Hears the organ sound, but doesn't know what is happening
  • 36:45
    • Asked what happens when the magnet touches the coil
    • Thinks it might be the low humming sound
  • 37:40
    • After some hints, realizes that the bong sound is when the magnet touches the coil
  • 39:17
    • What happens when you flip the magnet
    • magnet makes a clicking sound and an organ sound
  • Sim's capabilities meet my requirements - Agree.
  • Using the sim is a frustrating experience - Agree
  • Using the sim is easy to use -  disagree
  • I have to spend too much time correcting things in the sim - disagree
  • Sound were helpful - strongly agree
  • Sounds were interesting - strongly agree
  • Sounds were pleasant - strongly agree
  • Sounds were easy to understand - strongly agree
  • Sounds were relatable to their ideas -  agree
  • Easy to match sounds to the meanings -  agree
  • It was difficult to understand how the sounds changed from one variable to the next -  disagree
  • Sounds were fun - strongly agree
  • It was boring sound - strongly disagree
  • Confusing - strongly disagree
  • Easy to understand what the sounds mean - agree
  • The sim was complex - somewhat disagree
  • The sim is easy to use - somewhat disagree
  • I need a technical support to use this - somewhat agree
  • Functions were well integrated - neutral
  • Too much inconsistency in the sim - strongly disagree
  • I think others will learn to use this sim quickly - somewhat agree
  • I found it awkward to use - strongly disagree
  • I felt confident using this sim - somewhat agree
  • I needed to learn new things in order to use this sim - strong disagree
  • 44:55
    • How would you describe this sim to a friend
    • "I would describe it as incredibly confusing." "There were a lot of pieces and I didn't know what to do with them until you told me."
    • Didn't like how you had to go in and out of Forms mode. "Found that incredibly frustrating."
  • 47:30
    • Would you see this sim as being helpful for others learning the concepts.
    • Said the descriptions were good and perhaps not use as much sounds.
  • 48:40
    • How would you improve the simulation
    • Label the items so they know it is interactable.
    • Thought the checkboxes were confusing
  • 49:30
    • Asked to elaborate on having more descriptions
    • Felt that the sounds and descriptions were competing with one another
    • Couldn't pay attention to both at the same time.
    • Was relying more on the description - they made more sense than the sounds did
  • 50:20
    • Compared to Friction, how does this one compare?
    • Found FL more difficult because of all the pieces and playing with each one individually.
  • 51:00
    • Asked to comment on overall experience
    • Said that once she figured out what was happening, everything became more clear
    • Found that 2 coils was more difficult than 1.
    • Liked knowing where everything was like "the coil was to the left."
  • 51:52
    • Asked about not knowing about the voltmeter was
    • Guesses that it's somehow measuring the electricity between the magnet and the coil
    • Hadn't realized that the sound was associated with the lightbulb or voltmeter

#602

  • 0:00 to 10:30
    • Exploring sim
  • 0:10:33
    • Enabled field lines and wondering about whether the field lines changed
    • Wondering what they're supposed to be showing.