Lumen Learning Analysis of Utility Simulation

For students who are more willing to explore and experiment, this simulation works well for them. If a student is more cautious or likes to understand things before acting, this simulation is unforgiving. Many times the learner is:

• forced into advancing even though they may not be ready

• unable to go back and choose different options

• not given opportunity to review concepts

• Give more options for users to retry and review.
  
  

• Change wording of choices as to not make the student feel they have failed to understand.

Screen readers offer higher degree of control of navigation than just conventional keyboard interaction. This unfortunately allows a screen reader user to get into states which break the experience of the simulation:

• items which are supposed to be non-interactative and hidden are focusable by the screen reader and are read out loud

• inconsistent focus order

• Elements which are supposed to be completely hidden to users, including screen readers, should follow established techniques.

• Improving document structure through use of HTML semantic elements, and WAI-ARIA should help improve screen reader navigation and focus order.

• Focus order should go from top to bottom and left to right in most cases.

• Test with users of screen readers and keyboard users to further identify issues.

Important visuals (like graphs and tables) are background images which are inaccessible to screen readers. These images also lack any text descriptions.

• Use W3C recommended technique for describing complex graphics.

• Background images are for cosmetic purposes only. Graphs should have appropriate use of <figure> and <img> elements.

• Graphs should have data tables (possible implementation described later in this document)

• Tables should be HTML <table> and not images.

Issue

• Some screens only have 1 option and forces the player forward.

• Sometimes offer more choices or opportunities to seek out further explanation.

• Example: in the definition of margin, the choices are either “Got it” or “Grumble”. In both cases it assumes the learner understood what margin meant which may not be the case.

• Example: on the node that says “Let’s take our little animal example and apply a few economist tools to it”, the user is forced to advance. Perhaps give choices for users to review topics like margin and utility.
  
  

Recommendation

• Change the wording to be more accommodating.
  
  

• Also see "Interface Vocabulary" below.

• Provide opportunities for users to review, revisit, or retry before proceeding.
  
  

Issue

• Sometimes it is unclear what some choices mean.

• “Say that in English”

  • implies that there is "something wrong" for not understanding it

  • What is the outcome? The words are already in English.

  • Users need to be familiar with this colloquial language.
    
    

• “Say that as an economist might say it”

  • Unclear what this means and what the outcome is.

Recommendation

• Change the wording to make it clear what the outcome would be.

• See "Interface Vocabulary" below for recommendation on changes.

Issue:

• There is a lack of closure on after going through the Marginal Utility per Hour sim (choosing between Apples and Berries). It just ends rather abruptly.
  
  

• Feedback (i.e. "Great" / "Excellent") wasn't enough to offset the feeling that you could have made better choices.

Recommendation:

• Add a reflection / summary at the end to recap what you should have learned.

• Feels like there are multiple paths through the MU sim, but there's no way to go and explore those options. Give users the opportunity to retry parts of the sim to learn something new.