/
Preferences Framework QA Test Plan

Preferences Framework QA Test Plan

Jun 28, 2021

Preferences Framework QA Test Plan

Environments

BrowserVersion
ChromeLatest Stable Release
FirefoxLatest Stable Release
MS EdgeLatest Stable Release
Safari [fluid:1]Latest Stable Release

[fluid:1] keyboard a11y can be slightly improved if you select the "all controls" option from "Keyboard Shortcuts" under the "Keyboard & Mouse" settings. May also need to use "option + tab" for tab navigation.

General QA Guidelines

General Use

  • Does the tool behave the way that you would expect
  • Are you surprised by anything
  • Does something take longer than you would expect
  • When the tool does something unexpected or takes too long to do something, does the tool provide appropriate feedback
On This Page
Specification

QA Tests

ProtocolPerform the following tests using each browser/system environment

Report issues at: http://issues.fluidproject.org/secure/Dashboard.jspa

Please search for issues before reporting them, so as to limit the number of duplicate entries.

FSS Jira Filter
UI Options Jira Filter

 

Unit Test

Protocol

Launch the following websites to execute unit tests.

Site
http://build.fluidproject.org/infusion/tests/framework-tests/preferences/all-tests.html

State Tests

Description

Ensures that the component properly traverses through the various states. 

Protocol

Perform these tasks on the following site, perform the tests 1-15 and 16-30 in order.

Site
Demo

Mouse 

Test 1: Mouse, Open

  • Procedure

    1. Using the mouse, click to open the Preferences Editor

  • Expected Results

    • The Preferences Editor should open (slide down), with the current values selected

Test 2: Mouse, Close Immediately After Open

  • Procedure

    1. Complete Test 1

    2. Using the mouse, click the "Hide" button

  • Expected Results

    • The Preferences Editor should close (slide up)

    • The style of the page should not have changed

Test 3: Mouse, Change Text Style

  • Procedure

    1. Complete Test 2

    2. Using the mouse, click to open the Preferences Editor

    3. Using the mouse, under "text style", select a different text style

  • Expected Results

    1. The text in the main window should change to the selected style

Test 4: Mouse, Change Text Size (stepper)

  • Procedure

    1. Complete Test 3

    2. Using the mouse, under "text size", click the stepper buttons to select a different text size

  • Expected Results

    • The value in the textfield should change to show the new value

    • The text in the main window should change to the selected size

Test 5: Mouse, Change Text Size (textfield)

  • Procedure

    1. Complete Test 4

    2. Using the mouse, under "text size",  click the textfield and type a new value, to select a different text size

  • Expected Results

    • The text in the main window should change to the selected size

Test 6: Mouse, Change Line Spacing (stepper)

  • Procedure

    1. Complete Test 5

    2. Using the mouse, under "line spacing", click the stepper buttons to change the line spacing

  • Expected Results

    • The value in the textfield should change to show the new value

    • The main window should change to have the selected line spacing

Test 7: Mouse, Change Line Spacing (textfield)

  • Procedure

    1. Complete Test 6

    2. Using the mouse, under "line spacing", click the textfield and type a new value to change the line spacing

  • Expected Results

    • The main window should change to have the selected line spacing

Test 8: Mouse, Change Letter Spacing (stepper)

  • Procedure

    1. Complete Test 7

    2. Using the mouse, under "letter spacing", click the stepper buttons to change the letter spacing

  • Expected Results

    • The value in the textfield should change to show the new value

    • The main window should change to have the selected letter spacing

Test 9: Mouse, Change Letter Spacing (textfield)

  • Procedure

    1. Complete Test 8

    2. Using the mouse, under "letter spacing", click the textfield and type a new value to change the letter spacing

  • Expected Results

    • The main window should change to have the selected letter spacing

Test 10: Mouse, Change Word Spacing (stepper)

  • Procedure

    1. Complete Test 9

    2. Using the mouse, under "word spacing", click the stepper buttons to change the word spacing

  • Expected Results

    • The value in the textfield should change to show the new value

    • The main window should change to have the selected word spacing

Test 11: Mouse, Change Word Spacing (textfield)

  • Procedure

    1. Complete Test 10

    2. Using the mouse, under "word spacing", click the textfield and type a new value to change the word spacing

  • Expected Results

    • The main window should change to have the selected word spacing

Test 12: Mouse, Change Contrast

  • Procedure

    1. Complete Test 11

    2. Using the mouse, under "colour & contrast", select a different contrast theme

  • Expected Results

    • The contrast of the content in the main window should change to the selected theme

Test 13: Mouse, Toggle Table of Contents

  • Procedure

    1. Complete Test 12

    2. Using the mouse, under "table of contents", toggle the setting

  • Expected Results

    • The display of the table of contents, in the main window, should match the selected setting

Test 14: Mouse, Toggle Enhance Inputs

  • Procedure

    1. Complete Test 13

    2. Using the mouse, under "enhance inputs", toggle the setting

  • Expected Results

    • The display of links and other inputs, in the main window, should match the selected setting

Test 15: Mouse, Toggle Syllables

  • Procedure

    1. Complete Test 14

    2. Using the mouse, under "syllables", toggle the setting

  • Expected Results

    • The text in the main window should match the selected setting

Test 16: Mouse, Toggle Text-to-Speech

  • Procedure

    1. Complete Test 15

    2. Using the mouse, under "text-to-speech", toggle the setting

  • Expected Results

    • When "on", a widget for self-voicing the page should be added to the main window

Test 17: Mouse, Toggle Simplify

  • Procedure

    1. Complete Test 16

    2. Using the mouse, under "simplify", toggle the setting

  • Expected Results

    • When "on", the layout of the page should be simplified

Test 18: Mouse, Close and Re-open

  • Procedure

    1. Complete Test 17

    2. Using the mouse, click the "Hide" button

    3. Using the mouse, re-open the Preferences Editor

  • Expected Results

    • The selected options should still be set

    • The main window should display the effects of the selected options

    • The Preferences Editor should display the effects of the selected options

Test 19: Mouse, Reset

  • Procedure

    1. Complete Test 18

    2. Using the mouse, click the "Reset" button

  • Expected Results

    • The options should all be set to the initial default values

    • The main window should be reset to the initial default styles

    • The Preferences Editor should be reset to the initial default styles

  • Stop Test

    • Refresh the browser to return the page to its initial state.

Keyboard

Test 20: Keyboard, Open

  • Procedure

    1. Using the keyboard, tap the 'tab' key until the element to open the Preferences Editor has focus

    2. Using the keyboard, tap the 'enter' key to open the Preferences Editor

  • Expected Results

    • The Preferences Editor should open (slide down), with the current values selected

Test 21: Keyboard, Close Immediately After Open

  • Procedure

    1. Complete Test 20

    2. Using the keyboard, tap the 'tab' key until the "Hide" button has focus

    3. Using the keyboard, tap the 'enter' key to close the Preferences Editor

  • Expected Results

    • The Preferences Editor should close (slide up)

    • The style of the page should not have changed

Test 22: Keyboard, Change Text Style

  • Procedure

    1. Complete Test 21

    2. Using the keyboard, tap the 'tab' key until the element to open the Preferences Editor has focus

    3. Using the keyboard, tap the 'enter' key to open the Preferences Editor

    4. Using the keyboard, under "text style", select a different text style

  • Expected Results

    • The text in the main window should change to the selected style

Test 23: Keyboard, Change Text Size (stepper)

  • Procedure

    1. Complete Test 22

    2. Using the keyboard, under "text size", tap the "tab" key until the textfield has focus

    3. Using the keyboard, tap the up and down arrow keys to select a different text size

  • Expected Results

    • The value in the textfield should change to show the new value

    • The text in the main window should change to the selected size

Test 24: Keyboard, Change Text Size (textfield)

  • Procedure

    1. Complete Test 23

    2. Using the keyboard, under "text size", tap the "tab" key until the textfield has focus

    3. Using the keyboard, type a new value in the textfield, to select a different text size

  • Expected Results

    • The text in the main window should change to the selected size

Test 25: Keyboard, Change Line Spacing (stepper)

  • Procedure

    1. Complete Test 24

    2. Using the keyboard, under "line spacing", tap the "tab" key until the textfield has focus

    3. Using the keyboard, tap the up and down arrow keys to select a different line spacing

  • Expected Results

    • The value in the textfield should change to show the new value

    • The main window should change to have the selected line spacing

Test 26: Keyboard, Change Line Spacing (textfield)

  • Procedure

    1. Complete Test 25

    2. Using the keyboard, under "line spacing", tap the "tab" key until the textfield has focus

    3. Using the keyboard, type a new value in the textfield, to select a different line spacing

  • Expected Results

    • The main window should change to have the selected line spacing

Test 27: Keyboard, Change Letter Spacing (stepper)

  • Procedure

    1. Complete Test 26

    2. Using the keyboard, under "letter spacing", tap the "tab" key until the textfield has focus

    3. Using the keyboard, tap the up and down arrow keys to select a different letter spacing

  • Expected Results

    • The value in the textfield should change to show the new value

    • The main window should change to have the selected letter spacing

Test 28: Keyboard, Change Letter Spacing (textfield)

  • Procedure

    1. Complete Test 27

    2. Using the keyboard, under "letter spacing", tap the "tab" key until the textfield has focus

    3. Using the keyboard, type a new value in the textfield, to select a different letter spacing

  • Expected Results

    • The main window should change to have the selected letter spacing

Test 29: Keyboard, Change Word Spacing (stepper)

  • Procedure

    1. Complete Test 28

    2. Using the keyboard, under "word spacing", tap the "tab" key until the textfield has focus

    3. Using the keyboard, tap the up and down arrow keys to select a different word spacing

  • Expected Results

    • The value in the textfield should change to show the new value

    • The main window should change to have the selected word spacing

Test 30: Keyboard, Change Word Spacing (textfield)

  • Procedure

    1. Complete Test 29

    2. Using the keyboard, under "word spacing", tap the "tab" key until the textfield has focus

    3. Using the keyboard, type a new value in the textfield, to select a different word spacing

  • Expected Results

    • The main window should change to have the selected word spacing

Test 31: Keyboard, Change Contrast

  • Procedure

    1. Complete Test 30

    2. Using the keyboard, under "colour & contrast", select a different contrast theme

  • Expected Results

    • The contrast of the content in the main window should change to the selected theme

Test 32: Keyboard, Toggle Table of Contents

  • Procedure

    1. Complete Test 31

    2. Using the keyboard, under "table of contents", toggle the "Show Table of Contents" setting

  • Expected Results

    • The display of the table of contents, in the main window, should match the selected setting

Test 33: Keyboard, Toggle Enhance Inputs

  • Procedure

    1. Complete Test 32

    2. Using the keyboard, under "enhance inputs", toggle the setting

  • Expected Results

    • The display of links and other inputs, in the main window, should match the selected setting

Test 34: Keyboard, Toggle Syllables

  • Procedure

    1. Complete Test 33

    2. Using the keyboard, under "syllables", toggle the setting

  • Expected Results

    • The text in the main window should match the selected setting

Test 34: Keyboard, Toggle Text-to-Speech

  • Procedure

    1. Complete Test 34

    2. Using the keyboard, under "text-to-speech", toggle the setting

  • Expected Results

    • When "on", a widget for self-voicing the page should be added to the main window

Test 36: Keyboard, Toggle Simplify

  • Procedure

    1. Complete Test 35

    2. Using the keyboard, under "simplify", toggle the setting

  • Expected Results

    • When "on", the layout of the page should be simplified

Test 37: Keyboard, Close and Re-open

  • Procedure

    1. Complete Test 36

    2. Using the keyboard, tap the 'tab' key until the "Hide" button has focus

    3. Using the keyboard, tap the 'enter' key to close the Preferences Editor

    4. Using the keyboard, tap the 'tab' key until the element to open the Preferences Editor has focus

    5. Using the keyboard, tap the 'enter' key to open the Preferences Editor

  • Expected Results

    • The selected options should still be set

    • The main window should display the effects of the selected options

    • The Preferences Editor should display the effects of the selected options

Test 38: Keyboard, Reset

  • Procedure

    1. Complete Test 37

    2. Using the keyboard, tap the 'tab' key until the "Reset" button has focus

    3. Using the keyboard, tap the 'enter' key to reset the options

  • Expected Results

    • The options should all be set to the initial default values

    • The main window should be reset to the initial default styles

    • The Preferences Editor should be reset to the initial default styles

  • Stop Test

    • Refresh the browser to return the page to its initial state.

Assistive Technology (AT)

Description
Tests to ensure compatibility with Assistive Technologies.

Protocol
Perform these tasks on the following site.

Site
Demo

Test 1: AT Tests

  • Procedure
    1. Open the browser and navigate to the specified URL
    2. Using the state tests as a guide, attempt to navigate through each state of the system
      1. Example ATs
        1. Screen Readers: JAWS, NVDA, VoiceOver, Orca
        2. Built in AT features: Windows, Mac, Linux, iOS, Android
        3. Others ATs: Speech Recognition, Screen Magnifiers, switch access, etc.
  • Expected Results
    • All states of the system should be reachable and usable while using the AT

Task Oriented Functional Tests

Description

 Ensures that the component is able to handle expected input.

Protocol

 Perform these tasks on the following site.

Site
Demo

Test 1: Change the Text Style

  • Procedure

    1. Open the Preferences Editor

    2. Under "text style", change the text style

  • Expected Results

    • The text in the main window should change to the selected style

  • Stop Test

    • Clear cookies and refresh the browser or reset the changes

Test 2: Change the Text Size

  • Procedure

    1. Open the Preferences Editor

    2. Under "text size", change the text size

  • Expected Results