User Interface Options QA Test Plan - Full With Preview
User Interface Options QA Test Plan - Full: With Preview
Environments
| Browser | Version |
|---|---|
| Chrome | Latest Stable Release |
| Firefox | Latest Stable Release |
| MS Edge | Latest Stable Release |
| Safari [fluid:1] | Latest Stable Release |
[fluid:1] keyboard a11y can be slightly improved if you select the "all controls" option from "Keyboard Shortcuts" under the "Keyboard & Mouse" settings. May also need to use "option + tab" for tab navigation.
General Use
- Does the tool behave the way that you would expect
- Are you surprised by anything
- Does something take longer than you would expect
- When the tool does something unexpected or takes too long to do something, does the tool provide appropriate feedback
QA Tests
Protocol
Perform the following tests using each browser/system environment
Report issues at: http://issues.fluidproject.org/secure/Dashboard.jspa
Please search for issues before reporting them, so as to limit the number of duplicate entries.
Unit Test
Protocol
Launch the following websites to execute unit tests.
Site
http://build.fluidproject.org/infusion/tests/framework-tests/preferences/all-tests.html
State Tests
Description
Ensures that the component properly traverses through the various states.
Protocol
Perform these tasks on the following site, perform the tests 1-11 and 12-22 in order.
Site
Mouse
Test 1: Mouse, Change Text Style
Procedure
Using the mouse, under the "Text and Display" header, select a different text style
Expected Results
The text in the preview window should change to the selected style
Test 2: Mouse, Change Text Size (slider)
Procedure
Complete Test 1
Using the mouse, under the "Text and Display" header, move the slider to select a different text size
Expected Results
The value in the textfield should change to show the value represented by the slider
The text in the preview window should change to the selected size
Test 3: Mouse, Change Text Size (textfield)
Procedure
Complete Test 2
Using the mouse, under the "Text and Display" header, type a new value in the textfield, to select a different text size
Expected Results
The position of the thumb, on the slider, should change to represent the value entered in the textfield
The text in the preview window should change to the selected size
Test 4: Mouse, Change Line Spacing (slider)
Procedure
Complete Test 3
Using the mouse, under the "Text and Display" header, move the slider to change the line spacing
Expected Results
The value in the textfield should change to show the value represented by the slider
The preview window should change to have the selected line spacing
Test 5: Mouse, Change Line Spacing (textfield)
Procedure
Complete Test 4
Using the mouse, under the "Text and Display" header, type a new value in the textfield to change the line spacing
Expected Results
The position of the thumb, on the slider, should change to represent the value entered in the textfield
The preview window should change to have the selected line spacing
Test 6: Mouse, Change Contrast
Procedure
Complete Test 5
Using the mouse, under the "Text and Display" header, select a different contrast theme
Expected Results
The contrast of the content in the preview window should change to the selected theme
Test 7: Mouse, Toggle Table of Contents
Procedure
Complete Test 6
Using the mouse, under the "Layout and Navigation" header, toggle the "Show Table of Contents" setting
Expected Results
The display of the table of contents, in the preview window, should match the selected setting
Test 8: Mouse, Emphasize Links
Procedure
Complete Test 7
Using the mouse, under the "Links and Buttons" tab, toggle the "underline and bold" setting
Expected Results
The display of links, in the preview window, should match the selected setting
Test 9: Mouse, Make Inputs Larger
Procedure
Complete Test 8
Using the mouse, under the "Links and Button" header, toggle the "enlarge buttons, menus, text-fields, and other inputs" setting
Expected Results
The display of inputs, in the preview window, should match the selected setting
Test 10: Mouse, Save and Apply
Procedure
Complete Test 9
Using the mouse, click the "Save and Apply" button
Expected Results
The selected options should still be set
The preview window should display the effects of the selected options
The UI Options interface should display the effects of the selected options
Test 11: Mouse, Reset
Procedure
Complete Test 10
Using the mouse, click the "Reset" button
Using the mouse, click the "Save and Apply" button
Expected Results
The options should all be set to the initial default values
The preview window should be reset to the initial default styles
The UI Options interface should be reset to the initial default styles
Stop Test
Clear cookies and refresh the browser or reset the changes
Keyboard
Test 12: Keyboard, Change Text Style
Procedure
Using the keyboard, under the "Text and Display" header, select a different text style
Expected Results
The text in the preview window should change to the selected style
Test 13: Keyboard, Change Text Size (slider)
Procedure
Complete Test 12
Using the keyboard, under the "Text and Display" header, tap the "tab" key until the thumb of the slider has focus
Using the keyboard, tap the left and right arrow keys to select a different text size
Expected Results
The value in the textfield should change to show the value represented by the slider
The text in the preview window should change to the selected size
Test 14: Keyboard, Change Text Size (textfield)
Procedure
Complete Test 13
Using the keyboard, under the "Text and Display" header, tap the "tab" key until the textfield has focus
Using the keyboard, type a new value in the textfield, to select a different text size
Expected Results
The position of the thumb, on the slider, should change to represent the value entered in the textfield
The text in the preview window should change to the selected size
Test 15: Keyboard, Change Line Spacing (slider)
Procedure
Complete Test 14
Using the keyboard, under the "Text and Display" header, tap the "tab" key until the thumb of the slider has focus
Using the keyboard, tap the left and right arrow keys to select a different line spacing
Expected Results
The value in the textfield should change to show the value represented by the slider
The preview window should change to have the selected line spacing
Test 16: Keyboard, Change Line Spacing (textfield)
Procedure
Complete Test 15
Using the keyboard, under the "Text and Display" header, tap the "tab" key until the textfield has focus
Using the keyboard, type a new value in the textfield, to select a different line spacing
Expected Results
The position of the thumb, on the slider, should change to represent the value entered in the textfield
The preview window should change to have the selected line spacing
Test 17: Keyboard, Change Contrast
Procedure
Complete Test 16
Using the keyboard, under the "Text and Display" header, select a different contrast theme
Expected Results
The contrast of the content in the preview window should change to the selected theme
Test 18: Keyboard, Toggle Table of Contents
Procedure
Complete Test 17
Using the keyboard, under the "Layout and Navigation" header, toggle the "Show Table of Contents" setting
Expected Results
The display of the table of contents, in the preview window, should match the selected setting
Test 19: Keyboard, Emphasize Links
Procedure
Complete Test 18
Using the keyboard, under the "Links and Buttons" header, toggle the "underline and bold" setting
Expected Results
The display of links, in the preview window, should match the selected setting
Test 20: Keyboard, Make Inputs Larger
Procedure
Complete Test 19
Using the keyboard, under the "Links and Navigation" header, toggle the "enlarge buttons, menus, text-fields, and other inputs" setting
Expected Results
The display of inputs, in the preview window, should match the selected setting
Test 21: Keyboard, Save and Apply
Procedure
Complete Test 20
Using the keyboard, tap the 'tab' key until the "Save and Apply" button has focus
Using the keyboard, tap the 'enter' key save the settings
Expected Results
The selected options should still be set
The preview window should display the effects of the selected options
The UI Options interface should display the effects of the selected options
Test 22: Keyboard, Reset
Procedure
Complete Test 21
Using the keyboard, tap the 'tab' key until the "Reset" button has focus
Using the keyboard, tap the 'enter' key reset the settings
Using the keyboard, tap the 'tab' key until the "Save and Apply" button has focus
Using the keyboard, tap the 'enter' key save the settings
Expected Results
The options should all be set to the initial default values
The preview window should be reset to the initial default styles
The UI Options interface should be reset to the initial default styles
Stop Test
Clear cookies and refresh the browser or reset the changes
Assistive Technology (AT)
Description
Tests to ensure compatibility with Assistive Technologies.
Protocol
Perform these tasks on the following site.
Site
Task Oriented Functional Tests
Description
Ensures that the component is able to handle expected input.
Protocol
Perform these tasks on the following site.
Site
Test 1: Change the Text Style
Procedure
Under the "Text and Display" header, change the text style
Expected Results
The text in the preview window should change to the selected style
Stop Test
Refresh the browser or reset the changes
Test 2: Change the Text Size
Procedure
Under the "Text and Display" header, change the text size
Expected Results
The text in the preview window should change to the selected size
Stop Test
Refresh the browser or reset the changes
Test 3: Change the Line Spacing
Procedure
Under the "Text and Display" header, change the line spacing
Expected Results
The preview window should change to have the selected line spacing
Stop Test
Refresh the browser or reset the changes
Test 4: Change the Contrast Theme
Procedure
Under the "Text and Display" header, change the contrast theme
Expected Results
The contrast of the content in the preview window should change to the selected theme
Stop Test
Refresh the browser or reset the changes
Test 5: Emphasize Links
Procedure
Under the "Links and Buttons" header, toggle the "underline and bold" setting
Expected Results
The display of links, in the preview window, should match the selected setting
Stop Test
Refresh the browser or reset the changes
Test 6: Make Inputs Larger
Procedure
Under the "Links and Navigation" header, toggle the "enlarge buttons, menus, text-fields, and other inputs" setting
Expected Results
The display of inputs, in the preview window, should match the selected setting
Stop Test
Refresh the browser or reset the changes
Test 7: Toggle Table of Contents
Procedure
Under the "Layout and Navigation" header, toggle the "Show Table of Contents" setting
Expected Results
The display of the table of contents, in the preview window, should match the selected setting
Stop Test
Refresh the browser or reset the changes
Test 8: Reset Changes
Procedure
Change some of the settings
Trigger the "Reset" button
Expected Results
The options should all be set to the initial default values
The preview window should be reset to the initial default styles
Stop Test
Reset the browser
Test 9: Persistence via Cookie
Procedure
Change some of the settings
Trigger the "Save and Apply" button
Trigger the "Return To Site" button
Expected Results
The demo page should show the options in effect
Stop Test
Clear cookies and refresh the browser or reset the changes
Boundary Tests
Description
Ensures proper functionality at the input limits
Protocol
Perform these tasks on the following site.
Site
Test 1: Minimum Text Size
Procedure
Under the "Text and Display" header, change the text size to the smallest value by moving the slider to the far left
Expected Results
After saving, the text on the page and the preview window should appear with the selected size
Stop Test
Clear cookies and refresh the browser or reset the changes
Test 2: Maximum Text Size
Procedure
Under the "Text and Display" header, change the text to the largest size by moving the slider to the far right
Expected Results
After saving, the text on the page and the preview window should appear with the selected size
Stop Test
Clear cookies and refresh the browser or reset the changes
Test 3: Minimum Line Spacing
Procedure
Under the "Text and Display" header, change the line spacing to the smallest value by moving the slider to the far left
Expected Results
After saving, the line spacing on the page and the preview window should appear with the selected size
Stop Test
Clear cookies and refresh the browser or reset the changes
Test 4: Maximum Line Spacing
Procedure
Under the "Text and Display" header, change the line spacing to the largest size by moving the slider to the far right
Expected Results
After saving, the line spacing on the page and the preview window should appear with the selected size
Stop Test
Clear cookies and refresh the browser or reset the changes
Test 5: Table of Contents On
Procedure
Under the "Layout and Navigation" header, select "Show Table of Contents"
Expected Results
The table of contents should be visible in the preview window
Stop Test
Clear cookies and refresh the browser or reset the changes
Test 6: Table of Contents Off
Procedure
Under the "Layout and Navigation" header, deselect "Show Table of Contents"
Expected Results
The table of contents should not be visible on the page and the preview window
Stop Test
Clear cookies and refresh the browser or reset the changes
Test 7: underline and bold On
Procedure
Under the "Links and Buttons" header, select "underline and bold"
Expected Results
The links should be emphasized on the page and the preview window
Stop Test
Clear cookies and refresh the browser or reset the changes
Test 8: underline and bold Off
Procedure
Under the "Links and Buttons" header, deselect "underline and bold"
Expected Results
The links should not be emphasized on the page and the preview window
Stop Test
Clear cookies and refresh the browser or reset the changes
Test 9: Make Input Larger On
Procedure
Under the "Links and Buttons" header, select "enlarge buttons, menus, text-fields, and other inputs"
Expected Results
The inputs should appear larger on the page and the preview window
Stop Test
Clear cookies and refresh the browser or reset the changes
Test 10: Make Input Larger Off
Procedure
Under the "Links and Buttons" header, deselect "enlarge buttons, menus, text-fields, and other inputs"
Expected Results
The inputs should not appear larger on the page and the preview window
Stop Test
Clear cookies and refresh the browser or reset the changes
Test 16: No Preferences Changed
Procedure
Trigger the "Save and Apply" button without having made any changes
Expected Results
The page and the preview window should appear as they initially did on page load.
Stop Test
Clear cookies and refresh the browser or reset the changes
Test 17: All Preferences Changed
Procedure
Change all of the options
Expected Results
The page and the preview window should appear with all of the style changes
Stop Test
Clear cookies and refresh the browser or reset the changes
Test 18: Cookies Turned Off
Procedure
Turn off cookies in the browser
Change some of the settings
Trigger the "Save and Apply" button
Refresh the browser
Expected Results
The page should show the original default styles
Stop Test
Refresh the page and turn cookies back on
Test-to-Fail
Description
Tests which should cause errors or not be accepted as input
Protocol
Perform these tasks on the following site.
Site
Test 1: Enter a text size larger than the maximum
Procedure
Under the "Text and Display" tab, type in a text size that is larger than the maximum text size
Tap the 'enter' key to set the value
Expected Results
The value should change to the maximum allowable text size
Stop Test
Refresh the browser or reset the changes
Test 2: Enter a text size smaller than the minimum
Procedure
Under the "Text and Display" tab, type in a text size that is smaller than the minimum text size
Tap the 'enter' key to set the value
Expected Results
The value should change to the minimum allowable text size
Stop Test
Refresh the browser or reset the changes
Test 3: Enter a line spacing larger than the maximum
Procedure
Under the "Text and Display" tab, type in a line spacing that is larger than the maximum line spacing
Tap the 'enter' key to set the value
Expected Results
The value should change to the maximum allowable line spacing
Stop Test
Refresh the browser or reset the changes
Test 4: Enter a line spacing smaller than the minimum
Procedure
Under the "Text and Display" tab, type in a line spacing that is smaller than the minimum line spacing
Tap the 'enter' key to set the value
Expected Results
The value should change to the minimum allowable line spacing
Stop Test
Refresh the browser or reset the changes
Test 5: Enter non-numeric characters for the text size
Procedure
Under the "Text and Display" tab, in the text size textfield enter non-numeric characters
Tap the 'enter' key to set the value
Expected Results
The value should change back to the last valid value
Stop Test
Refresh the browser or reset the changes
Test 6: Enter non-numeric characters for the line spacing
Procedure
Under the "Text and Display" tab, in the line spacing textfield enter non-numeric characters
Tap the 'enter' key to set the value
Expected Results
The value should change back to the last valid value
Stop Test
Refresh the browser or reset the changes
Validation
Description
Tests to ensure that specifications are being met
Protocol
Perform these tasks on the following site.
Site
Ad-hoc
Description
Improvised tests for quickly discovering critical issues, and uncovering ones that may be outside of formalized testing.
Protocol
Attempt to use the tool in various situations, using your imagination and freedom to explore the interface and interactions.
Site