PGA Task 0003 - QA Test Plan - First Discovery
Guidlines
Environments
- OS
- Windows 7
- Windows 8.1
- Windows 10
- Mac OS 10.11 ( El Capitan )
- Browser
- Chrome (latest)
General QA Guidelines
General Use
- Does the tool behave the way that you would expect
- Are you surprised by anything
- Does something take longer than you would expect
- When the tool does something unexpected or takes too long to do something, does the tool provide appropriate feedback
QA Tests
Protocol
Perform the following tests using each browser/system environment
Unit Test
________________________________________________________
Protocol
Launch the following link to execute unit tests.
Test 1: First Discovery Unit tests
Procedure
Clone or download the First Discovery tool ( https://github.com/pga03/first-discovery/tree/sprint3-integration )
Server the First Discovery tool through a web server
run the tests from tests/all-tests.html
Expected Results
All of the tests should complete successfully
State Tests
________________________________________________________
Description
Ensures that the component properly traverses through the various states.
Protocol
Perform these tasks on the following site using both the mouse and keyboard, all tests should be done in sequence.
http://first-discovery.mybluemix.net/demos/prefsServerIntegration/index.html?preview=electron
http://first-discovery.mybluemix.net/demos/prefsServerIntegration/index.html?preview=search
Test 1: Launch
Procedure
Open the browser and navigate to the specified URL
Expected Results
Self voicing should be enabled and reading out the instructions
The self voicing toggle should say "turn voice OFF"
The Language screen should be displayed
The step count should be "Step 1 of 15"
A preview window should appear on the right hand side
Test 2: Hover/Focus
Procedure
Complete Test 1
Hover/Focus the self voicing toggle
Remove hover/focus from the self voicing toggle
Expected Results
Hover
The border around the self voicing toggle should increase to indicate the mouse hover
A tool tip should appear describing the button's action
The tooltip should be self voiced
Focus
An outline around the self voicing toggle should appear to indicate focus
A tool tip should appear describing the button's action
The tooltip should be self voiced
Test 3: Disable self voicing
Procedure
Complete Test 2
Activate the self voicing toggle
Expected Results
The self voicing should indicate that it is now off
The text of the self voicing toggle should change to "turn voice ON"
The tooltip should change to indicate the new action of the toggle button
Test 4: Enable self voicing
Procedure
Complete Test 3
Activate the self voicing toggle
Expected Results
The self voicing should indicate that it is now on
The text of the self voicing toggle should change to "turn voice OFF"
The tooltip should change to indicate the new action of the toggle button
Test 5: Language Selection
Procedure
Complete Test 4
Press the 'h' key
Expected Results
English should be the selected language
The up arrow should be disabled
The down arrow should be enabled
There should be a "continue" button, but no "back" button
Pressing 'h' should re-read the instructions
Test 6: Language Selection - Hover/Focus
Procedure
Complete Test 5
Hover/Focus the arrow buttons
Hover/Focus the language options
Hover/Focus the "continue" button
Expected Results
No tooltip should be displayed for the disabled up arrow
Should not be able to focus the disabled up arrow
Tooltips should be displayed and self voiced for the language options, down arrow button and continue button
Tooltips for the language options should be localized to the related language and self voiced in that language
Test 7: Language Selection - Scroll Languages
Procedure
Complete Test 6
mouse
Click on the down arrow
Click on the up arrow
keyboard
place focus on English
press the down arrow key
press the up arrow key
Expected Results
The list of languages should scroll up and down
There should always be only three language options displayed
The name of each language should be displayed in its own language
Clicking on the up/down arrows when they are disabled should have no result
Test 8: Language Selection - Change Language
Procedure
Complete Test 7
Select language other than English
Expected Results
The page should reload with tool now using the selected language
The tool should self voice in the selected language
The selected language should be selected in the language list
The preview should be rendered with the selected language
The preview should self voice in the selected language
Test 9: Language Selection - Restore Language to English
Procedure
Complete Test 8
Select "English"
Expected Results
The page should reload with tool using English
The tool should self voice in English language
English should be selected in the language list
The preview should be rendered in English
The preview should self voice in English
Test 10: Language Selection - Continue
Procedure
Complete Test 9
Activate Continue
Expected Results
The tool should transition to the Welcome screen
Self voicing should read the current instructions and step
The step count should be "Step 2 of 15"
Test 11: Welcome
Test 12: Welcome - Back
Procedure
Complete Test 11
Activate the "back" button
Expected Results
The tool should transition to the Language screen
Self voicing should read the current instructions and step
The step count should be "Step 1 of 15"
English should be selected in the language list
Test 13: Welcome - Return
Procedure
Complete Test 12
Activate the "continue" button
Expected Results
The tool should transition to the Welcome screen
Self voicing should read the current instructions and step
The step count should be "Step 2 of 15"
Test 14: Welcome - Continue
Procedure
Complete Test 13
Activate the "next" button
Expected Results
The tool should transition to the Text-to-Speech screen
Self voicing should read the current instructions and step
The step count should be "Step 3 of 15"
Test 15: Text-to-Speech
Procedure
Complete Test 14
Press the 'h' key
Expected Results
Yes should be the selected option
There should be a "back" button
There should be a "next" button
Pressing 'h' should re-read the instructions
Test 16: Text-to-Speech - Disable
Procedure
Complete Test 15
Select No
Expected Results
The self voicing should indicate that it is now off
The text of the self voicing toggle should change to "turn voice ON"
The tooltips should be updated to indicate the selection
Test 17: Text-to-Speech - Enable
Procedure
Complete Test 16
Select Yes
Expected Results
The self voicing should indicate that it is now on
The text of the self voicing toggle should change to "turn voice OFF"
The tooltips should be updated to indicate the selection
Test 18: Text-to-Speech - Back
Procedure
Complete Test 17
Activate the "back" button
Expected Results
The tool should transition to the Welcome screen
Self voicing should read the current instructions and step
The step count should be "Step 2 of 15"
Test 19: Text-to-Speech - Return
Procedure
Complete Test 18
Activate the "next" button
Expected Results
The tool should transition to the Text-to-Speech screen
Self voicing should read the current instructions and step
The step count should be "Step 3 of 15"
Test 20: Text-to-Speech - Continue
Procedure
Complete Test 19
Activate the "next" button
Expected Results
The tool should transition to the Speech Rate screen
Self voicing should read the current instructions and step
The step count should be "Step 4 of 15"
Test 21: Speech Rate
Procedure
Complete Test 20
Press the 'h' key
Expected Results
The meter indicator should be about half way
The + and - buttons should be enabled
There should be a "back" button
There should be a "next" button
Pressing 'h' should re-read the instructions
Test 22: Speech Rate - Increase
Procedure
Complete Test 21
Activate the + button
Expected Results
The meter should increase
The - button should be enabled
The + should be disabled when at the max
As the Speech Rate increases, the self voicing should be speaking more quickly
Test 23: Speech Rate - Decrease
Procedure
Complete Test 22
Activate the - button
Expected Results
The meter should decrease
The + button should be enabled
The - should be disabled when at the min
As the Speech Rate decreases, the self voicing should be speaking more slowly
Test 24: Speech Rate - Disabled Text-to-Speech
Procedure
Complete Test 23
Activate the self voicing toggle
Expected Results
The adjuster should be replaced by a message indicating that the "speak text aloud" option needs to be set
Test 25: Speech Rate - Enable Text-to-Speech
Procedure
Complete Test 24
Activate the self voicing toggle
Expected Results
The message should be replaced by the adjuster
Test 26: Speech Rate - Back
Test 27: Speech Rate - Return
Procedure
Complete Test 26
Activate the "next" button
Expected Results
The tool should transition to the Speech Rate screen
Self voicing should read the current instructions and step
The step count should be "Step 4 of 15"
Test 28: Speech Rate - Continue
Procedure
Complete Test 27
Activate the "next" button
Expected Results
The tool should transition to the Contrast screen
Self voicing should read the current instructions and step
The step count should be "Step 5 of 15"
Test 29: Contrast
Procedure
Complete Test 28
Press the 'h' key
Expected Results
original should be selected
the contrast options should be rendered in the contrast they refer to
There should be a "back" button
There should be a "next" button
Pressing 'h' should re-read the instructions
Test 30: Contrast - Change Contrast
Procedure
Complete Test 29
Select a new contrast option
Expected Results
The tool should use the selected contrast
The contrast options should be rendered in the contrast they refer to
The preview should be rendered in the selected contrast
The tooltips should be updated to indicate the selection
Test 31: Contrast - Restore to Original
Procedure
Complete Test 30
Select "original"
Expected Results
The tool should use the original colours
The contrast options should be rendered in the contrast they refer to
The preview should be rendered in the original colours
The tooltips should be updated to indicate the selection
Test 32: Contrast - Back
Procedure
Complete Test 31
Activate the "back" button
Expected Results
The tool should transition to the Speech Rate screen
Self voicing should read the current instructions and step
The step count should be "Step 4 of 15"
Test 33: Contrast - Return
Procedure
Complete Test 32
Activate the "next" button
Expected Results
The tool should transition to the Contrast screen
Self voicing should read the current instructions and step
The step count should be "Step 5 of 15"
Test 34: Contrast - Continue
Procedure
Complete Test 33
Activate the "next" button
Expected Results
The tool should transition to the Text Size screen
Self voicing should read the current instructions and step
The step count should be "Step 6 of 15"