Reorderer QA Test Plan - List
Reorderer QA Test Plan - List
Environments
Browser | Version |
---|---|
Chrome | Latest Stable Release |
Firefox | Latest Stable Release |
MS Edge | Latest Stable Release |
Safari [fluid:1] | Latest Stable Release |
[fluid:1] keyboard a11y can be slightly improved if you select the "all controls" option from "Keyboard Shortcuts" under the "Keyboard & Mouse" settings. May also need to use "option + tab" for tab navigation.
General QA Guidelines
General Use
- Does the tool behave the way that you would expect
- Are you surprised by anything
- Does something take longer than you would expect
- When the tool does something unexpected or takes too long to do something, does the tool provide appropriate feedback
QA Tests
Protocol
Perform the following tests using each browser/system environment
Report issues at: http://issues.fluidproject.org/secure/Dashboard.jspa
Please search for issues before reporting them, so as to limit the number of duplicate entries.
Unit Test
Protocol
Launch the following website to execute unit tests.
Site
http://build.fluidproject.org/infusion/tests/component-tests/reorderer/all-tests.html
State Tests
Description
Ensures that the component properly traverses through the various states.Â
Protocol
Perform these tasks on the following site, perform the tests 1-4 and 5-7 in order.
Site
Demo
MouseÂ
Test 1: Mouseover
- Procedure
- Open the browser and navigate to the specified URL
- Using the mouse, hover over one of the list items
- Expected Results
- The pointer should be a move cursor (cross or hand)
- The styling of the list item should change
Test 2: Mouse, Pickup Avatar
- Procedure
- Complete Test 1
- Using the mouse, press and hold the 'left-mouse-button' down
- Using the mouse, drag slightly to the right
- Expected Results
- An avatar (representing the item) should be created
- The avatar should remain under the pointer as you drag around
Test 3: Mouse, Move Avatar
- Â Procedure
- Complete Test 2
- Using the mouse, drag the avatar around the screen
- Expected Results
- Notice that drop targets appear as you move over valid drop points
Test 4: Mouse, Drop Avatar
- Procedure
- Complete Test 3
- Using the mouse, release the 'left-mouse-button' over a drop target
- Â Expected Results
- The avatar should drop and move the list item to the new location
- The other items should shift to fill in the empty space where the list item was originally located
- The numbering for the items should be updated
- The moved item should remain focused.
KeyboardÂ
Test 5: Keyboard, Focus
- Procedure
- Open the browser and navigate to the specified URL
- Using the keyboard, tap the 'tab' key until one of the list items has focus
- Expected Results
- The styling of the element should change to indicate that the item has focus
Test 6: Keyboard, Navigate List
- Procedure
- Complete Test 5
- Using the keyboard, tap the 'i', 'm', 'up arrow' or 'down arrow'
- Expected Results
- The keyboard focus styling should move to the other element
- 'i' or 'up arrow' to move up
- 'm' or 'down arrow' to move down
- The keyboard focus styling should move to the other element
Test 7: Keyboard, Move Item
- Â Procedure
- Complete Test 6
- Using the keyboard, hold the 'ctrl' key (On Mac OS you'll need to also hold the 'command/Apple' key when using the arrows)
- Using the keyboard, while still holding down the 'ctrl' key use the navigation keys (see Test 6) to move the item
- Expected Results
- The item should move with the presses of the navigation key
- The other items should shift to fill in the empty space where the list item was originally located
- The numbering for the items should be updated
Assistive Technology (AT)
Description
Tests to ensure compatibility with Assistive Technologies.
Protocol
Perform these tasks on the following site.
Site
Demo
Test 1: AT Tests
- Procedure
- Open the browser and navigate to the specified URL
- Using the state tests as a guide, attempt to navigate through each state of the system
- Expected Results
- All states of the system should be reachable and usable while using the AT
Task Oriented Functional Tests
Description
Ensures that the component is able to handle expected input.
Protocol
Perform these tasks on the following site.
Site
Demo
Test 1: Move Item
- Procedure
- Open the browser and navigate to the specified URL
- Using the mouse, hover over one of the list items
- Using the mouse, press and hold the 'left-mouse-button' down
- Using the mouse, drag the avatar around the screen
- Using the mouse, release the 'left-mouse-button' over a drop target
- Â Expected Results
- The avatar should drop and move the list item to the new location
- The other items should shift to fill in the empty space where the list item was originally located
- The numbering for the items should be updated
- Stop Test
- Refresh the browser to return the page to its initial state
Test 2: Scroll Page
- Procedure
- Open the browser and navigate to the specified URL
- Adjust the browser size so that a vertical scroll bar appears
- Using the mouse, hover over one of the list items
- Using the mouse, press and hold the 'left-mouse-button' down
- Using the mouse, attempt to drag the avatar to a drop target that is currently off screen
- Using the mouse, release the 'left-mouse-button' over a drop target
- Â Expected Results
- The screen should scroll, revealing the drop targets which were off screen
- The avatar should drop and move the list item to the new location
- The other items should shift to fill in the empty space where the list item was originally located
- The numbering for the items should be updated
- Stop Test
- Refresh the browser to return the page to its initial state
- Reset your browser size
Boundary Tests
Description
Ensures proper functionality at the input limitsÂ
Protocol
Perform these tasks on the following site.
Site
Demo
Test 1: Move to Top of List
- Procedure
- Open the browser and navigate to the specified URL
- Using the mouse, hover over one of the list items
- Using the mouse, press and hold the 'left-mouse-button' down
- Using the mouse, drag the avatar above the first list item
- Using the mouse, release the 'left-mouse-button' over a drop target
- Â Expected Results
- The avatar should drop and move the list item to the new location
- The other items should shift to fill in the empty space where the list item was originally located
- The numbering for the items should be updated
- Stop Test
- Refresh the browser to return the page to its initial state
Test 2: Move to End of List
- Procedure
- Open the browser and navigate to the specified URL
- Using the mouse, hover over one of the list items
- Using the mouse, press and hold the 'left-mouse-button' down
- Using the mouse, drag the avatar below the last list item
- Using the mouse, release the 'left-mouse-button' over a drop target
- Â Expected Results
- The avatar should drop and move the list item to the new location
- The other items should shift to fill in the empty space where the list item was originally located
- The numbering for the items should be updated
- Stop Test
- Refresh the browser to return the page to its initial state
Test 3: Keyboard Navigation Wrap
- Procedure
- Open the browser and navigate to the specified URL
- Using the keyboard, tap the 'tab' key until one of the list items has focus
- Using the keyboard, tap the 'i', 'm', 'down arrow' or 'up arrow'
- Using the keyboard, continue tapping the same key until the original item has focus again
- Â Expected Results
- The keyboard focus styling should move to the other element
- 'i' or 'up arrow' to move up
- 'm' or 'down arrow' to move down
- The focus navigation should wrap around the list (e.g. from last element to first element, with a down direction)
- The keyboard focus styling should move to the other element
- Stop Test
- Refresh the browser to return the page to its initial state
Test 4: Keyboard Move Wrap
- Procedure
- Open the browser and navigate to the specified URL
- Using the keyboard, tap the 'tab' key until one of the list items has focus
- Using the keyboard, hold the 'ctrl' key
- Using the keyboard, tap the 'i', 'm', 'down arrow' or 'up arrow'
- Using the keyboard, continue tapping the same key until the original item has focus again
- Â Expected Results
- The item should move with the presses of the navigation key
- The other items should shift to fill in the empty space where the list item was originally located
- The numbering for the items should be updated
- The item movement should wrap around the list (e.g. move from the bottom to the top, with a call to move down)
- Stop Test
- Refresh the browser to return the page to its initial state
Test 5: Drop, not on a valid drop target
- Procedure
- Open the browser and navigate to the specified URL
- Using the mouse, hover over one of the list items
- Using the mouse, press and hold the 'left-mouse-button' down
- Using the mouse, drag the avatar out of the list and onto some whitespace in the browser
- Using the mouse, release the 'left-mouse-button'
- Â Expected Results
- A drop target should always be present
- The avatar should drop to the location of the drop target
- Stop Test
- Refresh the browser to return the page to its initial state
Test 6: Drop out of browser
- Procedure
- Open the browser and navigate to the specified URL
- Adjust the size of the browser so that the desktop is visible
- Using the mouse, hover over one of the list items
- Using the mouse, press and hold the 'left-mouse-button' down
- Using the mouse, drag the avatar out of the browser
- Using the mouse, release the 'left-mouse-button'
- Â Expected Results
- The avatar should drop to the location of the drop target
- Stop Test
- Refresh the browser to return the page to its initial state
Test-to-Fail
Description
Tests which should cause errors or not be accepted as inputÂ
Protocol
Perform these tasks on the following site.
Site
Demo
Test 1: Move left or right
- Procedure
- Open the browser and navigate to the specified URL
- Using the keyboard, tap the 'tab' key until one of the list items has focus
- Using the keyboard, hold down the 'ctrl' key
- Attempt to move an item with the 'j', 'k', 'left arrow' or 'right arrow' key
- Â Expected results
- List items should not move
- Stop Test
- Refresh the browser to return the page to its initial state.
Test 2: Keyboard, Attempt to tab through all list items
- Procedure
- Open the browser and navigate to the specified URL
- Using the keyboard, tap the 'tab' key until one of the list items has focus
- Using the keyboard, tap either 'shift-tab' or 'tab' to navigate through the list items
- Expected Results
- On pressing 'shift-tab' or 'tab' focus should not be on any list item. Only the 'i', 'j', 'k', 'm', or an 'arrow' keys should move focus between list items.
- Stop Test
- Refresh the browser to return the page to its initial state
Validation
Description
Tests to ensure that specifications are being met
Protocol
Perform these tasks on the following site.
Site
Demo
Test 1: HTML Validation
- Procedure
- Open the browser and navigate to the specified URL
- For each state of the system, validate the HTML markup
- Tools for validation
- Expected Results
- All of the HTML markup should properly validate in all states.
- Stop Test
- Refresh the browser to return the page to its initial state
- Quit the tool you are using to validate
Test 2: WCAG Validation
- Procedure
- Open the browser and navigate to the specified URL
- For each state of the system (see: State Tests), ensure that the WCAG guidelines are being met to at least AA level
- Tools for validation (Note: Automated tools are not yet capable of catching all issues. It is important to go through the checklist, making use of automated tools where possible, and manual processes otherwise).
- Expected Results
- Passes WCAG 2.0 AA requirements
- Stop Test
- Refresh the browser to return the page to its initial state
- Quit the tool you are using to validate
Ad-hoc
Description
Improvised tests for quickly discovering critical issues, and uncovering ones that may be outside of formalized testing.
Protocol
Attempt to use the tool in various situations, using your imagination and freedom to explore the interface and interactions.
Site
Demo