Fluid Engage home QA test plan
QA overview
Environments
- iPhone OS 3.0 or higher on iPhone 3G or 3GS
- iPhone OS 3.0 or higher on iPod touch 1G, 2G or 3G
For testing Fluid Engage with VoiceOver:
- iPhone OS 3.0 or higher on iPhone 3GS
- iPhone OS 3.0 or higher on iPod touch 32 GB or 64 GB (Fall 2009 or later)
Protocol overview
- Perform each of the tests under "QA tests" using each system environment.
- Report issues at http://issues.fluidproject.org/secure/Dashboard.jspa.
- Please search for issues before reporting them, so as to limit the number of duplicate entries.
General QA guidelines
- Does the tool behave the way that you would expect?
- Are you surprised by anything?
- Does something take longer than you would expect?
- When the tool does something unexpected or takes too long to do something, does the tool provide appropriate feedback?
QA tests
Unit tests
Protocol: Launch the following websites to execute unit tests.
Task-oriented functional tests
Description: Ensures that the component is able to handle expected input.
Protocol: Perform these tasks after completing initial Engage setup (to be added: instructions on adding app to home screen).
Test all screens: Absence of horizontal scroll
Procedure:
- Drag the screen left and right while holding the device in portrait mode.
Expected results:
- The screen should not shift left or right (i.e., it is fixed).
Test 1: Home page load
Procedure:
- Load the application and invoke "English" at the language selection screen.
- (For VO: After the page load announcement, have VO read the screen from top to bottom.)
Expected results:
- The name of the museum should appear in the navigation bar. No other elements should be present on the bar.
- On the screen should appear, in that order, the following items:
- Exhibitions
- My collection
- Enter object code
- Change language
- Each one of the items should consist of an icon and a text below.
- Both elements of the item should be tappable.
- There should be a maximum of 3 options per row.
- The items should appear ordered and well distributed.
- All text should appear in the language selected at the previous language selection screen.
- Text label under 'My collection' icon should indicate the number of objects stored in My Collection current session ('0').
Expected results for VoiceOver:
- Completion of page loading should be indicated by VO announcement "Web page loaded - Home".
- The name of the museum should be read out as the first (application) item on the screen.
- The icon link descriptions and text following each of them should be read out for the four items as above.
- Both elements of the item should be tappable.
- All text should be read out in the language selected at the previous language selection screen.
- Text label under 'My collection' icon should indicate the number of objects stored in My Collection current session ('0').
Test 2: Go to Exhibitions (cont'd from Test 1)
Procedure:
- Complete Test 1.
- At the home page, invoke "Exhibitions".
- (For VO: After the page load announcement, have VO read the screen from top to bottom. Also tap around the screen to check position of elements.)
Expected results:
- (For VO: Completion of page loading should be indicated by VO announcement "Web page loaded - Browse".)
- A back button, a home button, and "Exhibitions" title should appear in the navigation bar, in that order. No other elements should be present on the bar.
- A list of exhibitions should appear in the page.
- All text should appear in the language selected at the language selection screen.
Test 3: Back to the home from Exhibitions (cont'd from Test 2)
Procedure:
- Complete Test 2.
- While on Exhibitions page, invoke the home button in the navigation bar.
- (For VO: After the page load announcement, have VO read the screen from top to bottom. Also tap around the screen to check position of elements.)
Expected results:
- (For VO: Completion of page loading should be indicated by VO announcement "Web page loaded - Home".)
- The home page (as seen in the Test 1) should appear, with the name of the museum at the navigation bar, and the four options.
- Options should appear in the same order as before.
- All text should appear in the language selected at the language selection screen.
Test 4: Go to My Collection (cont'd from Test 3)
Procedure:
- Complete Test 3.
- At the home page, invoke "My Collection".
- (For VO: After the page load announcement, have VO read the screen from top to bottom. Also tap around the screen to check position of elements.)
Expected results:
- (For VO: Completion of page loading should be indicated by VO announcement "Web page loaded - My Collection".)
- A back button, a home button, and "My Collection" title should appear in the navigation bar, in that order. No other elements should be present on the bar.
- A message "Your collection is empty. Tap 'Collect' when viewing an artifact to add it here" should appear.
- All text should appear in the language selected at the language selection screen.
Test 5: Back to the home from My Collection (cont'd from Test 4)
Procedure:
- Complete Test 4.
- While on My Collection page, invoke the home button in the navigation bar.
- (For VO: After the page load announcement, have VO read the screen from top to bottom. Also tap around the screen to check position of elements.)
Expected results:
- (For VO: Completion of page loading should be indicated by VO announcement "Web page loaded - Home".)
- The home page (as seen in the Test 1) should appear, with the name of the museum at the navigation bar, and the four options.
- Options should appear in the same order as before.
- All text should appear in the language selected at the language selection screen.
Test 6: Enter object code (cont'd from Test 5)
Procedure:
- Complete Test 5.
- At the home page, invoke "Enter object code".
- (For VO: After the page load announcement, have VO read the screen from top to bottom. Also tap around the screen to check position of elements.)
Expected results:
- (For VO: Completion of page loading should be indicated by VO announcement "Web page loaded - Code entry".)
- A back button and "Enter object code" title should appear in the navigation bar, in that order. No other elements should be present on the bar.
- Short instructions (e.g., "Enter code from the object's label to learn more about the object") should appear below the navigation bar.
- Two empty fields should appear below the instructions.
- A keypad should appear below the empty fields, including the numbers 0-9 and a delete key.
- All text should appear in the language selected at the language selection screen.
Test 7: Back to the home from Code entry (cont'd from Test 6)
Procedure:
- Complete Test 6.
- While on Enter object code page, invoke the back button in the navigation bar.
- (For VO: After the page load announcement, have VO read the screen from top to bottom. Also tap around the screen to check position of elements.)
Expected results:
- (For VO: Completion of page loading should be indicated by VO announcement "Web page loaded - Home".)
- The home page (as seen at the Test 1) should appear, with the name of the museum at the navigation bar, and the four options.
- Options should appear in the same order as before.
- All text should appear in the language selected at the language selection screen.
Test 8: Change language (cont'd from Test 7)
Procedure:
- Complete Test 7.
- At the home page, invoke "Change language".
- (For VO: After the page load announcement, have VO read the screen from top to bottom. Also tap around the screen to check position of elements.)
Expected results:
- (For VO: Completion of page loading should be indicated by VO announcement "Web page loaded - Language selection".)
- A flag icon and "Language selection" title should appear in the navigation bar, in that order. No other elements should be present on the bar.
- Options to select "English" or "Français" should appear, in that order.
Test 9: Back to the home from Change language (cont'd from Test 8)
Procedure:
- Complete Test 8.
- While on Language selection page, invoke "Français".
- (For VO: After the page load announcement, have VO read the screen from top to bottom. Also tap around the screen to check position of elements.)
Expected results:
- (For VO: Completion of page loading should be indicated by VO announcement "Web page loaded - Home".)
- The home page (as seen at the Test 1) should appear, with the name of the museum at the navigation bar, and the four options.
- Options should appear in the same order as before.
- All text should be in French.
Boundary Tests
Description: Ensures proper functionality at the input limits.
Protocol: Perform these tasks on the following site.
Specifications
On this page