Fluid Engage an exhibition, catalogue QA test plan

QA overview

Environments

  • iPhone OS 3.0 or higher on iPhone 3G or 3GS
  • iPhone OS 3.0 or higher on iPod touch 1G, 2G or 3G

For testing Fluid Engage with VoiceOver: 

  • iPhone OS 3.0 or higher on iPhone 3GS
  • iPhone OS 3.0 or higher on iPod touch 32 GB or 64 GB (Fall 2009 or later)

Protocol overview

General QA guidelines

  • Does the tool behave the way that you would expect?
  • Are you surprised by anything?
  • Does something take longer than you would expect?
  • When the tool does something unexpected or takes too long to do something, does the tool provide appropriate feedback?

QA tests

Unit tests

Protocol: Launch the following websites to execute unit tests.

url to be filled

Task-oriented functional tests

Description: Ensures that the component is able to handle expected input.

Protocol: Perform these tasks after completing initial Engage setup (to be added: instructions on adding app to home screen).

Test all screens: Absence of horizontal scroll

Procedure:

  1. Drag the screen left and right while holding the device in portrait mode.

Expected results:

  • The screen should not shift left or right (i.e., it is fixed).
Test 1: Catalogue page load

Procedure:

  1. From the application home screen, invoke "Exhibitions" or its icon.
  2. At the Exhibitions page, invoke "Simply Montreal" exhibition.
  3. At Simply Montreal main page, invoke "View the full catalogue".
  4. (For VO: After the page load announcement, have VO read the screen from top to bottom. Also tap around the screen to check position of elements.)

Expected results:

  • (For VO: User should hear "Web page loaded - Catalogue".)
  • A back button, a home button, the name of the exhibition and a button to switch to list view should appear in the navigation bar, in that order. No other elements should be present on the bar.
  • The exhibition objects should appear in grid view.
  • At the top of the page, a "View all objects" option should appear, with the number of objects in the catalogue.
  • If the exhibition has themes, the objects will appear included in these themes.
  • Each object is represented by a thumbnail link. The name of the object doesn't appear.
    (For VO: User should hear a link label indicating the name of the artifact the thumbnail is linked to.)
  • If the object hasn't any image available, an icon "no image" should appear instead of the thumbnail.
  • There should be a maximum of 4 objects per row.
  • A "View all in (the theme title)" option appears at the bottom of each theme, with the number of objects included in that theme.
Test 2: Switch to list view (cont'd from Test 1)

Procedure:

  1. Complete Test 1.
  2. Invoke the button at the right side of the navigation bar (switch to list layout button).
  3. (For VO: After the screen load announcement, have VO read the screen from top to bottom. Also tap around the screen to check position of elements.)

Expected results:

  •  
  • (For VO: User should hear a message about the loading of objects in list layout.)
  • The exhibition objects should appear in list layout.
  • At the top of the page, the "View all objects" option should remain, with the number of objects in the catalogue.
  • If the exhibition has themes, the objects will appear included in these themes, one below the other.
  • Each object takes a row. Each row contains a thumbnail at the left side, and the object's name and a secondary information (usually date) at the right.
  • If the object hasn't any image available, an icon "no image" should appear instead of the thumbnail.
  • A "View all in (the theme title)" option appears at the bottom of each theme, with the number of objects included in that theme. 
  • The screen should display the same themes and objects as in the grid layout.
Test 3: View an object's information (cont'd from Test 2)

Procedure:

  1. Complete Test 2
  2. Invoke one of the objects (anywhere on the row).
  3. (For VO: After the page load announcement, have VO read the screen from top to bottom. Also tap around the screen to check position of elements.)

Expected results:

  • (For VO: User should hear "Web page loaded - Artifact".)
  • A back button, a home button, and the name of the object should appear in the navigation bar, in that order. No other elements should be present on the bar.
  • Information about the selected object should appear on the page.
Test 4: Back to the main catalogue page (cont'd from Test 3)

Procedure:

  1. Complete Test 3
  2. At the object's page, invoke the back button (at the left side of the navigation bar).
  3. (For VO: After the page load announcement, have VO read the screen from top to bottom. Also tap around the screen to check position of elements.)

Expected results:

  • (For VO: User should hear "Web page loaded - Catalogue".)
  • The main catalogue screen should be displayed in list view (consistently with the list view at the test 2).
Test 5: Switch to grid view (cont'd from Test 4)

Procedure:

  1. Complete Test 4.
  2. Invoke the button at the right side of the navigation bar.
  3. (For VO: After the screen load announcement, have VO read the screen from top to bottom. Also tap around the screen to check position of elements.)

Expected results:

  • (For VO: User should hear a message about the loading of objects in grid layout.)
  • The right button at the navigation bar should now become switch to list layout button.
  • The exhibition objects should appear in grid view (same screen as in the Test 1).
  • The screen should display the same themes and objects as in the previous list layout.
Test 6: View an object's information (cont'd from Test 5)

Procedure:

  1. Complete Test 5
  2. Invoke one of the objects (any thumbnail).

Expected results:

  • (For VO: User should hear "Web page loaded - Artifact".)
  • A back button, a home button, and the name of the object should appear in the navigation bar, in that order. No other elements should be present on the bar.
  • Information about the selected object should appear on the page.
Test 7: Back to the main catalogue page (cont'd from Test 6)

Procedure:

  1. Complete Test 6
  2. At the object's page, invoke the back button (at the left side of the navigation bar).
  3. (For VO: After the page load announcement, have VO read the screen from top to bottom. Also tap around the screen to check position of elements.)

Expected results:

  • (For VO: User should hear "Web page loaded - Catalogue".)
  • The main catalogue screen should be displayed in grid view (consistently with the grid view at the test 5).
Test 8: View all objects in the catalogue (grid view)

Procedure:

  1. Load the catalogue main screen. Ensure you are at the grid view.
  2. At the catalogue main screen, invoke the option "View all objects".
  3. (For VO: After the page load announcement, have VO read the screen from top to bottom. Also tap around the screen to check position of elements.)

Expected results:

  • (For VO: User should hear "Web page loaded - Browse Artifacts".)
  • A back button, a home button, the name of the exhibition and a button to switch to list view should appear in the navigation bar, in that order. No other elements should be present on the bar.
  • The exhibition objects should appear in grid view (4 objects per row).
  • The title "Viewing all objects" + number of objects in the catalogue should appear at the top of the page.
  • Each object is represented by its thumbnail. Its name doesn't appear.
  • (For VO: User should hear a link label indicating the name of the artifact the thumbnail is linked to.)
  • Objects are displayed without categories (themes don't appear).
  • If there are more than 20 objects, a button to load 20 more objects appear at the bottom of the page.
Test 9: View all objects in the catalogue: switch to list view (cont'd from Test 8)

Procedure:

  1. Complete Test 8.
  2. Invoke the button at the right side of the navigation bar.
  3. (For VO: After the screen load announcement, have VO read the screen from top to bottom. Also tap around the screen to check position of elements.)

Expected results:

  • (For VO: User should hear a message about the loading of objects in list layout.)
  • The right button at the navigation bar should now become "switch to grid layout" button.
  • The exhibition objects should appear in list view, without themes.
  • Same objects as in the grid view should be displayed. 
  • If there are more than 20 objects, a button to load 20 more objects appear at the bottom of the page.
Test 10: Back to the main catalogue screen (cont'd from Test 9)

Procedure:

  1. Complete Test 9.
  2. Invoke the back button, at the left side of the navigation bar.
  3. (For VO: After the page load announcement, have VO read the screen from top to bottom. Also tap around the screen to check position of elements.)

Expected results:

  • (For VO: User should hear "Web page loaded - Catalogue".)
  • The main catalogue screen should be displayed in list view (consistently with the list view at the test 9).
Test 11: View all objects in a theme (grid view)

Procedure:

  1. Load the catalogue main screen. Ensure you are at the grid view.
  2. At the catalogue main screen, invoke the option "View all in..." one of the themes.
  3. (For VO: After the page load announcement, have VO read the screen from top to bottom. Also tap around the screen to check position of elements.)

Expected results:

  • (For VO: User should hear "Web page loaded - Browse Artifacts".)
  • A back button, a home button, the name of the exhibition and a button to switch to list view should appear in the navigation bar, in that order. No other elements should be present on the bar.
  • The theme objects should appear in grid view (4 objects per row).
  •  
  • The title "Viewing all objects in" + theme name + number of objects in the theme should appear at the top of the page.
  • Each object is represented by its thumbnail. Its name doesn't appear.
  • (For VO: User should hear a link label indicating the name of the artifact the thumbnail is linked to.)
  • Objects are displayed without categories.
  • If there are more than 20 objects, a button to load 20 more objects should appear at the bottom of the page.
Test 12: Load more objects (grid view) (cont'd from Test 11)

Procedure:

  1. Complete the Test 11
  2. At the bottom of the page, invoke "Load 20 more objects".
  3. (For VO: After the screen load announcement, have VO read the screen from top to bottom. Also tap around the screen to check position of elements.)

Expected results:

  • (For VO: User should hear a message about the loading of 20 new objects.)
  • 20 more objects should appear following the previous ones. 
  • The new objects should appear in grid view.
  • The previous objects should remain in the page, keeping the same order they had before.
  • The rest of the page should remain the same.
  • If there are more objects, a button to load 20 more objects should appear at the bottom of the page.
Test 13: View all objects in a theme: switch to list view (cont'd from Test 11)

Procedure:

  1. Complete Test 11.
  2. Invoke the button at the right side of the navigation bar.
  3. (For VO: After the screen load announcement, have VO read the screen from top to bottom. Also tap around the screen to check position of elements.)

Expected results:

  • (For VO: User should hear a message about the loading of objects in list layout.)
  • The right button at the navigation bar should now become "switch to grid layout" button..
  • The objects should appear in list view, without categories.
  • Same objects as in the grid view should be displayed. 
  • If there are more than 20 objects, a button to load 20 more objects should appear at the bottom of the page. 
Test 14: Load more objects (list view) (cont'd from Test 13)

Procedure:

  1. Complete the Test 13
  2. At the bottom of the page, invoke "Load 20 more objects".
  3. (For VO: After the screen load announcement, have VO read the screen from top to bottom. Also tap around the screen to check position of elements.)

Expected results:

  • (For VO: User should hear a message about the loading of 20 new objects.)
  • 20 more objects should appear following the previous ones. 
  • The new objects should appear in list view.
  • The previous objects should remain in the page, keeping the same order they had before.
  • The rest of the page should remain the same.
  • If there are more objects, a button to load 20 more objects should appear at the bottom of the page.

Boundary Tests

Description: Ensures proper functionality at the input limits.

Protocol: Perform these tasks on the following site.