This testing grid is intended to act as a minimal set of tests which should be run before each release. For more details on the format of this page and for a full test suite, please see the full Storytelling Tool Manual Testing Grid
Grid last updated: February 26, 2021
Tests last completed: February 26, 2021
Action sequences:
- Story Builder: User is able to publish a story with no blocks and no other fields filled in
- Story Builder: User is able to publish a story with one empty block of each type and no other fields filled in (empty, but with empty blocks too)
- Story Builder: User is able to publish a story with two text blocks
- Story Builder: User is able to publish a story with two image blocks, both images uploaded from the file system*
- Story Builder: User is able to publish a story with two image blocks, both images captured from the device*
- Story Builder: User is able to publish a story with two image blocks, one image captured, one image uploaded*
- Story Builder: User is able to publish a story with two audio blocks, both files uploaded from the file system*
- Story Builder: User is able to publish a story with two audio blocks, both files captured from the device*
- Story Builder: User is able to publish a story with two audio blocks, one file captured, one file uploaded*
- Story Builder: User is able to publish a story with two video blocks, both files uploaded from the file system*
- Story Builder: User is able to publish a story with two video blocks, both files captured from the device*
- Story Builder: User is able to publish a story with two video blocks, one file captured, one file uploaded*
- Story Builder: User can publish a story with one block of each type and all the fields filled in
- Story Builder/Viewer: Listening to the story with the Orator plays the story completely both in the Story Preview and on viewing a published story, and the Orator highlights text as it reads
- All pages: Imagery changes along with UIO contrast theme changes
- Back and forward within the editor steps works properly, state is not remembered on page reload
- Story Viewer: User sees appropriate error message when trying to load a story with an invalid ID
- Story Builder: User sees appropriate error message when trying to edit a story with an invalid ID
- Story Builder: User is able to load a published story into the editor, make changes and republish
* for the sequences that require two images, videos, audio files, etc. the intent is that these files be different from one another. I.e. for two uploaded images, make sure they're different images.
| Device Name | OS & Version | Browser & Version | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Apple iPad Air 3 | iOS 13.3 | Safari | 6 | Pass | Pass | Pass | Pass | Pass | Pass | 1 | 1 | Pass | Pass | Pass | Pass | Pass | Pass | 3, 4 | Pass | Pass | 7 |
| Desktop PC | Windows 10 Pro v.20H2 | Chrome 88 | 6 | Pass | Pass | Pass | N/A | N/A | Pass | N/A | N/A | Pass | N/A | N/A | Pass | 2 | Pass | 4 | Pass | Pass | 7 |
| Desktop PC | Windows 10 Pro v.20H2 | Firefox 86 | 6 | Pass | Pass | Pass | N/A | N/A | Pass | N/A | N/A | Pass | N/A | N/A | Pass | Pass | Pass | 4 | Pass | Pass | 7 |
| Google Pixel 5 | Android 11 | Chrome 86 | 6 | Pass | Pass | Pass | Pass | Pass | Pass | Pass | Pass | Pass | Pass | Pass | Pass | 2 | Pass | 4 | Pass | Pass | 7 |
| MacBook Pro 15" (mid-2015) | macOS High Sierra 10.13.6 | Safari 13.0.2 | 6 | Pass | Pass | Pass | N/A | N/A | Pass | N/A | N/A | Pass | N/A | N/A | Pass | Pass | Pass | 4 | Pass | Pass | 7 |
Issues noted in latest pass:
| Issue # | Jira | Description |
|---|---|---|
| 1 | Error rendering macro 'jira' : Unable to locate Jira server for this macro. It may be due to Application Link configuration. | Audio capture option is not presented, can only upload. Likely not much to be done about this, as it may depend on Firefox not sending the same Android Intents as Chrome. This is a previously known issue. |
| 2 |
| The Orator highlighting does not appear at all. This is a previously known issue. |
| 3 |
| Safari can navigate back through history after publishing |
| 4 |
| After traversing backward through history in the story editor and refreshing the page, can navigate forward. |
| 5 |
| iPad: Uploading freshly-captured image, the block editor preview did not appear, though the file uploaded and showed in the story preview just fine. Issue went away after capturing a new photo |
| 6 |
| Stories can no longer be published with no content (and no blocks added), so Test 1 will always fail. It appears to publish successfully, but since the localStorage ID was null, the author is redirected to the View page with a story ID of null afterwards, which of course fails. Consider removing this test from the grid, or adding a check for null story before publishing, and then adjusting this test to reflect the check |
| 7 |
| Since accounts are not enabled on the staging site, Test 19 is no longer usable. Either enable accounts on the Staging site (needs a Jira + work) or remove this test |