Decapod 0.6 Import-Export Test Plan
Decapod 0.6 Import-Export Test Plan
Environments
- OS: Ubuntu 12.04
- Browser: Firefox 15
General QA Guidelines
General Use
- Does the tool behave the way that you would expect
- Are you surprised by anything
- Does something take longer than you would expect
- When the tool does something unexpected or takes too long to do something, does the tool provide appropriate feedback
QA Tests
Protocol
Perform the following tests using each browser/system environment
Report issues at: http://issues.fluidproject.org/secure/Dashboard.jspa
Please search for issues before reporting them, so as to limit the number of duplicate entries.
Unit Test: UI
Protocol
Launch the following in a browser (paths relative to the decapod-ui directory) as a local file instead of through python server (e.g. file:///home/username/decapod-0.6/decapod-ui/tests/all-tests.html).
Note: You may need to adjust the security permissions to allow local ajax. (see: Browser settings to support local Ajax calls)
Test Suite:
- tests/all-tests.html
- Results
- All unit tests except the last one pass
- The last unit test "global failure" fails, which is a known issue
Unit Tests: Server
Protocol
From the decapod-server/tests directory launch the following through python command line (e.g. python test.py).
Note: Ensure that the Decapod Server is not running when the tests are being executed
Test Suite:
- test.py
- Results
- "OK" is prompted at the end of the output.
State Tests
Description
Ensures that the component properly traverses through the various states.Â
Protocol
Run through Tests 1-6, then 7-12 in order.
Run through Tests 7-12 a second time using Orca.
Decapod Server:
Mouse
Test 1: Load Application
- Procedure
- Load the application in a web browser
- Results
- The message "Select 'Browse files' to choose images to export." should appear towards the top
- The 'Browse files' button should be enabled
- 4 PDF export types (Image PDF, Image PDF with OCR Text, Computer Traced PDF with OCR Text, Font Matched PDF with OCR Text) and 2 Image export types (TIFF, PNG) should be listed.
Test 2: Mouse, Expand Export Options
- Procedure
- Complete Test 1
- Using the mouse, click on any of the export types
- Results
- The options for the export should expand below the export's description
- For PDF export, the "Output" select box should be enabled and showing the "A4 (210x297 mm) option
- The 'Start Export' button should be disabled
Test 3: Mouse, Add Images to Import
- Procedure
- Complete Test 2
- Using the mouse, click on the 'Browse files' button
- Select 1 or more images to import
- Results
- The message area above the 'Browse files' button should indicate the number of files added and if there were errors adding any of them to the queue.
- The 'Start Export' button under each of the export types should be enabled
Test 4: Mouse, Export
- Procedure
- Complete Test 3
- Using the mouse, click on any of the export types to expand its options
- Using the mouse, click the 'Start Export' button
- Results
- The 'Browse Files' button should be disabled
- The other export options should be disabled
- The 'Start Export' button should be replaced by a progress indicator
- After the export is finished, the progress indicator should be replaced by a "Download" and "Start Over" link
Test 5: Mouse, Download
- Procedure
- Complete Test 4
- Using the mouse, click the "Download" link
- Results
- The interface should remain unchanged
- A PDF, of the type selected, or zip file (image export) should be downloaded through the web browser
Test 6: Mouse, Start Over
- Procedure
- Complete Test 5
- Using the mouse, click the "Start Over" link
- Results
- The interface should be reset to its initial state (See: Test 1)
Keyboard
Test 7: Load Application
- Procedure
- Load the application in a web browser
- Results
- The message "Select 'Browse files' to choose images to export." should appear towards the top
- The 'Browse files' button should be enabled
- 4 PDF export types (Image PDF, Image PDF with OCR Text, Computer Traced PDF with OCR Text, Font Matched PDF with OCR Text) and 2 Image export types (TIFF, PNG) should be listed.
Test 8: Keyboard, Expand Export Options
- Procedure
- Complete Test 7
- Using the keyboard, tap the 'Tab' key until one of the export types has focus
- Using the keyboard, tap the up or down arrow keys to focus a different export type if desired
- Using the keyboard, tap the "Enter/Return" key to select the focused export type
- Results
- The options for the export should expand below the export's description
- For PDF export, the "Output" select box should be enabled and showing the "A4 (210x297 mm) option
- The 'Start Export' button should be disabled
Test 9: Keyboard, Add Images to Import
- Procedure
- Complete Test 8
- Using the keyboard, tap the "Tab" key until the 'Browse files' button has focus
- Using the keyboard, tap the "Enter" key to activate the 'Browse files' button and open the file picker
- Select 1 or more images to import
- Results
- The message area above the 'Browse files' button should indicate the number of files added and if there were errors adding any of them to the queue.
- The 'Start Export' button under each of the export types should be enabled
Test 10: Keyboard, Export
- Procedure
- Complete Test 9
- Using the keyboard, tap the 'Tab' key until one of the export types has focus
- Using the keyboard, tap the up or down arrow keys to focus a different export type if desired
- Using the keyboard, tap the "Enter/Return" key to select the focused export type
- Using the keyboard, tap the "Tab" key until the 'Start Export' button has focus
- Using the keyboard, tap the "Enter/Return" key to activate the 'Start Export' button
- Results
- The 'Browse Files' button should be disabled
- The other export options should be disabled
- The 'Start Export' button should be replaced by a progress indicator
- After the export is finished, the progress indicator should be replaced by a "Download" and "Start Over" link
Test 11: Keyboard, Download
- Procedure
- Complete Test 10
- Using the keyboard tap the "Tab" key until the "Download" link has focus
- Using the keyboard tap the "Enter/Return" key to activate the "Download" link
- Results
- The interface should remain unchanged
- A PDF, of the type selected, or zip file (image export) should be downloaded through the web browser
Test 12: Keyboard, Start Over
- Procedure
- Complete Test 11
- Using the keyboard tap the "Tab" key until the "Start Over" link has focus
- Using the keyboard tap the "Enter/Return" key to activate the "Start Over link
- Results
- The interface should be reset to its initial state (See: Test 1)
- The interface should be reset to its initial state (See: Test 1)
Task Oriented Functional Tests
Description
Ensures that the component is able to handle expected input.
Protocol
Perform these tasks on the following site.
Perform these tasks a second time using Orca.
Decapod Server:
Test 1: Reset after adding images
- Procedure
- Start the server and load the application
- Add images to import
- Trigger the reset link
- Results
- The interface should be reset to its initial state
- The message "Select 'Browse files' to choose images to export." should appear towards the top
- The 'Browse files' button should be enabled
- 4 PDF export types (Image PDF, Image PDF with OCR Text, Computer Traced PDF with OCR Text, Font Matched PDF with OCR Text) and 2 Image export types (TIFF, PNG) should be listed.
- Stop Test
- Stop the server and close the browser
Test 2: Generate an Image PDF
- Procedure
- Start the server and load the application
- Add images to import
- Expand the "Image PDF" export type and trigger the "Start Export" button
- After the export has completed, download the PDF
- Results
- An image PDF, representing the imported images, should be produced
- Stop Test
- Refresh the browser to return the page to its initial state
Test 3: Generate an Image PDF with OCR Text
- Procedure
- Start the server and load the application
- Add images to import
- Expand the "Image PDF with OCR Text" export type and trigger the "Start Export" button
- After the export has completed, download the PDF
- Results
- An image PDF with OCR text, representing the imported images, should be produced
- Stop Test
- Refresh the browser to return the page to its initial state
Test 4: Generate a Computer Traced PDF with OCR Text
- Procedure
- Start the server and load the application
- Add images to import
- Expand the "Computer Traced PDF with OCR Text" export type and trigger the "Start Export" button
- After the export has completed, download the PDF
- Results
- A computer traced PDF with OCR text, representing the imported images, should be produced
- Stop Test
- Refresh the browser to return the page to its initial state
Test 5: Generate a Font Matched PDF with OCR Text
- Procedure
- Start the server and load the application
- Add images to import
- Expand the "Font Matched PDF with OCR Text" export type and trigger the "Start Export" button
- After the export has completed, download the PDF
- Results
- A font matched PDF with OCR text, representing the imported images, should be produced
- Stop Test
- Refresh the browser to return the page to its initial state
Test 6: Generate a TIFF export
- Procedure
- Start the server and load the application
- Add images to import
- Expand the "TIFF" export type and trigger the "Start Export" button
- After the export has completed, download the zip
- Results
- A computer traced PDF with OCR text, representing the imported images, should be produced
- Stop Test
- Refresh the browser to return the page to its initial state
Test 7: Generate a PNG export
- Procedure
- Start the server and load the application
- Add images to import
- Expand the "PNG" export type and trigger the "Start Export" button
- After the export has completed, download the zip
- Results
- A computer traced PDF with OCR text, representing the imported images, should be produced
- Stop Test
- Refresh the browser to return the page to its initial state
Boundary Tests
________________________________________________________
Description
Ensures proper functionality at the input limitsÂ
Protocol
Perform these tasks on the following site.
Perform these tasks a second time using Orca.
Test Images
Decapod Server:
Test 1: Reset before import
- Procedure
- Start the server and load the application
- Trigger the reset button
- Results
- The interface should be reset to its initial state
- The message "Select 'Browse files' to choose images to export." should appear towards the top
- The 'Browse files' button should be enabled
- 4 PDF export types (Image PDF, Image PDF with OCR Text, Computer Traced PDF with OCR Text, Font Matched PDF with OCR Text) and 2 Image export types (TIFF, PNG) should be listed.
- Stop Test
- Stop the server and close the browser
Test 2: Start Over
- Procedure
- Start the server and load the application
- Add images to import
- Trigger "Start Export" for one of the export types
- After the export has finished, trigger the "Start Over" link
- Results
- The interface should be reset to its initial state
- The message "Select 'Browse files' to choose images to export." should appear towards the top
- The 'Browse files' button should be enabled
- 4 PDF export types (Image PDF, Image PDF with OCR Text, Computer Traced PDF with OCR Text, Font Matched PDF with OCR Text) and 2 Image export types (TIFF, PNG) should be listed.
- Stop Test
- Stop the server and close the browser
Test 3: Large File
- Procedure
- Start the server and load the application
- Add a 100MB image file
- Trigger "Start Export" for one of the export types
- Results
- A PDF or zip for the type of export selected should be generated
- Stop Test
- Stop the server and close the browser
Test 4: With a large number of images generate an Image PDF
- Procedure
- Start the server and load the application
- Add 100+ images to import
- Expand the "Image PDF" export type and trigger the "Start Export" button
- After the export has completed, download the PDF
- Results
- An image PDF, representing the imported images, should be produced
- Stop Test
- Refresh the browser to return the page to its initial state
Test 5: With a large number of images generate an Image PDF with OCR Text
- Procedure
- Start the server and load the application
- Add 100+ images to import
- Expand the "Image PDF with OCR Text" export type and trigger the "Start Export" button
- After the export has completed, download the PDF
- Results
- An image PDF with OCR text, representing the imported images, should be produced
- Stop Test
- Refresh the browser to return the page to its initial state
Test 6: With a large number of images generate a Computer Traced PDF with OCR Text
- Procedure
- Start the server and load the application
- Add 100+ images to import
- Expand the "Computer Traced PDF with OCR Text" export type and trigger the "Start Export" button
- After the export has completed, download the PDF
- Results
- A computer traced PDF with OCR text, representing the imported images, should be produced
- Stop Test
- Refresh the browser to return the page to its initial state
Test 7: With a large number of images generate a Font Matched PDF with OCR Text
- Procedure
- Start the server and load the application
- Add 100+ images to import
- Expand the "Font Matched PDF with OCR Text" export type and trigger the "Start Export" button
- After the export has completed, download the PDF
- Results
- A font matched PDF, representing the imported images, should be produced
- Stop Test
- Refresh the browser to return the page to its initial state
Test 8: With a large number of images generate a TIFF export
- Procedure
- Start the server and load the application
- Add 100+ images to import
- Expand the "TIFF" export type and trigger the "Start Export" button
- After the export has completed, download the zip
- Results
- A zip containing TIFF versions of the images should be produced
- Stop Test
- Refresh the browser to return the page to its initial state
Test 9: With a large number of images generate a PNG export
- Procedure
- Start the server and load the application
- Add 100+ images to import
- Expand the "PNG" export type and trigger the "Start Export" button
- After the export has completed, download the zip
- Results
- A zip containing PNG versions of the images should be produced
- Stop Test
- Refresh the browser to return the page to its initial state
Test 10: Custom Output Settings - min
- Procedure
- Start the server and load the application
- Add some images to import
- Expand one of the PDF export types
- Change the width to 1, height to 1, and dpi 50
- Results
- The changes should be accepted and the "Start Export" should remain enabled
- Stop Test
- Refresh the browser to return the page to its initial state
Test 11: Custom Output Settings - max
- Procedure
- Start the server and load the application
- Add some images to import
- Expand one of the PDF export types
- Change the width to 300, height to 300, and dpi 600
- Results
- The changes should be accepted and the "Start Export" should remain enabled
- Stop Test
- Refresh the browser to return the page to its initial state
Test-to-Fail
________________________________________________________
Description
Tests which should cause errors or not be accepted as inputÂ
Protocol
Perform these tasks on the following site.
Perform these tasks a second time using Orca.
Test Images
Decapod Server:
Test 1: Export Before Import
- Procedure
- Start the server and load the application
- Attempt to trigger the "Start Export" button for any of the export types
- Results
- The "Start Export" button should be disabled and nothing should happen
- Stop Test
- Stop the server and close the browser
Test 2: Add more after export
- Procedure
- Start the server and load the application
- Add images to import
- Trigger "Start Export" for one of the export types
- Attempt to add more images to import
- Results
- The "Browse Files" button should be disabled and nothing should happen
- Stop Test
- Stop the server and close the browser
Test 3: Import non-image files
- Procedure
- Start the server and load the application
- Add non-image files to import
- Trigger "Start Export" for one of the export types
- Results
- A "415 unsupported Media Type" error should be returned from the server
- Stop Test
- Stop the server and close the browser
Test 4: Image files that exceed the size limit
- Procedure
- Start the server and load the application
- Add an image file that is larger than 100MB
- Results
- An error message indicating that the size limit has been exceeded should be displayed.
- Stop Test
- Stop the server and close the browser
Test 5: Custom Output Settings - below min
- Procedure
- Start the server and load the application
- Add some images to import
- Expand one of the PDF export types
- Change the width to 0, height to 0, and dpi 49
- Results
- The changes should not be accepted and an error message should appear
- The "Start Export" should remain enabled
- Stop Test
- Refresh the browser to return the page to its initial state
Test 6: Custom Output Settings - above max
- Procedure
- Start the server and load the application
- Add some images to import
- Expand one of the PDF export types
- Change the width to 301, height to 301, and dpi 601
- Results
- The changes should not be accepted and an error message should appear
- The "Start Export" should remain enabled
- Stop Test
- Refresh the browser to return the page to its initial state
Test 7: Custom Output Settings - non-numeric
- Procedure
- Start the server and load the application
- Add some images to import
- Expand one of the PDF export types
- Change the width, height, and dpi to have a non-numeric value
- Results
- The changes should not be accepted and an error message should appear
- The "Start Export" should remain enabled
- Stop Test
- Refresh the browser to return the page to its initial state
- Refresh the browser to return the page to its initial state