Test Results


About Test Results

The Test Results window is where details of any test are viewed, and decisions and comments are made. What is shown, and what you can do, depends on the properties of the step defined in the workflow. If a step does not have an analytic test, it shows the Description, Examiner comments, and Decision history only. However, it is still where you can make or alter decisions, add comments, and review the purpose of the step.

For our purposes here, a Step is any leaf node in the Workflow tree. A Test is any Step with associated analysis. Most of the time though, we use the terms interchangeably, differentiating only when its important to do so.

Page Contents

Page contents

  1. Name of test and analytic result. Color coded: pass-blue, fail-red, NA-grey.
  2. Description - from workflow step property. Descriptions often include the rule specifications or regulations. These are easily changed by the jurisdiction staff.
  3. Information messages - text messages of interest. Generated from the test code, and included to assist the examiner. If empty, will not be shown, as in this case above.
  4. Error messages - text messages concerning errors. Generated from the test code, and part of the test specification.
  5. Examiner comments - text entry box. Comments are required in most jurisdictions before a prior decision can be changed.
  6. Decision history - record of all decisions, timestamped, and including the examiner comments.
  7. Table of results - specific to each analytic test. There will be no table for steps without an analytic test. Records with errors shown in red.

Details

Key points about Test Results:

  1. Test Results will load information and any prior results and decision data, when the step is selected in the Workflow or Results and Decisions windows.
  2. Test Results will load new results if a test is executed in the Workflow window.
  3. If step has no analytic test associated, only the title, description and any prior decision data are loaded.
  4. Error messages should accompany an analysis fail (red title), except for rare specified exceptions specified by jurisdiction.
  5. Decisions are made using the toolbar, and once done, the Test Results window is reset to empty.
  6. The decision status is not obvious in the Test Results window, as it is obvious from the source activating the step results.

Note: Prior decision data will NOT be reset on re-execution of an analytic test!


Actions (Toolbar Controls)

Click on the action's icon or name below to jump to the details page for each.

Icon Action Description Target
Pass Pass (accept) test or step. Decision
Fail Fail (reject) test or step. Decision
Ignore Ignore test or step. Decision
Refresh Results Refresh results in table. Table
Next Error Scroll table to next error and select row. Table
Save Save test results page as HTML. Page
Print Print results and decisions page. Page

Note: The Pass, Fail and ignore actions are disable for steps with no requirement for a decision. If all buttons are disabled, click the Test Results window title bar to make it the active window.