Results & Decisions


About Results & Decisions

The Results and Decisions window is opened after a batch run of automated tests. It provides a quick means to review the analytic results summaries and to make decisions in "batch". Selection of a row in the table will open the Test Result window showing the details of the test description and analytic results.

Colors on the rows indicate the decision, to make it easy to see the overall state of the examination. These colors are customizable. In the image below, decisions have been made. Yellow shows Fail, blue Pass, and gray Ignore. The cyan row is selected, and its results would show in the Test Results window. No decision is white.

Note: The report is updated on every decision, comment or analytic result change. It is always current.


Sorting Table Columns

The table can be sorted on a column (ascending or descending) by clicking the column header. Up to three columns may be selected (primary sort, followed by secondary, then tertiary). Sort columns are shaded to show the sort. read more...

Our Preference: We like to sort on the Analysis column to bring all tests that failed analysis. Since these are obviously the ones to review, it makes it much simpler. Then click on in the toolbar to be able to use the down arrows to move from one test to the other, while looking at the results in the Test Results window.


Modes

The interaction is in two modes:

  1. Review and then apply Group decisions.
  2. Select row for Test Results window decisions.

Review and Group Decisions

As suggested in our preferences callout, you can easily review the detailed analytic test results using the arrow keys to navigate the table rows. After a quick review of steps that have passed their tests, or are shown as Not Applicable, you may assign decisions as a group using the actions on the toolbar. There is no group assignment for Fail, to ensure fails are less "automatic".

Group decisions are usually done when the examiner is familiar with the type of plan and the analysis of each test. So they are more sure of the correctness of the analysis result.

Test Results Window

Decisions on analytic fails can only be made in the Test Results window. It also has the most options for making and modifying decisions, including adding comments. If you do not enable "Keep Focus", it is the default action for row selection.

Selection of a row in the table will open the Test Result window showing the details of the test description and analytic results. The focus is passed to the Test Result window. Decisions can then be made for that step using the Test Results toolbar actions. read more...


Actions (Toolbar Controls)

Click on the action's icon or name below to jump to the details page.

Icon Tool Description Target
Accept All Passed Accept all tests that passed analysis. Decisions
Ignore All NA Ignore all tests that are not applicable. Decisions
Refresh Results Refresh results in table. Table
Keep Focus Keep focus on this window, update Test Results window. Window
Save Save results and decisions page as HTML. Page
Print Print results and decisions page. Page