Test Run Results

The Test Run Results page lists run details of a test or execution plan. You can access the page from the following locations:

  • Tests > Details View > <Test> > Runs > <Run ID>
  • Execution Planning > Details View > <Execution Plan> > Runs > <Run ID>
  • Execution Planning > Details View > <Execution Plan> > Runs > Test Runs > <Run ID>
  • Tracking > Activities > Last Executions > <Run ID> > Assigned Tests > <Run ID>

The Test Run Results page displays the following tabs/sections:

Tab Description
Details

Shows the details of the run, including its Duration, Execution Path, the Execution Plan Run ID of the execution plan run that included the test run, any Warnings/Errors, and the run comment, if a comment is added to the run. This tab also allows you to change the status of the test run. This option is useful if you need to manually overrule the status of a test run.

When a manual status change is performed, the details of the change are reflected in this tab's Status, Status Changed On, Status Changed By, Previous Status, and Status Change Comment fields.

Timeline

The Timeline tab shows a grid that allows easy result and error analysis of test runs by combining the following:

  • The structure of the test suite if an output.xml file is available including failure/error/warning count.
  • Incidents from the output.xml file.
  • Log entries and messages.
  • Result files.

The entries are listed chronologically and the view contains check boxes allowing you to filter the different types of items.

You can also access this tab from the Analyze Results and Analyse Errors actions in the Test Run grids.

Note: The tab is displayed for all test types except for manual tests and Silk Test Workbench tests.
Specific Only displayed for Silk Test Classic, Silk Performer, and manual tests. This tab includes details that are specific to the selected test type. For example, when a Silk Test Classic test is selected, this view includes the selected test case, test data, and any warnings that were displayed during the test run.
Files Lists all files that were generated by this run, along with file sizes. The names of Silk Test Classic .rex files act as download links. Once downloaded, these files can be viewed directly in a text editor.

The upper table lists files that are associated with the test, such as result files or manually uploaded files for manual tests. The lower table lists files that are associated with the execution plan, for example execution log files or code analysis results.

In the Actions column of the Result Files, click Delete Run Results to delete a specific result file. Note that some files are protected and cannot be deleted.

Click Download All Files to download all result files generated by the test run, as a zipped package.

For Silk Test Workbench, click the result.stwx file to open Silk Test Workbench in context of the result file.

For Silk Test Workbench, click the error.png to see the last screenshot for a Visual Test when a playback error occurs.

Messages

Lists all messages that were generated by this run, along with the timestamp and severity of the messages.

Success Conditions Only displayed for automated tests. This tab shows all the success conditions that are defined for the test in Tests > Details View > <Test> > Properties during the test planning process, and the result values from the execution run. Success conditions are used to determine if a test is Passed or if it has Failed.
Data Driven Only displayed for data-driven tests using the option of having a single test for all data rows of the data set. This tab lists the status of each instance (data row) run of the test. Clicking an instance brings up another instance of the Test Run Results dialog box with run details of the selected instance.
Attributes Any attributes that are configured for the test.
Parameters Any parameters that are configured for the test.

The following table lists the UI elements that are used to step through the test results of an execution run. These elements are only visible when accessing the Test Run Results dialog box from an execution plan.

Item Description
Skip Passed Used to determine which test run results should be displayed when browsing using the Previous Result and Next Result buttons. Checking this option only displays tests with a status other than Passed.
< Previous Result Jumps to the result details of the previous test in the selected execution plan run.
Next Result > Jumps to the result details of the next test in the selected execution plan run.