Comparing Result Files

The Compare Two Results command allows you to quickly note only the results that have changed from a prior run without having to look at the same errors over again. The command identifies differences based on the following criteria:

A test passes in one test plan run and fails in the other.
A test fails in both runs but the error is different.
A test is executed in one test plan run but not in the other.

Silk Test Classic uses the test descriptions as well as the test statements to identify and locate the various cases in the test plan. Therefore, if you change the descriptions or statements between runs, Silk Test Classic will not be able to find the test when you run Compare Two Results.

Open two results files.
Make the results set you want to compare to another results set the active window.
Choose Results > Compare Two Results.
On the Compare Two Results dialog, select a results set from the list box and click OK.
When the results set is displayed again, a colored arrow is positioned in the left margin for every test that is different.
A red arrow indicates that the difference is due to the pass/fail state of the test changing.

A magenta arrow indicates that the difference is due to the addition or removal of the test in the compared test run.
Click Results > Next Result Difference to search for the next difference or choose Results > Next Error Difference to search for the next difference that is due to the change in a pass/fail state of a test.

Silk Test Classic uses the test descriptions as well as the script, testcase, and testdata statements to identify and locate the various cases in the test plan and in the results set. When test results overlap in the two results set that were merged, the more recent run is used. If you change a test description between runs or modify the statements, Silk Test Classic might be unable to find the test when you try to merge results. Silk Test Classic places these orphaned tests at the top of the results set.