Testing Cycle Status

Problem

Testing cycles can be complex objects as they contain information about manual testers, tests, different builds and versions of products, and maybe even configurations. To not lose track it is important to find answers to questions like:

  • How many tests have been finished?
  • How many of them passed or failed per build?
  • Are my manual testers still busy or can they do additional work?

Solution

Use the data mart view RV_TestingCycleStatus to create a report that shows the status of a testing cycle per tester and build that will give you an overview of how many tests are passed, failed, not executed grouped by manual tester, configuration and build.

SELECT BuildName, TesterLogin, TesterExecutionName,
  PassedCount, FailedCount, NotExecutedCount
FROM RV_TestingCycleStatus
WHERE TestingCycleID = ${testingCycleID|3|Testing Cycle ID}
ORDER BY BuildOrderNumber, TesterLogin
The query does the following:
  • Uses the view RV_TestingCycleStatus as data source, as it contains BuildName, TesterLogin and TesterExecutionName, which is the generated name reflecting tester, configuration and test.
  • Limits the data to the testing cycle ID that you are interested in.
The result of the SQL query shows the status per build and tester.
BuildName TesterLogin TesterExecutionName PassedCount FailedCount NotExecuted Count
352 No specific tester (Test Assets) 0 0 1
351 admin admin (English|SQL2008|FF|Tomcat - Test Assets) 0 1 0
352 admin admin (English|SQL2008|FF|Tomcat - Test Assets) 0 0 1
352 gmazzuchelli gmazzuchelli (English|Oracle10g|IE8|Tomcat - Test Assets) 0 1 1
352 jallen jallen (German|Oracle11g|FF|Tomcat - Test Assets) 1 1 0
352 smiller smiller (German|SQL2008|IE8|IIS - Test Assets) 1 1 0

For unassigned tests a "no specific tester" group is created with empty values for TesterLogin, TesterFirstName, and TesterLastName.

In case you just want to see how your test cycle is doing based on the performance of your manual testers, a slight variation of the query will help:
SELECT TesterLogin, TesterExecutionName, SUM(PassedCount) PassedCount,
  SUM(FailedCount) FailedCount, SUM(NotExecutedCount) NotExecutedCount
FROM RV_TestingCycleStatus
WHERE TestingCycleID = ${testingCycleID|3|Testing Cycle ID}
GROUP BY TesterLogin, TesterExecutionName
ORDER BY TesterLogin
The query is extended by:
  • GROUP BY TesterLogin, TesterExecutionName for denoting the remaining columns.
  • SUM() to the counters for aggregating the figures.
TesterLogin TesterExecution Name PassedCount FailedCount NotExecutedCount
No specific tester (Test Assets) 0 0 1
admin admin (English|SQL2008|FF|Tomcat - Test Assets) 0 1 1
gmazzuchelli gmazzuchelli (English|Oracle10g|IE8|Tomcat - Test Assets) 0 1 1
jallen jallen (German|Oracle11g|FF|Tomcat - Test Assets) 1 1 0
smiller smiller (German|SQL2008|IE8|IIS - Test Assets) 1 1 0