Tests Overview

The Tests Overview page provides a consolidated view of test execution activity, including execution trends, pass and fail rates, and overall test distribution. You can also drill down into individual test runs to investigate failures and analyze execution details.

info

The Tests Overview page is available to Cloud Administrators, Project Admins, and Users. Each user can view data only for the projects they are allocated to.

Understanding Trend Indicators

Trend indicators provide contextual insights by comparing current performance metrics against an equivalent preceding timeframe (such as comparing the last 30 days to the 30 days prior). Rather than showing static values in isolation, these indicators highlight directional shifts, performance velocity, and overall health across key testing metrics.

• Percentage Change: Calculated as the difference between the current period's metric and the previous period's metric, divided by the previous period's metric.
• Arrow Direction: Indicates whether the numerical value went up ↑ or down ↓.
• Color Coding:
  • Green: Indicates a positive outcome (e.g., an increase in Total Tests or Pass Rate, or a decrease in Fail Rate).
  • Red: Indicates a negative outcome (e.g., a decrease in Pass Rate or an increase in Failures).

info

The above image displays the KPI summary, Status Distribution, Tests Over Time, and the start of Mobile Test Distribution (toggle by OS, OS version, or Model).

KPIs

KPI	Description
Failed	Total executions with a Failed status.
Pass Rate	Percentage of executions with a Passed status.
Total Tests	Total executions in the selected period.

Charts

Chart	Description
Mobile Test Distribution	Coverage broken down by OS, OS version, or Model, with a details table of runs and pass, fail, error, and skip counts per category.
Status Distribution	Share of executions that are Passed, Failed, Skipped, Error, or Healed.
Tests Over Time	Test execution volume per week, over time.

Switch the Mobile Test Distribution grouping

1. Locate Mobile Test Distribution.
2. Click OS, OS version, or Model in the toggle at the top-right of the chart.

Result: The donut chart and coverage details table update to group results by the selected dimension.

All Tests

Scroll down for a paginated table of individual test executions, sorted by Start Time, most recent first.

Column	Description
Cause	The underlying cause category, where available.
Duration	How long the execution ran.
ID	Unique identifier for the execution.
Start Time	When the execution started.
Status	Passed, Failed, Error, Skipped, or Healed.
Test Name	Name of the test. Click it to open the execution video report.

::: The above image displays the execution table alongside the Add Filter drawer — a partial view of the available filters. :::

Open a test execution's video report

1. Locate the execution in the table.
2. Click its Test Name.

Result: The video report opens in a new browser tab. For how to read the report.

Sort and Navigate through Test Executions

1. Click a column header to sort by that column. Click again to reverse the order.
2. Use the page size control to show 10, 25, or 50 rows per page. The default is 25.
3. Use the pager at the bottom of the table to move between pages.

Manage Columns and Sort Tests

The All Tests table allows you to customize the column layout and sort execution results to analyze test performance effectively:

• Sort Columns: Click any column header or the up/down arrows next to column names (e.g., Start Time, Duration, Status) to toggle ascending or descending order.

• Manage Columns:

  1. Click the Manage Columns button above the table.
  2. Select or deselect columns to show or hide specific test attributes (e.g., Project, Framework, User). Mandatory default columns cannot be removed.
  3. Search for specific attributes using the search bar within the Manage Columns menu.
  4. Drag and drop column items in the list to rearrange their order in the table.