Customize Test Result Dashboard

Introduction

After executing a test a default dashboard is shown which shows a variety of information about the test. While this is a useful starting place, Testable supports deep customization of this dashboard.

Dashboards can be saved for later use.

Panel Location

The panels can be reordered by clicking and dragging on the header and releasing in the newly desired location. The top level panels (console, agents map, and regional results) are reordered separately from the regional result ones (summary, results grid, charts).

Drag Panel

Add/Remove Panel

Each panel can be removed by clicking on the red 'x' in the upper right. To add a panel click on the Dashboard... button in the upper right and select the type of panel to add. Note that the console, agent map, summary, and regional results can only be displayed once, so if it is already visible you will not be able to add it again.

Dashboard Menu

Add/Customize a Chart

Make sure the Regional Results are visible to add a chart (Show Regional Results in the action menu). Then select the Add Chart action.

There are currently two types of charts:

  1. Line: Time is plotted on the x-axis and whichever metrics are selected on the y-axis.
  2. Histogram: A histogram which visualizes the count per bucket using a donut chart.

Simply select the metrics to plot and click the Add Chart button.

Click the configure icon on any chart panel to customize its name and metrics.

Add Chart

New charts are always added at the top of the regional results tabs.

Customize Summary

The summary panel provides a quick high level analysis of this test execution and how it compares to other recent executions of the same configuration. You can customize which metrics are part of this analysis and what percentage change thresholds are considered an improvement, consistent, concerning, or a failure. Note that the percentage change is relative to that metric across a weighted average of the last 10 (if that many exist) test executions.

Click the configure icon on the Summary panel to customize.

Configure Summary

Customize Metrics

Click the configure icon on the Metrics panel to customize which metrics are displayed. Any column with the 'Show in dashboard' checkbox will show up on the home page if this dashboard is made the default one.

Configure Metrics

Customize By Resources Grid

Click the configure icon on the Results Grid panel to customize which metrics are displayed in the grid. Any column with the 'Show in execution history' checkbox will show up on the Test Configuration page if this dashboard is made the default one (see the Dashboard Actions section).

Configure Grid

Dashboard Actions

If any changes have been made to the dashboard a ** * ** appears next to the test configuration name at the top of the dashboard. Use the dashboard menu to manage your dashboards.

Open Dashboard

Open Dashboard

Save/Save As Dashboard

Save any customizations to this dashboard or as a new dashboard. Note that when you customize the default dashboard it can only be saved as a new dashboard.

Save Dashboard

Rename Dashboard

Give the dashboard a different name. Not supported for the default dashboard.

Delete Dashboard

Delete the dashboard. Not supported for the default dashboard.

Make Default Dashboard

Mark this dashboard as the default one for this test configuration, test case, and/or account. Making a dashboard the default for a test configuration overrides the default dashboard for the test case which override the default dashboard for the account. The dashboard will load by default when opening the results page. The default dashboard configuration is also used on other pages as follows:

  1. Testable Overall Dashboard: In the Summary widget configuration, any metric that has the 'Show in dashboard' checkbox checked is displayed.
  2. Test Configuration Summary: On the Test Case landing page, in the Test Configurations tab, the first metric shown in the Dashboard is displayed.
  3. Test Execution History: Click on the name of a Test Configuration. The page has a grid showing the test execution history. The columns displayed are the ones that have the 'Show in executions history' checkbox checked in the Result Grid configuration.

Make Default Dashboard