Test Runners


Test Runners run your tests from a variety of infrastructure sources. Test runners are what actually generate virtual users and execute your defined scenario as configured. We currently support three sources of test runners:

  1. A public shared grid distributed across the globe on the infrustructure of various cloud providers.
  2. A private shared grid distributed across your own infrastructure. This private grid can span both your own data centers and any cloud provider. This grid is then shared across tests run in your account only.
  3. On demand grid for a single test execution ensures full isolation. Currently this supports AWS EC2 instances only, either using Testable's account or your own. Other cloud platforms will be added in the future.

Test Configuration

When creating a new test configuration you must select one or more test runners to execute your test. The same test runner can be configured multiple times within a single configuration as long as you stay within your account limits.

So for example you could run your scenario on our shared public grid, inside your data center, and using on demand AWS instances all at the same time.

AWS On Demand Test Runner


You can run your test on isolated AWS instances, either by self-hosting within your own AWS account or running within our account.

Option 1: EC2 Instances Within the Testable AWS Account

Select AWS On Demand - Testable Account to have the EC2 test runner instances hosted within Testable's account.

AWS On Demand Public

Option 2: Self Hosted EC2 Instances Within Your AWS Account

Configure your own AWS account to self-host the EC2 test runner instances. Testable will automatically terminate the instances once the test is finished in that region. Click the New... option if you are setting up your AWS account for the first time and make sure to read our Self-Hosted AWS Test Runner Setup guide for detailed requirements.

Self-Hosted AWS On Demand

Notice the extra settings:

  • VPC: The AWS VPC where you want the test runners to run. Make sure the VPC chosen can connect the https://agents.testable.io.
  • Subnet: The subnet within the chosen VPC where you want the test runners to run.
  • Tags: Additional tags to add to any EC2 instance started. These can be specified either in the test configuration or a default set when creating/updating the test runner configuration.
  • Key Pair:Choose a key pair you have access to so that you can connect and monitor the instances we spun up as part of your test.

Public Shared Grid

The quickest way to run your test is on our public shared grid. Assuming there is no queue, your test will execute immediately in the regions selected.

Public Grid

As far as plan limits are concerned, shared grid usage is rounded to the nearest second (unlike AWS On Demand where rounding is up to the next hour).

Private Shared Grid

If you run on premises the My Shared Grid test runner will be automatically created. Whatever region names you provide when running your agents will appear in the list.

Private Grid


Go to Account -> Test Runners to add/remove/update your account's test runners. In the list you will see both public test runners (e.g. Public Shared Grid and AWS On Demand - Testable Account) as well as any private runners for your account.

Test Runner List

Add New Test Runner

Press the Create button in the upper right to add a new test runner. Only AWS On Demand runners can be configured here. If you run an agent on premises the My Shared Grid runner will be created automatically and whatever region names you choose will appear in the list on this page.

Read the Self-Hosted AWS Test Runner Setup guide for step-by-step instructions.

Add New Test Runner

Update Test Runner Configuration

For private AWS On Demand test runners you can update the AWS credentials and default VPC settings by clicking the configure icon next to the test runner name.

Delete Test Runner

For private AWS On Demand test runners you can delete it by clicking the trash icon next to the test runner name.