This month we introduce the ability to generate load using on demand, isolated AWS infrastructure using your AWS account or ours with more cloud providers coming soon.
AWS On Demand Load Generation
Until now all load was generated on shared infrastructure. Either shared across all accounts via our public grid or across all tests within your account using our on premises solution.
We now have a third option and also did a major internal overhaul to support new test runners in the future while we were at it.
From today you can generate load from isolated, on demand AWS instances that are spun up for each test separately. Use your own AWS account or ours.
When running a test you can select multiple test runners. This means you can run your scenario from multiple AWS regions, our shared public grid, and within your data center (or VPC) all at the same time.
Look out for more test runners in the near future to support on demand instances on other platforms like the Microsoft Cloud. Click here for more detailed documentation on the new features.
When creating a new test configuration you can now specify exactly which percentiles you want to calculate for all timing metrics. This includes our own metrics (e.g. latency) as well as any custom ones you define in your test.
While we were at it, we also improved the speed at which we process and aggregate results by 10x using a new approach for calculating percentiles.
Please check out all the new features and let us know if you have any thoughts or concerns. Happy testing!