Load Impact Announces Performance Alerts for Automated Load Testing Results Analysis
Automated results analysis can really cut down on the time spent poring over test data to figure out where the bottlenecks are. In our user survey, we found that automated results analysis is the second most wanted capability for a load testing solution.
Load Impact automatically analyzes k6 (https://loadimpact.com/
There are two categories of alerts: Smart Result Performance Alerts and Test Health Performance Alerts.
Smart Result Performance Alerts
Smart Result Performance Alerts analyze the performance test results and alert users to performance issues in the system under test. There are currently 2 alerts in this category:
Throughput Limit Alert
The target system (website, SaaS / web app, API, or microservice)
High HTTP Failure Rate Alert
The HTTP error rate for some period during the load test is at least 10% higher than at the beginning of the test. It usually means the target system is close to its performance limit.
Test Health Performance Alerts
These alerts highlight test script related issues. These issues can either skew the performance test results or make analysis harder. These issues can often be quickly resolved by making changes in the test script. There are currently 4 alerts in this category:
Third Party Content Alert
Insights detects more than 3 different domains in a test. This is typically caused by the test script containing requests to 3rd party resources such as CDNs, social media scripts, analytic tools, etc. That should usually be avoided.
Too Many URLs
Insights detects more than 500 unique URLs in your test results. Commonly caused by a URL that contains a query parameter that is unique per iteration, e.g. tokens, session IDs, etc. The k6 URL grouping feature can be used to eliminate this issue.
High Load Generator CPU / Memory Usage (2 separate alerts)
These alerts tell users if their test configuration is causing over utilization of the load generator resources (CPU and Memory), which can skew test results.
"Performance Alerts are another key feature that allows DevOps teams to bring high quality software to market faster and at lower cost," said Haakan Tylen, CEO at Load Impact.
DevOps teams can try out k6, Load Impact Insights and Cloud Execution for free. k6 will always be freely available (see the GitHub link below) while Load Impact Insights and Cloud Execution are available through a 30-day free trial (https://app.loadimpact.com/
• Loadimpact.com (https://www.loadimpact.com/
• Insights (https://loadimpact.com/
• Load Impact Cloud Execution (https://loadimpact.com/
• k6 (https://loadimpact.com/