The goal in DevOps is to enable faster release and deployment cycles with high quality by taking advantage of agile development methodologies to achieve automated continuous delivery. This practice helps organizations achieve faster release cycles while delivering newer features to meet customer demand.
Applying an effective testing process within a high-speed delivery cycle is a major challenge, and traditional non-automated testing methods would become a bottleneck. Continuous testing overcomes this problem by fully automating testing throughout the delivery cycle. In this blog, we will discuss potential challenges of applying continuous load testing and how to overcome them with Micro Focus StormRunner Load (SRL).
StormRunner Load (SRL) is the market-leading, cloud-based performance testing solution, designed to support agile teams and DevOps environments. SRL provides a rich set of features and flexible capabilities that makes it easy to implement continuous load testing into variety of DevOps environments.
Scalability in a continuous testing environment
Managing hardware for performance testing tools is always a challenge. It becomes an even bigger challenge in advanced DevOps environments that have multiple teams and multiple pipelines executing performance tests--now that you need to manage a larger pool of load generators and controllers. Using SRL, a complete cloud-based solution eliminates the dependency on hardware, allowing multiple users and teams to connect to a single cloud solution. This cloud-based solution allows them to run unlimited concurrent tests without worrying about hardware availability for the tests, since SRL instantly provisions the required infrastructure in the cloud.
Automation and integration with CI/CD tools
SRL has built-in integration with Git so that all scripts can be managed in the repository and automatically updated before every run. In addition, by supporting CI tools such as Jenkins, Bamboo, AWS Code Pipeline and Azure DevOps, each load test can be configured and then triggered either independently, or as part of a pipeline. For more information about SRL supported CI tools visit our help center.
In addition, SRL provides a rich public API, which serves as a gateway for users to easily perform actions from external tools, and to take advantage of varied and advanced product capabilities without the need to interact manually with SRL’s UI. At Micro Focus, we keep expanding SRL’s public API capabilities based on our users’ needs. For more information about our public API, visit our ADM Help Center.
Collaboration between users and teams is key in DevOps environments; great collaboration improves the overall efficiency and velocity. SRL provides several capabilities allowing members from multiple teams to collaborate on performance engineering:
- Git integration to edit and synchronize scripts and for version control
- Sharing test results with different stakeholders, one can export and then share reports in different formats (CSV, PDF and Word) or use the option to email a summary report in PDF format automatically at the end of the test
- Support for project management, allowing users on the same project to share different assets such as scripts, licenses, load generators and more
Reporting and analysis
On one hand, introducing performance testing into DevOps requires immediate reporting feedback, since action must be taken instantly--but on the other hand, applications are getting more complex and require smart and advanced analysis capabilities to allow quick root cause analysis.
SRL provides a built in pass/fail mechanism, allowing the user to define the criteria for a successful test. At the end of the test, SRL will automatically set the test status to pass/fail, and this indication will flow automatically to your CI tool as well, so you will immediately know if your current build has failed, allowing you to take action if needed. It also provides trending and advanced comparison capabilities (to a benchmark or to an older run) allowing you to easily identify performance drops. Other advanced analysis capabilities include anomaly detection and the NV Insights report, which provides optimization recommendations to improve transaction performance.
In addition, enabling users to get real time backend data is critical, so SRL integrates with most common APM (monitoring) solution such as App-Dynamics, Dynatrace, New Relic or SiteScope (cloud or on-premises). For more information about our integrations with different monitoring tools, check out the ADM Help Center.
This is an exciting time for Micro Focus StormRunner Load, as we are supporting many of our customers throughout their different DevOps journeys. Our focus on DevOps remains and we will keep extending the SRL solution in this area. If you want to try out StormRunner Load for yourself, you can give it a go by signing up for the free 30-day trial.
Please feel free to leave comments and questions!
Thanks to Sharon Levin, StormRunner Load Product Manager, for his contributions to this post
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.