StormRunner Load as an essential component of your DevOps pipeline

Micro Focus Contributor
Micro Focus Contributor
1 0 1,072

srl lior.pngThe goal in DevOps is to enable faster release and deployment cycles with high quality by taking advantage of agile development methodologies to achieve automated continuous delivery. This practice helps organizations achieve faster release cycles while delivering newer features to meet customer demand.

Applying an effective testing process within a high-speed delivery cycle is a major challenge, and traditional non-automated testing methods would become a bottleneck. Continuous testing overcomes this problem by fully automating testing throughout the delivery cycle. In this blog, we will discuss potential challenges of applying continuous load testing and how to overcome them with Micro Focus StormRunner Load (SRL).

StormRunner Load (SRL) is the market-leading, cloud-based performance testing solution, designed to support agile teams and DevOps environments. SRL provides a rich set of features and flexible capabilities that makes it easy to implement continuous load testing into variety of DevOps environments.  

Scalability in a continuous testing environment
Managing hardware for performance testing tools is always a challenge. It becomes an even bigger challenge in advanced DevOps environments that have multiple teams and multiple pipelines executing performance tests--now that you need to manage a larger pool of load generators and controllers. Using SRL, a complete cloud-based solution eliminates the dependency on hardware, allowing multiple users and teams to connect to a single cloud solution. This cloud-based solution allows them to run unlimited concurrent tests without worrying about hardware availability for the tests, since SRL instantly provisions the required infrastructure in the cloud.

lioru 2.png

 

Automation and integration with CI/CD tools
SRL has built-in integration with Git so that all scripts can be managed in the repository and automatically updated before every run. In addition, by supporting CI tools such as Jenkins, Bamboo, AWS Code Pipeline and Azure DevOps, each load test can be configured and then triggered either independently, or as part of a pipeline. For more information about SRL supported CI tools visit our help center.

In addition, SRL provides a rich public API, which serves as a gateway for users to easily perform actions from external tools, and to take advantage of varied and advanced product capabilities without the need to interact manually with SRL’s UI. At Micro Focus, we keep expanding SRL’s public API capabilities based on our users’ needs. For more information about our public API, visit our ADM Help Center.

Team collaboration
Collaboration between users and teams is key in DevOps environments; great collaboration improves the overall efficiency and velocity. SRL provides several capabilities allowing members from multiple teams to collaborate on performance engineering:

  • Git integration to edit and synchronize scripts and for version control
  • Sharing test results with different stakeholders, one can export and then share reports in different formats (CSV, PDF and Word) or use the option to email a summary report in PDF format automatically at the end of the test
  • Support for project management, allowing users on the same project to share different assets such as scripts, licenses, load generators and more

Scripting technologies
SRL supports a wide range of LoadRunner protocols from Web HTTP/HTML to TruClient, as well as open source such as Gatling, JMeter and Selenium. Support for a new, innovative scripting protocol has been added–TruWeb.  TruWeb can be downloaded for free in its standalone version, and will enable you to perform small load tests locally. These same scripts can then be used in SRL to run load tests from a global region or at higher scale. TruWeb is ideal for developers and Dev Testers, since scripts can be written in modern development environments using JavaScript on a variety of IDEs and platforms. For more information about our supported protocols, visit the ADM Help Center.

Reporting and analysis
On one hand, introducing performance testing into DevOps requires immediate reporting feedback, since action must be taken instantly--but on the other hand, applications are getting more complex and require smart and advanced analysis capabilities to allow quick root cause analysis.

SRL provides a built in pass/fail mechanism, allowing the user to define the criteria for a successful test. At the end of the test, SRL will automatically set the test status to pass/fail, and this indication will flow automatically to your CI tool as well, so you will immediately know if your current build has failed, allowing you to take action if needed. It also provides trending and advanced comparison capabilities (to a benchmark or to an older run) allowing you to easily identify performance drops. Other advanced analysis capabilities include anomaly detection and the NV Insights report, which provides optimization recommendations to improve transaction performance.

In addition, enabling users to get real time backend data is critical, so SRL integrates with most common APM (monitoring) solution such as App-Dynamics, Dynatrace, New Relic or SiteScope (cloud or on-premises).  For more information about our integrations with different monitoring tools, check out the ADM Help Center.

lioru3.png

 

This is an exciting time for Micro Focus StormRunner Load, as we are supporting many of our customers throughout their different DevOps journeys. Our focus on DevOps remains and we will keep extending the SRL solution in this area. If you want to try out StormRunner Load for yourself, you can give it a go by signing up for the free 30-day trial.

Please feel free to leave comments and questions! 

Thanks to Sharon Levin, StormRunner Load Product Manager, for his contributions to this post

The opinions expressed above are the personal opinions of the authors, not of Micro Focus. By using this site, you accept the Terms of Use and Rules of Participation. Certain versions of content ("Material") accessible here may contain branding from Hewlett-Packard Company (now HP Inc.) and Hewlett Packard Enterprise Company. As of September 1, 2017, the Material is now offered by Micro Focus, a separately owned and operated company. Any reference to the HP and Hewlett Packard Enterprise/HPE marks is historical in nature, and the HP and Hewlett Packard Enterprise/HPE marks are the property of their respective owners.