We recently conducted a webinar, “How AI is Revolutionizing Software Test Automation,” and we had a great turn out. But the fact that so many were interested in this topic wasn’t really a surprise—at least not to us.
But this raises the question, why all the interest in something that is going to “revolutionize” test automation? After all, wasn’t test automation itself supposed to revolutionize software testing and push aside the high cost and challenges of manual testing?
Glad you asked, and here’s our take. Even though test automation is the key component to ensuring software quality (long gone are the
hours days of manual regression testing, replaced with test automation’s significant reduction in human error, improved defect detection, fewer defects escaping into production, etc.). No, the key we think lies in this one stat:
On average, organizations only automate 20-30% of their tests.
This deserves to be said again, for those organizations who automate their software testing, on average, only 20-30% fully automate their tests. When it comes down to both speed and reliability of test automation, this is where most organizations seem to struggle.
However, just one caveat, this is the “average” organization, and it should be noted that there is a great deal of difference among organizations based on the solutions they use to automate testing. For example, Harvard Pilgrim is leveraging Micro Focus test automation solutions for 89% automated test coverage (QA Transformation: The Journey from 15% Automated Testing to 89%)
But it should still be noted that apart from organizations who are currently succeeding with Micro Focus test automation solutions, why are so many other organizations, in general, struggling with test automation?
Again, glad you asked, because this takes us right back to the webinar, How AI is Revolutionizing Software Test Automation. In this webinar, we conducted a poll that asked, “What is your greatest challenge with automated testing?”
The results were fascinating, but not entirely surprising, with the “pace of change is too fast” and “tests keep breaking” tying for the top challenges, and “lack of test coverage” coming in at a close second. Here are the complete results:
But again, these results really weren’t a surprise. In a related study, we conducted a survey of QA/testing managers, CIOs and other IT executives in 32 countries, and across ten industry sectors, when asked about the main challenges in achieving desired level of test automation, the top response was, “We have difficulties to automate because our applications change too much with every release.”
It should be noted that this was clearly the top challenge, with other challenges lagging quite far behind it. Clearly, both the pace of change and the number of application changes have QA organizations struggling to keep pace. If interested, you can learn more about this study here: World Quality Report, 2019-20, eleventh edition.
Also, not being able to keep pace with rapid change can have quantifiable implications for agile and DevOps organizations, especially the closer to production they are found. In another recent survey we conducted about the cost that defects can incur on an organization, we found that functional defects that escape into production contributed to negative business impacts, with revenue, brand reputation, and regulatory fines tied for the top business impacts.
To learn more about this study, and how best to combat production defects, visit our blog post, “How to slash the high cost of software defects.” (Spoiler alert, shift-left testing plays a major role in combatting software defects.)
But I digress, and back to the webinar…
We think that in this webinar, now available on demand, you’ll learn 1) why some organizations may be struggling to get the automated test coverage they hope for, 2) how Micro Focus is using Artificial Intelligence to deliver revolutionary advances in functional testing that will 3) enable testers to leverage Micro Focus UFT One's AI-based test automation capabilities to easily keep up with the speed of application changes across multiple devices and platforms while reducing the cost of building and maintaining automation assets.
Take a watch, you can find it here:
On a related note, please take a look at our new AI-based test automation video. We think you might like it as well:
- How AI is Revolutionizing Software Test Automation
- QA Transformation: The Journey from 15% Automated Testing to 89%
- World Quality Report, 2019-20, eleventh edition
- How to slash the high cost of software defects
- AI Powered Intelligent Test Automation with the UFT Family
- Independent Health Leveraging AI