The World Quality Report (WQR) is back. The only global report of its kind analyzes the latest application quality and testing trends.
Micro Focus teamed up with Capgemini and Sogeti to conduct the global survey. This year, we interviewed 1,750 executives and professionals, across 10 industries, from 32 countries. The results are based on seven respondent groups, ranging from testing managers to C-suite executives.
This year’s report highlights seven featured themes aligned with market trends:
- Quality orchestration in Agile enterprises
- Quality automation
- Quality infrastructure testing and provisioning
- Test data provisioning and data validation
- Quality and sustainable IT
- Quality engineering for emerging technologies
- Value stream management (VSM)
In addition to the main report, there are 12 country reports with insight into each geographic region. Reports are available for:
- Australia and New Zealand
- Eastern Europe
- Nordic Region (except Sweden)
- North America
- Southern Europe
- United Kingdom
All reports are available here.
Now more than ever, quality assurance (QA) must transform from pure testing to quality engineering practices. Customer experience, time to market, security, and cost continue to be the core objectives for QA. Quality experts and teams have a critical role to play in Agile transformation, as they are best positioned for this task, centered between development and operations teams. This year’s key takeaways include:
- Adequate orchestration of quality activities in and across Agile development teams—While QA is increasingly embedded in feature teams, we also see a clear rise of the quality function or quality support across teams.
- End-to-end automation of quality and test activities—Teams are automating activities across all types and levels of testing, from planning and design to execution and continuous quality monitoring. This end-to-end quality automation must be fully integrated into the IT development process.
- Quality infrastructure testing and provisioning—Leveraging smarter technologies assists quality experts in making the right strategic decisions early in the process.
- Test data provisioning and validation—Teams are paying more attention to test infrastructure and test data provisioning.
- Defining, tracking, and monitoring the right set of quality indicators against which to measure progress.
- Increasing the technological and domain skill levels of quality teams. Quality experts will need to develop their skills beyond testing and engineering to subject matter business expertise.
Two New Areas with Potential Impact
One of the key trends that emerged from this year’s World Quality Report is the importance of VSM. Looking closely at processes helps deliver value with more assurance, less waste, and greater flow.
In addition, sustainable IT is increasing in popularity. Most organizations have moved to an execution phase with clearly defined goals and timelines. Let’s take a closer look at these two emerging trends.
- Sustainable IT—There is a clear understanding that the quality of applications directly relates to sustainable IT. But the specific quality attributes for a sustainable application—and how to measure and monitor—are still unknown to some businesses. Environmental consciousness is an additional aspect for quality teams to consider.
- Value Stream Management—Several sectors are rapidly adopting this concept. With VSM, organizations aim to manage, control, and visualize software development and delivery activities for business and IT.
Agile Quality Orchestration
- Make quality engineers an integral part of Agile development programs, including enterprise systems. The right talent, offering a blend of technical and business skills, is critical for quality engineers in Agile.
- Use package-specific tools for enterprise management systems that increase levels of automation with prebuilt libraries for Agile.
- Track and monitor metrics that are holistic quality indicators across the development lifecycle. For example, a “failed deployments” metric gives a holistic view of quality across teams.
- Embed an automation-first approach into requirements and stories.
- Focus on what delivers the best benefits to customers and the business, rather than justifying ROI.
- One tool can’t do everything. Pick the best tools for the job.
Quality Infrastructure Testing and Provisioning
- Combine value streams into a single platform to build heterogeneous software delivery pipelines.
- Provision legacy environments using the power of the cloud—at speed.
- Augment a new dimension to application reliability through cloud and infrastructure testing.
Test Data Provisioning and Validation
- Follow the many organizations that are moving nonproduction workloads to the cloud.
- Make cloud testing an integral part of the overall software development lifecycle.
- Take advantage of the increasing automation of data provisioning and of the growth in synthetic data generation.
Quality and Sustainable IT
- Adapt and use existing quality frameworks and tools to achieve more sustainable design principles. How modular and reusable is the architecture? Is the programming language resource intensive? Can the number of interfaces and API calls be optimized?
- Customize application performance monitoring tools to support the measurement of environmental impacts at a transactional level.
- Bring quality to the center of the strategy for green IT for a consistent framework to measure, control, and quantify progress across the social, environmental, economic, and human facets of green IT, even to the extent of establishing “green quality gates.”
Quality Engineering for Emerging Technologies
Organizations need to ask themselves:
- Will building quality engineering skills around blockchain, Web 3.0, and cybersecurity be crucial to the success of implementations?
- What capabilities will we need to test seamless user experiences between physical and digital worlds?
- What would be the quality engineering strategy required for emerging technologies, even during the prototyping phase, to support successful implementation and scaling?
Value Stream Management
- Make sure you define with business owners and project owners the expected value outcome of testing and quality activities.
- Define concrete and measurable value indicators that are connected to business objectives for each project. And ensure that quality and test results are connected and related to these value indicators.
For an in-depth evaluation of this year’s trends, findings, and recommendations, download the 2022–2023 World Quality Report.