C-Suites trust AI-augmented software testing but still want human validation

AI-augmented testing tools have come a long way in the last few years: a staggering majority (79%) of organizations have already adopted them. However, neither C-Suite executives nor senior technical leaders believe humans are going away anytime soon. A majority of total respondents (74%) across organizations believe software testing will continue to need human validation for the foreseeable future. This is according to research from Leapwork surveying 400 respondents in the U.S. and UK, of which half were C-Suite and half were senior software engineering or technology leads.

The level of enthusiasm towards the need for human validation does differ depending on who is being asked. An overwhelming 80% of technical teams share this view compared to 68% of C-Suite executives. Depending on the exact role of the respondent, this disparity becomes starker: 92% of IT directors think testing will need human validation compared to just 64% of CIOs.

The need for human validation, however, is not indicative of the level of trust in AI-augmented testing tools. In fact, trust is high, with 68% of overall respondents saying they trust the results of AI-augmented testing tools – specifically, 64% of C-Suite executives compared to 72% of technical leaders. The sentiments around AI-augmented testing tools are positive enough that 74% of organizations say they will likely invest more money into the technology over the next year. This tracks with the generally strong belief that AI-augmented testing tools will improve testing efficiency and effectiveness. Over half of respondents (54%) agree, while just 10% disagree.

"I believe that the synergy between AI and human expertise represents a transformative partnership in software testing," says Robert Salesas, CTO at Leapwork. "AI tools can significantly enhance efficiency, allowing technical teams to focus on innovation and ideation rather than the repetitive details of testing in an increasingly complex software environment. However, no matter how advanced the tools become, the principle of requiring human oversight and independent review will always be essential to ensure accuracy and reliability."

Whether or not AI-augmented testing will significantly create or reduce jobs, however, is a matter that has divided C-Suites and technical teams. While nearly (45%) of overall respondents say AI-augmented testing has created new roles specifically for people with AI skills, almost just as many (43%) have seen a reduction in roles due to efficiency gains. A closer inspection reveals C-Suite executives have a much more bullish perception than technical leaders. Over half of C-Suite executives (53%) say the tools have increased the number of new roles compared to just over a third (36%) of technical leaders. These perceptions also vary based on sector: 52% of respondents in healthcare are seeing new jobs created (vs. 39% seeing reduced roles) compared to only 36% in government. About 57% of respondents in manufacturing report a reduction in jobs.