Empirical insights on the use of large language models in software verification and validation: evidence from the Brazilian IT industry

Abstract Artificial Intelligence (AI) has created new possibilities for improving Verification and Validation (V&V) activities in software engineering. Among recent advances, Large Language Models (LLMs) have gained attention for their potential to automate tasks such as test generation, defect detection, and requirements analysis. Although interest in these technologies has increased, their use in industrial environments is still limited and not well understood. Concerns remain about their reliability, transparency, and ethical implications, especially when applied in safety-critical or regulated domains. This paper reports an exploratory empirical study based on a survey with 39 software professionals from different sectors and company sizes in Brazil. The questionnaire investigates the reported use of conventional V&V tools, AI-based testing solutions, and LLM-supported practices, as well as perceptions of effectiveness, workflow integration, cost, and governance challenges. Respondents reported perceived benefits, such as support for automation, test-case creation, code understanding, and efficiency-oriented tasks, along with difficulties related to integration, transparency, reliability, hallucinations, over-reliance, data misuse, and governance. By documenting current practices, perceptions, and expectations, this study offers an exploratory empirical view of how AI and LLMs are being selectively incorporated into industrial V&V activities in Brazil. The findings may inform discussions on responsible AI adoption in software engineering and provide preliminary, practitioner-informed insights for future research and governance-oriented decision-making. Given the exploratory design, convenience sample, and self-reported data, these findings should be interpreted as indicative perceptions rather than statistically generalizable evidence.

Authors

Institutions

Publication Details

Journal
Empirical Software Engineering
Published
2026-11-03
DOI
https://doi.org/10.1007/s10664-026-10971-8
Primary Topic
Software Testing and Debugging Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Empirical insights on the use of large language models in software verification and validation: evidence from the Brazilian IT industry

Maicon Bernardino, Fábio Paulo Basso, Guilherme Bolfe, Elder Rodrigues et al.
Empirical Software Engineering
Software Testing and Debugging Techniques
article

Empirical insights on the use of large language models in software verification and validation: evidence from the Brazilian IT industry

Maicon Bernardino, Fábio Paulo Basso, Guilherme Bolfe, Elder Rodrigues, Filipe Garcia Silva
article en

Abstract

Abstract Artificial Intelligence (AI) has created new possibilities for improving Verification and Validation (V&V) activities in software engineering. Among recent advances, Large Language Models (LLMs) have gained attention for their potential to automate tasks such as test generation, defect detection, and requirements analysis. Although interest in these technologies has increased, their use in industrial environments is still limited and not well understood. Concerns remain about their reliability, transparency, and ethical implications, especially when applied in safety-critical or regulated domains. This paper reports an exploratory empirical study based on a survey with 39 software professionals from different sectors and company sizes in Brazil. The questionnaire investigates the reported use of conventional V&V tools, AI-based testing solutions, and LLM-supported practices, as well as perceptions of effectiveness, workflow integration, cost, and governance challenges. Respondents reported perceived benefits, such as support for automation, test-case creation, code understanding, and efficiency-oriented tasks, along with difficulties related to integration, transparency, reliability, hallucinations, over-reliance, data misuse, and governance. By documenting current practices, perceptions, and expectations, this study offers an exploratory empirical view of how AI and LLMs are being selectively incorporated into industrial V&V activities in Brazil. The findings may inform discussions on responsible AI adoption in software engineering and provide preliminary, practitioner-informed insights for future research and governance-oriented decision-making. Given the exploratory design, convenience sample, and self-reported data, these findings should be interpreted as indicative perceptions rather than statistically generalizable evidence.

Empirical Software EngineeringVol. 32(2)
Universidade Federal do Pampa (BR)
Openalex Percentile: Top 6%
Software Testing and Debugging Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon