Promises and Pitfalls: Evaluating Generative AI Tools in Software Engineering

The software development industry faces numerous ongoing and increasing challenges, the most significant of which are the software development time and code quality. Reducing the development time without sacrificing code quality would significantly decrease overhead costs and improve the bottom line for Information Technology companies. This study investigates software developers’ perceptions and utilisation of Generative AI tools to address these challenges and improve the software development process. We employ a mixed-method approach to examine the impact of Gen AI tools on Software Development Time and Software Code Quality. We adopt semi-structured interviews with experienced software developers for qualitative study and administer a survey for quantitative research. Our study also examines how developers exploit the capabilities of Gen AI technologies in their professional endeavours, drawing on the principles of Delone & McLean Information System success model theory. The findings aim to elucidate the effective integration of Gen AI into software development processes, aiming to transform the sector by enhancing productivity and quality.

Publication Details

Journal
Journal of the Association for Information Systems
Published
2024-12-10
Primary Topic
Software Engineering Techniques and Practices
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Promises and Pitfalls: Evaluating Generative AI Tools in Software Engineering

Journal of the Association for Information Systems
Software Engineering Techniques and Practices
article

Promises and Pitfalls: Evaluating Generative AI Tools in Software Engineering

article en

Abstract

The software development industry faces numerous ongoing and increasing challenges, the most significant of which are the software development time and code quality. Reducing the development time without sacrificing code quality would significantly decrease overhead costs and improve the bottom line for Information Technology companies. This study investigates software developers’ perceptions and utilisation of Generative AI tools to address these challenges and improve the software development process. We employ a mixed-method approach to examine the impact of Gen AI tools on Software Development Time and Software Code Quality. We adopt semi-structured interviews with experienced software developers for qualitative study and administer a survey for quantitative research. Our study also examines how developers exploit the capabilities of Gen AI technologies in their professional endeavours, drawing on the principles of Delone & McLean Information System success model theory. The findings aim to elucidate the effective integration of Gen AI into software development processes, aiming to transform the sector by enhancing productivity and quality.

Journal of the Association for Information Systems
Industry, innovation and infrastructure
Openalex Percentile: Top 32%
Software Engineering Techniques and Practices
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.