Utvärdering av kodkvalitet i AI-genererade mobilapplikationer : En jämförande studie av React Native- och Kotlin-implementeringar

The increasing integration of AI-powered tools in software development raises crucial questions about the quality of the code they generate, particularly in rapidly evolving fields like mobile application development. This study addresses the need for up-to-date evaluations of AI-generated code quality in non-native applications, a gap in current research. To investigate this problem, we conducted an experiment where five prominent AI code generation tools– Gemini Code Assist, GitHub Copilot, ChatGPT, Windsurf IDE, and Deepseek– were prompted to generate code for a chess game in two mobile development frameworks: React Native and Kotlin. This resulted in a comparative analysis of ten AI-generated applications. The quality of the generated code was assessed using software quality metrics, informed by a comprehensive literature review. Our analysis revealed a moderate to high degree of variation across the generated applications in key metrics such as cyclomatic complexity, lines of code, and cognitive complexity. However, the observed results did not provide conclusive evidence to definitively identify a single AI tool as consistently producing the highest quality code across both frameworks. While the study provides valuable insights into the variability of code quality among different AI tools, the findings suggest that further research is necessary to achieve a more comprehensive understanding of the factors influencing the quality of AI-generated code. More in-depth investigation is required to draw definitive conclusions regarding the optimal AI tools for specific development contexts and to explore strategies for consistently generating high-quality code with AI assistance.

Publication Details

Journal
KTH Publication Database DiVA (KTH Royal Institute of Technology)
Published
2025-01-01
Primary Topic
Software Engineering Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Utvärdering av kodkvalitet i AI-genererade mobilapplikationer : En jämförande studie av React Native- och Kotlin-implementeringar

KTH Publication Database DiVA (KTH Royal Institute of Technology)
Software Engineering Research
article

Utvärdering av kodkvalitet i AI-genererade mobilapplikationer : En jämförande studie av React Native- och Kotlin-implementeringar

article en

Abstract

The increasing integration of AI-powered tools in software development raises crucial questions about the quality of the code they generate, particularly in rapidly evolving fields like mobile application development. This study addresses the need for up-to-date evaluations of AI-generated code quality in non-native applications, a gap in current research. To investigate this problem, we conducted an experiment where five prominent AI code generation tools– Gemini Code Assist, GitHub Copilot, ChatGPT, Windsurf IDE, and Deepseek– were prompted to generate code for a chess game in two mobile development frameworks: React Native and Kotlin. This resulted in a comparative analysis of ten AI-generated applications. The quality of the generated code was assessed using software quality metrics, informed by a comprehensive literature review. Our analysis revealed a moderate to high degree of variation across the generated applications in key metrics such as cyclomatic complexity, lines of code, and cognitive complexity. However, the observed results did not provide conclusive evidence to definitively identify a single AI tool as consistently producing the highest quality code across both frameworks. While the study provides valuable insights into the variability of code quality among different AI tools, the findings suggest that further research is necessary to achieve a more comprehensive understanding of the factors influencing the quality of AI-generated code. More in-depth investigation is required to draw definitive conclusions regarding the optimal AI tools for specific development contexts and to explore strategies for consistently generating high-quality code with AI assistance.

KTH Publication Database DiVA (KTH Royal Institute of Technology)
Openalex Percentile: Top 36%
Software Engineering Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.