Software Engineering for Large Language Models: Research Status, Challenges, and the Road Ahead

The rapid advancement of large language models (LLMs) has redefined artificial intelligence (AI), pushing the boundaries of AI research and enabling unbounded possibilities for both academia and industry. However, LLM development faces increasingly complex challenges throughout its lifecycle, while existing research has not systematically investigated these challenges and solutions from the perspective of software engineering (SE) approaches. To fill the gap, we systematically analyze the research status throughout the LLM development lifecycle, which is divided into six phases: requirements engineering, dataset construction, model development and enhancement, testing and evaluation, deployment and operations, and maintenance and evolution. We conclude by identifying the key challenges in each phase and presenting potential research directions to address them. In general, we provide valuable insights from an SE perspective to facilitate future advances in LLM development.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Software Engineering and Methodology
Published
2026-11-16
DOI
https://doi.org/10.1145/3860527
Citations
14
Primary Topic
Software Engineering Research
Type
article
Field-Weighted Citation Impact
23.15
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Software Engineering for Large Language Models: Research Status, Challenges, and the Road Ahead

Shenao Wang, Xinyi Hou, Haoyu Wang, Yanjie Zhao
14 citations
ACM Transactions on Software Engineering and Methodology
Software Engineering Research
23.15
article

Software Engineering for Large Language Models: Research Status, Challenges, and the Road Ahead

Shenao Wang, Xinyi Hou, Haoyu Wang, Yanjie Zhao
article en
14 citations

Abstract

The rapid advancement of large language models (LLMs) has redefined artificial intelligence (AI), pushing the boundaries of AI research and enabling unbounded possibilities for both academia and industry. However, LLM development faces increasingly complex challenges throughout its lifecycle, while existing research has not systematically investigated these challenges and solutions from the perspective of software engineering (SE) approaches. To fill the gap, we systematically analyze the research status throughout the LLM development lifecycle, which is divided into six phases: requirements engineering, dataset construction, model development and enhancement, testing and evaluation, deployment and operations, and maintenance and evolution. We conclude by identifying the key challenges in each phase and presenting potential research directions to address them. In general, we provide valuable insights from an SE perspective to facilitate future advances in LLM development.

ACM Transactions on Software Engineering and Methodology
Huazhong University of Science and Technology (CN)
Openalex Percentile: Top 1%
Software Engineering Research
23.15
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon