Design Problems, Decisions, and Evidence in Agentic Software Engineering: A Systematic Mapping Study

Agentic Software Engineering (ASE) systems depend on decisions about context, reasoning, coordination, tool use, execution, and verification. This systematic mapping study maps problems, design decisions, operationalizations, and evidence in peer-reviewed studies of LLM- or foundation-model-based agentic systems in Software Engineering from 1 January 2024 to 13 July 2026. ACM Digital Library, IEEE Xplore, Scopus, and Springer Nature Link were searched on 13 July 2026 using the same Boolean string. From 1069 records, 94 studies were included. A frozen, single-paper-isolated extraction protocol identified 1018 design decisions, followed by deterministic multi-label synthesis; no formal study-level risk-of-bias assessment was performed. Of these decisions, 633 were linked to 656 problems or objectives, and 913 (89.7%) had empirical or comparative evaluation records. Only 19.8% of evaluation records attributed evidence to an individual decision, whereas 52.3% assessed complete systems; multi-agent configurations represented 68.7% of problem-linked decisions. Heterogeneous metrics and system-level evaluation limit inference about effectiveness. The findings expose a gap between evaluation coverage and decision-level attribution and motivate ablations and human-centered evaluations. The review received no external funding and was not registered.

Authors

Publication Details

Journal
Electronics
Published
2026-11-04
DOI
https://doi.org/10.3390/electronics15215121
Primary Topic
Software Engineering Techniques and Practices
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Design Problems, Decisions, and Evidence in Agentic Software Engineering: A Systematic Mapping Study

Jorge Díaz-Villegas, Ania Cravero, Zihao Xiao
Electronics
Software Engineering Techniques and Practices
article

Design Problems, Decisions, and Evidence in Agentic Software Engineering: A Systematic Mapping Study

Jorge Díaz-Villegas, Ania Cravero, Zihao Xiao
article en

Abstract

Agentic Software Engineering (ASE) systems depend on decisions about context, reasoning, coordination, tool use, execution, and verification. This systematic mapping study maps problems, design decisions, operationalizations, and evidence in peer-reviewed studies of LLM- or foundation-model-based agentic systems in Software Engineering from 1 January 2024 to 13 July 2026. ACM Digital Library, IEEE Xplore, Scopus, and Springer Nature Link were searched on 13 July 2026 using the same Boolean string. From 1069 records, 94 studies were included. A frozen, single-paper-isolated extraction protocol identified 1018 design decisions, followed by deterministic multi-label synthesis; no formal study-level risk-of-bias assessment was performed. Of these decisions, 633 were linked to 656 problems or objectives, and 913 (89.7%) had empirical or comparative evaluation records. Only 19.8% of evaluation records attributed evidence to an individual decision, whereas 52.3% assessed complete systems; multi-agent configurations represented 68.7% of problem-linked decisions. Heterogeneous metrics and system-level evaluation limit inference about effectiveness. The findings expose a gap between evaluation coverage and decision-level attribution and motivate ablations and human-centered evaluations. The review received no external funding and was not registered.

ElectronicsVol. 15(21)
Openalex Percentile: Top 34%
Software Engineering Techniques and Practices
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
Design Problems, Decisions, and Evidence in Agentic Software Engineering: A Systematic Mapping Study — Jorge Díaz-Villegas, Ania Cravero, et al. · Electronics (2026) | TGRS Research Map | TGRS