Agent READMEs: An Empirical Study of Context Files for Agentic Coding

Agentic coding tools receive goals written in natural language, break them down into specific tasks, and write or execute code with minimal human intervention. Central to this process are agent context files (e.g., AGENTS.md and CLAUDE.md) that provide persistent, project-level instructions. In this paper, we conduct the first large-scale empirical study of 2,303 agent context files from 1,925 repositories to characterize their structure, maintenance, and content. We find that these files are not static documentation but complex, difficult-to-read artifacts that evolve like configuration code through frequent, small additions. Our content analysis of 16 instruction types shows that developers prioritize functional context, such as test procedures (75.9%), implementation details (70.8%), and architecture (68.1%). We also identify a significant gap: non-functional requirements such as security (14.8%) and performance (14.5%) are rarely specified. These findings indicate that while developers use context files to make agents functional, they provide few guardrails to ensure that agent-written code is secure or performant, highlighting the need for improved tools and practices.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Software Engineering and Methodology
Published
2026-09-15
DOI
https://doi.org/10.1145/3840295
Citations
2
Primary Topic
Multi-Agent Systems and Negotiation
Type
article
Field-Weighted Citation Impact
11.90

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Agent READMEs: An Empirical Study of Context Files for Agentic Coding

Bundit Manaskasemsak, Arnon Rungsawang, Yutaro Kashiwa, Hajimu Iida et al.
2 citations
ACM Transactions on Software Engineering and Methodology
Multi-Agent Systems and Negotiation
11.90
article

Agent READMEs: An Empirical Study of Context Files for Agentic Coding

Bundit Manaskasemsak, Arnon Rungsawang, Yutaro Kashiwa, Hajimu Iida, Kundjanasith Thonglek, Bram Adams, Brittany Reid, Pattara Leelaprute, Ahmed E. Hassan, Hao Li, Worawalan Chatlatanagulchai
article en
2 citations

Abstract

Agentic coding tools receive goals written in natural language, break them down into specific tasks, and write or execute code with minimal human intervention. Central to this process are agent context files (e.g., AGENTS.md and CLAUDE.md) that provide persistent, project-level instructions. In this paper, we conduct the first large-scale empirical study of 2,303 agent context files from 1,925 repositories to characterize their structure, maintenance, and content. We find that these files are not static documentation but complex, difficult-to-read artifacts that evolve like configuration code through frequent, small additions. Our content analysis of 16 instruction types shows that developers prioritize functional context, such as test procedures (75.9%), implementation details (70.8%), and architecture (68.1%). We also identify a significant gap: non-functional requirements such as security (14.8%) and performance (14.5%) are rarely specified. These findings indicate that while developers use context files to make agents functional, they provide few guardrails to ensure that agent-written code is secure or performant, highlighting the need for improved tools and practices.

ACM Transactions on Software Engineering and Methodology
Kasetsart University (TH), Queen's University (CA), Nara Institute of Science and Technology (JP)
Natural Sciences and Engineering Research Council of Canada, Japan Society for the Promotion of Science, Core Research for Evolutional Science and Technology
Openalex Percentile: Top 3%
Multi-Agent Systems and Negotiation
11.90
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.