The Secret Life of Bots in Pull Requests: An Empirical Study based on Apache Projects
Bots are increasingly used in software development for automation and collaboration, particularly in open-source communities like Apache. However, their role in Pull Request (PR) processing is not well understood. This study analyzed 128 Apache Foundation projects with active GitHub repositories, examining 16,989 PRs and 436,057 atomic activities. We identified 29 Bot accounts and 22,208 Bot activities through semi-automated methods. Our analysis addresses four key questions about Bot adoption, usage, behavior, and interaction with developers in PRs. Bots were adopted in 30% of Apache projects, primarily for Build Management, PR Management, and Quality Checking. While commenting is the most common activity (77.1%), most comments (76%) remain technical rather than conversational. Our study highlights the current state of Bot use in PRs and identifies areas for improved automation and intelligence in Bot design.
Authors
- Lu Xiao (ORCID: https://orcid.org/0000-0002-3202-3077)
- Chenhao Wei (ORCID: https://orcid.org/0000-0002-2707-120X)
- Ting Liao (ORCID: https://orcid.org/0000-0003-1786-8706)
- Yutong Zhao (ORCID: https://orcid.org/0000-0003-3764-5542)
Institutions
- Stevens Institute of Technology (US)
- University of Central Missouri (US)
Publication Details
- Published
- 2025-04-27
- DOI
- https://doi.org/10.1109/botse67031.2025.00015
- Primary Topic
- Network Security and Intrusion Detection
- Type
- article
- Field-Weighted Citation Impact
- 0.00