SWE-Dev: Building Software Engineering Agents with Training and Inference Scaling

Large language models (LLMs) have advanced rapidly from conversational problem solving to addressing real-world tasks involving tool use, such as software engineering (SWE).Recent LLM-powered SWE systems, such as Ope-nAI Codex and Cursor, have offered end-to-end automation of the software development process.However, building effective SWE agents remains challenging due to the lack of highquality training data and reliable test-time evaluation.To address this issue, we present SWE-DEV, an SWE agent built upon open-source LLMs, with a focus on training and inference scaling.For training scaling, we develop a robust pipeline to synthesize test cases and scale up agent trajectories to construct the training data.For inference scaling, we increase the interaction budget within a single run to enable further thinking within one independent attempt.Experiments on the SWE-bench-Verified benchmark show that the SWE-DEV models can achieve top performance among all open SWE agents.Specifically, the resolve rate of our 7B and 32B models reach 23.4% and 36.6%,respectively, outperforming state-of-the-art open-source models.All code, models, and datasets are publicly available at

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.findings-acl.193
Primary Topic
Business Process Modeling and Analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

SWE-Dev: Building Software Engineering Agents with Training and Inference Scaling

Zhenyu Hou, Wei Yao, Yuxiao Dong, Jie Tang et al.
1 links
Business Process Modeling and Analysis
article

SWE-Dev: Building Software Engineering Agents with Training and Inference Scaling

Zhenyu Hou, Wei Yao, Yuxiao Dong, Jie Tang, Haoran Wang
article en

Abstract

Large language models (LLMs) have advanced rapidly from conversational problem solving to addressing real-world tasks involving tool use, such as software engineering (SWE).Recent LLM-powered SWE systems, such as Ope-nAI Codex and Cursor, have offered end-to-end automation of the software development process.However, building effective SWE agents remains challenging due to the lack of highquality training data and reliable test-time evaluation.To address this issue, we present SWE-DEV, an SWE agent built upon open-source LLMs, with a focus on training and inference scaling.For training scaling, we develop a robust pipeline to synthesize test cases and scale up agent trajectories to construct the training data.For inference scaling, we increase the interaction budget within a single run to enable further thinking within one independent attempt.Experiments on the SWE-bench-Verified benchmark show that the SWE-DEV models can achieve top performance among all open SWE agents.Specifically, the resolve rate of our 7B and 32B models reach 23.4% and 36.6%,respectively, outperforming state-of-the-art open-source models.All code, models, and datasets are publicly available at

Openalex Percentile: Top 67%
Business Process Modeling and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.