Does Fine-Tuning Still Pay Once a Stronger Planner Starts?

Prior studies found that written plans from planners no larger than the agent shrink its fine-tuning gain; here the planner is a stronger model that taught the agent. The smaller agent, Granite 4.2 8B, tuned on gpt-5.6-luna's runs of AppWorld training tasks, outscored its off-the-shelf version. On AppWorld's harder test tasks, its lead in the share of automatic checks passed was 26.43 percentage points without help and, unlike in those studies, survived the planner's written plan and the planner acting every 10 steps. A head start, replaying the planner's first 6 actions, brought it to -1.60 [-5.07, +1.85] on runs the smaller agent took over. Planned in advance: On harder tasks, 6 actions removed three quarters; no 5-point lead remained. This also held against an off-the-shelf agent hinted to use the user's passwords and never sign up. On tasks fully completed, the head start moved the lead from +7.67 [+5.04, +10.67] to -6.36 [-10.62, -2.21]. We hypothesise that much of the lead sits in a learned opening routine, though head starts may even out any two agents.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-02
DOI
https://doi.org/10.5281/zenodo.23882360
Primary Topic
AI-based Problem Solving and Planning
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Does Fine-Tuning Still Pay Once a Stronger Planner Starts?

Nguyễn Như Hiếu, Kien Nguyen Thanh
1 links
Zenodo (CERN European Organization for Nuclear Research)
AI-based Problem Solving and Planning
preprint

Does Fine-Tuning Still Pay Once a Stronger Planner Starts?

Nguyễn Như Hiếu, Kien Nguyen Thanh
preprint en

Abstract

Prior studies found that written plans from planners no larger than the agent shrink its fine-tuning gain; here the planner is a stronger model that taught the agent. The smaller agent, Granite 4.2 8B, tuned on gpt-5.6-luna's runs of AppWorld training tasks, outscored its off-the-shelf version. On AppWorld's harder test tasks, its lead in the share of automatic checks passed was 26.43 percentage points without help and, unlike in those studies, survived the planner's written plan and the planner acting every 10 steps. A head start, replaying the planner's first 6 actions, brought it to -1.60 [-5.07, +1.85] on runs the smaller agent took over. Planned in advance: On harder tasks, 6 actions removed three quarters; no 5-point lead remained. This also held against an off-the-shelf agent hinted to use the user's passwords and never sign up. On tasks fully completed, the head start moved the lead from +7.67 [+5.04, +10.67] to -6.36 [-10.62, -2.21]. We hypothesise that much of the lead sits in a learned opening routine, though head starts may even out any two agents.

Zenodo (CERN European Organization for Nuclear Research)
Queensland University of Technology (AU)
AI-based Problem Solving and Planning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon