Learning to reset in target search problems

Abstract Target search problems are central to a wide range of fields, from biological foraging to optimization algorithms. Recently, the ability to reset the search has been shown to significantly improve the searcher’s efficiency. However, the optimal resetting strategy depends on the specific properties of the search problem and can often be challenging to determine. In this work, we propose a reinforcement learning (RL)-based framework to train agents capable of optimizing their search efficiency in environments by learning how to reset. First, we validate the approach in a well-established benchmark: the Brownian search with resetting. There, RL agents consistently recover strategies closely resembling the sharp resetting distribution, known to be optimal in this scenario. We then extend the framework by allowing agents to control not only when to reset, but also their spatial dynamics through turning actions. In this more complex setting, the agents discover strategies that adapt both resetting and turning to the properties of the environment, outperforming the proposed benchmarks. These results demonstrate how RL can serve both as an optimization tool and a mechanism for uncovering new, interpretable strategies in stochastic search processes with resetting.

Authors

Institutions

Publication Details

Journal
New Journal of Physics
Published
2025-09-01
DOI
https://doi.org/10.1088/1367-2630/ae02bc
Citations
3
Primary Topic
Diffusion and Search Dynamics
Type
article
Field-Weighted Citation Impact
2.42

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Learning to reset in target search problems

Hans J. Briegel, Michele Caraglio, Gorka Muñoz-Gil
3 citations
New Journal of Physics
Diffusion and Search Dynamics
2.42
article

Learning to reset in target search problems

Hans J. Briegel, Michele Caraglio, Gorka Muñoz-Gil
article en
3 citations

Abstract

Abstract Target search problems are central to a wide range of fields, from biological foraging to optimization algorithms. Recently, the ability to reset the search has been shown to significantly improve the searcher’s efficiency. However, the optimal resetting strategy depends on the specific properties of the search problem and can often be challenging to determine. In this work, we propose a reinforcement learning (RL)-based framework to train agents capable of optimizing their search efficiency in environments by learning how to reset. First, we validate the approach in a well-established benchmark: the Brownian search with resetting. There, RL agents consistently recover strategies closely resembling the sharp resetting distribution, known to be optimal in this scenario. We then extend the framework by allowing agents to control not only when to reset, but also their spatial dynamics through turning actions. In this more complex setting, the agents discover strategies that adapt both resetting and turning to the properties of the environment, outperforming the proposed benchmarks. These results demonstrate how RL can serve both as an optimization tool and a mechanism for uncovering new, interpretable strategies in stochastic search processes with resetting.

New Journal of PhysicsVol. 27(9)
Universität Innsbruck (AT)
European Commission, Austrian Science Fund
Openalex Percentile: Top 10%
Diffusion and Search Dynamics
2.42
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.