Avoidance of an unexpected obstacle without reinforcement learning: Why not using advanced control-theoretic tools?

This communication on collision avoidance with unexpected obstacles is motivated by some critical appraisals on reinforcement learning (RL) which “requires ridiculously large numbers of trials to learn any new task” (Yann LeCun). We use the classic Dubins’ car in order to replace RL with flatness-based control, combined with the HEOL feedback setting, and the latest model-free predictive control approach. The two approaches lead to convincing computer experiments where the results with the model-based one are only slightly better. They exhibit a satisfactory robustness with respect to randomly generated mismatches/disturbances, which become excellent in the model-free case. Those properties would have been perhaps difficult to obtain with today’s popular machine learning techniques in AI. Finally, we should emphasize that our two methods require a low computational burden.

Authors

Institutions

Publication Details

Published
2025-10-22
DOI
https://doi.org/10.1109/icsc67755.2025.11334738
Primary Topic
Reinforcement Learning in Robotics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Avoidance of an unexpected obstacle without reinforcement learning: Why not using advanced control-theoretic tools?

Michel Fliess
Reinforcement Learning in Robotics
article

Avoidance of an unexpected obstacle without reinforcement learning: Why not using advanced control-theoretic tools?

Michel Fliess
article en

Abstract

This communication on collision avoidance with unexpected obstacles is motivated by some critical appraisals on reinforcement learning (RL) which “requires ridiculously large numbers of trials to learn any new task” (Yann LeCun). We use the classic Dubins’ car in order to replace RL with flatness-based control, combined with the HEOL feedback setting, and the latest model-free predictive control approach. The two approaches lead to convincing computer experiments where the results with the model-based one are only slightly better. They exhibit a satisfactory robustness with respect to randomly generated mismatches/disturbances, which become excellent in the model-free case. Those properties would have been perhaps difficult to obtain with today’s popular machine learning techniques in AI. Finally, we should emphasize that our two methods require a low computational burden.

Centre National de la Recherche Scientifique (FR), Laboratoire d'Informatique de l'École Polytechnique (FR), Université de Lorraine (FR)
Openalex Percentile: Top 16%
Reinforcement Learning in Robotics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Avoidance of an unexpected obstacle without reinforcement learning: Why not using advanced control-theoretic tools? — Michel Fliess · (2025) | TGRS Research Map | TGRS