Resilient multi-agent reinforcement learning for centralised tactical conflict resolution under uncertain perturbations and non-cooperative traffic in urban air mobility

• A centralised Tactical Conflict Resolution Solver using MARL with transformers. • A perturbation module modelling GNSS noise, comms loss, and sensor defects. • Evaluation under degraded data and mixed cooperative and non-cooperative traffic. • Resilient solver reducing NMAC risks compared with a baseline MARL model. • Limitations appear under dynamic-intent intruders with mixed airspace operations. This research investigates tactical conflict resolution for Unmanned Aircraft Systems (UAS) and Urban Air Mobility (UAM) operations under degraded conditions and in the presence of non-cooperative UAS/UAM and manned Commercial Air Transportation and General Aviation (CAT/GA) intruders. The study adopts a centralised safety-net approach within UAS Traffic Management (UTM) architectures, envisioning ground-based conflict resolution services. We propose a set of Tactical Conflict Resolution Solvers (TCRS), each built upon a Multi-Agent Reinforcement Learning (MARL) core using a shared-policy transformer architecture and executed in a decentralised manner. To assess resilience of TCRS variants, we introduce domain-specific perturbations, including positioning noise, communication loss, and sensor-related defects. The TCRS operates with partial decision-making ability in non-cooperative traffic environments, while the perturbation model increases realism by simulating varying degrees of information availability. Results show that the perturbation-trained models achieve substantial safety gains compared with the baseline TCRS trained in ideal conditions. The most resilient variant; trained under multi-perturbation exposure and evaluated in non-cooperative environments, achieves a threefold reduction in critical safety violations compared with the baseline and remains robust under mixed cooperative/non-cooperative traffic with static intent. It exhibits a modest vulnerability under fully homogeneous non-cooperative scenarios with dynamic intent. Simulations involving concurrent CAT/GA and UAS operations further indicate that integrating UAS operations within the existing airspace classification remains hazardous for ground-based tactical conflict resolution when constrained by short look-ahead horizons and insufficient time to react.

Authors

Institutions

Publication Details

Journal
Transportation Research Part C Emerging Technologies
Published
2026-01-30
DOI
https://doi.org/10.1016/j.trc.2026.105542
Primary Topic
Air Traffic Management and Optimization
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Resilient multi-agent reinforcement learning for centralised tactical conflict resolution under uncertain perturbations and non-cooperative traffic in urban air mobility

Rodolphe Fremond, Junjie Zhao, Gokhan Inalhan, Yan Xu et al.
Transportation Research Part C Emerging Technologies
Air Traffic Management and Optimization
article

Resilient multi-agent reinforcement learning for centralised tactical conflict resolution under uncertain perturbations and non-cooperative traffic in urban air mobility

Rodolphe Fremond, Junjie Zhao, Gokhan Inalhan, Yan Xu, Antonios Tsourdos
article en

Abstract

• A centralised Tactical Conflict Resolution Solver using MARL with transformers. • A perturbation module modelling GNSS noise, comms loss, and sensor defects. • Evaluation under degraded data and mixed cooperative and non-cooperative traffic. • Resilient solver reducing NMAC risks compared with a baseline MARL model. • Limitations appear under dynamic-intent intruders with mixed airspace operations. This research investigates tactical conflict resolution for Unmanned Aircraft Systems (UAS) and Urban Air Mobility (UAM) operations under degraded conditions and in the presence of non-cooperative UAS/UAM and manned Commercial Air Transportation and General Aviation (CAT/GA) intruders. The study adopts a centralised safety-net approach within UAS Traffic Management (UTM) architectures, envisioning ground-based conflict resolution services. We propose a set of Tactical Conflict Resolution Solvers (TCRS), each built upon a Multi-Agent Reinforcement Learning (MARL) core using a shared-policy transformer architecture and executed in a decentralised manner. To assess resilience of TCRS variants, we introduce domain-specific perturbations, including positioning noise, communication loss, and sensor-related defects. The TCRS operates with partial decision-making ability in non-cooperative traffic environments, while the perturbation model increases realism by simulating varying degrees of information availability. Results show that the perturbation-trained models achieve substantial safety gains compared with the baseline TCRS trained in ideal conditions. The most resilient variant; trained under multi-perturbation exposure and evaluated in non-cooperative environments, achieves a threefold reduction in critical safety violations compared with the baseline and remains robust under mixed cooperative/non-cooperative traffic with static intent. It exhibits a modest vulnerability under fully homogeneous non-cooperative scenarios with dynamic intent. Simulations involving concurrent CAT/GA and UAS operations further indicate that integrating UAS operations within the existing airspace classification remains hazardous for ground-based tactical conflict resolution when constrained by short look-ahead horizons and insufficient time to react.

Transportation Research Part C Emerging TechnologiesVol. 184
École Nationale de l’Aviation Civile (FR), University of Bedfordshire (GB), Institute and Faculty of Actuaries (GB), Cranfield University (GB), Beihang University (CN)
Sustainable cities and communities
Openalex Percentile: Top 72%
Air Traffic Management and Optimization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.