CCAL-DQN for Grid-Based Maritime Search and Rescue Path Planning Under Partial Observability

Grid-based maritime search and rescue (SAR) planning requires sequential decisions from incomplete spatial observations. Increasing map size also expands the search space and can intensify reward sparsity. This paper proposes CCAL-DQN, an LSTM deep Q-network with a cropping-concatenation (CC) observation representation and a deterministic boundary sign mask for simulated SAR path planning under partial observability. The method formulates the task as a partially observable Markov decision process and encodes observation features before action-value estimation. Deterministic boundary-aware cropping and concatenation keep the observation input dimension fixed, with nonlocal samples included near map boundaries. In the original evaluation, the method was trained on 9×9 maps and evaluated without fine-tuning on fixed 20×20 maps with an 80-step mission budget. The reported score is the map-wise ratio of policy-collected value to the incumbent returned by Gurobi within 60 s on the same map. CCAL-DQN achieves a higher mean relative score than the classical ACO, PSO, and GA algorithms under the tested conditions. It also has the shortest measured post-training evaluation time, excluding offline training cost. In the reported DRL comparison, LSTM-DQN obtains 0.5275 compared with 0.4232 for DRQN. Cropping-concatenation obtains 0.66 compared with 0.64 for full observation. Additional implementation and CC sign comparisons yielded higher mean collection fractions for the LSTM-based and inversion-enabled variants, respectively, under their separately specified protocols. A supplementary analysis using DDQN, DRQN, and PPO indicates that the effect of global context augmentation depends on the backbone. These results support fixed-size observation representations for algorithmic search planning in the tested simulated-grid setting.

Authors

Institutions

Publication Details

Journal
Applied Sciences
Published
2026-11-03
DOI
https://doi.org/10.3390/app162110913
Primary Topic
Reinforcement Learning in Robotics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

CCAL-DQN for Grid-Based Maritime Search and Rescue Path Planning Under Partial Observability

Zihan Xu, Chen Gang, Zhiwei Yang
Applied Sciences
Reinforcement Learning in Robotics
article

CCAL-DQN for Grid-Based Maritime Search and Rescue Path Planning Under Partial Observability

Zihan Xu, Chen Gang, Zhiwei Yang
article en

Abstract

Grid-based maritime search and rescue (SAR) planning requires sequential decisions from incomplete spatial observations. Increasing map size also expands the search space and can intensify reward sparsity. This paper proposes CCAL-DQN, an LSTM deep Q-network with a cropping-concatenation (CC) observation representation and a deterministic boundary sign mask for simulated SAR path planning under partial observability. The method formulates the task as a partially observable Markov decision process and encodes observation features before action-value estimation. Deterministic boundary-aware cropping and concatenation keep the observation input dimension fixed, with nonlocal samples included near map boundaries. In the original evaluation, the method was trained on 9×9 maps and evaluated without fine-tuning on fixed 20×20 maps with an 80-step mission budget. The reported score is the map-wise ratio of policy-collected value to the incumbent returned by Gurobi within 60 s on the same map. CCAL-DQN achieves a higher mean relative score than the classical ACO, PSO, and GA algorithms under the tested conditions. It also has the shortest measured post-training evaluation time, excluding offline training cost. In the reported DRL comparison, LSTM-DQN obtains 0.5275 compared with 0.4232 for DRQN. Cropping-concatenation obtains 0.66 compared with 0.64 for full observation. Additional implementation and CC sign comparisons yielded higher mean collection fractions for the LSTM-based and inversion-enabled variants, respectively, under their separately specified protocols. A supplementary analysis using DDQN, DRQN, and PPO indicates that the effect of global context augmentation depends on the backbone. These results support fixed-size observation representations for algorithmic search planning in the tested simulated-grid setting.

Applied SciencesVol. 16(21)
National University of Defense Technology (CN)
Openalex Percentile: Top 16%
Reinforcement Learning in Robotics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
CCAL-DQN for Grid-Based Maritime Search and Rescue Path Planning Under Partial Observability — Zihan Xu, Chen Gang, et al. · Applied Sciences (2026) | TGRS Research Map | TGRS