A Stackelberg Game-Theoretic Hierarchical DRL Framework for RIS-Assisted ISAC Under Mobility

Integrated sensing and communication (ISAC) is a key enabler of next-generation wireless networks, where communication, sensing, and mobility-aware beam management must be jointly optimized under dynamic and imperfectly observed conditions. This paper proposes a game-theoretic hierarchical deep reinforcement learning framework for RIS-assisted ISAC (GT–HIDRL–ISAC), which formulates the coupled beamforming, RIS, sensing, and power-control problem as a Stackelberg bilevel optimization. A master agent jointly controls BS beamforming, RIS phase configuration, and sensing level, while a slave agent performs user-specific power control as an approximate best response. Hierarchical update timescales and centralized critics are employed to improve the learning process, while EKF-based mobility tracking accounts for imperfect sensing under Rician LoS/NLoS channels. Theoretical analysis establishes strong Stackelberg equilibrium (SSE) existence under standard regularity conditions and quantifies the effect of slave approximation errors on the master Stackelberg gradient. Simulation results show that GT–HIDRL–ISAC achieves approximately 0.82 bits/J median energy efficiency, compared with 0.795 bits/J for the no-Stackelberg ablation and 0.76 bits/J for Flat MAAG. It also achieves a median rate of 5.19 Mbps and a median tracking error of 1.00 m, corresponding to approximately 12.3% higher rate and 38.3% lower tracking error than Flat MAAG. Additional evaluations against TD3, SAC, AO–SCA, and AO–SDR demonstrate consistent gains across the considered channel, sensing, distance, multi-user, and RIS-size configurations.

Authors

Institutions

Publication Details

Journal
Technologies
Published
2026-11-13
DOI
https://doi.org/10.3390/technologies14110754
Primary Topic
Advanced Wireless Communication Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

A Stackelberg Game-Theoretic Hierarchical DRL Framework for RIS-Assisted ISAC Under Mobility

Anup Kumar Mandpura, Poongundran Selvaprabhu, Mukkara Prasanna Kumar, Karthikeyan Elumalai et al.
3 links
Technologies
Advanced Wireless Communication Technologies
article

A Stackelberg Game-Theoretic Hierarchical DRL Framework for RIS-Assisted ISAC Under Mobility

Anup Kumar Mandpura, Poongundran Selvaprabhu, Mukkara Prasanna Kumar, Karthikeyan Elumalai, Anirban Ghosh, Sunil Chinnadurai, Ammar Summaq
article en

Abstract

Integrated sensing and communication (ISAC) is a key enabler of next-generation wireless networks, where communication, sensing, and mobility-aware beam management must be jointly optimized under dynamic and imperfectly observed conditions. This paper proposes a game-theoretic hierarchical deep reinforcement learning framework for RIS-assisted ISAC (GT–HIDRL–ISAC), which formulates the coupled beamforming, RIS, sensing, and power-control problem as a Stackelberg bilevel optimization. A master agent jointly controls BS beamforming, RIS phase configuration, and sensing level, while a slave agent performs user-specific power control as an approximate best response. Hierarchical update timescales and centralized critics are employed to improve the learning process, while EKF-based mobility tracking accounts for imperfect sensing under Rician LoS/NLoS channels. Theoretical analysis establishes strong Stackelberg equilibrium (SSE) existence under standard regularity conditions and quantifies the effect of slave approximation errors on the master Stackelberg gradient. Simulation results show that GT–HIDRL–ISAC achieves approximately 0.82 bits/J median energy efficiency, compared with 0.795 bits/J for the no-Stackelberg ablation and 0.76 bits/J for Flat MAAG. It also achieves a median rate of 5.19 Mbps and a median tracking error of 1.00 m, corresponding to approximately 12.3% higher rate and 38.3% lower tracking error than Flat MAAG. Additional evaluations against TD3, SAC, AO–SCA, and AO–SDR demonstrate consistent gains across the considered channel, sensing, distance, multi-user, and RIS-size configurations.

TechnologiesVol. 14(11)
SRM University, Andhra Pradesh (IN), Indian Institute of Technology Bhilai (IN), Delhi Technological University (IN), Vellore Institute of Technology University (IN)
Industry, innovation and infrastructure
Advanced Wireless Communication Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon