Adaptive Jamming Decision-Making Against FHSS Communications via Inexpert Demonstrations Assisted Meta Reinforcement Learning

Reinforcement learning (RL)’s powerful optimization capabilities have been extensively applied in the field of wireless communication jamming decision-making. However, the generalization of jamming policies has rarely been explored, and most existing studies rely on task-customized reward functions, which are often intractable to design. To address these issues, we propose a meta RL method for frequency-hopping spread spectrum (FHSS) jamming decision-making, aided by inexpert demonstrations. Firstly, the policy network is meta-trained with multiple diverse tasks to obtain initial network parameters with good generalization. Subsequently, we combine RL and behavioral cloning (BC) to extract useful information from demonstrations, along with learning rate adaptation to achieve efficient policy exploration without the task-customized jamming reward. Simulations confirm that our proposed method not only adapts to unseen jamming tasks with just a few fine-tuning steps under general binary rewards condition, but also achieves higher accumulated jamming rewards and results in lower normalized throughput for users, outperforming state-of-the-art methods.

Authors

Institutions

Publication Details

Journal
IEEE Communications Letters
Published
2024-11-29
DOI
https://doi.org/10.1109/lcomm.2024.3502423
Citations
2
Primary Topic
Smart Grid Security and Resilience
Type
article
Field-Weighted Citation Impact
0.66

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Adaptive Jamming Decision-Making Against FHSS Communications via Inexpert Demonstrations Assisted Meta Reinforcement Learning

Ning Rao, Dan Wang, Xiang Peng, Hua Xu et al.
2 citations
IEEE Communications Letters
Smart Grid Security and Resilience
0.66
article

Adaptive Jamming Decision-Making Against FHSS Communications via Inexpert Demonstrations Assisted Meta Reinforcement Learning

Ning Rao, Dan Wang, Xiang Peng, Hua Xu, Lei Jiang, Zisen Qi
article en
2 citations

Abstract

Reinforcement learning (RL)’s powerful optimization capabilities have been extensively applied in the field of wireless communication jamming decision-making. However, the generalization of jamming policies has rarely been explored, and most existing studies rely on task-customized reward functions, which are often intractable to design. To address these issues, we propose a meta RL method for frequency-hopping spread spectrum (FHSS) jamming decision-making, aided by inexpert demonstrations. Firstly, the policy network is meta-trained with multiple diverse tasks to obtain initial network parameters with good generalization. Subsequently, we combine RL and behavioral cloning (BC) to extract useful information from demonstrations, along with learning rate adaptation to achieve efficient policy exploration without the task-customized jamming reward. Simulations confirm that our proposed method not only adapts to unseen jamming tasks with just a few fine-tuning steps under general binary rewards condition, but also achieves higher accumulated jamming rewards and results in lower normalized throughput for users, outperforming state-of-the-art methods.

IEEE Communications LettersVol. 29(1)
Air Force Engineering University (CN)
China Postdoctoral Science Foundation
Peace, Justice and strong institutions
Openalex Percentile: Top 28%
Smart Grid Security and Resilience
0.66
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.