KAFQN: Kolmogorov-Arnold Fuzzy-guided Q-Network in Reinforcement Learning
Conventional deep reinforcement learning approaches frequently struggle with large-scale parameter complexity and insufficient interpretability, particularly in safety-critical control signal processing tasks that demand transparency. While deep neural networks are highly effective, they typically function as "black-box" models, hindering insight into decision-making processes and requiring substantial computational resources, thus restricting their use in signal processing for resource-constrained environments. To address these challenges, we propose the Kolmogorov-Arnold Fuzzy-guided Q-Network, a novel framework that integrates the interpretability of fuzzy logic with the nonlinear approximation capabilities of Kolmogorov-Arnold Networks within a Deep Double Q-Network. Our approach leverages fuzzy rules during the initial training phase to accelerate convergence, improve stability, and reduce model complexity. Experimental results on dynamic control signal tasks, such as CartPole-v1, demonstrate that KAFQN achieves superior performance, a higher proposed Reward-Efficiency Index, and enhanced interpretability, making it highly appropriate for resource-constrained applications.
Authors
- Zhizhong Liu (ORCID: https://orcid.org/0000-0001-7219-245X)
- Bing Zhao (ORCID: https://orcid.org/0000-0002-0044-9743)
- Zhuo Tang
Institutions
- Hunan University (CN)
Publication Details
- Published
- 2025-03-12
- DOI
- https://doi.org/10.1109/icassp49660.2025.10890744
- Primary Topic
- Evolutionary Algorithms and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China