KAFQN: Kolmogorov-Arnold Fuzzy-guided Q-Network in Reinforcement Learning

Conventional deep reinforcement learning approaches frequently struggle with large-scale parameter complexity and insufficient interpretability, particularly in safety-critical control signal processing tasks that demand transparency. While deep neural networks are highly effective, they typically function as "black-box" models, hindering insight into decision-making processes and requiring substantial computational resources, thus restricting their use in signal processing for resource-constrained environments. To address these challenges, we propose the Kolmogorov-Arnold Fuzzy-guided Q-Network, a novel framework that integrates the interpretability of fuzzy logic with the nonlinear approximation capabilities of Kolmogorov-Arnold Networks within a Deep Double Q-Network. Our approach leverages fuzzy rules during the initial training phase to accelerate convergence, improve stability, and reduce model complexity. Experimental results on dynamic control signal tasks, such as CartPole-v1, demonstrate that KAFQN achieves superior performance, a higher proposed Reward-Efficiency Index, and enhanced interpretability, making it highly appropriate for resource-constrained applications.

Authors

Institutions

Publication Details

Published
2025-03-12
DOI
https://doi.org/10.1109/icassp49660.2025.10890744
Primary Topic
Evolutionary Algorithms and Applications
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

KAFQN: Kolmogorov-Arnold Fuzzy-guided Q-Network in Reinforcement Learning

Zhizhong Liu, Bing Zhao, Zhuo Tang
Evolutionary Algorithms and Applications
article

KAFQN: Kolmogorov-Arnold Fuzzy-guided Q-Network in Reinforcement Learning

Zhizhong Liu, Bing Zhao, Zhuo Tang
article en

Abstract

Conventional deep reinforcement learning approaches frequently struggle with large-scale parameter complexity and insufficient interpretability, particularly in safety-critical control signal processing tasks that demand transparency. While deep neural networks are highly effective, they typically function as "black-box" models, hindering insight into decision-making processes and requiring substantial computational resources, thus restricting their use in signal processing for resource-constrained environments. To address these challenges, we propose the Kolmogorov-Arnold Fuzzy-guided Q-Network, a novel framework that integrates the interpretability of fuzzy logic with the nonlinear approximation capabilities of Kolmogorov-Arnold Networks within a Deep Double Q-Network. Our approach leverages fuzzy rules during the initial training phase to accelerate convergence, improve stability, and reduce model complexity. Experimental results on dynamic control signal tasks, such as CartPole-v1, demonstrate that KAFQN achieves superior performance, a higher proposed Reward-Efficiency Index, and enhanced interpretability, making it highly appropriate for resource-constrained applications.

Hunan University (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 98%
Evolutionary Algorithms and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.