KFAE: Kalman Filter-Autoencoder Approach for Handling Faulty and Noisy Environments

Reinforcement Learning (RL) is widely applied in robotics, autonomous systems, and network optimization; however, it struggles with sensor noise and faulty actions, leading to instability. This paper introduces the Kalman Filter Autoencoder (KFAE), a novel approach that integrates Proximal Policy Optimization (PPO) with an Autoencoder and a Kalman Filter to denoise observations and correct action faults, thereby enhancing learning efficiency in noisy environments. KFAE stabilizes learning, improves decision reliability, and significantly outperforms the Noisy Environment (NE), achieving a 131.5% improvement in episode reward mean and an 184.1% increase in steps till collision. Additionally, KFAE closely approximates the Default Environment (DE) with minimal deviations, validating its effectiveness as a robust, fault-tolerant RL framework.

Authors

Institutions

Publication Details

Published
2025-09-15
DOI
https://doi.org/10.1109/elmar66948.2025.11194000
Primary Topic
Anomaly Detection Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

KFAE: Kalman Filter-Autoencoder Approach for Handling Faulty and Noisy Environments

Árpád Huszák, Hassanien Zanki
Anomaly Detection Techniques and Applications
article

KFAE: Kalman Filter-Autoencoder Approach for Handling Faulty and Noisy Environments

Árpád Huszák, Hassanien Zanki
article en

Abstract

Reinforcement Learning (RL) is widely applied in robotics, autonomous systems, and network optimization; however, it struggles with sensor noise and faulty actions, leading to instability. This paper introduces the Kalman Filter Autoencoder (KFAE), a novel approach that integrates Proximal Policy Optimization (PPO) with an Autoencoder and a Kalman Filter to denoise observations and correct action faults, thereby enhancing learning efficiency in noisy environments. KFAE stabilizes learning, improves decision reliability, and significantly outperforms the Noisy Environment (NE), achieving a 131.5% improvement in episode reward mean and an 184.1% increase in steps till collision. Additionally, KFAE closely approximates the Default Environment (DE) with minimal deviations, validating its effectiveness as a robust, fault-tolerant RL framework.

Budapest University of Technology and Economics (HU)
Openalex Percentile: Top 85%
Anomaly Detection Techniques and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.