ReSeleCT: A New Approach for Continual Learning With Application to Vehicle State Estimation

In time series and data stream analysis, neural networks (NNs) have demonstrated remarkable capacity in predicting current and future states. However, NNs often suffer from catastrophic forgetting (CF) when adapting to new tasks or data domains. This issue is particularly pressing in vehicle state estimation, given that new data domains are frequently invited to a pre-trained model. While memory-based techniques have been proposed to address CF in continual learning, they are less effective for time series regression problems due to the absence of a suitable subset selection strategy. This paper presents a novel method called ReSeleCT (Representative Selection for Continual learning in Time-series scenarios) for identifying and capturing a coreset of old datasets in memory-based continual learning with application to vehicle velocity estimation. The approach focuses on selecting a representative subset of historical data to retain key information from previous tasks. The framework is applied to estimate a vehicle's longitudinal and lateral velocities using neural networks, incorporating new maneuvers into the previously trained model. Experiments on sensor data from an electric Equinox vehicle demonstrate that ReSeleCT efficiently adapts to new data domains while preserving prediction accuracy on the old dataset, with the added benefit of fast model adaptation without significant computational overhead. Comparison against other algorithms in continual learning shows a superior performance of the proposed method in terms of prediction error while maintaining an acceptable training time.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Intelligent Vehicles
Published
2024-08-15
DOI
https://doi.org/10.1109/tiv.2024.3443755
Citations
1
Primary Topic
Fault Detection and Control Systems
Type
article
Field-Weighted Citation Impact
0.33
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

ReSeleCT: A New Approach for Continual Learning With Application to Vehicle State Estimation

Amir Khajepour, Shojaeddin Chenouri, Mohammad Pirani, Reza Valiollahi Mehrizi et al.
1 citations
IEEE Transactions on Intelligent Vehicles
Fault Detection and Control Systems
0.33
article

ReSeleCT: A New Approach for Continual Learning With Application to Vehicle State Estimation

Amir Khajepour, Shojaeddin Chenouri, Mohammad Pirani, Reza Valiollahi Mehrizi, Arvin Hosseinzadeh
article en
1 citations

Abstract

In time series and data stream analysis, neural networks (NNs) have demonstrated remarkable capacity in predicting current and future states. However, NNs often suffer from catastrophic forgetting (CF) when adapting to new tasks or data domains. This issue is particularly pressing in vehicle state estimation, given that new data domains are frequently invited to a pre-trained model. While memory-based techniques have been proposed to address CF in continual learning, they are less effective for time series regression problems due to the absence of a suitable subset selection strategy. This paper presents a novel method called ReSeleCT (Representative Selection for Continual learning in Time-series scenarios) for identifying and capturing a coreset of old datasets in memory-based continual learning with application to vehicle velocity estimation. The approach focuses on selecting a representative subset of historical data to retain key information from previous tasks. The framework is applied to estimate a vehicle's longitudinal and lateral velocities using neural networks, incorporating new maneuvers into the previously trained model. Experiments on sensor data from an electric Equinox vehicle demonstrate that ReSeleCT efficiently adapts to new data domains while preserving prediction accuracy on the old dataset, with the added benefit of fast model adaptation without significant computational overhead. Comparison against other algorithms in continual learning shows a superior performance of the proposed method in terms of prediction error while maintaining an acceptable training time.

IEEE Transactions on Intelligent VehiclesVol. 10(3)
University of Waterloo (CA), University of Ottawa (CA)
Openalex Percentile: Top 43%
Fault Detection and Control Systems
0.33
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.