Interpretability-Based Virtual Drift Detection and Adaptation Algorithm: A Case Study on Tetouan’s Energy Data

The feature impact in multilinear regression models can vary significantly with changes in learning environments. Identifying feature importance and building models with minimal possible features helps to streamline models and reduce costs. However, in many domains, the importance of features changes due to various factors, which can decrease model performance or render the model obsolete. This leads to the phenomenon known as concept drift.Proper monitoring of changes in feature importance can help mitigate it. Interpretability techniques can determine feature importance and help manage these shifts, especially in streaming data where virtual drifts are challenging to detect and address. The proactive approach we introduced here is to handle concept drift arising from frequent virtual drifts. Our method identifies the most suitable model for recent data, ensuring more accurate forecasting and minimizing the impact of concept drifts. This approach enhances model performance by continuously adapting to changes in feature importance, providing a robust solution for dynamic data environments.

Authors

Institutions

Publication Details

Published
2024-11-23
DOI
https://doi.org/10.1109/icec59683.2024.10837519
Citations
3
Primary Topic
Data Stream Mining Techniques
Type
article
Field-Weighted Citation Impact
1.04
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Interpretability-Based Virtual Drift Detection and Adaptation Algorithm: A Case Study on Tetouan’s Energy Data

Ebin Deni Raj, P Shahad
3 citations
Data Stream Mining Techniques
1.04
article

Interpretability-Based Virtual Drift Detection and Adaptation Algorithm: A Case Study on Tetouan’s Energy Data

Ebin Deni Raj, P Shahad
article en
3 citations

Abstract

The feature impact in multilinear regression models can vary significantly with changes in learning environments. Identifying feature importance and building models with minimal possible features helps to streamline models and reduce costs. However, in many domains, the importance of features changes due to various factors, which can decrease model performance or render the model obsolete. This leads to the phenomenon known as concept drift.Proper monitoring of changes in feature importance can help mitigate it. Interpretability techniques can determine feature importance and help manage these shifts, especially in streaming data where virtual drifts are challenging to detect and address. The proactive approach we introduced here is to handle concept drift arising from frequent virtual drifts. Our method identifies the most suitable model for recent data, ensuring more accurate forecasting and minimizing the impact of concept drifts. This approach enhances model performance by continuously adapting to changes in feature importance, providing a robust solution for dynamic data environments.

Indian Institute of Information Technology and Management, Kerala (IN)
Climate action
Openalex Percentile: Top 18%
Data Stream Mining Techniques
1.04
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.