Online clustering with interpretable drift adaptation to mixed features

In the era of big data, the rapid pace and variability of information have become increasingly evident, particularly in areas like seasonal trends and manufacturing processes. The dynamic nature of the environments that produce these data means that their behavior is time-dependent. Consequently, treating data streams as static entities is no longer effective. This has led to the concept of data drift, which refers to shifts in data distribution over time. Stream processing algorithms are designed to detect these changes promptly and adjust to the newly emerging data patterns. In our research, we introduce FURAKI, an innovative online clustering algorithm that incorporates drift detection. It employs a binary tree structure and is capable of handling both single-feature and mixed-feature data from unbounded streams. We conducted extensive testing of FURAKI against state-of-the-art algorithms using various datasets. Our findings reveal that FURAKI outperforms the state-of-the-art algorithms in the considered datasets. • FURAKI: Unsupervised online clustering for mixed data with concept drift handling. • Drift Types: Detects abrupt, recurrent, incremental, and gradual concept drifts using KDE and G-tests. • Interpretable Model: Uses binary tree to show features driving changes in clustering. • Performance: Beats SOTA in F1-score and ARI on synthetic and real-world data. • Mixed Features: Handles numeric and categorical features without transformations.

Authors

Institutions

Publication Details

Journal
Intelligent Systems with Applications
Published
2025-04-08
DOI
https://doi.org/10.1016/j.iswa.2025.200510
Primary Topic
Data Stream Mining Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Online clustering with interpretable drift adaptation to mixed features

Marco Piangerelli, Barbara Re, Flavio Corradini, Vincenzo Nucci
Intelligent Systems with Applications
Data Stream Mining Techniques
article

Online clustering with interpretable drift adaptation to mixed features

Marco Piangerelli, Barbara Re, Flavio Corradini, Vincenzo Nucci
article en

Abstract

In the era of big data, the rapid pace and variability of information have become increasingly evident, particularly in areas like seasonal trends and manufacturing processes. The dynamic nature of the environments that produce these data means that their behavior is time-dependent. Consequently, treating data streams as static entities is no longer effective. This has led to the concept of data drift, which refers to shifts in data distribution over time. Stream processing algorithms are designed to detect these changes promptly and adjust to the newly emerging data patterns. In our research, we introduce FURAKI, an innovative online clustering algorithm that incorporates drift detection. It employs a binary tree structure and is capable of handling both single-feature and mixed-feature data from unbounded streams. We conducted extensive testing of FURAKI against state-of-the-art algorithms using various datasets. Our findings reveal that FURAKI outperforms the state-of-the-art algorithms in the considered datasets. • FURAKI: Unsupervised online clustering for mixed data with concept drift handling. • Drift Types: Detects abrupt, recurrent, incremental, and gradual concept drifts using KDE and G-tests. • Interpretable Model: Uses binary tree to show features driving changes in clustering. • Performance: Beats SOTA in F1-score and ARI on synthetic and real-world data. • Mixed Features: Handles numeric and categorical features without transformations.

Intelligent Systems with ApplicationsVol. 26
Università di Camerino (IT)
European Commission, Ministero dell’Istruzione, dell’Università e della Ricerca
Climate action
Openalex Percentile: Top 97%
Data Stream Mining Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.