Matching Degree Histogram-Based Concept Drift Detector for Data Stream

Data stream is becoming more common in various applications, and concept drift detection is an important work in data stream mining. Data distribution-based detection meth-ods are direct and effective. Specially, describing the distribution by histograms is unsupervised and applicable to various data. However, histogram is a relatively rough description of data, making it difficult to completely cover the information contained in data. Therefore, a matching degree-based histo-gram (MD-Histogram) is constructed firstly in this paper, in which the matching degree of each feature to each breakpoint is calculated. Besides, combined with the fix-slide windows model, a MD-Histogram-based concept drift detector (MDH-CDD) is proposed. MD-Histogram is used to describe the distributions of the data in different windows, and Euclidean distance is used to measure the difference. Then, according to different thresholds, three different states can be reported. The effectiveness of MDH-CDD is verified on synthetic and real-world datasets.

Authors

Institutions

Publication Details

Published
2024-10-25
DOI
https://doi.org/10.1109/bigdia63733.2024.10808787
Primary Topic
Data Stream Mining Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Matching Degree Histogram-Based Concept Drift Detector for Data Stream

Xinyang Wu, Bingfeng Ge, Jianbin Sun, Jiang Jiang et al.
Data Stream Mining Techniques
article

Matching Degree Histogram-Based Concept Drift Detector for Data Stream

Xinyang Wu, Bingfeng Ge, Jianbin Sun, Jiang Jiang, Ruirui Zhao
article en

Abstract

Data stream is becoming more common in various applications, and concept drift detection is an important work in data stream mining. Data distribution-based detection meth-ods are direct and effective. Specially, describing the distribution by histograms is unsupervised and applicable to various data. However, histogram is a relatively rough description of data, making it difficult to completely cover the information contained in data. Therefore, a matching degree-based histo-gram (MD-Histogram) is constructed firstly in this paper, in which the matching degree of each feature to each breakpoint is calculated. Besides, combined with the fix-slide windows model, a MD-Histogram-based concept drift detector (MDH-CDD) is proposed. MD-Histogram is used to describe the distributions of the data in different windows, and Euclidean distance is used to measure the difference. Then, according to different thresholds, three different states can be reported. The effectiveness of MDH-CDD is verified on synthetic and real-world datasets.

National University of Defense Technology (CN)
Affordable and clean energy
Openalex Percentile: Top 78%
Data Stream Mining Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Matching Degree Histogram-Based Concept Drift Detector for Data Stream — Xinyang Wu, Bingfeng Ge, et al. · (2024) | TGRS Research Map | TGRS