Pre-Masking, Preprocessing Completion, and Anomaly Sensitivity in HDFS Log Classification with TF–IDF and LinearSVC

Log preprocessing determines both the representation supplied to a detector and whether the intended observations can be evaluated. We compared Drain3 without external regular-expression pre-masking (E), pre-masked Drain3 (D), and a regex bag-of-words representation (R) on HDFS-v1, comprising 11,175,629 log lines and 575,061 labeled block identifiers. Drain3 processing for E and D preceded a fixed 80/20 stratified block split; only D completed the full unlabeled corpus. TF–IDF and LinearSVC were fitted only on the training blocks. E was terminated after approximately 16 h, with 200,109 templates and 42,879 of 115,013 test block identifiers reached, before complete block-document coverage was established. D and R met the operational block-document coverage criterion and produced predictions for all 115,013 test blocks. D yielded 14 false negatives and 81 false positives, whereas R yielded 84 false negatives and 81 false positives. The anomaly recall was 99.584% for D and 97.506% for R. Among 3368 anomalous test blocks, D uniquely detected 73 and R uniquely detected 3, with 11 shared misses (exact two-sided p = 1.94 × 10−18). In this fixed-split setting, external pre-masking enabled the Drain3 branch to complete corpus processing. Under the study’s transductive representation setting, D achieved higher fixed-threshold anomaly sensitivity than R on the common test partition, with the same marginal false-positive count.

Authors

Institutions

Publication Details

Journal
Applied Sciences
Published
2026-11-13
DOI
https://doi.org/10.3390/app162211256
Primary Topic
Software System Performance and Reliability
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Pre-Masking, Preprocessing Completion, and Anomaly Sensitivity in HDFS Log Classification with TF–IDF and LinearSVC

Gökalp Tulum, Selahattin Koç
1 links
Applied Sciences
Software System Performance and Reliability
article

Pre-Masking, Preprocessing Completion, and Anomaly Sensitivity in HDFS Log Classification with TF–IDF and LinearSVC

Gökalp Tulum, Selahattin Koç
article en

Abstract

Log preprocessing determines both the representation supplied to a detector and whether the intended observations can be evaluated. We compared Drain3 without external regular-expression pre-masking (E), pre-masked Drain3 (D), and a regex bag-of-words representation (R) on HDFS-v1, comprising 11,175,629 log lines and 575,061 labeled block identifiers. Drain3 processing for E and D preceded a fixed 80/20 stratified block split; only D completed the full unlabeled corpus. TF–IDF and LinearSVC were fitted only on the training blocks. E was terminated after approximately 16 h, with 200,109 templates and 42,879 of 115,013 test block identifiers reached, before complete block-document coverage was established. D and R met the operational block-document coverage criterion and produced predictions for all 115,013 test blocks. D yielded 14 false negatives and 81 false positives, whereas R yielded 84 false negatives and 81 false positives. The anomaly recall was 99.584% for D and 97.506% for R. Among 3368 anomalous test blocks, D uniquely detected 73 and R uniquely detected 3, with 11 shared misses (exact two-sided p = 1.94 × 10−18). In this fixed-split setting, external pre-masking enabled the Drain3 branch to complete corpus processing. Under the study’s transductive representation setting, D achieved higher fixed-threshold anomaly sensitivity than R on the common test partition, with the same marginal false-positive count.

Applied SciencesVol. 16(22)
Üsküdar University (TR), Istanbul Topkapi University (TR)
Software System Performance and Reliability
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon