Integrating statistical significance and discriminative power in pattern discovery

Pattern discovery plays a central role in knowledge acquisition across multiple domains. Actionable patterns must meet rigorous statistical significance criteria and, in the presence of target variables, further uphold discriminative power. This work addresses the underexplored area of guiding pattern discovery by integrating statistical significance and discriminative power criteria into state-of-the-art algorithms while preserving pattern quality. We also address how pattern quality thresholds, imposed by some algorithms, can be rectified to accommodate these additional criteria. To assess the proposed methodology, we select the triclustering task as the guiding pattern discovery case and extend well-known greedy and multi-objective optimization triclustering algorithms, δ -Trimax and TriGen, with various merit functions, such as Mean Squared Residual (MSR), Least Squared Lines (LSL), and Multi Slope Measure (MSL). Results from three case studies show the role of the proposed methodology in discovering patterns with pronouncedly higher discriminative power and statistical significance without quality deterioration, highlighting the relevance of combining these criteria to guide the underlying searches and aid knowledge discovery. Although the proposed methodology is motivated over multivariate time series data, it is straightforwardly extensible to pattern discovery tasks involving multivariate, N-way (N > 3), transactional, and sequential data structures. Availability: The code is freely available at https://github.com/JupitersMight/MOF_Triclustering • Integration of discriminative power views into pattern discovery. • Adaptable framework for pattern-centric knowledge acquisition. • Patterns with guarantees of quality, statistical significance, and discriminative power. • Extended triclustering views for pattern discovery in tensor data. • Mitigation of false positive and false negative risks during pattern discovery.

Authors

Institutions

Publication Details

Journal
Knowledge-Based Systems
Published
2025-03-25
DOI
https://doi.org/10.1016/j.knosys.2025.113356
Citations
1
Primary Topic
Data Mining Algorithms and Applications
Type
article
Field-Weighted Citation Impact
3.25
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Integrating statistical significance and discriminative power in pattern discovery

Rafael S. Costa, Leonardo Alexandre, Rui Henriques
1 citations
Knowledge-Based Systems
Data Mining Algorithms and Applications
3.25
article

Integrating statistical significance and discriminative power in pattern discovery

Rafael S. Costa, Leonardo Alexandre, Rui Henriques
article en
1 citations

Abstract

Pattern discovery plays a central role in knowledge acquisition across multiple domains. Actionable patterns must meet rigorous statistical significance criteria and, in the presence of target variables, further uphold discriminative power. This work addresses the underexplored area of guiding pattern discovery by integrating statistical significance and discriminative power criteria into state-of-the-art algorithms while preserving pattern quality. We also address how pattern quality thresholds, imposed by some algorithms, can be rectified to accommodate these additional criteria. To assess the proposed methodology, we select the triclustering task as the guiding pattern discovery case and extend well-known greedy and multi-objective optimization triclustering algorithms, δ -Trimax and TriGen, with various merit functions, such as Mean Squared Residual (MSR), Least Squared Lines (LSL), and Multi Slope Measure (MSL). Results from three case studies show the role of the proposed methodology in discovering patterns with pronouncedly higher discriminative power and statistical significance without quality deterioration, highlighting the relevance of combining these criteria to guide the underlying searches and aid knowledge discovery. Although the proposed methodology is motivated over multivariate time series data, it is straightforwardly extensible to pattern discovery tasks involving multivariate, N-way (N > 3), transactional, and sequential data structures. Availability: The code is freely available at https://github.com/JupitersMight/MOF_Triclustering • Integration of discriminative power views into pattern discovery. • Adaptable framework for pattern-centric knowledge acquisition. • Patterns with guarantees of quality, statistical significance, and discriminative power. • Extended triclustering views for pattern discovery in tensor data. • Mitigation of false positive and false negative risks during pattern discovery.

Knowledge-Based SystemsVol. 316
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento (PT), University of Lisbon (PT), Rede de Química e Tecnologia (PT)
Reduced inequalities
Openalex Percentile: Top 10%
Data Mining Algorithms and Applications
3.25
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.