Advancing Joint Dimension Reduction and Clustering through Hyperparameter Tuning

Clustering high-dimensional data requires dimensionality reduction to improve performance. However, joint models that unify both tasks often rely on hyperparameter tuning, which is challenging in the absence of labels. In this work, we propose a method that transforms external metrics, such as the V-measure, into internal metrics by comparing clustering results in the reduced and original spaces. This enables unsupervised tuning of key parameters, such as dimensionality and regularization strength. We evaluate our approach on several models (DKM, DCN, RSDE) and datasets spanning image and text data. The results show that our method outperforms default settings and correlates more strongly with ground-truth-based metrics than standard internal criteria, such as silhouette or Davies-Bouldin scores. Our method offers a robust, label-free alternative for hyperparameter selection in joint dimension reduction and clustering.

Authors

Institutions

Publication Details

Published
2025-07-19
DOI
https://doi.org/10.1109/amlds63918.2025.11159333
Primary Topic
Manufacturing Process and Optimization
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Advancing Joint Dimension Reduction and Clustering through Hyperparameter Tuning

Mohamed Nadif, Imed Keraghel
Manufacturing Process and Optimization
article

Advancing Joint Dimension Reduction and Clustering through Hyperparameter Tuning

Mohamed Nadif, Imed Keraghel
article en

Abstract

Clustering high-dimensional data requires dimensionality reduction to improve performance. However, joint models that unify both tasks often rely on hyperparameter tuning, which is challenging in the absence of labels. In this work, we propose a method that transforms external metrics, such as the V-measure, into internal metrics by comparing clustering results in the reduced and original spaces. This enables unsupervised tuning of key parameters, such as dimensionality and regularization strength. We evaluate our approach on several models (DKM, DCN, RSDE) and datasets spanning image and text data. The results show that our method outperforms default settings and correlates more strongly with ground-truth-based metrics than standard internal criteria, such as silhouette or Davies-Bouldin scores. Our method offers a robust, label-free alternative for hyperparameter selection in joint dimension reduction and clustering.

Sorbonne Paris Cité (FR), Centre Borelli (FR)
Openalex Percentile: Top 65%
Manufacturing Process and Optimization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.