Advancing Joint Dimension Reduction and Clustering through Hyperparameter Tuning
Clustering high-dimensional data requires dimensionality reduction to improve performance. However, joint models that unify both tasks often rely on hyperparameter tuning, which is challenging in the absence of labels. In this work, we propose a method that transforms external metrics, such as the V-measure, into internal metrics by comparing clustering results in the reduced and original spaces. This enables unsupervised tuning of key parameters, such as dimensionality and regularization strength. We evaluate our approach on several models (DKM, DCN, RSDE) and datasets spanning image and text data. The results show that our method outperforms default settings and correlates more strongly with ground-truth-based metrics than standard internal criteria, such as silhouette or Davies-Bouldin scores. Our method offers a robust, label-free alternative for hyperparameter selection in joint dimension reduction and clustering.
Authors
- Mohamed Nadif (ORCID: https://orcid.org/0000-0002-0007-3950)
- Imed Keraghel (ORCID: https://orcid.org/0009-0008-4943-2556)
Institutions
- Sorbonne Paris Cité (FR)
- Centre Borelli (FR)
Publication Details
- Published
- 2025-07-19
- DOI
- https://doi.org/10.1109/amlds63918.2025.11159333
- Primary Topic
- Manufacturing Process and Optimization
- Type
- article
- Field-Weighted Citation Impact
- 0.00