Dimension Reduction with Locally Adjusted Graphs
Dimension reduction (DR) algorithms have proven to be extremely useful for gaining insight into large-scale high-dimensional datasets, particularly finding clusters in transcriptomic data. The initial phase of these DR methods often involves converting the original high-dimensional data into a graph. In this graph, each edge represents the similarity or dissimilarity between pairs of data points. However, this graph is frequently suboptimal due to unreliable high-dimensional distances and the limited information extracted from the high-dimensional data. This problem is exacerbated as the dataset size increases. If we reduce the size of the dataset by selecting points for a specific sections of the embeddings, the clusters observed through DR are more separable since the extracted subgraphs are more reliable. In this paper, we introduce LocalMAP, a new dimensionality reduction algorithm that dynamically and locally adjusts the graph to address this challenge. By dynamically extracting subgraphs and updating the graph on-the-fly, LocalMAP is capable of identifying and separating real clusters within the data that other DR methods may overlook or combine. We demonstrate the benefits of LocalMAP through a case study on biological datasets, highlighting its utility in helping users more accurately identify clusters for real-world problems.
Authors
- Cynthia Rudin (ORCID: https://orcid.org/0000-0003-4283-2780)
- Yingfan Wang (ORCID: https://orcid.org/0000-0003-1053-1713)
- Yiyang Sun (ORCID: https://orcid.org/0009-0007-0417-8534)
- Haiyang Huang (ORCID: https://orcid.org/0000-0001-9174-140X)
Institutions
- Duke University (US)
Publication Details
- Journal
- Proceedings of the AAAI Conference on Artificial Intelligence
- Published
- 2025-04-11
- DOI
- https://doi.org/10.1609/aaai.v39i20.35436
- Citations
- 3
- Primary Topic
- Digital Image Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 1.29