Space Complexity of Euclidean Clustering
The <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$(k, z)$ </tex-math></inline-formula><sc xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">-Clustering</small> problem in Euclidean space <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\mathbb {R}^{d}$ </tex-math></inline-formula> has been extensively studied. Given the scale of data involved, compression methods for the Euclidean <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$(k, z)$ </tex-math></inline-formula><sc xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">-Clustering</small> problem, such as data compression and dimension reduction, have received significant attention in the literature. However, the space complexity of the clustering problem, specifically, the number of bits required to compress the cost function within a multiplicative error <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\varepsilon $ </tex-math></inline-formula>, remains unclear in existing literature. This paper initiates the study of space complexity for Euclidean <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$(k, z)$ </tex-math></inline-formula><sc xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">-Clustering</small> and offers both upper and lower bounds. Our space bounds are nearly tight when <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">k</i> is constant, indicating that storing a coreset, a well-known data compression approach, serves as the optimal compression scheme. Furthermore, our lower bound result for <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$(k, z)$ </tex-math></inline-formula><sc xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">-Clustering</small> establishes a tight space bound of <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\Theta (n d)$ </tex-math></inline-formula> for terminal embedding, where <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">n</i> represents the dataset size. Our technical approach leverages new geometric insights for principal angles and discrepancy methods, which may hold independent interest.
Authors
- Zengfeng Huang (ORCID: https://orcid.org/0000-0003-2671-7483)
- Yuxiang Tian (ORCID: https://orcid.org/0009-0007-1933-1538)
- Lingxiao Huang (ORCID: https://orcid.org/0000-0001-7512-142X)
- Xiaoyi Zhu (ORCID: https://orcid.org/0009-0002-5587-4752)
Institutions
- Fudan University (CN)
- Nanjing University of Science and Technology (CN)
- Nanjing University (CN)
Publication Details
- Journal
- IEEE Transactions on Information Theory
- Published
- 2025-03-11
- DOI
- https://doi.org/10.1109/tit.2025.3550192
- Citations
- 1
- Primary Topic
- Advanced Clustering Algorithms Research
- Type
- article
- Field-Weighted Citation Impact
- 2.48
Funders
- National Natural Science Foundation of China