Nash Without Nash: A Review of Mamun's 'Riemannian Manifolds in Deep Learning' (Vol. III)
An independent review of Syed Muntasir Mamun's 'Riemannian Manifolds in Deep Learning: Foundations, Neural Representations, Geometric Architectures, and Computational Implications (Vol-III)' (2026). The review finds the survey well constructed in its essentials. Its five components - isometric embedding, manifold capacity, information geometry, optimisation on matrix submanifolds, and a geometric architecture - are the right selection for the field and are sequenced so that each rests only on what precedes it. The ambient-dimension bound from Nash's embedding theorem is stated correctly for the compact case, verified here against the literature. Most valuably, the paper keeps apart two things that comparable surveys routinely conflate: the manifolds formed by activations in feature space, and the statistical manifold formed by the distributions a network parameterises. Drawing that distinction early is what makes the treatment of natural gradient descent coherent, and it is the best decision in the paper's organisation. Three matters would repay attention in a revision. Nash's 1956 paper is not among the references, and the two footnote markers attached to the theorem resolve to unrelated work; Gardner and Amari are likewise named in the text but absent from the list. Nash's result establishes that an isometric embedding exists, which is a weaker claim than the guarantee the paper draws from it about what trained networks realise. And the first two takeaways are in tension, since a map cannot both preserve intrinsic geometry exactly and reduce intrinsic dimension - though a reconciliation is available, the capacity measures being extrinsic rather than intrinsic, and the paper draws precisely that distinction earlier for another purpose. The reference list would benefit from being rebuilt around the argument. These are contained repairs to a survey whose structure and topic selection are sound, and whose central distinction is one the field would do well to adopt.
Authors
- Hridoy Majumder Joy
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-11-17
- DOI
- https://doi.org/10.5281/zenodo.24298142
- Primary Topic
- Neural Networks and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00