KERNEL REGRESSION OF MULTI-WAY DATA VIA TENSOR TRAINS WITH HADAMARD OVERPARAMETRIZATION: THE DYNAMIC GRAPH FLOW CASE
A regression-based framework for interpretable multi-way data imputation, termed Kernel Regression via Tensor Trains with Hadamard overparametrization (KReTTaH), is introduced. KReTTaH adopts a nonparametric formulation by casting imputation as regression via reproducing kernel Hilbert spaces. Parameter efficiency is achieved through tensors of fixed tensor-train (TT) rank, which reside on low-dimensional Riemannian manifolds, and is further enhanced via Hadamard overparametrization, which promotes sparsity within the TT parameter space. Learning is accomplished by solving a smooth inverse problem posed on the Riemannian manifold of fixed TT-rank tensors. As a representative application, the estimation of dynamic graph flows is considered. In this setting, KReTTaH exhibits flexibility by seamlessly incorporating graph-based (topological) priors via its inverse problem formulation. Numerical tests on real-world graph datasets demonstrate that KReTTaH consistently outperforms state-of-the-art alternatives-including a nonparametric tensor-and a neural-network-based methods-for imputing missing, time-varying edge flows.
Authors
- Konstantinos Slavakis (ORCID: https://orcid.org/0000-0002-3370-3154)
- Eleftherios Kofidis (ORCID: https://orcid.org/0000-0002-5887-9404)
- Dimitris A. Pados (ORCID: https://orcid.org/0000-0001-8959-6450)
- Duc Thien Nguyen (ORCID: https://orcid.org/0009-0009-7485-7852)
Publication Details
- Published
- 2025-10-02
- DOI
- https://doi.org/10.36227/techrxiv.175886181.15513914/v2
- Citations
- 1
- Primary Topic
- Machine Learning and Data Classification
- Type
- article
- Field-Weighted Citation Impact
- 2.48