Online graph based transforms for intra-predicted imaging data
• A novel online graph-based transform learning framework (GBT-ONL) is proposed, which learns Graph-Based Transforms dynamically during encoding without any offline training phase. • The method employs a shallow fully connected neural network (FC-NN) that predicts the graph Laplacian for each residual block as data is pro-cessed, enabling real-time adaptation to content variations. • GBT-ONL requires no transmission of graph or model parameters in the bitstream since the same online learning process is mirrored at the decoder side. • By learning transforms online, the framework eliminates the need for large, curated, or domain-specific training datasets, ensuring robustness and general applicability across different imaging domains (e.g., natural, medical, remote sensing data). Orthogonal transforms are key components of several image and video compression systems and standards, as they provide a de-correlated representation of signals to enhance compressibility. However, the most commonly used transforms for compression, such as the Discrete Cosine transforms (DCT) and Discrete Sine transforms (DST), are fixed and non-adaptive, limiting their ability to capture complex or varying signal characteristics. Graph-based transforms (GBTs) have shown improved energy compaction and reconstruction performance, but face two major limitations: the need to signal graph information in the compressed bitstream, which increases overhead and may complicates decoder synchronization, and a dependency on offline training process, which is highly dependent on the quality and completeness of the training data. To address these issues, this paper introduces a novel framework, GBT-ONL, which learns GBTs online in the context of block-based predictive transform coding. The proposed GBT-ONL framework uses a shallow fully connected neural network to predict the graph Laplacian needed for both the forward and inverse GBT. By relying only on information available during encoding, GBT-ONL eliminates the need to signal additional information in the compressed bitstream, and removes the requirement for any prior offline training. Evaluations on several video sequences show that GBT-ONL outperforms both traditional (non-learnable) transforms and existing learnable transforms in terms of energy compaction, reconstruction error, and compression efficiency, as measured by BD-PSNR and BD-Rate metrics.
Authors
- Debaleena Roy (ORCID: https://orcid.org/0000-0002-4268-3423)
- Tanaya Guha (ORCID: https://orcid.org/0000-0003-2167-4891)
- Víctor Sánchez (ORCID: https://orcid.org/0000-0002-7089-7031)
Institutions
- Aston University (GB)
- University of Warwick (GB)
- University of Glasgow (GB)
Publication Details
- Journal
- Pattern Recognition
- Published
- 2025-11-08
- DOI
- https://doi.org/10.1016/j.patcog.2025.112649
- Primary Topic
- Advanced Graph Neural Networks
- Type
- article
- Field-Weighted Citation Impact
- 0.00