Online graph based transforms for intra-predicted imaging data

• A novel online graph-based transform learning framework (GBT-ONL) is proposed, which learns Graph-Based Transforms dynamically during encoding without any offline training phase. • The method employs a shallow fully connected neural network (FC-NN) that predicts the graph Laplacian for each residual block as data is pro-cessed, enabling real-time adaptation to content variations. • GBT-ONL requires no transmission of graph or model parameters in the bitstream since the same online learning process is mirrored at the decoder side. • By learning transforms online, the framework eliminates the need for large, curated, or domain-specific training datasets, ensuring robustness and general applicability across different imaging domains (e.g., natural, medical, remote sensing data). Orthogonal transforms are key components of several image and video compression systems and standards, as they provide a de-correlated representation of signals to enhance compressibility. However, the most commonly used transforms for compression, such as the Discrete Cosine transforms (DCT) and Discrete Sine transforms (DST), are fixed and non-adaptive, limiting their ability to capture complex or varying signal characteristics. Graph-based transforms (GBTs) have shown improved energy compaction and reconstruction performance, but face two major limitations: the need to signal graph information in the compressed bitstream, which increases overhead and may complicates decoder synchronization, and a dependency on offline training process, which is highly dependent on the quality and completeness of the training data. To address these issues, this paper introduces a novel framework, GBT-ONL, which learns GBTs online in the context of block-based predictive transform coding. The proposed GBT-ONL framework uses a shallow fully connected neural network to predict the graph Laplacian needed for both the forward and inverse GBT. By relying only on information available during encoding, GBT-ONL eliminates the need to signal additional information in the compressed bitstream, and removes the requirement for any prior offline training. Evaluations on several video sequences show that GBT-ONL outperforms both traditional (non-learnable) transforms and existing learnable transforms in terms of energy compaction, reconstruction error, and compression efficiency, as measured by BD-PSNR and BD-Rate metrics.

Authors

Institutions

Publication Details

Journal
Pattern Recognition
Published
2025-11-08
DOI
https://doi.org/10.1016/j.patcog.2025.112649
Primary Topic
Advanced Graph Neural Networks
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Online graph based transforms for intra-predicted imaging data

Debaleena Roy, Tanaya Guha, Víctor Sánchez
Pattern Recognition
Advanced Graph Neural Networks
article

Online graph based transforms for intra-predicted imaging data

Debaleena Roy, Tanaya Guha, Víctor Sánchez
article en

Abstract

• A novel online graph-based transform learning framework (GBT-ONL) is proposed, which learns Graph-Based Transforms dynamically during encoding without any offline training phase. • The method employs a shallow fully connected neural network (FC-NN) that predicts the graph Laplacian for each residual block as data is pro-cessed, enabling real-time adaptation to content variations. • GBT-ONL requires no transmission of graph or model parameters in the bitstream since the same online learning process is mirrored at the decoder side. • By learning transforms online, the framework eliminates the need for large, curated, or domain-specific training datasets, ensuring robustness and general applicability across different imaging domains (e.g., natural, medical, remote sensing data). Orthogonal transforms are key components of several image and video compression systems and standards, as they provide a de-correlated representation of signals to enhance compressibility. However, the most commonly used transforms for compression, such as the Discrete Cosine transforms (DCT) and Discrete Sine transforms (DST), are fixed and non-adaptive, limiting their ability to capture complex or varying signal characteristics. Graph-based transforms (GBTs) have shown improved energy compaction and reconstruction performance, but face two major limitations: the need to signal graph information in the compressed bitstream, which increases overhead and may complicates decoder synchronization, and a dependency on offline training process, which is highly dependent on the quality and completeness of the training data. To address these issues, this paper introduces a novel framework, GBT-ONL, which learns GBTs online in the context of block-based predictive transform coding. The proposed GBT-ONL framework uses a shallow fully connected neural network to predict the graph Laplacian needed for both the forward and inverse GBT. By relying only on information available during encoding, GBT-ONL eliminates the need to signal additional information in the compressed bitstream, and removes the requirement for any prior offline training. Evaluations on several video sequences show that GBT-ONL outperforms both traditional (non-learnable) transforms and existing learnable transforms in terms of energy compaction, reconstruction error, and compression efficiency, as measured by BD-PSNR and BD-Rate metrics.

Pattern RecognitionVol. 172
Aston University (GB), University of Warwick (GB), University of Glasgow (GB)
Openalex Percentile: Top 82%
Advanced Graph Neural Networks
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.