Optimising Real-Time Stereo Image Retargeting for AR/VR: Lightweight Disparity CNNs on AI-Driven Edge Architectures

Real-time stereo image retargeting for augmented reality (AR) and virtual reality (VR) necessitates precise per-pixel depth estimation and ultra-low latency performance on resource-limited edge devices. Current disparity convolutional neural networks (CNNs) and retargeting pipelines are unable to meet these demanding requirements concurrently. This paper presents EASNet, a compact end-to-end framework that unifies geometry-aware proposal generation, parallax-aligned feature encoding, sparse candidate aggregation, and uncertainty-guided refinement to enable high-fidelity stereo retargeting on edge architectures. This system enhances stereo vision through Epipolar-Adaptive Disparity Proposals (EADP) for search space reduction, a Parallax- Directed Deformable Encoder (PaDDE) for improved matching in repetitive and low-texture areas, Sparse Epipolar Candidate Volume (SECV) with Edge-Consistent Routing (ECR) for efficient, boundary-preserving cost aggregation, and Lightweight Uncertainty-Guided Refinement (LUGR) for subpixel structure and occlusion correction. Evaluated on high-resolution indoor stereo data, EASNet attains a favourable trade-off between accuracy and efficiency (≈0.21M parameters, 3.42 GFLOPs) while improving disparity fidelity and visual coherence required for retargeting (reported EPE ≈ 1.78 px, D1 ≈ 5.02%, VC ≈ 93.7%). The design emphasises quantisation compatibility and deterministic latency, enabling practical deployment on AR/VR edge devices. We analyse ablations, per-scene behaviour, and k-fold stability, and we discuss limitations, notably the indoor training bias and remaining challenges in extreme occlusion and large baseline scenarios, together with directions for extending EASNet via multi-scale context fusion and crossdomain adaptation.

Authors

Publication Details

Journal
Journal of Multiscale Modelling
Published
2025-12-18
DOI
https://doi.org/10.1142/s1756973726400160
Primary Topic
Advanced Vision and Imaging
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Optimising Real-Time Stereo Image Retargeting for AR/VR: Lightweight Disparity CNNs on AI-Driven Edge Architectures

Bhuvan Unhelkar, R Thiagarajan, Mahendra, Vishal Patil et al.
Journal of Multiscale Modelling
Advanced Vision and Imaging
article

Optimising Real-Time Stereo Image Retargeting for AR/VR: Lightweight Disparity CNNs on AI-Driven Edge Architectures

Bhuvan Unhelkar, R Thiagarajan, Mahendra, Vishal Patil, Pravin R. Kshirsagar, Nitin Rakesh
article en

Abstract

Real-time stereo image retargeting for augmented reality (AR) and virtual reality (VR) necessitates precise per-pixel depth estimation and ultra-low latency performance on resource-limited edge devices. Current disparity convolutional neural networks (CNNs) and retargeting pipelines are unable to meet these demanding requirements concurrently. This paper presents EASNet, a compact end-to-end framework that unifies geometry-aware proposal generation, parallax-aligned feature encoding, sparse candidate aggregation, and uncertainty-guided refinement to enable high-fidelity stereo retargeting on edge architectures. This system enhances stereo vision through Epipolar-Adaptive Disparity Proposals (EADP) for search space reduction, a Parallax- Directed Deformable Encoder (PaDDE) for improved matching in repetitive and low-texture areas, Sparse Epipolar Candidate Volume (SECV) with Edge-Consistent Routing (ECR) for efficient, boundary-preserving cost aggregation, and Lightweight Uncertainty-Guided Refinement (LUGR) for subpixel structure and occlusion correction. Evaluated on high-resolution indoor stereo data, EASNet attains a favourable trade-off between accuracy and efficiency (≈0.21M parameters, 3.42 GFLOPs) while improving disparity fidelity and visual coherence required for retargeting (reported EPE ≈ 1.78 px, D1 ≈ 5.02%, VC ≈ 93.7%). The design emphasises quantisation compatibility and deterministic latency, enabling practical deployment on AR/VR edge devices. We analyse ablations, per-scene behaviour, and k-fold stability, and we discuss limitations, notably the indoor training bias and remaining challenges in extreme occlusion and large baseline scenarios, together with directions for extending EASNet via multi-scale context fusion and crossdomain adaptation.

Journal of Multiscale Modelling
Openalex Percentile: Top 57%
Advanced Vision and Imaging
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Optimising Real-Time Stereo Image Retargeting for AR/VR: Lightweight Disparity CNNs on AI-Driven Edge Architectures — Bhuvan Unhelkar, R Thiagarajan, et al. · Journal of Multiscale Modelling (2025) | TGRS Research Map | TGRS