Attention-based matching cost for disparity estimation from light fields

This paper presents a neural network designed for light field (LF) disparity estimation. We improve the network's capability to use spatial and geometric information from light field data by:1. Incorporating positional encoding;2. Adding edge attention mechanisms. The positional encoding aids in deciphering the 3D structure of scenes, which is crucial for accurate LF disparity estimation. Meanwhile, edge attention directs the network to prioritize edge details, enabling the construction of more precise disparity maps. Additionally, edge attention ensures global consistency in disparity estimates, particularly in areas with prominent object edges and limited texture, where it can minimize estimation uncertainty. The attention mechanism also selectively refines features from each view, further boosting the accuracy of disparity estimation. Experiments demonstrate our model's improved accuracy, underscoring the effectiveness of our approach in enhancing LF disparity estimation techniques. The proposed method not only enhances performance but also streamlines the network architecture, making it more scalable and suitable for diverse computer vision scenarios.

Authors

Institutions

Publication Details

Published
2024-10-10
DOI
https://doi.org/10.1117/12.3036046
Primary Topic
Advanced Vision and Imaging
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Attention-based matching cost for disparity estimation from light fields

Jun Qiu, Xiaojuan Deng, Chang Liu, Junyao Weng
1 links
Advanced Vision and Imaging
article

Attention-based matching cost for disparity estimation from light fields

Jun Qiu, Xiaojuan Deng, Chang Liu, Junyao Weng
article en

Abstract

This paper presents a neural network designed for light field (LF) disparity estimation. We improve the network's capability to use spatial and geometric information from light field data by:1. Incorporating positional encoding;2. Adding edge attention mechanisms. The positional encoding aids in deciphering the 3D structure of scenes, which is crucial for accurate LF disparity estimation. Meanwhile, edge attention directs the network to prioritize edge details, enabling the construction of more precise disparity maps. Additionally, edge attention ensures global consistency in disparity estimates, particularly in areas with prominent object edges and limited texture, where it can minimize estimation uncertainty. The attention mechanism also selectively refines features from each view, further boosting the accuracy of disparity estimation. Experiments demonstrate our model's improved accuracy, underscoring the effectiveness of our approach in enhancing LF disparity estimation techniques. The proposed method not only enhances performance but also streamlines the network architecture, making it more scalable and suitable for diverse computer vision scenarios.

Beijing Information Science & Technology University (CN)
Openalex Percentile: Top 83%
Advanced Vision and Imaging
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.