A multi-scale 3D scene flow estimation network based on transformer

The purpose of scene flow estimation is to capture the intricate motion patterns within point clouds across successive frames. We incorporate the channel self-attention (CSA) into the estimation of scene flow for point clouds. Specifically, the channel self-attention mechanism prioritizes channels with significant disparities to prevent the merging of similar and redundant information. Through the subtraction operation embedded in the structure, attention weights are concentrated in regions with salient characteristics and crucial information within the point cloud, thereby reducing attention toward noise points. By incorporating channel self-attention at each stage of the network, we can extract local features and capture rich contextual information. Additionally, we introduce a channel excitation module to enhance the global correlation among channels and enhance the model's representation capability by introducing additional nonlinear relationships. Experimental results verify that our proposed method is effective.

Authors

Institutions

Publication Details

Published
2024-09-13
DOI
https://doi.org/10.1117/12.3039120
Primary Topic
Advanced Vision and Imaging
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A multi-scale 3D scene flow estimation network based on transformer

Liwei Chen, Yingxin Wei
Advanced Vision and Imaging
article

A multi-scale 3D scene flow estimation network based on transformer

Liwei Chen, Yingxin Wei
article en

Abstract

The purpose of scene flow estimation is to capture the intricate motion patterns within point clouds across successive frames. We incorporate the channel self-attention (CSA) into the estimation of scene flow for point clouds. Specifically, the channel self-attention mechanism prioritizes channels with significant disparities to prevent the merging of similar and redundant information. Through the subtraction operation embedded in the structure, attention weights are concentrated in regions with salient characteristics and crucial information within the point cloud, thereby reducing attention toward noise points. By incorporating channel self-attention at each stage of the network, we can extract local features and capture rich contextual information. Additionally, we introduce a channel excitation module to enhance the global correlation among channels and enhance the model's representation capability by introducing additional nonlinear relationships. Experimental results verify that our proposed method is effective.

Harbin Engineering University (CN)
Openalex Percentile: Top 85%
Advanced Vision and Imaging
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A multi-scale 3D scene flow estimation network based on transformer — Liwei Chen, Yingxin Wei · (2024) | TGRS Research Map | TGRS