A computational model for the concurrent retrieval of object and self-motion information from optic flow

In a scene where self-motion and observer independent movement is present, the optic flow is complex because the global flow pattern resulting from ego-motion is locally confounded. Important information can still be obtained, although various biases were reported. The estimation of self-motion direction is affected by the direction of object movement and the perception of the object's trajectory by the ego-motion. While the underlying processes and their interactions remain largely unknown, some research proposes a sequential procedure. First, an initial estimation of the heading is made, followed by segmentation of areas of flow that do not match the estimation. The heading estimation is then refined, excluding these areas. The estimation could then aid in accounting for self-motion and disentangle the combined flow at the objects' retinal location for the retrieval of object properties. However, other research contests the need for prior heading estimation to estimate an object's trajectory. We present a computational model that computes retinotopic maps displaying the likelihood of heading directions given local flow. The likelihood distribution serves as a reliable indicator for the presence of independent object motion. Omitting certain parts of the flow, the objects' influence on heading estimation can be reduced. Furthermore, details about the objects' retinal position and movement can be extracted from the distributions. In summary, the model offers a concurrent estimation of both object properties and heading without either process relying on the outcome of the other. The model replicates various aspects of human performance, including the initial rise in heading estimation error with an increase in object speed, followed by a reduction in error due to enhanced object detection performance. The perception of an object's trajectory is biased by its heading direction, in line with prior research. This bias occurs without requiring the completion of the heading estimation process beforehand.

Authors

Institutions

Publication Details

Journal
Journal of Vision
Published
2024-09-15
DOI
https://doi.org/10.1167/jov.24.10.870
Primary Topic
Advanced Vision and Imaging
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A computational model for the concurrent retrieval of object and self-motion information from optic flow

Malte Scherff, Markus Lappe
Journal of Vision
Advanced Vision and Imaging
article

A computational model for the concurrent retrieval of object and self-motion information from optic flow

Malte Scherff, Markus Lappe
article en

Abstract

In a scene where self-motion and observer independent movement is present, the optic flow is complex because the global flow pattern resulting from ego-motion is locally confounded. Important information can still be obtained, although various biases were reported. The estimation of self-motion direction is affected by the direction of object movement and the perception of the object's trajectory by the ego-motion. While the underlying processes and their interactions remain largely unknown, some research proposes a sequential procedure. First, an initial estimation of the heading is made, followed by segmentation of areas of flow that do not match the estimation. The heading estimation is then refined, excluding these areas. The estimation could then aid in accounting for self-motion and disentangle the combined flow at the objects' retinal location for the retrieval of object properties. However, other research contests the need for prior heading estimation to estimate an object's trajectory. We present a computational model that computes retinotopic maps displaying the likelihood of heading directions given local flow. The likelihood distribution serves as a reliable indicator for the presence of independent object motion. Omitting certain parts of the flow, the objects' influence on heading estimation can be reduced. Furthermore, details about the objects' retinal position and movement can be extracted from the distributions. In summary, the model offers a concurrent estimation of both object properties and heading without either process relying on the outcome of the other. The model replicates various aspects of human performance, including the initial rise in heading estimation error with an increase in object speed, followed by a reduction in error due to enhanced object detection performance. The perception of an object's trajectory is biased by its heading direction, in line with prior research. This bias occurs without requiring the completion of the heading estimation process beforehand.

Journal of VisionVol. 24(10)
University of Münster (DE)
Reduced inequalities
Openalex Percentile: Top 84%
Advanced Vision and Imaging
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A computational model for the concurrent retrieval of object and self-motion information from optic flow — Malte Scherff, Markus Lappe · Journal of Vision (2024) | TGRS Research Map | TGRS