A Spatiotemporal Decomposition of a Video Stream Based on the Retina-Inspired Filter

The goal of this work is to propose a simple yet efficient way to dynamically transform a video stream according to the functional properties of the visual system. To achieve this goal, we extend to video sequences the Retina-Inspired Filter (RIF), which we have recently proposed for still images. Under the assumption that the input signal remains constant for a given time, the RIF decomposition was proven to be in-vertible, meaning that the image could be perfectly recovered. In this paper, we relax this assumption into a piece-wise constant input and analytically prove that the RIF can be applied to a group of pictures (GOP). We experimentally show that the size of GOP is important when motion appears, as some artifacts are generated. However, in the absence of motion among the GOP frames we can still perfectly reconstruct the video frames reducing the computational cost of the whole process.

Authors

Institutions

Publication Details

Published
2024-10-02
DOI
https://doi.org/10.1109/mmsp61759.2024.10743223
Primary Topic
Advanced Optical Imaging Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Spatiotemporal Decomposition of a Video Stream Based on the Retina-Inspired Filter

Effrosyni Doutsi, Panagiotis Tsakalides
Advanced Optical Imaging Technologies
article

A Spatiotemporal Decomposition of a Video Stream Based on the Retina-Inspired Filter

Effrosyni Doutsi, Panagiotis Tsakalides
article en

Abstract

The goal of this work is to propose a simple yet efficient way to dynamically transform a video stream according to the functional properties of the visual system. To achieve this goal, we extend to video sequences the Retina-Inspired Filter (RIF), which we have recently proposed for still images. Under the assumption that the input signal remains constant for a given time, the RIF decomposition was proven to be in-vertible, meaning that the image could be perfectly recovered. In this paper, we relax this assumption into a piece-wise constant input and analytically prove that the RIF can be applied to a group of pictures (GOP). We experimentally show that the size of GOP is important when motion appears, as some artifacts are generated. However, in the absence of motion among the GOP frames we can still perfectly reconstruct the video frames reducing the computational cost of the whole process.

University of Crete (GR), Foundation for Research and Technology Hellas (GR)
Openalex Percentile: Top 69%
Advanced Optical Imaging Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.