Zoetrope: A Deadline-Aware Architecture for Continuous Multimodal Perception, Reasoning, and Authorized Action

A live visual assistant must do more than describe successive images: it must maintain a coherent account of an evolving situation, allocate reasoning effort before relevant opportunities expire, and distinguish an authorized action from a plausible but outdated suggestion. We propose Zoetrope, a model-agnostic architecture for continuous multimodal perception, asynchronous reasoning, and bounded intervention. Its starting configuration samples every other frame of a video stream. Rather than equating this sampling frequency with the frequency or latency of complete reasoning, Zoetrope separates observation ingestion, temporal state maintenance, reasoning admission, and action execution. A versioned evidence store connects claims to timestamped observations; a deadline-aware scheduler allocates deeper inference; and an independent execution gate revalidates permissions and action-critical evidence before an intervention. The design supports both responsive questions and standing requests that require proactive notice or action, while perception continues during response generation. We formalize the distinction between throughput and freshness, specify bounded-memory and overload behavior, and develop a causal evaluation protocol that measures deadline-conditioned correctness, stale-state errors, interruption burden, and resource use. The central hypothesis is that explicit evidence validity and selective reasoning improve useful real-time performance over isolated frame analysis and asynchronous systems without freshness checks. This manuscript presents an architecture, analytical constraints, and an experimental plan; it reports no implementation measurements or benchmark results.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-15
DOI
https://doi.org/10.5281/zenodo.23405844
Primary Topic
AI-based Problem Solving and Planning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Zoetrope: A Deadline-Aware Architecture for Continuous Multimodal Perception, Reasoning, and Authorized Action

Payton Ison
Zenodo (CERN European Organization for Nuclear Research)
AI-based Problem Solving and Planning
article

Zoetrope: A Deadline-Aware Architecture for Continuous Multimodal Perception, Reasoning, and Authorized Action

Payton Ison
article en

Abstract

A live visual assistant must do more than describe successive images: it must maintain a coherent account of an evolving situation, allocate reasoning effort before relevant opportunities expire, and distinguish an authorized action from a plausible but outdated suggestion. We propose Zoetrope, a model-agnostic architecture for continuous multimodal perception, asynchronous reasoning, and bounded intervention. Its starting configuration samples every other frame of a video stream. Rather than equating this sampling frequency with the frequency or latency of complete reasoning, Zoetrope separates observation ingestion, temporal state maintenance, reasoning admission, and action execution. A versioned evidence store connects claims to timestamped observations; a deadline-aware scheduler allocates deeper inference; and an independent execution gate revalidates permissions and action-critical evidence before an intervention. The design supports both responsive questions and standing requests that require proactive notice or action, while perception continues during response generation. We formalize the distinction between throughput and freshness, specify bounded-memory and overload behavior, and develop a causal evaluation protocol that measures deadline-conditioned correctness, stale-state errors, interruption burden, and resource use. The central hypothesis is that explicit evidence validity and selective reasoning improve useful real-time performance over isolated frame analysis and asynchronous systems without freshness checks. This manuscript presents an architecture, analytical constraints, and an experimental plan; it reports no implementation measurements or benchmark results.

Zenodo (CERN European Organization for Nuclear Research)
Openalex Percentile: Top 13%
AI-based Problem Solving and Planning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.