Silent Misalignment in Multimodal Generative System: A Trace-Based Analysis of Cross-Turn State Drift in Text–Image Workflows

This working paper reports a trace-based field analysis of a multimodal generative workflow in which textual coherence and visual artefact integrity diverged across turns. In a long-horizon design scenario (text–image co-generation for a future-city concept), the language layer maintained high semantic continuity and repeatedly confirmed constraints, while the image outputs drifted across iterations—exhibiting palette dominance, region-programme misalignment, and label-only “corrections” without underlying structural compliance. The paper argues that the core issue is not best framed as model “accuracy” or single-turn prompt sensitivity. Instead, it is a governance failure of cross-modal state control: the interaction lacks non-bypassable mechanisms for state-locking, cross-modal verification, and mismatch visibility. The analysis is intentionally vendor- and model-agnostic, treating the observed pattern as a structural risk that can plausibly recur across systems with different epistemic positioning, consistent with parallel false-completion and artefact-mismatch incidents in AI-mediated document workflows. Supporting evidence (full trace logs, screenshots, and time-ordered notes) is preserved. This working paper does not include raw materials; a later revision will include an anonymised trace index and selected excerpts under appropriate disclosure constraints.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-01-12
DOI
https://doi.org/10.5281/zenodo.18221462
Primary Topic
Digital Humanities and Scholarship
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Silent Misalignment in Multimodal Generative System: A Trace-Based Analysis of Cross-Turn State Drift in Text–Image Workflows

Sincere Ann Ma
Zenodo (CERN European Organization for Nuclear Research)
Digital Humanities and Scholarship
article

Silent Misalignment in Multimodal Generative System: A Trace-Based Analysis of Cross-Turn State Drift in Text–Image Workflows

Sincere Ann Ma
article en

Abstract

This working paper reports a trace-based field analysis of a multimodal generative workflow in which textual coherence and visual artefact integrity diverged across turns. In a long-horizon design scenario (text–image co-generation for a future-city concept), the language layer maintained high semantic continuity and repeatedly confirmed constraints, while the image outputs drifted across iterations—exhibiting palette dominance, region-programme misalignment, and label-only “corrections” without underlying structural compliance. The paper argues that the core issue is not best framed as model “accuracy” or single-turn prompt sensitivity. Instead, it is a governance failure of cross-modal state control: the interaction lacks non-bypassable mechanisms for state-locking, cross-modal verification, and mismatch visibility. The analysis is intentionally vendor- and model-agnostic, treating the observed pattern as a structural risk that can plausibly recur across systems with different epistemic positioning, consistent with parallel false-completion and artefact-mismatch incidents in AI-mediated document workflows. Supporting evidence (full trace logs, screenshots, and time-ordered notes) is preserved. This working paper does not include raw materials; a later revision will include an anonymised trace index and selected excerpts under appropriate disclosure constraints.

Zenodo (CERN European Organization for Nuclear Research)
Sustainable cities and communities
Openalex Percentile: Top 91%
Digital Humanities and Scholarship
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Silent Misalignment in Multimodal Generative System: A Trace-Based Analysis of Cross-Turn State Drift in Text–Image Workflows — Sincere Ann Ma · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS