Hy-Nomas: Towards Free-form Interactive World Generation
Interactive world generation requires models to follow successive commands while preserving relevant history and action consequences. We present Hy-Nomas, a video world model with an 8B diffusion backbone that supports free-form text instructions and continuous camera control across multiple interaction turns. It generates variable-length segments conditioned on current inputs and cached history. Our central design aligns structured video captions with action-aware causal attention: descriptive context remains accessible across segments, while action instructions are restricted to their intended temporal windows. A vision-language Prompt Enhancer (PE) translates user requests and multimodal interaction histories into structured conditions for the next segment. A multi-stage curriculum progressively introduces causal generation, text interaction, camera control, and training on model-generated histories, followed by diffusion distillation. In human evaluation, Hy-Nomas shows superior performance over existing world models. We release model weights, code and benchmarks, together with a lightweight adaptation workflow, to support reproducible research on interactive world generation.
Authors
- Zhang Key
- Xilun Wu
- Mingji Han
- W. Wang (ORCID: https://orcid.org/0009-0003-7874-9468)
- Haoyi Duan (ORCID: https://orcid.org/0000-0002-5551-2594)
- Tiankai Hang (ORCID: https://orcid.org/0000-0003-1005-7150)
- Enhua Jiang (ORCID: https://orcid.org/0000-0001-9323-126X)
- Shunkai Li
- Linghao Chen (ORCID: https://orcid.org/0000-0002-2081-3258)
- Yao Teng
- Yanzhe Liang
- Ke Xing (ORCID: https://orcid.org/0009-0009-4422-945X)
- Xueqing Deng (ORCID: https://orcid.org/0009-0001-6064-8349)
- Jiaxiang Cheng
- Ray Ying
- Longjun Cao
- Tao Lu
- Rui Zhao
- Jiaming Han
- Yu Tang
- Yifan Liu
- Xiyao Wang
- Bing Wu
- Cong Wang
- Qinwei Ma
- Junshu Tang
- Zhengguang Zhou
- Mingyu Yang
- Yu Tian
- Yuan Zhou
- Heng Wang
- Lei Wang
- Ji Hou
- Yangbin Yu
- Kai Zou
- Zhentao Yu
- Jiaqi Li
- Qiaoling Chen
Publication Details
- Journal
- arXiv (Cornell University)
- Published
- 2026-10-27
- DOI
- https://doi.org/10.48550/arxiv.2610.36729
- Primary Topic
- Multimodal Machine Learning Applications
- Type
- preprint