Skip to content

Source paper

Yume-1.5: A Text-Controlled Interactive World Generation Model

Xiaofeng Mao, Zhen Li, Chuanhao Li and 6 more

Xiaofeng Mao, Zhen Li, Chuanhao Li, Xiaojie Xu, Kaining Ying, Tong He, Jiangmiao Pang, Yu Qiao, Kaipeng Zhang

arXiv 2512.22096 · 202550 upvotes on Hugging Face

Research ideas from this paper (3)

Generated by AI. The paper’s authors did not write these.

AI summary

This paper presents Yume1.5, a multimodal framework designed to generate infinite, interactive, and photorealistic video worlds from a single image or text prompt. The authors address limitations in latency and context length by introducing a Joint Temporal-Spatial-Channel Modeling (TSCM) strategy for efficient history compression and a Self-Forcing training paradigm to mitigate autoregressive error accumulation.

How it works (AI summary)

The model utilizes a Video Diffusion Transformer (based on Wan 2.1) modified with TSCM, which splits historical context compression into two pathways: temporal-spatial compression (via random frame sampling and patchify) and channel-wise compression (via Linear Attention). It employs a distillation-based acceleration method combining score distillation and a 'Self-Forcing' technique where the model trains on its own predictions to enable robust 4-step real-time inference.