Skip to content

Source paper

WorldCam: Interactive Autoregressive 3D Gaming Worlds with Camera Pose as a Unifying Geometric Representation

Jisu Nam, Yicong Hong, Chun-Hao Paul Huang and 9 more

Jisu Nam, Yicong Hong, Chun-Hao Paul Huang, Feng Liu, JoungBin Lee, Jiyoung Kim, Siyoon Jin, Yunsung Lee, Jaeyoon Jung, Suhwan Choi, Seungryong Kim, Yang Zhou

arXiv 2603.16871 · 202651 upvotes on Hugging Face

Research ideas from this paper (3)

Generated by AI. The paper’s authors did not write these.

AI summary

The paper introduces WorldCam, an interactive gaming world model based on video Diffusion Transformers (DiTs) that uses camera pose as a unifying geometric representation. By mapping user actions to a continuous Lie algebra action space and retrieving historical frames via global camera poses, the model achieves precise action control and long-horizon 3D consistency.

How it works (AI summary)

WorldCam translates user input actions into 6-DoF relative camera poses using the SE(3) manifold (Lie algebra) to accurately capture coupled translation and rotation. These poses are converted into Plücker embeddings and injected into the intermediate layers of a progressive autoregressive DiT. Long-horizon consistency is maintained by using global camera poses as spatial indices to retrieve and concatenate relevant historical latents from a long-term memory pool.