Skip to content

Source paper

DeepGen 1.0: A Lightweight Unified Multimodal Model for Advancing Image Generation and Editing

Dianyi Wang, Ruihang Li, Feng Han and 17 more

Dianyi Wang, Ruihang Li, Feng Han, Chaofan Ma, Wei Song, Siyuan Wang, Yibin Wang, Yi Xin, Hongjian Liu, Zhixiong Zhang, Shengyuan Ding, Tianhang Wang, Zhenglin Cheng, Tao Lin, Cheng Jin, Kaicheng Yu, Jingjing Chen, Wenjie Wang, Zhongyu Wei, Jiaqi Wang

arXiv 2602.12205 · 202650 upvotes on Hugging Face

Research ideas from this paper (3)

Generated by AI. The paper’s authors did not write these.

AI summary

The paper introduces DeepGen 1.0, a lightweight (5B parameter) unified multimodal model capable of image generation, editing, and reasoning. By employing a novel Stacked Channel Bridging (SCB) architecture to fuse Vision-Language Model (VLM) features with a Diffusion Transformer (DiT) and utilizing a three-stage training pipeline culminating in Reinforcement Learning (MR-GRPO), the model achieves performance competitive with significantly larger closed-source and open-source models.

How it works (AI summary)

DeepGen 1.0 integrates a Qwen-2.5-VL (3B) backbone with an SD3.5-Medium (2B) DiT generator. The core innovation is Stacked Channel Bridging (SCB), which extracts hidden states from six uniformly distributed VLM layers, fuses them with learnable 'think tokens' via channel concatenation, and projects them into the DiT's condition space. Training involves Alignment Pre-training (connector only), Joint Supervised Fine-tuning (VLM LoRA + DiT), and Multi-Reward Group Relative Policy Optimization (MR-GRPO) to align with human preferences.