Skip to content

Source paper

RAG-Anything: All-in-One RAG Framework

Zirui Guo, Xubin Ren, Lingrui Xu and 2 more

Zirui Guo, Xubin Ren, Lingrui Xu, Jiahao Zhang, Chao Huang

arXiv 2510.12323 · 202552 upvotes on Hugging Face

Research ideas from this paper (3)

Generated by AI. The paper’s authors did not write these.

AI summary

This paper introduces RAG-Anything, a multimodal Retrieval-Augmented Generation framework designed to treat non-textual elements (images, tables, equations) as first-class knowledge entities alongside text. It overcomes the limitations of text-centric RAG systems by constructing a unified dual-graph (cross-modal and text-based) that preserves structural relationships and visual semantics, enabling precise reasoning over heterogeneous documents.

How it works (AI summary)

The framework employs a Dual-Graph Construction strategy: a 'Cross-Modal Knowledge Graph' links visual/tabular elements via structural relationships (e.g., belongs_to) and VLM-generated descriptions, while a 'Text-Based Knowledge Graph' captures semantic entity relations. Retrieval is performed using a hybrid approach combining 'Structural Knowledge Navigation' (following graph edges) and 'Semantic Similarity Matching' (dense vector search), followed by multi-signal fusion scoring to rank evidence for a VLM-based answer generator.