Skip to content

Source paper

Arch-Router: Aligning LLM Routing with Human Preferences

Co Tran, Salman Paracha, Adil Hafeez, Shuguang Chen
arXiv 2506.16655 · 202517 upvotes on Hugging Face

Research ideas from this paper (3)

Generated by AI. The paper’s authors did not write these.

AI summary

This paper introduces Arch-Router, a compact 1.5B parameter model designed to route LLM queries based on user-defined natural language policies rather than opaque performance benchmarks. By decoupling intent classification from model assignment and utilizing a synthetic data pipeline with Domain-Action taxonomies, the authors achieve state-of-the-art routing accuracy and reduced latency compared to proprietary models like GPT-4o.

How it works (AI summary)

The authors fine-tuned a Qwen-2.5-1.5B model on a synthetically generated dataset comprising 43k samples of multi-turn conversations labeled with Domain-Action routing policies. The model functions as a generative router that takes a user query and a list of XML-formatted policy descriptions as input, outputting the specific route identifier that best matches the user's intent.