Ablation of Structured Communication Protocol
A control variant framework that replaces structured report passing with standard chat history to evaluate communication protocols in multi-agent trading.
Time
Compute level
Resources
Prerequisites
Scope
The Gap
In Section 4.1, the paper asserts that natural language communication causes a 'telephone effect' where details are lost, and replaces it with 'structured documents.' However, the experiments (Section 6.1) only compare the full framework against rule-based baselines (MACD, Buy&Hold).
Limitation
There is no isolation of the 'Structured Communication' contribution. We do not know if the performance gains come from the multi-agent debate itself or the specific document-passing protocol. It is possible that standard chat history would perform similarly without the engineering overhead.
Proposed Solution
Implement a control variant of the framework: 'TradingAgents-Chat'. Keep the exact same agent roles (Analyst, Trader, Risk) and tools, but replace the structured report passing with a standard shared context window or chat history (similar to MetaGPT or ChatDev). Compare the Cumulative Return and 'Instruction Adherence' rate between the Structured and Chat variants.
Why This Matters
scientifically isolates the paper's core theoretical claim regarding communication protocols, proving whether structured constraints are necessary for financial agents.
How to Get Started
- Implement a shared context window chat history mechanism within the multi-agent trading framework.
- Maintain identical agent roles and tools while swapping out structured document passing for natural language dialogue.
- Compare cumulative returns and instruction adherence rates against the structured protocol and rule-based baselines.
Code linked to this paper on Hugging Face: github.com/tauricresearch/tradingagents
Suggested by AI. Adapt it to your setup.
Has This Been Done?
None of the listed papers evaluate the specific ablation of replacing structured report passing with a shared chat history in a financial multi-agent trading framework comparing cumulative return and instruction adherence. The survey and security papers cover general protocols and risks, but do not implement or test this specific control variant.
- A Survey of AI Agent Protocols · 2025 · 195 citations
- A stigmergy-driven multi-agent framework for intelligent task orchestration · 2026 · 0 citations
- AdaMARP: An Adaptive Multi-Agent Interaction Framework for General Immersive Role-Playing · 2026 · 12 citations
We searched OpenAlex for “A control variant framework that replaces structured report passing with standard chat history to evaluate communication protocols in multi-agent trading.” and “Ablation of Structured Communication Protocol” and an AI compared the idea with the top 10 results. A small search can miss relevant work.
Source Paper
TradingAgents: Multi-Agents LLM Financial Trading FrameworkYijia Xiao, Edward Sun, Di Luo +1 more · 2024
This paper introduces TradingAgents, a multi-agent framework for financial trading that mimics the organizational structure of a professional trading firm. By assigning specific roles (Analysts, Researchers, Traders, Risk Managers) to LLMs and enforcing a structured communication protocol to reduce information loss, the system achieves superior returns and Sharpe ratios compared to traditional algorithmic baselines on major tech stocks.
Related Ideas
- Complex Social Interaction BenchmarkingVery Large-Scale Multi-Agent Simulation in AgentScope🟠Medium
- Persistent Agenda Management for Asynchronous Colleague ClarificationSWE-CoWork: Benchmarking Coding Agents as Digital Employees in Organizations🟡Fairly easy
- Proactive User-in-the-Loop Clarification for High-Ambiguity Daily TasksStep-GUI Technical Report🟠Medium
- Asynchronous RL for Multi-Turn Agentic TasksAReaL: A Large-Scale Asynchronous Reinforcement Learning System for Language Reasoning🟡Fairly easy
- Interactive Human-in-the-Loop Refinement with Grounded Revision ConstraintsPaperOrchestra: A Multi-Agent Framework for Automated AI Research Paper Writing🟡Fairly easy