Skip to content

Research Ideas

Fresh research opportunities generated by AI from trending papers. Click on any idea to explore it in detail.

62 ideas match

Controlled Multi-Agent Causal Benchmark for Autonomous Research Harnesses

Evaluate cross-model adversarial research agents against compute-matched single-agent and homogeneous baselines using blinded expert peer reviewers across benchmark paper tasks.

ARIS: Autonomous Research via Adversarial Multi-Agent Collaboration
🟠MediumπŸ”¬Significant ResearchMultiple GPUsRelated work found#Agents#Data & evaluation

Calibrating Automated Scientific Literature Review Evaluators Against Structural LLM Bias

Calibrate LLM literature review judges using preference tuning on paired human critiques to eliminate rigid structural formatting bias and reward nuanced factual synthesis.

PaperOrchestra: A Multi-Agent Framework for Automated AI Research Paper Writing
🟑Fairly easyπŸ’‘Moderate InnovationSingle GPU or lessRelated work found#Data & evaluation#LLMs

Requirement-Coverage and Execution-Trace-Aware Candidate Deliverable Selection

Augment final output selection with trajectory-derived behavioral invariants and requirement-coverage checklists to prevent selectors from picking incomplete or non-conforming deliverables.

Harness^2: Recursive Agent Harnessing for an Open World
🟒EasyπŸ”§Minor TweakSingle GPU or lessRelated work found#Agents#Data & evaluation

Uncertainty-Aware Proposal and Rollout Allocation for Continual Recursive Self-Improvement

Dynamically allocate proposal counts and evaluation rollouts based on memory confidence to prevent wasted inference compute on low-uncertainty harness defects.

Self-Improvement Memory Enables Continual Recursive Self-Improvement
🟠MediumπŸ’‘Moderate InnovationMultiple GPUsRelated work found#Efficiency#Agents

Adversarial and Continuous Time-Conditioned Adaptation for eNose Sensor Drift

Train domain-adversarial and continuous time-conditioned neural networks to align drifting sensor feature representations across deployment weeks and prevent temporal accuracy degradation.

Breath-Dx: A Time Series Classification Benchmark for Disease Screening with eNose
🟑Fairly easyπŸ’‘Moderate InnovationSingle GPU or lessRelated work found#Training#AI for science

Feature-Parity Verification and Latency-Accuracy Co-Evaluation for Served Frontier VLAs

Verify numerical feature parity between fast serving engines and evaluation pipelines while logging observation age during asynchronous robotic control.

ScaleVLA: Scaling Vision-Language-Action Models to 552 Billion Parameters
🟑Fairly easyπŸ”§Minor TweakMultiple GPUsRelated work found#Efficiency#Data & evaluation

Token-Normalized and Convergence-Controlled Evaluation of VLM Scaling Laws in Robotics

Isolate visual token count, convergence training budgets, and subset-only normalization to measure the true contribution of backbone parameter scale in robotic manipulation policies.

ScaleVLA: Scaling Vision-Language-Action Models to 552 Billion Parameters
🟑Fairly easyπŸ”§Minor TweakLarge clusterNo close match found#Data & evaluation#Robotics

Closed-Loop Evidence-Gated Handoff Verification for Coding Agents

Require coding agents to execute automated self-generated unit test contracts verifying each acquired requirement before submitting final handoff reports to eliminate ungrounded completion claims.

SWE-CoWork: Benchmarking Coding Agents as Digital Employees in Organizations
🟑Fairly easyπŸ’‘Moderate InnovationSingle GPU or lessClosely matching work found#Agents#Code

Formal Claim-to-Proof Consistency Verification for Detecting Mathematical Overclaims in Scientific Prose

Extract theorem dependency graphs and map formal mathematical guarantees against natural language claims to identify unsupported overstatements in scientific preprints.

K2-Horizon: A Frontier Fleet of Open Source Language Models
🟠MediumπŸ”¬Significant ResearchSingle GPU or lessNo close match found#Reasoning#AI for science

Multi-Seed Stability Analysis and Distributed Multi-NPU Collective Kernel Benchmarking

Add multi-seed trajectory repeats and multi-device collective workloads to the evaluation protocol so benchmark rankings capture search variance and distributed communication bottlenecks.

AscendGYM: A Cost-Aware Kernel Optimization Benchmark for Real-World Workloads on Ascend NPUs
πŸ”΄HardπŸ’‘Moderate InnovationLarge clusterNo close match found#Data & evaluation#Efficiency

Execution-Time and Hardware-Cost-Aware Scoring Beyond Token Budgets in Agentic Kernel Optimization

Incorporate compilation, profiling, and hardware execution wall-clock time into the optimization score so agents are rewarded for fast turnaround rather than low token usage alone.

AscendGYM: A Cost-Aware Kernel Optimization Benchmark for Real-World Workloads on Ascend NPUs
🟑Fairly easyπŸ’‘Moderate InnovationSingle GPU or lessNo close match found#Data & evaluation#Efficiency

Multi-Shape Generalization and End-to-End Workload Evaluation for NPU Kernel Optimization

Extend kernel optimization evaluation to dynamic tensor shapes, fused multistage operators, and end-to-end model throughput so agents cannot overfit single static input configurations.

AscendGYM: A Cost-Aware Kernel Optimization Benchmark for Real-World Workloads on Ascend NPUs
🟠MediumπŸ’‘Moderate InnovationMultiple GPUsRelated work found#Efficiency#Data & evaluation

Automated Ablation Study for Component Isolation

A method that systematically decouples and tests individual memory architectural components to isolate their exact performance contributions.

MIRIX-2.0: Multi-Agent Memory System
🟑Fairly easyπŸ”§Minor TweakSingle GPU or lessNo close match found#Data & evaluation#Training

Dual-Stream Vision Fusion for Concurrent Motion Dynamics and Text/OCR Recognition

Combine frozen V-JEPA motion representations with text-aligned SigLIP features via dual-stream spectral projection to preserve dynamic reasoning while restoring static visual knowledge.

V-JEPA-LM: Video-Language Models That Read Dynamics Beyond Static, Text-Aligned Representations
🟑Fairly easyπŸ’‘Moderate InnovationMultiple GPUsNo close match found#Multimodal#Vision

Multi-Corpus Pretraining and Post-Training Reasoning Evaluation of Loopback Transformers

Evaluate parameter-shared language models across multiple pretraining corpora and instruction-tuned reasoning tasks using execution and generation metrics rather than likelihood alone.

Loopback Transformer: Towards a Unified View of Residual Looped Transformers
🟠MediumπŸ’‘Moderate InnovationLarge clusterNo close match found#LLMs#Reasoning

Multimodal and Full-Document Soundness Assessment Across Figures and Appendices

Extend automated paper reviewing to vision-language models with full-document processing so reviewers can inspect plots, diagrams, and appendices instead of truncated text.

PaperCritic: Training AI Reviewers to Assess the Soundness of Papers
πŸ”΄HardπŸ”¬Significant ResearchMultiple GPUsNo close match found#Multimodal#Retrieval & memory

Claim-Coverage and Iterative Reference Expansion to Overcome Incomplete, LLM-Skewed Recall

Reward automated reviewers for stress-testing every core paper claim rather than matching a static reference list, preventing valid novel critiques from being penalized.

PaperCritic: Training AI Reviewers to Assess the Soundness of Papers
🟠MediumπŸ’‘Moderate InnovationMultiple GPUsNo close match found#LLMs#Reinforcement learning

Programmatic and Decomposed Soundness Verification Without Frontier Distillation Bottlenecks

Build a tool-augmented claim verifier that checks equations and table statistics programmatically, replacing single-pass language model reward models that weakly correlate with human judgments.

PaperCritic: Training AI Reviewers to Assess the Soundness of Papers
🟠MediumπŸ”¬Significant ResearchMultiple GPUsNo close match found#LLMs#Reinforcement learning

Retrieval-Augmented Soundness Verification Against External Literature

Augment automated paper reviewers with scholarly literature retrieval so they can verify novelty, baseline coverage, and prior-work claims against published research.

PaperCritic: Training AI Reviewers to Assess the Soundness of Papers
πŸ”΄HardπŸ”¬Significant ResearchMultiple GPUsNo close match found#LLMs#Retrieval & memory

Cross-Family Harness Standardization and Multi-Judge Debiasing in Agentic Clinical Evaluation

Standardize agent execution harnesses across model families and evaluate with multi-judge ensembles so workflow scores measure model capability rather than tooling artifacts.

InclusionMed: Benchmarking AI for Inclusive Healthcare
🟠MediumπŸ’‘Moderate InnovationSingle GPU or lessRelated work found#Agents#Data & evaluation

Full-Trajectory Deployment Cost and Retry-Overhead Profiling for Medical AI Agents

Profile end-to-end agent deployment costs including failed retries, external judges, and sandbox overhead so healthcare teams can compare true operational affordability.

InclusionMed: Benchmarking AI for Inclusive Healthcare
🟑Fairly easyπŸ”§Minor TweakSingle GPU or lessRelated work found#Efficiency#Agents

Sensitivity-Aware Composite Indexing and Item-Response Calibration Across Heterogeneous Benchmarks

Calibrate composite benchmark indices using item-response modeling and leave-one-out weighting sensitivity so model rankings reflect true clinical capability rather than arbitrary portfolio weights.

InclusionMed: Benchmarking AI for Inclusive Healthcare
🟑Fairly easyπŸ’‘Moderate InnovationSingle GPU or lessRelated work found#Data & evaluation#LLMs

Patient-Facing, Multilingual, and Multimodal Benchmark Expansion for Uncovered Atlas Cells

Build a multilingual, multimodal benchmark suite for patient-facing health conversations so medical AI evaluations reflect non-Western care settings and everyday patient needs.

InclusionMed: Benchmarking AI for Inclusive Healthcare
πŸ”΄HardπŸ”¬Significant ResearchSingle GPU or lessNo close match found#Data & evaluation#Multimodal

Contact-Aware Physical Validity and Full-Body Posture Verification in 4D Scene Scorers

Incorporate ground-plane contact, center-of-mass support, and joint-pose checks into deterministic scene evaluators to catch floating characters and missed body-posture events.

VibePrevisBench: Evaluating Agentic Coding for 4D Scene Generation in Blender
🟒EasyπŸ”§Minor TweakSingle GPU or lessNo close match found#Data & evaluation#Vision

End-to-End Empirical Validation of Proxy Scores Against Downstream Video Generation Quality

Benchmark how strongly 4D scene-accuracy scores predict final synthesized video quality across diverse agents and generative renderers to validate proxy-level evaluation.

VibePrevisBench: Evaluating Agentic Coding for 4D Scene Generation in Blender
πŸ”΄HardπŸ”¬Significant ResearchLarge clusterNo close match found#Generative media#Data & evaluation

Artifact-to-Claim Cross-Verification and Process Consistency Rewards for Agentic Deliverables

Add a schema-aware final cross-verification stage and consistency rewards to multi-step agent training so reported summaries match detailed execution logs and artifacts.

Sage S2.1 Flash Technical Report
🟑Fairly easyπŸ’‘Moderate InnovationMultiple GPUsRelated work found#Agents#Data & evaluation

End-to-End Benchmarking of Native Scientific Perception Within Interactive Agentic Workflows

Build a benchmark suite pairing raw molecular, sequence, and spectral inputs with multi-step software tools to evaluate whether multimodal agents actually use scientific perception during discovery.

Sage S2.1 Flash Technical Report
🟠MediumπŸ”¬Significant ResearchMultiple GPUsNo close match found#AI for science#Agents

Conformal Multimodal Outcome Verification to Mitigate Premature Completion Bias

Construct an independent multi-view verification network using split conformal prediction to prevent premature task completion bias in visual-language agents.

Envisioning Agentic Robotics: A New Era of Robotic Systems
🟑Fairly easyπŸ’‘Moderate InnovationMultiple GPUsNo close match found#Robotics#Multimodal