Self-Summarization Deep Research Agent

Published:

GitHub Repository

  • Built a self-summarizing research agent for BrowseComp-Plus that iteratively executes tool calls (e.g. search, retrieve docs) while automatically compacting interaction history to operate within a fixed context window.
  • Developed an end-to-end reinforcement learning pipeline with vLLM-based rollout generation, reward-aligned trajectory extraction, and GRPO training using VERL.
  • Enabled Qwen3.5-9B to solve long-horizon research tasks with context compaction, achieving a 2× improvement in accuracy on BrowseComp-Plus.
Direct Link