Deep Agent Tuning for Different Models
Key point
LangChain has added model-specific profiles to Deep Agent, improving benchmark performance by 10-20 points.
Details
Deep Agent previously provided a single harness (prompts, tools, middleware) that worked across all LLMs. However, prompting guides differ by model, and even the same model's performance could vary significantly depending on the harness configuration.
To address this, LangChain has released the harness profiles feature. It allows customizing system prompts, tool implementations, and middleware for each model, and provides default profiles for OpenAI, Anthropic, and Google models.
Performance improvement results (based on tau2-bench subset):
- GPT 5.3 Codex: 33% → 53% (20 point improvement)
- Claude Opus 4.7: 43% → 53% (10 point improvement)
Key changes:
Codex profile:
- Uses the recommended tool
apply_patchinstead of the defaultedit_file - Aliases the
executetool toshell_command - Added prompting related to parallel tool call batch processing
Claude Opus profile:
- Added reflection guidance on tool results (
<tool_result_reflection>) - Encourages checking state directly via tools instead of memory (
<tool_usage>)
Profiles can be defined in Python code or YAML, and are automatically applied when calling create_deep_agent(model="..."). Custom profiles can also be registered or distributed as plugins.
This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.
Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.