AI Briefing
KO

Deep Agent Tuning for Different Models

·2026.04.30 02:00

Key point

LangChain has added model-specific profiles to Deep Agent, improving benchmark performance by 10-20 points.

Details

Deep Agent previously provided a single harness (prompts, tools, middleware) that worked across all LLMs. However, prompting guides differ by model, and even the same model's performance could vary significantly depending on the harness configuration.

To address this, LangChain has released the harness profiles feature. It allows customizing system prompts, tool implementations, and middleware for each model, and provides default profiles for OpenAI, Anthropic, and Google models.

Performance improvement results (based on tau2-bench subset):

  • GPT 5.3 Codex: 33% → 53% (20 point improvement)
  • Claude Opus 4.7: 43% → 53% (10 point improvement)

Key changes:

Codex profile:

  • Uses the recommended tool apply_patch instead of the default edit_file
  • Aliases the execute tool to shell_command
  • Added prompting related to parallel tool call batch processing

Claude Opus profile:

  • Added reflection guidance on tool results (<tool_result_reflection>)
  • Encourages checking state directly via tools instead of memory (<tool_usage>)

Profiles can be defined in Python code or YAML, and are automatically applied when calling create_deep_agent(model="..."). Custom profiles can also be registered or distributed as plugins.

This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.

Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.