eagworks migrates LangGraph workflows to AgentCore Runtime, reducing TTFT p95 by 5.5 seconds

·2026.10.26 21:09

Key point

Migrated LangGraph workflows without rewriting to mitigate high-concurrency latency.

1 / 3

Details

  • Migrated the execution environment to Amazon Bedrock AgentCore Runtime without rewriting existing LangGraph workflows
  • TTFT p95 at concurrency 16 was reduced by approximately 5.5 seconds compared to the previous ECS single setup, achieving performance on par with ECS scaleout
  • Cold start delays (9.5–10.8 seconds) occurred due to pre-warmed capacity being exceeded during sudden spikes in new sessions, mitigated by image lightweighting
  • Established a latency and error root-cause tracking system by linking Langfuse and CloudWatch structured logs via trace_id and job_id

This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.

Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.