Test Agent Changes with LangSmith Preview Builds
Key point
LangSmith now provides PR-based temporary deployment environments, enabling testing of agent changes before production.
Details
LangSmith has launched a new deployment feature called Preview Builds. This feature creates temporary, production-like deployment environments from pull request (PR) branches, allowing changes to be tested before merging.
Previously, local testing alone made it difficult for entire teams to review agent behavior in a consistent environment. Preview Builds provide an isolated staging environment for each PR, enabling verification of the impact of various changes—such as prompts, tools, and models—in a real execution environment.
Key features include:
- Branch Testing in Deployment Environments: When a PR is triggered, code runs in an isolated environment linked to the parent deployment. Reviewers can review agents in the same environment without reproducing local settings.
- PR Synchronization: When new commits are pushed to the branch, LangSmith automatically creates a new revision of the preview deployment to keep it up to date.
- Shared Review Environment: Stakeholders other than developers (such as product managers and domain experts) can verify agent behavior through shared artifacts linked to the PR.
Teams can configure previews to be generated for all PRs or only when specific GitHub labels are added. This allows safe review of agent changes within CI/CD workflows without additional deployment configuration overhead.
This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.
Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.