LangSmith: Product Homepage Redesign and Introduction of Tagging Feature for Resource Management

LangChain has completely redesigned the product homepage of LangSmith to support the process of developing and optimizing LLM applications. This redesign was designed around three core areas that developers consider most important: Observability, Evaluation, and Prompt Engineering.

In the Observability section, you can monitor and debug application performance through Tracing Projects and Dashboards. Developers can check detailed traces at the data point level, or track key metrics such as cost, latency, and quality through custom charts.

The Evaluation section supports the process from dataset building to experiments and human review.

• Datasets: You can automatically import data from log data to run experiments.
• Annotation Queues: Systematically manage data points that require human review to increase the consistency of feedback.

The Prompt Engineering section supports storing and version control of prompts, and through the Playground, you can test prompts in real time and compare performance between models. In addition, the Resource Tags feature has also been improved to efficiently classify resources within a workspace.