LangSmith

Platform for observing, evaluating, and deploying ai agents and LLM applications.

Visit site

Overview

LangSmith is a framework-agnostic platform for developing and operating ai agents and LLM applications. It traces agent steps, tool calls, costs, latency, and errors, then supports datasets, offline and online evaluations, regression tests, alerts, and dashboards. LangSmith Deployment runs durable agents with persistent state, background execution, and human-in-the-loop workflows.

Key features

  • Agent and LLM tracing
  • Online and offline evaluations
  • Datasets and regression testing
  • Dashboards and alerts
  • Durable agent deployment
  • Persistent state and background execution
  • Human-in-the-loop workflows

Use cases

Show all 7Show fewer

Alternatives

  • NVIDIA NeMoAI agent platform and toolkit for building, deploying, and managing agent workflows.ai agent framework
  • PortkeyAI gateway for routing, securing, and observing LLM and agent requests.ai agent framework
  • PydanticAIPython framework for building typed ai agents with tools, structured outputs, and model integrations.ai agent framework
  • QuantumBlackMcKinsey AI practice combining consulting, industry expertise, and platforms for building and scaling AI applications.ai agent

Last updated 2026-09-16