Skip to main content
Weekly updates to LangSmith Cloud and LangSmith Fleet.
Subscribe: This changelog includes an RSS feed that can integrate with Slack, email, Discord bots like Readybot or RSS Feeds to Discord Bot, and other subscription tools.
If you use self-hosted LangSmith, see the self-hosted changelog for updates.

Observability and evaluations

Automations

  • Automations now let you control trace retention per action, so traces matched by a rule can stay at base retention instead of being upgraded.

Engine

  • The Engine issue board now shows a Connect GitHub action when GitHub is not connected, so you can set up pull request creation without leaving the board.
  • Engine now has a unified enablement screen with access requests, and organization settings consolidate Engine usage and limits in one place.
  • Organization admins now receive Engine spend emails when spend crosses each configured threshold, and pausing or disabling Engine now asks for confirmation.

Datasets and experiments

  • Experiments now show live loading progress in the header and the Progress column, so you can track completed and evaluated runs in real time.
  • Evaluators now include a trace-retention toggle in the advanced options, so scored traces can stay at base retention when that fits your workflow.
  • Evaluator prompt editing now offers an advanced mode for editing Mustache templates directly with separate variable mappings.
  • You can now apply resource tags when creating a dataset, including from scratch, file upload, or a clone.
  • Auto-attached Assertions evaluators now read assertions from the reference output, so experiment scores reflect actual pass and fail results.

Prompts and playground

  • OAuth client credentials now support per-workspace setup on model configurations, so workspace admins can self-serve OAuth on saved prompts and models.
  • The Playground now exposes a Reasoning Summary option for OpenAI reasoning models on the Responses API.
  • The model dropdown no longer suggests OpenAI models for an OpenAI Compatible Endpoint, so you can enter your own custom model name.

Tracing

  • Trace query syntax now has a full operator reference, field table, and quick examples, so API filtering is easier to discover.
  • The OpenTelemetry guide now explains how to link spans to an existing LangSmith SDK trace and what happens when a parent span never arrives, so cross-process traces are easier to debug.

Monitoring and alerting

  • Dashboards now include a chart builder with chart templates, a create and edit pane, and brush and series controls on time series charts.
  • You can now send alerts to Slack as a native notification target and connect or disconnect the Slack app from the UI.

Deployment

  • Preview deployments now build the image for the preview commit instead of reusing the parent deployment’s image.

Sandboxes

  • Sandbox auth proxy now documents GCP rules and service-account handling, so Google API access through the proxy is clearer.
  • Sandboxes now marks AWS US SaaS availability as generally available, so the region table reflects the current rollout.
  • Sandboxes now support Git mounts and Google Cloud Storage bucket mounts.

Admin and billing

Administration

  • Organization settings now clarify that SSO/SCIM group names can omit spaces, so enterprise IdPs that disallow spaces still work cleanly.
  • The Vanta MCP integration is now generally available to all workspaces.
  • Applying tags when creating datasets, prompts, and projects is now governed by dedicated tag-on-create permissions.

LLM Gateway

  • The LLM gateway now supports native Gemini routes for Vertex AI and the OpenAI embeddings endpoint.
  • Gateway guard policies now accept a granular PII configuration and a configurable timeout action.

Usage and billing

Observability and evaluations

Engine

  • Engine now shows only project-level spend in project view, so org-wide spend stays in the org settings surface.
  • Engine now keeps the Slack issue-alert deck pinned above the scrolling issues list, so the callout stays visible as you browse.

Datasets and experiments

The experiments table now displays loading progress bars showing the number of runs completed and evaluated, and experiments that predate this feature show a placeholder progress bar.
  • Dashboards now support time series bar and line charts backed by the v2 chart API, so monitored metrics can use the newer chart type.
  • Categorical feedback now shows derived percentages in experiment tables, so pass/fail metrics are easier to scan.

Prompts and playground

  • Playground now mints OAuth bearers end to end for OAuth-enabled presets, so long-running batches and streams keep working.

Sandboxes

  • Sandbox auth proxy now supports GCP auth flows, so sandbox workloads can reach Google APIs through the proxy.

Admin and billing

Administration

  • Organization settings no longer expose the hidden LCU rate-card admin modal or tenantless routes, so rate-card management stays behind the scenes.

Fixes

  • The Engine trial modal no longer shows the rough-math LCU bullet, so the pricing copy is less misleading.

Observability and evaluations

Automations

  • Run rule webhook payloads now include a trace deep link for each run, so downstream systems can jump straight back to the trace.

Engine

  • Per-workspace Engine spend is now generally available: you can view LCU and USD spend directly on the Engine settings page, including session-level spend.
  • The Engine settings page now surfaces additional Engine details in one place.
  • You can rotate Engine issue-board webhook signing secrets from both the API and the webhook settings UI.
  • The Engine issues list adds a sort option by trace count.

Datasets and experiments

  • A new out-of-the-box Assertions evaluator scores outputs against an explicit list of criteria specified in the reference output, and an Assertions rule is auto-attached when you add assertion-style examples to a dataset.
  • Evaluator metrics are improved in the experiment detail, comparison, and global experiments tables.

Prompts and playground

  • The Playground supports Amazon Bedrock API key authentication, letting you authenticate with a bearer token instead of AWS credentials.

Tracing

  • The trace view now shows an unread indicator on a run’s actions menu when the run has reviewer notes you have not seen yet.
  • The waterfall view is now full-height with sticky turn headers, so you keep your place while scrolling through long traces.
  • Global search now includes context and sandboxes

Deployment

Sandboxes

  • Sandbox proxy rules now support configuring AWS authentication, so sandboxes can reach AWS services through the proxy with signed requests.
  • Sandboxes can create snapshots from a Dockerfile build source.

Admin and billing

Administration

  • Organization admins can now disable personal access token creation from the organization settings page.

Usage and billing

  • Granular billable usage now supports filtering and grouping by retention tier, separating long-lived from short-lived traces.
  • The Granular Billable Usage page now surfaces LangSmith Deployment usage, including nodes executed, agent runs, and agent uptime, alongside trace usage.

Fixes

  • Performance improvements for the loading of large traces.
  • Filter values for metadata are now preserved when you reopen a filter dropdown to edit it.
  • Dataset creation now uses a multi-select dropdown for choosing CSV fields.