LangSmith Custom Apps 正式 GA:用提示词生成智能体数据界面
LangChain 把 LangSmith 的运行数据开放成自定义界面了,写句提示词就能生成标注队列或 trace 审查页,做 Agent 评估的可以试试。
LangChain 宣布 LangSmith Custom Apps 正式发布(GA),核心思路是用一句提示词从智能体运行数据生成任意界面。
官方列举了三种典型用法:标注队列(annotation queues)可逐条或批量审查和标注运行记录;实验对比视图可并排查看不同实验的输出和指标;
追踪审查(trace reviews)可构建 trace 或会话历史页面来排查应用行为。该功能面向使用 LangSmith 做 LLM 应用观测和评估的团队,把过去需要自建的数据面板变成提示词即得。
A few things you can build: 1️⃣ Annotation queues: Review and label one (or many) runs at a time 2️⃣ Experiment comparisons: Compare outputs and metrics across experiments side by side 3️⃣ Trace reviews: Build trace or thread history views to inspect app behavior LangChain @LangChain Introducing LangSmith Custom Apps Create any interface from your agent data with a prompt. If you can think it, LangSmith can build it. Now GA. langchain.com/blog/langsmith…
This report is categorized under AITOP's "Products" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows. Key entities and technical topics under continuous tracking include LangSmith, LangChain, agents, MCP and tools.
Source attribution: curated from LangChain (@LangChainAI).