LangSmith helps Morningstar trace agent decisions

Agent debugging usually means grepping raw traces; this inverts the workflow by letting teams describe the failure in natural language and get matching trajectories back. Engineering teams running LLM apps in production can use it to find specific behaviours without building custom query tooling. Compared with generic observability search, the two-stage filter-then-verify design reduces the model's workload and latency.

官方账号LangChain@LangChainAISource

The practical takeaway is the failure feedback loop: every production failure becomes a new dataset sample, turning evals into a continuously growing asset rather than a one-off gate. Engineers building or maintaining agents can adopt the graded evaluator stack — deterministic code checks before LLM judges, pairwise comparison over absolute scores — to cut cost and improve stability. It pairs well with LangSmith-style tooling and contrasts with teams that still rely on manual spot checks.

shao__meng@shao__meng3 sourcesSource