Latest

Every published item, in order · 5281 items
Oct 20
Tomorrow 08:00, the daily lands in your inboxTelegram channel or email. Same screening as this page, no ads.
How-toBuildersSelected12:57
vLLM KV Cache Offloading Poster at PyTorch Conference

The routing layer is the interesting part: simply offloading KV cache to CPU or storage is not enough, since a request must land on the node whose cache already holds its blocks. Engineers running multi-node inference can use this to decide between cheaper CPU offload and shared-storage tiers. The poster session is open to PyTorch Conference attendees on 20-21 October in San Jose.

Official accountPyTorch@PyTorchSource
How-toBuildersSelected03:52
LangChain's Harrison Chase Shares Agent Building Lessons on Twenty Minute VC

The model-plus-context-plus-harness decomposition gives teams a concrete decision framework for where to invest effort first, rather than defaulting to fine-tuning. Practitioners building or budgeting for agents get a tested sequence for cutting spend and a candid view that memory distillation is still the hardest unsolved piece. The claim that horizontal agents will call vertical agents also hints at where agent infrastructure investment is heading.

Official accountLangChain@LangChainAISource
How-toBuildersSelected03:52
LangChain: run agent evals through the same graph

Testing evals against the production agent graph removes the gap between what benchmarks measure and what users actually experience. Builders of conversational or multi-turn agents can reuse this pattern: simulate personas through the same entry point as live traffic, then trust the same scores in CI. It pairs well with LangSmith-style tracing workflows for regressions.

Official accountLangChain@LangChainAISource

Only the latest 2000 items are listed; for older ones see the daily archive