Latest

Every published item, in order · 9945 items
Oct 20
ProductsBuildersSelected15:01
Marvell Demonstrates Photonic Module Placing HBM 50 Meters From GPU

Memory and compute can now scale on separate axes, which could reshape how AI datacentres provision capacity and ease HBM supply bottlenecks. Infrastructure engineers, chip architects and cloud buyers should track Marvell's progress against rivals like NVIDIA's NVLink Fusion and CXL-based memory pooling as they plan cluster topologies.

rohanpaul_ai@rohanpaul_aiSource
ProductsBuildersSelected13:07
PhysisServe Launches as Autoregressive Denoising Inference System for vLLM-Omni

This signals that diffusion-style and autoregressive denoising workloads are getting dedicated serving infrastructure rather than piggybacking on standard LLM stacks. Engineers running multimodal or video generation pipelines should watch vLLM-Omni, since the pipelining and multi-stream scheduling tricks could cut tail latency without a separate deployment. vLLM's direct endorsement also suggests upstream adoption of these scheduling techniques is likely.

Official accountvLLM@vllm_projectSource
Tomorrow 08:00, the daily lands in your inboxTelegram channel or email. Same screening as this page, no ads.
ProductsBuildersMulti-sourceSelected08:42
SGLang Low-Latency Mode Launches with NVIDIA and AMD Support

The same serving stack now optimises both NVIDIA and AMD paths, giving operators a concrete reason to benchmark MI355X deployments against GB300 rather than defaulting to CUDA. Teams running agentic inference traces can enable the mode through SGLang and expect P90 latency gains without changing models. The plugin system also means third-party kernels — starting with GLM-5.3, K3, and MiniMax M3 — will arrive without waiting for a core release.

Event
Official accountLMSYS Org (SGLang)@lmsysorgSource

Only the latest 2000 items are listed; for older ones see the daily archive