vLLM-Omni Technical Report: Unified Serving Runtime for Omni-Modality Generation
Serving stacks have so far been split between LLM servers optimized for autoregressive decode and diffusion stacks built for denoising, forcing teams to glue disjoint runtimes together in production. vLLM-Omni replaces that with one control plane supporting session-shaped, long-lived workloads like robot loops and world models. Engineers building multimodal assistants on Qwen3-Omni or MiniCPM-o should evaluate it against their current inference setups.