VPP: Virtual Pipeline Parallelism for LLM Inference
VPP significantly improves efficiency for long-context LLM inference, reducing pipeline bubbles by 98% compared to DCPP on 512K-token sequences.
VPP significantly improves efficiency for long-context LLM inference, reducing pipeline bubbles by 98% compared to DCPP on 512K-token sequences.