KVCache Meetup Korea Spotlights LLM Serving Optimization
The talks show that LLM serving bottlenecks sit as much in memory architecture — CXL pooling, HBM bandwidth — as in GPU compute, a framing many benchmark writeups skip. Engineers building inference infrastructure can study the roofline analysis and LMCache MP Mode patterns for their own deployments. The event also signals a growing Korean accelerator and serving stack around FuriosaAI's RNGD and SK hynix memory.
