#FuriosaAI

7 stories · 2 in 7 days · 4 in 30 days
Stories, products and papers tagged "FuriosaAI", newest first.
Nov 4
How-toBuildersSelected00:57
KVCache Meetup Korea Spotlights LLM Serving Optimization

The talks show that LLM serving bottlenecks sit as much in memory architecture — CXL pooling, HBM bandwidth — as in GPU compute, a framing many benchmark writeups skip. Engineers building inference infrastructure can study the roofline analysis and LMCache MP Mode patterns for their own deployments. The event also signals a growing Korean accelerator and serving stack around FuriosaAI's RNGD and SK hynix memory.

Event
官方账号PyTorch@PyTorch2 sourcesSource
Oct 29
Sep 22
Aug 5
Jul 29