Latest

Every published item, in order · 7652 items
Oct 15
Tomorrow 08:00, the daily lands in your inboxTelegram channel or email. Same screening as this page, no ads.
PapersBuildersSelected09:22
Primus Projection Cuts Distributed LLM Training Tuning to Single-Node Simulation

Teams burning GPU-hours on OOM crashes and suboptimal parallelism recipes can instead score candidate configurations in seconds on one machine, then commit only to the promising ones. The paper's validated error rates at production scale — including on DeepSeek V3 and Qwen3 — make the projections credible for real deployments. Engineers planning training runs on 256 to 1,024 GPU clusters, or on hardware not yet available, get a practical tuning workflow they can adopt directly.

arXiv: DeepSeek@Anshu Raina et al. (10)Source
PapersBuildersMulti-sourceSelected09:13
Optimal-Delay Online Tokenization Algorithm Achieves Up to 34.8x Lower Latency

Tokenization is usually treated as a solved preprocessing step, so the result that streaming tokenizers can hit provably optimal delay reframes a real bottleneck for serving latency, especially time-to-first-token. Teams building inference infrastructure can swap in this algorithm without changing tokenizer semantics, since it works with tiktoken and HuggingFace vocabularies. The lower-bound proof also signals that further constant-factor gains are unlikely, which narrows where optimization effort should go.

Event
arXiv: OpenAI@Mina Dalirrooyfard, Christopher YeSource

Only the latest 2000 items are listed; for older ones see the daily archive