Latest

Every published item, in order · 9845 items
Nov 3
PapersSelected15:17
Scaling Theory Links Multi-Epoch Pretraining Overfitting to Ensembling

As datasets saturate, labs will reuse data across epochs, and this work predicts when that overfits and how ensembling shifts the optimal stopping point. Practitioners planning pretraining or distillation budgets get concrete allocation rules rather than intuition. The FineWeb experiments make the theory testable against single-model scaling baselines.

arXiv cs.LG@Zhen Yang et al. (3)Source
Tomorrow 08:00, the daily lands in your inboxTelegram channel or email. Same screening as this page, no ads.
PapersBuildersSelected14:48
Milvus tests hyperbolic embeddings in image search rankings

The geometry matters less than the query type: hyperbolic scoring helps descriptive captions but hurts broad category queries where rare taxonomy terms dominate the gap. Teams running image search should benchmark Lorentz against cosine on their own query logs instead of assuming hyperbolic is uniformly better. Milvus supports hyperbolic ranking through a standard inner product, so no new infrastructure is required to test it.

Milvus@milvusioSource
PapersPolicySelected14:40
Paper: First Tokens After Thinking Tag Limit CoT Controllability

The finding points to a cheap, practical lever: intervening at the very start of a reasoning trace can double a model's compliance with reasoning-style instructions, no retraining required. Practitioners building monitored or steerable CoT pipelines can try token prefilling or banned-opening lists right away. The split between add/restyle control and omission control also gives benchmark designers a concrete axis to test separately.

elvis@omarsar0Source

Only the latest 2000 items are listed; for older ones see the daily archive