#预训练优化

1 stories · 1 in 7 days · 1 in 30 days
Stories, products and papers tagged "预训练优化", newest first.
Nov 14
ModelsBuildersMulti-sourceSelected05:49
Inkling 2 Small trained with native 4-bit forward pass on GB300s

The striking part is the duration: 68 hours of pretraining replaces what normally takes weeks, suggesting quantisation-aware training has matured beyond inference-only tricks. Engineers running large-scale training on NVIDIA clusters can study the recipe for memory and throughput gains, and enterprises weighing fine-tuning budgets should watch how it affects cost curves. It also signals that Thinking Machines is competing on infrastructure efficiency rather than model size alone.

Event
Official accountMira Murati (TML)@miramuratiSource