#4-bit 训练

1 stories · 1 in 7 days · 1 in 30 days
Stories, products and papers tagged "4-bit 训练", newest first.
Nov 14
ModelsBuildersSelected05:49
Inkling 2 Small trained with native 4-bit forward pass on GB300s

The striking part is the duration: 68 hours of pretraining replaces what normally takes weeks, suggesting quantisation-aware training has matured beyond inference-only tricks. Engineers running large-scale training on NVIDIA clusters can study the recipe for memory and throughput gains, and enterprises weighing fine-tuning budgets should watch how it affects cost curves. It also signals that Thinking Machines is competing on infrastructure efficiency rather than model size alone.

Official accountMira Murati (TML)@miramuratiSource