#NVIDIA V100

1 stories · 1 in 7 days · 1 in 30 days
Stories, products and papers tagged "NVIDIA V100", newest first.
Nov 21
ModelsBuildersSelected13:30
Lawyer runs DeepSeek-V4.1-Flash on 12 used Nvidia V100 GPUs

Second-hand datacentre GPUs plus aggressive expert quantisation can still beat newer consumer units like the DGX Spark on throughput per dollar, but only at the cost of 2,100W power draw and noise that rules out desk-side use. Builders weighing local inference for large MoE models should compare this V100 route against renting GPU capacity, especially where electricity is costly. The published per-context benchmark table is directly reusable for planning similar PP/TP cluster builds.

Event
IT之家Source