General Compute 的 CTO 在讲为什么编程智能体的等待时间值得从一小时压到几秒,给高薪工程师省时间这事真有算盘可打。
#General Compute
neocloud 公司 General Compute 拿了 1 亿美元 A 轮,专门用 Nvidia 之外的芯片做推理,算是对 neocloud 泡沫论的一次回应。
Specialising silicon per inference phase sidesteps the compromise a single chip type must make, and avoiding HBM removes exposure to the tightest supply constraint in AI hardware. Teams running high-volume generation workloads can compare this two-chip endpoint against all-GPU serving on cost and tokens-per-second. It also signals a broader shift toward heterogeneous inference stacks that infrastructure buyers should track.
This partnership represents a significant challenge to NVIDIA's GPU monopoly in AI cloud infrastructure by combining complementary strengths. For cloud providers and enterprises evaluating hardware options, this hybrid approach offers potential cost and performance benefits, particularly for inference workloads where memory bandwidth is critical.