黄仁勋解释 AI 为何可能需要十亿倍算力
黄仁勋说 AI 从背答案转向试方案,每一步推理都烧 GPU,所以才要十亿倍算力,逻辑挺清楚。
NVIDIA CEO Jensen Huang 在 Bg2 Pod 节目中解释了 AI 算力需求可能增长十亿倍的原因。过去模型采用检索方式,直接调取记忆中的内容作答。现在模型转向问题求解,需权衡多个选项、保留最优的一到三个方案并剪掉其余。这种搜索比调用存储答案的工作量大得多,每一步都在 GPU 上运行。
Jensen Huang explains why AI may soon need a billion times more compute.
The old way was retrieval: the model pulled up what it had memorized and answered.
The new way is problem solving, where the model weighs several options, rolls out the best one to three and prunes the rest.
That search takes far more work than recalling a stored answer, and every step of it runs on GPUs.
---- Full video on "Bg2 Pod" YouTube channel, (link in comment)