闭源前沿模型更强,但微调后的开源模型在许多任务上足够用
Santiago 发的一条心态贴,讲清了闭源模型、本地开源模型、微调后模型各自的定位,做技术选型前看一眼挺省纠结。
作者提出三个并行成立的判断:闭源前沿模型整体比本地(自托管开源)模型更聪明;本地模型对许多应用已经足够;通过微调开源模型,可以低成本、高速运行,并在不少具体问题上超过大型实验室的最强前沿模型。文中将 local 明确定义为可自行托管的开源模型,强调三种说法并不矛盾。
Multiple things can be true at the same time:
1. Closed, frontier models are generally smarter than local models[*].
2. Local models are extremely capable and more than enough for many applications.
3. You can fine-tune open models and run them very fast, for very little money, and outperform even the best frontier models from Big AI labs on many problems.
(*) I've seen people interpret the term "local" in different ways. In this context, I assume "local" refers to open models you can host yourself.