Jerry Liu 谈 LLM 应用:上下文技能优于模型训练

Agreed with this. people underestimate the importance of good abstractions and maintainability. pa...

精选理由

LlamaIndex 创始人聊数据策略:别费劲训练模型,把数据做成上下文技能更划算。

AI 摘要

LlamaIndex 创始人 Jerry Liu 在推文中赞同一种观点:企业利用数据的核心不在于训练模型,而在于将数据转化为模型可在推理时通过上下文使用的技能或工件。他指出训练模型耗时费力且需随基模型更新重复,且难以撤销。相比之下,通过提示词和编排利用模型推理时的易用性是 LLM 流行的部分原因。

原文 · Jerry Liu

Agreed with this. people underestimate the importance of good abstractions and maintainability. pa...

Agreed with this. people underestimate the importance of good abstractions and maintainability. part of the reason LLMs/AI are so popular in the first place is because of the ease of using the models during inference-time (through prompting, orchestration) instead of training Jesse Zhang @thejessezhang I actually feel strongly that the "learning" companies will want to do with their data will mostly not be to train models. Let's say you have a bunch of valuable data about your customers or employees. Your best bet to make that IP useful is to turn it into skills or artifacts that models can use in-context. If you go through the effort to train it into the model: 1. that is hard to get right and takes a lot of time + effort 2. you will have to do it all over again when the next base model comes out 3. most importantly, it is irreversible... when things change, you cannot untrain what you did 🔗 View Quoted Tweet 💬 2 🔄 1 ❤️ 4 👀 794 📊 2 ⚡