这篇论文用Weaviate和LangChain搭了个RAG助手,专门帮天文台员工从文档堆里找答案,很实用,不是吹概念的那种。
该论文为NSF-DOE Vera C. Rubin天文台开发了一个基于检索增强生成(RAG)的虚拟助手原型。系统整合了操作指南、技术笔记和科学论文等分布多平台的大量异构文档。它使用Weaviate进行嵌入存储、LangChain编排查询流程、OpenAI GPT模型作为LLM后端。通过语义搜索和对话式交互,助手将回答锚定在领域知识上,减少了幻觉,提升了准确性。
Development of a Retrieval-Augmented Generation Virtual Assistant for Enhanced Information Discovery at Rubin Observatory
The NSF-DOE Vera C. Rubin Observatory will generate petabytes of data through the Legacy Survey of Space and Time (LSST) over the next decade, enabling discoveries across a broad range of astrophysical fields. Alongside these data products, Rubin maintains a large but heterogeneous collection of supporting documentation, including operational guides, technical notes, and scientific papers. Because this material is distributed across multiple platforms and formats, staff and scientists often struggle to efficiently locate accurate, up-to-date information. Many resources also reside on internal systems, limiting the ability of general-purpose language models to provide reliable answers to Rubin-specific questions. To address these challenges, we explore the use of Retrieval Augmented Generation (RAG) to improve information discovery. We present a prototype RAG-based virtual assistant that delivers context-aware, factual, conversational access to Rubin's vast and heterogenous documentation ecosystem. The system integrates material from multiple sources and enables semantic search through a conversational interface, using Weaviate for embeddings, LangChain for query orchestration, and an OpenAI GPT model as the LLM backend. By grounding responses in domain-specific knowledge, the assistant reduces hallucinations, improves accuracy, and demonstrates the potential of RAG to enhance access to distributed knowledge, streamline workflows, and support effective use of LSST data products.
- IT之家07-03 02:30原文