Pezego-HITL:面向加纳农业扩展的策略导向大语言模型架构

Pezego-HITL: A policy-grounded large language model architecture for agricultural extension in Ghana

精选理由

这篇论文搞了个P-EVAL框架来评估农业AI的安全性,Pezego-HITL架构在加纳测试,延迟降了55%,还挺靠谱的。

AI 摘要

本文提出P-EVAL评估框架,用于策略约束的大语言模型决策支持,在加纳模拟场查询数据库(1,240例)上测试。Pezego-HITL架构在P-EVAL下实现Policy Alignment Rate (PAR) 0.94,Agronomic Utility Rate (AUR) 0.95,P95延迟降低55%(从28.6s到12.9s)。通过59.6%缓存重用率实现延迟优化。在Qwen3.5-9B-DeepSeek-V4-Flash模型上泛化取得PAR 0.86,延迟降低54.5%(至10.2s)。对加纳30名推广官员和36名小农进行问卷评估,验证了实际效用。

原文 · arXiv: DeepSeek

Pezego-HITL: A policy-grounded large language model architecture for agricultural extension in Ghana

Large language models are increasingly deployed in agricultural decision-support settings, yet high-stakes crop protection in smallholder agriculture requires more than output-quality benchmarks. Over a two-year design and evaluation programme, we formalise policy-constrained large language model assessment as an adaptive compute allocation problem that jointly captures safety compliance, helpfulness, operational latency, and expert supervision workload. We introduce P-EVAL (Policy-grounded Expert-calibrated VALidation protocol), a unified evaluation framework for policy-grounded decision support, evaluating the architecture on a simulated field query database consisting of 1,240 cases. The protocol is instantiated on the Pezego advisory architecture (Pezego-HITL) and evaluated in Ghana. Following offline judge calibration against gold-standard human expert decisions ($κ= 0.77$), we evaluate the architectural performance under simulated query workloads. Under P-EVAL, our memory-routed architecture improves the Policy Alignment Rate (PAR) to 0.94 and the Agronomic Utility Rate (AUR) to 0.95, while reducing P95 latency by 55% (from 28.6s to 12.9s) through a 59.6% cache reuse ratio. We also demonstrate generalisability using the open-source \texttt{Qwen3.5-9B-DeepSeek-V4-Flash} model, achieving a PAR of 0.86 and a 54.5% latency reduction (to 10.2s). To evaluate practical utility and socio-technical integration, we administer detailed questionnaires to Ghanaian Extension Services Officers ($N=30$) and smallholder farmers ($N=36$). Taken together, this work demonstrates how policy-grounded structured retrieval-augmented generation with validated-memory routing makes safety-utility-latency trade-offs explicit, offering a scalable template for trustworthy AI-driven extension in smallholder farming systems.