这篇论文深入探讨了LLM在行业合规文档生成中的应用，揭示了不同格式要求对输出质量的影响，为LLM辅助合规提供了有价值的见解。
欧盟在可持续性和隐私法规制定中成为领先机构。新法规要求包括文档，如ESPR的数字产品护照和GDPR的数据保护影响评估。创建这些合规文档具有挑战性，因为工业数据格式异构且分散。研究人员提出使用LLM生成合规文档，但对其影响未充分评估。本研究通过基准测试不同模型，评估数据提取指令和法规模糊性对LLM生成合规文档的质量和一致性影响。结果显示，对格式要求较低的DPIA需要更高上下文提示以保持一致性和完整性，而格式要求严格的DBP则在不同提示下产生一致结果，但可能导致更多幻觉输出。
From Regulation to Implementation: A Critical Evaluation of LLM-Assisted Regulatory Compliance in Industry
The European Union (EU) has emerged as a leading regulatory body in the development of sustainability and privacy regulations. While new regulation requirements vary, many include a documentation artifact to ensure compliance. Notably, the Ecodesign for Sustainable Products Regulation (ESPR) introduces Digital Product Passports (DPPs) for life cycle transparency, while the General Data Protection Regulation (GDPR) mandates Data Protection Impact Assessments (DPIAs) to mitigate privacy risks. Creating these compliance artifacts, however, is challenging. Industrial data, which often exists in heterogeneous formats and is scattered across company and supplier systems, is required for DPPs and can be difficult to extract into compliant DPP formatting. Furthermore, DPIA documents require interdisciplinary expertise and follow no standardized format, making development difficult for novel systems. To address the particular complexity of compliance artifact creation for both regulations, researchers have proposed the use of LLMs in the generation process; however, the impact of the aforementioned problems on the output of these systems is largely unaddressed. This work investigates the existing research gap by exploring how data extraction instructions and regulatory vagueness impact the quality and consistency of LLM-produced compliance artifacts. The resulting artifacts are evaluated by benchmarking different models against manually created ground-truth schemas. The results reveal that less strict guidelines, such as DPIA formatting, require higher context prompts to maintain consistency and completeness. Stricter guidelines, such as formatting for Digital Battery Passports (DBP), result in consistent results regardless of prompt context, but may lead to more hallucinations in the output