做 LLM 价值对齐的研究者终于有了从人口统计维度精细建模的方法——DVMap 用结构化 CoT 和 GRPO 实现了跨群体泛化，比国家标签更准，建议做 AI 伦理和可控生成的团队点开看看。
当前大语言模型（LLM）通常使用粗粒度的国家标签进行多元价值对齐，但这会忽略国家内部的价值异质性，导致对齐松散。DVMap 提出从国家标签转向多维人口统计约束，通过世界价值观调查（WVS）构建包含 56,152 样本的高质量对齐语料库，并引入结构化思维链（CoT）机制引导模型推理人口与价值的关系。实验表明，Qwen3-8B-DVMap 在跨人口统计测试中达到 48.6% 准确率，超越 DeepSeek-v3.2（45.1%），并展现出强泛化性和鲁棒性。该框架解决了宏观标签无法捕捉群体内价值差异的问题，为 LLM 的多元对齐提供了更精细的解决方案。
DVMap: Fine-Grained Pluralistic Value Alignment via High-Consensus Demographic-Value Mapping
Current Large Language Models (LLMs) typically rely on coarse-grained national labels for pluralistic value alignment. However, such macro-level supervision often obscures intra-country value heterogeneity, yielding a loose alignment. We argue that resolving this limitation requires shifting from national labels to multi-dimensional demographic constraints, which can identify groups with predictable, high-consensus value preference. To this end, we propose DVMap (High-Consensus Demographic-Value Mapping), a framework for fine-grained pluralistic value alignment. In this framework, we first present a demographic archetype extraction strategy to construct a high-quality value alignment corpus of 56,152 samples from the World Values Survey (WVS) by strictly retaining respondents with consistent value preferences under identical demographics. Over this corpus, we introduce a Structured Chain-of-Thought (CoT) mechanism that explicitly guides LLMs to reason about demographic-value correlations. Subsequently, we employ Group Relative Policy Optimization (GRPO) to achieve adaptive anchoring of value distributions. To rigorously evaluate generalization, we further establish a triple-generalization benchmark (spanning cross-demographic, cross-country, and cross-value) comprising 21,553 samples. Experimental results demonstrate that DVMap effectively learns the manifold mapping from demographics to values, exhibiting strong generalization and robustness. On cross-demographic tests, Qwen3-8B-DVMap achieves 48.6% accuracy, surpassing the advanced open-source LLM DeepSeek-v3.2 (45.1%). The source code and dataset are available at https://github.com/EnlightenedAI/DVMap.