Papers

用软标签双向锚定与主动学习构建电网方言俚语词库

Constructing a Regional Slang Lexicon for Electricity Demands via Soft-Label Bidirectional Anchoring and Active Learning

Why we picked it

云南玉溪电网客服的方言词库搭建方法,软标签让候选词从41个涨到349个,做方言NLP的可以参考。

论文提出弱监督框架,从方言锚点词与电力领域种子词出发构建区域俚语词库,候选词通过 PMI、Sentence-BERT 相似度和 jieba 词性度量打分,并引入不确定性感知的主动学习,用规则和 RAG 增强的 LLM 作为标注 oracle。在云南玉溪 11,177 条真实微信消息上评估,估计方言精确率 DP=1.0 且零误报。消融实验显示软标签分层在相同精确率下比严格电力门控多保留 751% 候选词,候选池从 41 个扩展到 349 个。人类校准(n=46)得到 κ_dialect=1.0、κ_power=0.85,最终产出 25–33 个词的词库。

Original · arXiv cs.AI

Constructing a Regional Slang Lexicon for Electricity Demands via Soft-Label Bidirectional Anchoring and Active Learning

Power-grid customer service increasingly relies on community social media, where customers describe outages, billing, and equipment faults in informal regional dialect. Such messages exhibit non-standard morphology, semantic drift, and out-of-vocabulary expressions that make manual lexicon construction costly and degrade conventional NLP tools. We propose a weak-supervision framework constructing a regional slang lexicon from curated dialect anchors and power-domain seed terms. Candidates are generated via Pointwise Mutual Information with soft-label bidirectional anchoring, retaining dialect-anchored terms while recording power-domain relevance as separate metadata, and are scored by combining Sentence-BERT semantic similarity with a jieba-based wordhood measure. Uncertainty-aware active learning with rule-based and retrieval-augmented LLM oracles is applied under three query strategies, and the resulting lexicon is evaluated by a higher-capability LLM calibrated against human expert annotations via Cohen's $κ$. On 11,177 real WeChat messages from Yuxi (Yunnan, China), the framework achieves an evaluator-estimated dialect precision of DP~$=$~1.0 with zero false positives. An ablation shows that soft-label layering retains 751\% more candidates than strict power-gating at identical precision, expanding the candidate pool from 41 to 349 terms. Human calibration ($n=46$) yields $κ_{\text{dialect}}=1.0$ and $κ_{\text{power}}=0.85$. The resulting 25--33-term lexicon, 4--5 of which are power-relevant, provides a preliminary resource for dialect-aware power-grid service NLP.