论文精选73°

BEACON框架提升地理空间模型表现

BEACON: Behavioral and Semantic Enrichment of AlphaEarth Embeddings through Tri-Modal Contrastive Learning

精选理由

研究人员提出BEACON框架,通过整合三种数据源,让地理空间模型更好地理解城市功能和人类行为。

AI 摘要

BEACON是一种三模态对比学习框架,通过整合地球观测图像、兴趣点文本和人类行为数据,增强AlphaEarth地理基础模型的表现。在休斯顿都市区的9项下游任务测试中,BEACON在肥胖率预测上相对R²提升43%,精神健康问题预测提升34%,家庭收入中位数预测提升22%。该模型在保持物理和环境变量预测竞争力的同时,将应用范围从地球观测扩展到以人为中心的都市分析。

原文 · arXiv cs.LG

BEACON: Behavioral and Semantic Enrichment of AlphaEarth Embeddings through Tri-Modal Contrastive Learning

Geospatial foundation models such as the AlphaEarth Foundation produce compact and globally consistent representations of the Earth's surface that transfer effectively to a wide range of downstream tasks. However, because these models are trained primarily on Earth-observation imagery, their embeddings mainly capture physical and spectral characteristics while encoding human activity and urban function only weakly. To address this limitation, we propose BEACON, a tri-modal contrastive learning framework that aligns three complementary views of urban space: physical representations from AE embeddings, semantic representations from point-of-interest (POI) text, and human behavioral representations from hourly POI visitation, while keeping the deployed representation image-only. Using the Houston Metropolitan Area as a case study area, we evaluated the performance of the BEACON framework on nine downstream tasks, including seven regression and two classification tasks against six baselines (raw coordinates, Space2Vec, SatCLIP, TESSERA, Clay and AlphaEarth), using frozen linear and MLP probes over five seeds. Under a linear probe, BEACON improves relative R^2 over AlphaEarth by up to 43% for obesity prevalence, 34% for poor mental health, and 22% for median household income, while remaining competitive in the prediction of physical and environmental variables. These findings highlight the value of augmenting geospatial foundation models with semantic and behavioral signals, extending their applicability from physical Earth observation to human-centered urban analytics.