论文精选

In-Context Learning 优化潜空间贝叶斯优化:分子设计新突破

In-Context Learning for Latent Space Bayesian Optimization

精选理由

做分子设计或材料优化的团队终于有了适配LSBO的上下文学习代理——它解决了预训练任务与潜空间优化不匹配的痛点,直接提升分子优化效率,建议做AI制药或计算化学的开发者试试。

AI 摘要

潜空间贝叶斯优化(LSBO)用于分子和蛋白质等结构化对象的设计,但现有上下文学习模型(如TabPFN)在LSBO中存在任务不匹配问题:它们预训练于标准回归任务,而LSBO中潜码到目标值的映射差异显著。研究者提出通过分子VAE的潜空间合成优化任务对表格基础模型进行持续预训练,并加入正则化项保持原始回归先验。在分子优化基准上,该模型表现强劲,验证了LSBO特定适配对上下文代理的重要性。这项工作为AI驱动的分子设计提供了更高效的优化方法。

原文 · arXiv cs.LG

In-Context Learning for Latent Space Bayesian Optimization

Bayesian optimization (BO) is a central tool for sample-efficient design, and latent-space Bayesian optimization (LSBO) extends it to structured objects such as molecules and proteins. In parallel, tabular foundation models such as TabPFN and TabICL now achieve state-of-the-art regression performance and are increasingly used as BO surrogates. Because their Bayesian behavior is induced by large synthetic pretraining collections, the composition of this pretraining distribution is crucial. LSBO creates a distinctive mismatch: the induced map from latent code to objective value differs markedly from the regression tasks used to train current in-context models. We address this mismatch by complementing the pretraining stage of tabular foundation model surrogates with synthetic optimization tasks defined on the latent space of a molecular VAE. The continued-pretraining objective features a regularizer that anchors the model to the original checkpoint, preserving its broad regression prior while avoiding overspecialization to the adaptation tasks. On held-out molecular optimization benchmarks, the resulting model achieves strong performance, supporting the relevance of LSBO-specific adaptation for in-context surrogates.