提出一种通用核框架,用于处理非条件负定距离测量的稀疏地标嵌入
A General Kernel Framework for Non-CND Distance Measures Using |D|-Dimensional Sparse Landmark Embeddings
这篇论文提出了一种新的核方法框架,解决了核方法在处理非条件负定距离时的问题,理论严谨,实验结果也很有说服力。
本文提出稀疏地标嵌入(SLE)核,通过将输入映射到由训练点中心化的紧凑支持 bump 函数生成的稀疏特征向量空间,解决了核方法在自然输入空间(如流形和概率分布空间)上无法保证核矩阵正定性的问题。该框架允许使用任何标准正定核,并提供了理论保证,实验表明其在预测准确性和不确定性量化方面优于基于测地线和沃罗诺夫距离的基线模型。
A General Kernel Framework for Non-CND Distance Measures Using |D|-Dimensional Sparse Landmark Embeddings
Kernel methods, and Gaussian Processes (GPs) in particular, require a Hilbertian distance measure---one whose square is conditionally negative definite (CND)---to guarantee positive semi-definiteness (PSD) of the kernel matrix; a condition that fails for many natural input spaces, including smooth manifolds and spaces of probability distributions. We propose the Sparse Landmark Embedding (SLE) kernel, which eliminates this requirement entirely. Each input is embedded into a sparse feature vector via compactly supported bump functions centered at all |D| training points; applying any standard PSD kernel in this embedding space yields a kernel that is provably PSD for arbitrary distance measures. The compact support automatically controls embedding sparsity, keeping kernel matrices well-conditioned and computationally tractable despite the high ambient dimension. We provide theoretical guarantees on PSD, sparsity, stability, and universal approximation, and demonstrate, using geodesic and Wasserstein distances, that the SLE kernel matches or substantially exceeds domain-specific baselines in both predictive accuracy and uncertainty quantification.