SORT:一种用于方程发现、逼近与积分的稀疏正交回归谱框架

Sparse Orthogonal Regression Technique: A Spectral Framework for Equation Discovery, Approximation, and Integration

精选理由

这篇论文提出了SORT框架,用稀疏谱方法从噪声数据里发现微分方程,比SINDy更抗稀疏采样,还能顺带做积分逼近,适合做系统辨识的人看。

AI 摘要

SORT利用L1正则化回归直接从含噪声和不规则采样的观测数据估计正交基展开系数,避免显式数值积分。在动力学系统实验中,SORT在基函数适配问题时匹配或优于SINDy等库稀疏回归基线,且在稀疏采样、噪声导数估计和表示失配下退化更稳定。实验显示主导低阶系数随模型阶数增加而保持,支持阶数一致的模型增长。SORT还可用于非线性逼近和复杂高维积分估计,将基设计显式纳入科学建模问题。

原文 · arXiv cs.LG

Sparse Orthogonal Regression Technique: A Spectral Framework for Equation Discovery, Approximation, and Integration

We develop the Sparse Orthogonal Regression Technique (SORT), a sparse spectral framework for learning orthonormal-basis expansions from noisy and irregularly sampled data. SORT estimates expansion coefficients directly from observations using L1-regularized regression, avoiding explicit quadrature or analytic inner-product evaluation. The central application is data-driven discovery of ordinary differential equations: vector fields are represented in chosen orthogonal bases and learned as sparse coefficient expansions. This provides a complementary route to symbolic regression, grammar-based discovery, and SINDy-style sparse identification by first recovering a compact spectral representation, which can later guide searches for simpler analytic forms. Across the dynamical-system experiments, SORT matches or improves upon library-based sparse-regression baselines when the basis is well adapted to the problem, and shows more stable degradation under sparse sampling, noisy derivative estimates, and representation mismatch. Specific examples illustrate why this representation is useful: if a finite library misses the problem-specific nonlinearity, the resulting model can fail. SORT is not immune to mismatch, but it shifts the problem away from brittle selection among generic terms to basis design adapted to the problem domain. The experiments also show that dominant low-order coefficients persist as model order increases, supporting order-consistent model growth. Beyond equation discovery, the same learned expansion supports nonlinear approximation and estimation of complex, high-dimensional integrals by coefficient readout. Overall, SORT provides a reusable intermediate representation for system identification, approximation, and integration, while making basis design an explicit part of the scientific modeling problem.