这篇论文把VARMA从低维度限制里解放出来了,迭代成本不再随序列长度增长,在d=40时还能稳定预测,做时间序列的可以看看。
该研究提出一种VARMA模型估计框架,使每次优化迭代的计算成本与序列长度T无关,通过偏自相关重参数化保证平稳性和可逆性。损失函数仅依赖固定大小的充分统计量,借助Parseval恒等式以近线性成本评估截断长度。两种点估计器(正则化最小二乘和协方差边缘化最大后验)在固定维度下以近参数速率恢复真实过程的无穷自回归表示。实验中,从d=10到d=40,估计器接近oracle预测误差,而经典条件MLE在d=40时产生非可逆拟合且预测发散。该方法在零售需求、气象和空气质量数据上匹配或优于VAR、贝叶斯VAR、成分ARMA和稀疏VARMA基线。
Scalable estimation of VARMA models
Vector autoregressive moving-average (VARMA) models have long been considered impractical beyond moderate dimensions: the likelihood is non-convex, the parametrization is identified only up to equivalence, and every evaluation costs a pass over the entire series. Yet their moving-average term captures with a few parameters what a pure autoregression matches only with many lags. We introduce an estimation framework that removes this computational barrier: each optimization iteration is independent of the series length $T$. The framework combines a partial-autocorrelation reparametrization that guarantees stationarity and invertibility by construction, Gaussian priors on the reparametrized coefficients with separate scales for diagonal and off-diagonal entries, and losses that depend on the data only through fixed-size sufficient statistics, evaluated by a Parseval (Fourier) identity at near-linear cost in the truncation length. This yields two point estimators: a regularized least-squares fit and a covariance-marginalized maximum-a-posteriori estimator. We prove that both recover the infinite-autoregressive representation of the true process at a near-parametric rate in fixed dimension, so the truncation introduces no asymptotic bias. The same machinery extends, at the same leading cost, to seasonal dynamics, exogenous regressors (VARMAX), and rolling-window refits. Empirically, the estimators stay close to the oracle forecast error from $d=10$ to $d=40$ (where classical conditional MLE returns non-invertible fits whose forecasts diverge) and match or beat VAR, Bayesian-VAR, component-wise ARMA, and sparse-VARMA baselines on retail-demand, meteorological, and air-quality data. This brings likelihood-based VARMA estimation, at a per-iteration cost independent of the series length, to the problem sizes where practitioners have so far relied on VAR models.