这篇论文告诉你,不用盲目调参:用光谱的熵、相关性等指标就能提前猜出CNN该设多大卷积核、多少学习率,省掉一堆试错时间。
论文在25个近红外回归任务上测试了光谱数据属性(熵、内在秩、小波能量支撑比等)能否为CNN设计提供经验先验。使用两种可解释1D-CNN框架,通过5折交叉验证贝叶斯超参数优化(HPO)发现:最小CNN中最佳卷积核分数随光谱熵和内在秩降低、随小波能量支撑比升高,学习率随训练集大小降低。直接和留一数据集验证的中位测试RMSE比分别为0.953和1.017,接近HPO性能。单独实验中联合预处理和CNN HPO在19/25任务上优于标准化光谱HPO。
Using Data-Derived Priors to Guide CNN Architecture Design for NIR Chemometrics
Convolutional neural networks (CNN) for near-infrared (NIR) chemometrics are often designed using generic architectural rules, although spectral datasets differ in sampling, smoothness, redundancy, and sample size. We tested whether these properties can provide empirical priors for CNN design. Across 25 NIR regression tasks, we computed descriptors of dataset size, spectral length and spacing, entropy, intrinsic rank, autocorrelation, and wavelet-scale structure. Two interpretable 1D-CNN scaffolds (a minimal single-convolution model and an extended shallow model with optional branching, dilation, etc) were optimized using five-fold cross-validated Bayesian hyperparameter optimization (HPO). Relationships extracted from near-optimal trials were converted into warm-start heuristics and evaluated directly and through leave-one-dataset-out (LODO) validation. The clearest relationships involved convolutional receptive fields. In the minimal CNN, the preferred kernel fraction decreased with spectral entropy and intrinsic rank, increased with the wavelet energy-support fraction, and the learning rate tended to decrease with training-set size. Direct and LODO heuristics were competitive with HPO, with median test-RMSE ratios of 0.953 and 1.017, respectively. The extended CNN showed similar but less transferable structure across branch usage, dilation, dropout, filter counts, and receptive-field choices. Ten stochastic refits showed seed sensitivity comparable to that of HPO-selected configurations. In a separate experiment, joint preprocessing and CNN HPO outperformed standardized-spectra HPO in 19 of 25 tasks, although gains were dataset-dependent. These results show that spectral descriptors can provide practical CNN design priors, guiding shallow NIR models toward plausible hyperparameter regions before target-specific tuning