HiReLC:基于分层强化学习的神经网络压缩框架(剪枝与量化)

Hierarchical Reinforcement Learning for Neural Network Compression (HiReLC): Pruning and Quantization

精选理由

这个框架能自动给神经网络做剪枝和量化,压缩比达到6倍多,准确率几乎不掉,适合做模型部署。

AI 摘要

HiReLC是一个分层集成强化学习框架,用于深度神经网络的自动联合量化与结构化剪枝。低层智能体按块独立选择位宽、剪枝保留比、量化类型和粒度,高层智能体基于Fisher信息估计协调全局预算分配。框架使用轻量MLP代理进行奖励塑造,降低策略评估成本。在Vision Transformer和CNN基准上,实现参数存储压缩比5.99-6.72倍,一个设定下准确率提升3.83%,其他设定准确率下降0.55-5.62%。

原文 · arXiv cs.LG

Hierarchical Reinforcement Learning for Neural Network Compression (HiReLC): Pruning and Quantization

We present HiReLC, a hierarchical ensemble-reinforcement learning framework for automated joint quantization and structured pruning of deep neural networks. The framework decomposes the compression search across two levels of abstraction: low-level agents (LLAs) operate independently per block, selecting per-kernel configurations over a multi-discrete action space spanning bitwidth, pruning keep-ratio, quantization type, and granularity, while high-level agents (HLAs) coordinate global budget allocation via ensemble voting guided by Fisher Information-based sensitivity estimates. To mitigate the computational cost of policy evaluation, an iterative active learning loop interleaves surrogate-guided RL optimization with post-compression fine-tuning, using a lightweight MLP surrogate to amortize expensive evaluations and a logit-MSE proxy during cold-start. The surrogate is used for reward shaping rather than as a replacement for final post-compression evaluation. The controller is architecture-agnostic by design, with a modular layer abstraction decoupling the RL environment from the underlying network topology. Experiments across Vision Transformer and CNN benchmarks demonstrate effective parameter-storage compression ratios of 5.99 - 6.72$\times$ with a 3.83 % gain in one setting and 0.55 - 5.62 % accuracy drops elsewhere, supporting hierarchical policy decomposition and sensitivity-aware guidance as practical design choices for joint neural network compression.