Variational Network QuantizationDownload PDF

Feb 15, 2018 (edited Feb 10, 2022)ICLR 2018 Conference Blind SubmissionReaders: Everyone
  • Keywords: Network compression, variational inferene, ternary network, Bayesian neural network, weight quantization, weight sharing
  • TL;DR: We quantize and prune neural network weights using variational Bayesian inference with a multi-modal, sparsity inducing prior.
  • Abstract: In this paper, the preparation of a neural network for pruning and few-bit quantization is formulated as a variational inference problem. To this end, a quantizing prior that leads to a multi-modal, sparse posterior distribution over weights, is introduced and a differentiable Kullback-Leibler divergence approximation for this prior is derived. After training with Variational Network Quantization, weights can be replaced by deterministic quantization values with small to negligible loss of task accuracy (including pruning by setting weights to 0). The method does not require fine-tuning after quantization. Results are shown for ternary quantization on LeNet-5 (MNIST) and DenseNet (CIFAR-10).
  • Data: [CIFAR-10](, [MNIST](
11 Replies