Slimmable Neural Networks

Jiahui Yu, Linjie Yang, Ning Xu, Jianchao Yang, Thomas S. Huang

Abstract: We present a simple and general method to train a single neural network executable at different widths (number of channels in a layer), permitting instant and adaptive accuracy-efficiency trade-offs at runtime.