Quantization in Layer's Input is Matter

Daning Cheng, Wenguang Chen

Abstract: In this paper, we will show that the quantization in layer's input is more important than parameters' quantization for loss function. And the algorithm which is based on the layer's input quantization error is better than hessian-based mixed precision layout algorithm.