Feature learning and random features in standard finite-width convolutional neural networks: An empirical study

Maxim Samarin, Volker Roth, David Belius

Abstract: The Neural Tangent Kernel is an important milestone in the ongoing effort to build a theory for deep learning. Its prediction that sufficiently wide neural networks behave as kernel methods, or equ...