Where Does Linguistic Information Emerge in Neural Language Models? Measuring Gains and Contributions across Layers

Jenny Kunz, Marco Kuhlmann