Improving Neural Language Modeling via Adversarial Training

Dilin Wang, ChengYue Gong, Qiang Liu

Abstract: Recently, substantial progress has been made in language modeling by using deep neural networks. However, in practice, large scale neural language models have been shown to be prone to overfitting....