Self-conditioning Pre-Trained Language Models

Xavier Suau Cuadros, Luca Zappella, Nicholas Apostoloff

Abstract: In this paper we aim to investigate the mechanisms that guide text generation with pre-trained Transformer-based Language Models (TLMs). Grounded on the Product of Experts formulation by Hinton (19...