On the validity of pre-trained transformers for natural language processing in the software engineering domain

Julian von der Mosel, Alexander Trautsch, Steffen Herbold