Does Pre-training Induce Systematic Inference? How Masked Language Models Acquire Commonsense Knowledge

Ian Porada, Alessandro Sordoni, Jackie Chi Kit Cheung