When classifying grammatical role, BERT doesn't care about word order... except when it matters

Isabel Papadimitriou, Richard Futrell, Kyle Mahowald