Implementation of specialised attention mechanisms: ICD-10 classification of Gastrointestinal discharge summaries in English, Spanish and Swedish

Alberto Blanco, Sonja Remmer, Alicia Pérez, Hercules Dalianis, Arantza Casillas

Abstract: Highlights•PlaBERT: a multi-label text classifier with Per-label Attention.•Electronic Health Record automatic coding in English, Spanish and Swedish.•The attention mechanism computes specific attention importance for each input token and label pair.•The study focuses on 157 ICD-10 diagnostic terms within Chapter XI – Diseases of the Digestive System.•PlaBERT output the computed attention importance for each token and label and allow its visualisation.