Contextualized medication information extraction using Transformer-based deep learning architectures

Aokun Chen, Zehao Yu, Xi Yang, Yi Guo, Jiang Bian, Yonghui Wu

Abstract: Highlights•Transformer-based NLP systems for medication extraction and event/context classification.•Comparison of 6 pretrained state-of-the-art transformer models.•Top performance from GatorTron model - trained using over 90 billion words of text.