Offline handwritten mathematical expression recognition with graph encoder and transformer decoder

Jia-Man Tang, Hong-Yu Guo, Jin-Wen Wu, Fei Yin, Lin-Lin Huang

Abstract: Highlights•A Graph-Encoder-Transformer-Decoder (GETD) approach is proposed for offline HMER, which has good interpretability.•The approach consists of a graph encoder (GNN) for aggregating spatial structure information and a Transformer decoder for generating recognition result.•Experiments on public datasets demonstrate that the proposed method achieves competitive recognition performance.