The Care2Report System: Automated Medical Reporting as an Integrated Solution to Reduce Administrative Burden in Healthcare

Lientje Maas, Mathan Geurtsen, Florian Nouwt, Stefan Schouten, Robin Van De Water, Sandra van Dulmen, Fabiano Dalpiaz, Kees van Deemter, Sjaak Brinkkemper

Abstract: Documenting patient medical information in the electronic medical record is a time-consuming task at the expense of direct patient care. We propose an integrated solution to automate the process of medical reporting. This vision is enabled through the integration of speech and action recognition technology with semantic interpretation based on knowledge graphs. This paper presents our dialogue summarization pipeline that transforms speech into a medical report via transcription and formal representation. We discuss the functional and technical architecture of our Care2Report system along with an initial system evaluation with data of real consultation sessions.