CliniDial: A Naturally Emerged Multimodal Dialogue Dataset for Team Reflection During Clinical Operation

ACL ARR 2024 June Submission3300 Authors

16 Jun 2024 (modified: 02 Jul 2024)ACL ARR 2024 June SubmissionEveryoneRevisionsBibTeXCC BY 4.0
Abstract: In clinical operations, teamwork can be the crucial factor that determines the final outcome. Prior studies have shown that there can be 58\% more deaths than expected due to insufficient collaboration. To understand how the team practices teamwork during the operation, we collected **CliniDial** from simulations of medical operations. **CliniDial** includes the audio data and its transcriptions, the simulated physiology signals of the patient manikins, and how the team operates from two camera angles. We annotated behavior codes following an existing framework to understand the teamwork process. Experimental results show that **CliniDial** poses significant challenges to the existing models.
Paper Type: Short
Research Area: Resources and Evaluation
Research Area Keywords: benchmarking, clinical benchmarking, LLM evaluation, NLP evaluation
Contribution Types: Model analysis & interpretability, NLP engineering experiment, Data resources, Data analysis
Languages Studied: English
Submission Number: 3300
Loading