Development of Real-time Handwashing Assessment using Video Analysis

Esa Prakasa, Bambang Sugiarto, Agastya Pandu Satriya Utama, Siti Yuliyanti

Abstract: The world communities have suffered from the COVID-19 pandemic for the last two years. Even though many countries have started to normalise the situation, the COVID-19 still becomes a severe threat in the future. Healthy habits, such as complete and frequent handwashing, still need to be practised. These habits can minimise the transmission risks. The paper proposed a single-board computer system that aims to assess the handwashing steps. The standardised handwashing procedure is used to validate the acquired video of hand movement. The system is installed in a Raspberry Pi and receives video data from the connected mini camera. The deep learning model is implemented to provide classification capabilities. The assessment result is summarised according to the movement completeness and total duration. The testing stages found that the proposed system can provide accuracy and F1-score values of 82.55% and 86.66%, respectively.