Multi-Stream Deep Convolutional Network Using High-Level Features Applied to Fall Detection in Video Sequences

Sarah Almeida Carneiro, Gabriel Pellegrino da Silva, Guilherme Vieira Leite, Ricardo Moreno, Silvio Jamil Ferzoli Guimarães, Hélio Pedrini

Abstract: Sporadic falls, due to the lack of balance and other factors, are some of the complications that elderly people might experience more frequently than others. Accordingly, as there is a high probability of these events causing major health casualties, such as bone breaking or head clots, studies have been monitoring these falls to rapidly assist the victim. In this work, we propose and evaluate a multi-stream learning model based on convolutional neural networks using high-level handcrafted features as input in order to cope with this situation. Therefore, our approach consists of extracting high-level handcrafted features, for instance, human pose estimation and optical flow, and using each one as an input for a distinct VGG-16 classifier. In addition, these experiments are able to showcase what features can be used in fall detection. The results have shown that by assembling our directed input learners, our approach outperforms, in terms of accuracy and sensitivity rates, to other similar tested methods found in literature.