A robust scene recognition system for baseball broadcast using data-driven approach

Ryoichi Ando, Koichi Shinoda, Sadaoki Furui, Takahiro Mochizuki

Abstract: We propose a robust scene recognition system for baseball broadcast videos. This system is based on the data-driven approach which has been successful in continuous speech recognition. It uses a multi-stream hidden Markov model to model each scene and an unsupervised adaptation method to achieve robustness against differences in environmental conditions among games. It also employs an n-gram language model to represent the contexts among scenes, and a model for scene length information. The proposed system was evaluated in scene recognition experiments with 16 scene types acquired from video data of 25 baseball games. The system reduced errors in scene recognition by 6.3 % absolute.