Abstract: Highlights•We propose an online real-time crowd behavior detection method.•Our solution is suitable for real automatic surveillance applications.•Three publicly available data sets are used for computing the results.•Our method is quantitatively compared with similar approaches.