Forecasting backdraft with multimodal method: Fusion of fire image and sensor data

Tianhang Zhang, Fangqiang Ding, Zilong Wang, Fu Xiao, Chris Xiaoxuan Lu, Xinyan Huang

Abstract: Highlights•Full-scale fire experiments are conducted to establish a real backdraft fire database.•Visual and temperature sensor data are integrated in a data fusion model to forecast backdraft.•The AI model via fusing visual and temperature data predicts backdraft with accuracy of 84%.•The multimodal model demonstrates a prototype of future smart firefighting application.