Hybrid random forests

Open Webpage

Baoxun Xu, Joshua Zhexue Huang, Graham Williams, Mark Junjie Li, Yunming Ye

Published: 01 Jan 2012, Last Modified: 15 Jan 2026Advances in Knowledge Discovery and Data Mining - 16th Pacific-Asia Conference, PAKDD 2012, ProceedingsEveryoneRevisionsBibTeXCC BY-SA 4.0
Abstract: Random forests are a popular classification method based on an ensemble of a single type of decision tree. In the literature, there are many different types of decision tree algorithms, including C4.5, CART and CHAID. Each type of decision tree algorithms may capture different information and structures. In this paper, we propose a novel random forest algorithm, called a hybrid random forest. We ensemble multiple types of decision trees into a random forest, and exploit diversity of the trees to enhance the resulting model. We conducted a series of experiments on six text classification datasets to compare our method with traditional random forest methods and some other text categorization methods. The results show that our method consistently outperforms these compared methods.