Gated Siamese Fusion Network based on multimodal deep and hand-crafted features for personality traits assessment

Elena Ryumina, Maxim Markitantov, Dmitry Ryumin, Alexey Karpov

Abstract: Highlights•Automatic pairwise analysis of people to boost personality traits assessment performance.•A novel gated Siamese network for multimodal fusion of deep and hand-crafted features.•In-depth analysis of meaningful heterogeneous facial, acoustic and linguistic features.•A novel publicly available multimodal personality traits assessment framework.