Heterogeneous Image Knowledge Driven Visual Perception

Lan Yan, Wenbo Zheng, Fei-Yue Wang

Abstract: Dear Editor, This letter is concerned with visual perception closely related to heterogeneous images. Facing the huge challenge brought by different image modalities, we propose a visual perception framework based on heterogeneous image knowledge, i.e., the domain knowledge associated with specific vision tasks, to better address the corresponding visual perception problems. In particular, we first introduce the motivation and key idea of our framework. Then the proposed framework is described in detail. Furthermore, case studies demonstrate that the proposed framework can be successfully applied to practical tasks and provide a reference for constructing a heterogeneous image perception model based on the framework.