A survey on advancements in image-text multimodal models: From general techniques to biomedical implementations

Ruifeng Guo, Jingxuan Wei, Linzhuang Sun, Bihui Yu, Guiyong Chang, Dawei Liu, Sibo Zhang, Zhengbing Yao, Mingjun Xu, Liping Bu

Abstract: Highlights•Overview of the evolution of image–text models and multimodal biomedical models.•Traces key innovations driving models’ technological advancements.•To study the role of technological advances to the biomedical field.•Categorizes challenges and proposes targeted resolution strategies.•Established an open-source repository on GitHub for collaboration.