Haotian Zhang

Researcher, NVIDIA

Joined

February 2020

Names

Haotian Zhang (Preferred)

Emails

****@uw.edu (Confirmed)

****@apple.com (Confirmed)

****@gmail.com (Confirmed)

Personal Links

Homepage

Google Scholar

ORCID

Career & Education History

Researcher

NVIDIA (nvidia.com)

2025 – Present

Researcher

Apple AI/ML (apple.com)

2022 – 2025

Intern

Microsoft Research, Research, Microsoft (research.microsoft.com)

2020 – 2022

PhD student

University of Washington, Seattle (uw.edu)

2017 – 2022

Undergrad student

Shanghai Jiao Tong University (sjtu.edu.cn)

2013 – 2017

Advisors, Relations & Conflicts

PhD Advisor

Jenq-Neng Hwang

2017 – 2022

Expertise

Visual Grounding

Present

Vision and Language

2020 – Present

Large Language Model

2020 – Present

Mutimodal Large Language Model

2020 – Present

Computer Vision

2017 – Present

Publications

MANZANO: A Simple and Scalable Unified Multimodal Model with a Hybrid Vision Tokenizer
Yanghao Li, Rui Qian, Bowen Pan, Haotian Zhang, Haoshuo Huang, Bowen Zhang, Jialing Tong, Haoxuan You, Xianzhi Du, Zhe Gan, Hyunjik Kim, Chao Jia, Zhenbang Wang, Yinfei Yang, Mingfei Gao, Zi-Yi Dou, Wenze Hu, Chang Gao, Dongxu Li, Philipp Dufter et al. (7 additional authors not shown)
- ICLR 2026 Poster
- Readers: Everyone
Ferret-UI Lite: Lessons from Building Small On-Device GUI Agents
Zhen Yang, Zi-Yi Dou, Di Feng, Forrest Huang, Anh Tuan Nguyen, Keen You, Omar Attia, Yuhao Yang, Michael Feng, Haotian Zhang, Ram Ramrakhya, Chao Jia, Jeffrey Nichols, Alexander T Toshev, Yinfei Yang, Zhe Gan
- Submitted to ICLR 2026
- Readers: Everyone
Contrastive Localized Language-Image Pre-Training
Hong-You Chen, Zhengfeng Lai, Haotian Zhang, Xinze Wang, Marcin Eichner, Keen You, Meng Cao, Bowen Zhang, Yinfei Yang, Zhe Gan
- ICML 2025 poster
- Readers: Everyone
How Easy is It to Fool Your Multimodal LLMs? An Empirical Analysis on Deceptive Prompt
Yusu Qian, Haotian Zhang, Yinfei Yang, Zhe Gan
- SafeGenAi Poster
- Readers: Everyone
Improve Vision Language Model Chain-of-thought Reasoning
Ruohong Zhang, Bowen Zhang, Yanghao Li, Haotian Zhang, Zhiqing Sun, Zhe Gan, Yinfei Yang, Ruoming Pang, Yiming Yang
- ICLR 2025 Conference Withdrawn Submission
- Readers: Everyone
MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuning
Haotian Zhang, Mingfei Gao, Zhe Gan, Philipp Dufter, Nina Wenzel, Forrest Huang, Dhruti Shah, Xianzhi Du, Bowen Zhang, Yanghao Li, Sam Dodge, Keen You, Zhen Yang, Aleksei Timofeev, Mingze Xu, Hong-You Chen, Jean-Philippe Fauconnier, Zhengfeng Lai, Haoxuan You, Zirui Wang et al. (3 additional authors not shown)
- ICLR 2025 Poster
- Readers: Everyone
Ferret-UI 2: Mastering Universal User Interface Understanding Across Platforms
Zhangheng LI, Keen You, Haotian Zhang, Di Feng, Harsh Agrawal, Xiujun Li, Mohana Prasad Sathya Moorthy, Jeffrey Nichols, Yinfei Yang, Zhe Gan
- ICLR 2025 Poster
- Readers: Everyone
Contrastive Localized Language-Image Pre-Training
Hong-You Chen, Zhengfeng Lai, Haotian Zhang, Xinze Wang, Marcin Eichner, Keen You, Meng Cao, Bowen Zhang, Yinfei Yang, Zhe Gan
- Submitted to ICLR 2025
- Readers: Everyone
Revisit Large-Scale Image-Caption Data in Pre-training Multimodal Foundation Models
Zhengfeng Lai, Vasileios Saveris, Chen Chen, Hong-You Chen, Haotian Zhang, Bowen Zhang, Wenze Hu, Juan Lao Tebar, Zhe Gan, Peter Grasch, Meng Cao, Yinfei Yang
- ICLR 2025 Poster
- Readers: Everyone
MMEgo: Towards Building Egocentric Multimodal LLMs for Video QA
Hanrong Ye, Haotian Zhang, Erik Daxberger, Lin Chen, Zongyu Lin, Yanghao Li, Bowen Zhang, Haoxuan You, Dan Xu, Zhe Gan, Jiasen Lu, Yinfei Yang
- ICLR 2025 Poster
- Readers: Everyone

View all 39 publications

Co-Authors

View all 202 co-authors