Mengjie Zhao

Visiting Researcher, Northeastern University

Senior Researcher, SB Intuitions / Softbank

Joined

July 2019

Names

Mengjie Zhao

Emails

****@cis.lmu.de (Confirmed)

****@sony.com (Confirmed)

****@fastmail.com (Confirmed)

Personal Links

Career & Education History

Visiting Researcher

Northeastern University (neu.edu.cn)

2026 – Present

Senior Researcher

SB Intuitions / Softbank (sbintuitions.co.jp)

2025 – Present

Researcher

Sony (sony.com)

2022 – 2025

PhD student

CIS, LMU Munich (lmu.de)

2018 – 2022

MS student

EPFL - EPF Lausanne (epfl.ch)

2015 – 2018

Advisors, Relations & Conflicts

PhD Advisor

Hinrich Schuetze

2018 – 2022

Expertise

Multimodal Large Language Models

2022 – Present

Large Language Models

2020 – Present

Natural Language Processing

2017 – Present

Publications

GLOV: Guided Large Language Models as Implicit Optimizers for Vision Language Models
Muhammad Jehanzeb Mirza, Mengjie Zhao, Zhuoyuan Mao, Sivan Doveh, Wei Lin, Paul Gavrikov, Michael Dorkenwald, Shiqi Yang, Saurav Jha, Hiromi Wakaki, Yuki Mitsufuji, Horst Possegger, Rogerio Feris, Leonid Karlinsky, James R. Glass
- Accepted by TMLR
- Readers: Everyone
VinaBench: Benchmark for Faithful and Consistent Visual Narratives
Silin Gao, Sheryl Mathew, Li Mi, Sepideh Mamooler, Mengjie Zhao, Hiromi Wakaki, Yuki Mitsufuji, Syrielle Montariol, Antoine Bosselut
- CoRR 2025
- Readers: Everyone
Cross-Modal Learning for Music-to-Music-Video Description Generation
Zhuoyuan Mao, Mengjie Zhao, Qiyu Wu, Zhi Zhong, Wei-Hsiang Liao, Hiromi Wakaki, Yuki Mitsufuji
- CoRR 2025
- Readers: Everyone
DeepResonance: Enhancing Multimodal Music Understanding via Music-centric Multi-way Instruction Tuning
Zhuoyuan Mao, Mengjie Zhao, Qiyu Wu, Hiromi Wakaki, Yuki Mitsufuji
- CoRR 2025
- Readers: Everyone
Mining your own secrets: Diffusion Classifier Scores for Continual Personalization of Text-to-Image Diffusion Models
Saurav Jha, Shiqi Yang, Masato Ishii, Mengjie Zhao, Christian Simon, Muhammad Jehanzeb Mirza, Dong Gong, Lina Yao, Shusuke Takahashi, Yuki Mitsufuji
- ICLR 2025
- Readers: Everyone
Unveiling Code Pre-Trained Models: Investigating Syntax and Semantics Capacities
Wei Ma, Shangqing Liu, Mengjie Zhao, Xiaofei Xie, Wenhan Wang, Qiang Hu, Jie Zhang, Yang Liu
- ACM Transactions on Software Engineering and Methodology
- Readers: Everyone
On the Language Encoder of Contrastive Cross-modal Models
Mengjie Zhao, Junya Ono, Zhi Zhong, Chieh-Hsin Lai, Yuhta Takida, Naoki Murata, Wei-Hsiang Liao, Takashi Shibuya, Hiromi Wakaki, Yuki Mitsufuji
- Findings of the Association for Computational Linguistics: ACL 2024
- Readers: Everyone
DiffuCOMET: Contextual Commonsense Knowledge Diffusion
Silin Gao, Mete Ismayilzada, Mengjie Zhao, Hiromi Wakaki, Yuki Mitsufuji, Antoine Bosselut
- Annual Meeting of the Association for Computational Linguistics (ACL)
- Readers: Everyone
Few-shot Dialogue Strategy Learning for Motivational Interviewing via Inductive Reasoning
Zhouhang Xie, Bodhisattwa Prasad Majumder, Mengjie Zhao, Yoshinori Maeda, Keiichi Yamada, Hiromi Wakaki, Julian McAuley
- Findings of the Association for Computational Linguistics: ACL 2024
- Readers: Everyone
ComperDial: Commonsense Persona-grounded Dialogue Dataset and Benchmark
Hiromi Wakaki, Yuki Mitsufuji, Yoshinori Maeda, Yukiko Nishimura, Silin Gao, Mengjie Zhao, Keiichi Yamada, Antoine Bosselut
- OpenReview Archive Direct Upload
- Readers: Everyone

View all 59 publications

Co-Authors

View all 93 co-authors