Shi Qiu

Undergrad student, School of Physics, Peking University

Joined

July 2019

Names

Shi Qiu (Preferred)

Emails

****@gmail.com (Confirmed)

****@stu.pku.edu.cn

****@qq.com

Personal Links

Homepage

Google Scholar

Career & Education History

Undergrad student

School of Physics, Peking University (stu.pku.edu.cn)

2022 – 2026

Intern

Department of Computer Science, Department of Computer Science, University of North Carolina at Chapel Hill (cs.unc.edu)

2024 – 2024

Advisors, Relations & Conflicts

Advisor

Dawn Song

2025 – Present

Advisor

Qing-Hong Cao

2025 – Present

Advisor

Ming-xing Luo

2025 – Present

Advisor

Hua Xing Zhu

2024 – Present

Advisor

Huaxiu Yao

2023 – Present

Advisor

Xiaojun Wan

2023 – 2024

Expertise

Agentic AI

2025 – Present

Multimodal Learning

2023 – Present

LLM Reasoning

2023 – Present

Publications

From EduVisBench to EduVisAgent: A Benchmark and Multi-Agent Framework for Reasoning-Driven Pedagogical Visualization
Haonian Ji, Shi Qiu, Siyang Xin, Siwei Han, Zhaorun Chen, Dake Zhang, Hongyi Wang, Huaxiu Yao
- MATH-AI 2025 Poster
- Readers: Everyone
From EduVisBench to EduVisAgent: A Benchmark and Multi-Agent Framework for Reasoning-Driven Pedagogical Visualization
Haonian Ji, Shi Qiu, Siyang Xin, Siwei Han, Zhaorun Chen, Dake Zhang, Hongyi Wang, Huaxiu Yao
- ICLR 2026 Poster
- Readers: Everyone
AgentXploit: End-to-End Red-Teaming for AI Agents Powdered by Multi-Agent Systems
Shi Qiu, Zhun Wang, Tianneng Shi, Zhaorun Chen, Wenbo Guo, Dawn Song
- ICLR 2026 Conference Withdrawn Submission
- Readers: Everyone
SuperGPQA: Scaling LLM Evaluation across 285 Graduate Disciplines
Xeron Du, Yifan Yao, Kaijing Ma, Bingli Wang, Tianyu Zheng, King Zhu, Minghao Liu, Yiming Liang, Xiaolong Jin, Zhenlin Wei, Chujie Zheng, Kaixin Deng, Shuyue Guo, Shian Jia, Sichao Jiang, Yiyan Liao, Rui Li, Qinrui Li, Sirun Li, Yizhi LI et al. (75 additional authors not shown)
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
MJ-Video: Benchmarking and Rewarding Video Generation with Fine-Grained Video Preference
Haibo Tong, Zhaoyang Wang, Zhaorun Chen, Haonian Ji, Shi Qiu, Siwei Han, Kexin Geng, Zhongkai Xue, Yiyang Zhou, Peng Xia, Mingyu Ding, Rafael Rafailov, Chelsea Finn, Huaxiu Yao
- NeurIPS 2025 spotlight
- Readers: Everyone
PHYBench: Holistic Evaluation of Physical Perception and Reasoning in Large Language Models
Shi Qiu, Shaoyang Guo, Zhuo-Yang Song, Yunbo Sun, Zeyu Cai, Jiashen Wei, Tianyu Luo, Yixuan Yin, Zhang Haoxu, Yi Hu, Chenyang Wang, Chencheng Tang, Haoling Chang, Qi Liu, Ziheng Zhou, Tianyu Zhang, Jingtian Zhang, Zhangyi Liu, Minghao Li, Yuku Zhang et al. (33 additional authors not shown)
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
MMIE: Massive Multimodal Interleaved Comprehension Benchmark for Large Vision-Language Models
Peng Xia, Siwei Han, Shi Qiu, Yiyang Zhou, Zhaoyang Wang, Wenhao Zheng, Zhaorun Chen, Chenhang Cui, Mingyu Ding, Linjie Li, Lijuan Wang, Huaxiu Yao
- AFM 2024 Poster
- Readers: Everyone
MMIE: Massive Multimodal Interleaved Comprehension Benchmark for Large Vision-Language Models
Peng Xia, Siwei Han, Shi Qiu, Yiyang Zhou, Zhaoyang Wang, Wenhao Zheng, Zhaorun Chen, Chenhang Cui, Mingyu Ding, Linjie Li, Lijuan Wang, Huaxiu Yao
- ICLR 2025 Oral
- Readers: Everyone

Co-Authors

View all 170 co-authors