Ruochen Xu

Principal Researcher, Om AI

Joined

April 2020

Names

Ruochen Xu (Preferred)

Emails

****@cs.cmu.edu (Confirmed)

****@gmail.com (Confirmed)

****@microsoft.com (Confirmed)

****@hzlh.com (Confirmed)

Personal Links

Career & Education History

Principal Researcher

Om AI (hzlh.com)

2024 – Present

Researcher

Research, Microsoft (research.microsoft.com)

2019 – 2024

PhD student

Language Technologies Institute, Carnegie Mellon University (cmu.edu)

2014 – 2019

Advisors, Relations & Conflicts

PhD Advisor

Yiming Yang

2014 – 2019

Expertise

Multimodality

Present

Natural Language Processing

2014 – Present

Publications

The Self-Improvement Paradox: Can Language Models Bootstrap Reasoning Capabilities without External Scaffolding?
Yutao Sun, Mingshuai Chen, Tiancheng Zhao, Ruochen Xu, Zilun Zhang, Jianwei Yin
- CoRR 2025
- Readers: Everyone
ERBench: An Entity-Relationship based Automatically Verifiable Hallucination Benchmark for Large Language Models
Jio Oh, Soyeon Kim, Junseok Seo, Jindong Wang, Ruochen Xu, Xing Xie, Steven Euijong Whang
- NeurIPS 2024 Track Datasets and Benchmarks Spotlight
- Readers: Everyone
Not All Tokens Are What You Need for Pretraining
Zhenghao Lin, Zhibin Gou, Yeyun Gong, Xiao Liu, yelong shen, Ruochen Xu, Chen Lin, Yujiu Yang, Jian Jiao, Nan Duan, Weizhu Chen
- NeurIPS 2024 oral
- Readers: Everyone
Dynamic Evaluation of Large Language Models by Meta Probing Agents
Kaijie Zhu, Jindong Wang, Qinlin Zhao, Ruochen Xu, Xing Xie
- ICML 2024 Poster
- Readers: Everyone
Supervised Knowledge Makes Large Language Models Better In-context Learners
Linyi Yang, Shuibai Zhang, Zhuohao Yu, Guangsheng Bao, Yidong Wang, Jindong Wang, Ruochen Xu, Wei Ye, Xing Xie, Weizhu Chen, Yue Zhang
- ICLR 2024
- Readers: Everyone
Language Models can be Deductive Solvers
Jiazhan Feng, Ruochen Xu, Junheng Hao, Hiteshi Sharma, Yelong Shen, Dongyan Zhao, Weizhu Chen
- NAACL-HLT (Findings) 2024
- Readers: Everyone
Rho-1: Not All Tokens Are What You Need
Zhenghao Lin, Zhibin Gou, Yeyun Gong, Xiao Liu, Yelong Shen, Ruochen Xu, Chen Lin, Yujiu Yang, Jian Jiao, Nan Duan, Weizhu Chen
- CoRR 2024
- Readers: Everyone
OmChat: A Recipe to Train Multimodal Language Models with Strong Long Context and Video Understanding
Tiancheng Zhao, Qianqian Zhang, Kyusong Lee, Peng Liu, Lu Zhang, Chunxin Fang, Jiajia Liao, Kelei Jiang, Yibo Ma, Ruochen Xu
- CoRR 2024
- Readers: Everyone
Preserving Knowledge in Large Language Model with Model-Agnostic Self-Decompression
Zilun Zhang, Yutao Sun, Tiancheng Zhao, Leigang Sha, Ruochen Xu, Kyusong Lee, Jianwei Yin
- CoRR 2024
- Readers: Everyone
ERBench: An Entity-Relationship based Automatically Verifiable Hallucination Benchmark for Large Language Models
Jio Oh, Soyeon Kim, Junseok Seo, Jindong Wang, Ruochen Xu, Xing Xie, Steven Euijong Whang
- CoRR 2024
- Readers: Everyone

View all 75 publications

Co-Authors

View all 140 co-authors