Wenhan Xiong

Researcher, Facebook

Joined

July 2019

Names

Wenhan Xiong

Emails

****@cs.ucsb.edu (Confirmed)

,

****@fb.com (Confirmed)

,

****@gmail.com (Confirmed)

Personal Links

Career & Education History

Researcher

Facebook (fb.com)

2021 – Present

PhD student

, UC Santa Barbara (cs.ucsb.edu)

2016 – 2021

Advisors, Relations & Conflicts

PhD Advisor

Present

Expertise

Natural Language Processing

2016 – Present

Publications

Law of the Weakest Link: Cross Capabilities of Large Language Models
Ming Zhong, Aston Zhang, Xuewei Wang, Rui Hou, Wenhan Xiong, Chenguang Zhu, Zhengxing Chen, Liang Tan, Chloe Bi, Mike Lewis, Sravya Popuri, Sharan Narang, Melanie Kambadur, Dhruv Mahajan, Sergey Edunov, Jiawei Han, Laurens van der Maaten
- ICLR 2025 Poster
- Readers: Everyone
Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length
Xuezhe Ma, Xiaomeng Yang, Wenhan Xiong, Beidi Chen, LILI YU, Hao Zhang, Jonathan May, Luke Zettlemoyer, Omer Levy, Chunting Zhou
- NeurIPS 2024 poster
- Readers: Everyone
FLAME : Factuality-Aware Alignment for Large Language Models
Sheng-Chieh Lin, Luyu Gao, Barlas Oguz, Wenhan Xiong, Jimmy Lin, Wen-tau Yih, Xilun Chen
- NeurIPS 2024 poster
- Readers: Everyone
Code Llama: Open Foundation Models for Code
Jingyu Liu, Baptiste Roziere, Jonas Gehring, Fabian Gloeckle, Sten Sootla, Itai Gat, Xiaoqing Tan, Yossi Adi, Tal Remez, Jérémy Rapin, Ivan Evtimov, Joanna Bitton, Manish Bhatt, Cristian Canton Ferrer, Wenhan Xiong, Alexandre Défossez, Jade Copet, Hugo Touvron, Louis Martin, Nicolas Usunier et al. (2 additional authors not shown)
- OpenReview Archive Direct Upload
- Readers: Everyone
Effective Long-Context Scaling of Foundation Models
Jingyu Liu, Wenhan Xiong, Igor Molybog, Hejia Zhang, Prajjwal Bhargava, Rui Hou, Louis Martin, Rashi Rungta, Karthik Abinav Sankararaman, Barlas Oguz, Madian Khabsa, Han Fang, Yashar Mehdad, Sharan Narang, Kshitiz Malik, Angela Fan, Shruti Bhosale, Sergey Edunov, Mike Lewis, Sinong Wang et al. (1 additional authors not shown)
- NAACL 2024
- Readers: Everyone
LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models
Chi Han, Qifan Wang, Wenhan Xiong, Yu Chen, Heng Ji, Sinong Wang
- ICLR 2024 Conference Withdrawn Submission
- Readers: Everyone
Sub-network Discovery and Soft-masking for Continual Learning of Mixed Tasks
Zixuan Ke, Bing Liu, Wenhan Xiong, Asli Celikyilmaz, Haoran Li
- EMNLP 2023 Findings
- Readers: Everyone
Text-guided 3D Human Generation from 2D Collections
Tsu-Jui Fu, Wenhan Xiong, Yixin Nie, Jingyu Liu, Barlas Oguz, William Yang Wang
- EMNLP 2023 Findings
- Readers: Everyone
Adapting Pretrained Text-to-Text Models for Long Text Sequences
Wenhan Xiong, Anchit Gupta, Shubham Toshniwal, Yashar Mehdad, Scott Yih
- EMNLP 2023 Findings
- Readers: Everyone
Coarse-to-Fine Contrastive Learning in Image-Text-Graph Space for Improved Vision-Language Compositionality
Harman Singh, Pengchuan Zhang, Qifan Wang, Mengjiao Wang, Wenhan Xiong, Jingfei Du, Yu Chen
- EMNLP 2023 Main
- Readers: Everyone

View all 21 publications

Co-Authors

View all 113 co-authors