Omer Levy

Research Scientist, Facebook

Joined

October 2016

Names

Omer Levy (Preferred)

Emails

****@gmail.com (Confirmed)

****@cs.biu.ac.il (Confirmed)

****@cs.washington.edu (Confirmed)

****@fb.com (Confirmed)

****@tauex.tau.ac.il (Confirmed)

Personal Links

Career & Education History

Research Scientist

Facebook (fb.com)

2018 – Present

Senior Lecturer

Tel Aviv University (tau.ac.il)

2020 – 2024

Postdoc

University of Washington (washington.edu)

2016 – 2018

PhD student

Bar-Ilan University (biu.ac.il)

2012 – 2016

Advisors, Relations & Conflicts

No relations added

Expertise

Natural Language Processing

Present

Publications

Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model
Chunting Zhou, LILI YU, Arun Babu, Kushal Tirumala, Michihiro Yasunaga, Leonid Shamis, Jacob Kahn, Xuezhe Ma, Luke Zettlemoyer, Omer Levy
- ICLR 2025 Oral
- Readers: Everyone
Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length
Xuezhe Ma, Xiaomeng Yang, Wenhan Xiong, Beidi Chen, LILI YU, Hao Zhang, Jonathan May, Luke Zettlemoyer, Omer Levy, Chunting Zhou
- NeurIPS 2024 poster
- Readers: Everyone
Self-Alignment with Instruction Backtranslation
Xian Li, Ping Yu, Chunting Zhou, Timo Schick, Omer Levy, Luke Zettlemoyer, Jason E Weston, Mike Lewis
- ICLR 2024 oral
- Readers: Everyone
The Temporal Structure of Language Processing in the Human Brain Corresponds to The Layered Hierarchy of Deep Language Models
Ariel Goldstein, Eric Ham, Mariano Schain, Samuel Nastase, Zaid Zada, Avigail Dabush, Bobbi Aubrey, Harshvardhan Gazula, Amir Feder, Werner K Doyle, Sasha Devore, Patricia Dugan, Daniel Friedman, Roi Reichart, Michael Brenner, Avinatan Hassidim, Orrin Devinsky, Adeen Flinker, Omer Levy, Uri Hasson
- Submitted to ICLR 2024
- Readers: Everyone
ZeroSCROLLS: A Zero-Shot Benchmark for Long Text Understanding
Uri Shaham, Maor Ivgi, Avia Efrat, Jonathan Berant, Omer Levy
- EMNLP 2023 Findings
- Readers: Everyone
LIMA: Less Is More for Alignment
Chunting Zhou, Pengfei Liu, Puxin Xu, Srini Iyer, Jiao Sun, Yuning Mao, Xuezhe Ma, Avia Efrat, Ping Yu, LILI YU, Susan Zhang, Gargi Ghosh, Mike Lewis, Luke Zettlemoyer, Omer Levy
- NeurIPS 2023 poster
- Readers: Everyone
Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generation
Yuval Kirstain, Adam Polyak, Uriel Singer, Shahbuland Matiana, Joe Penna, Omer Levy
- NeurIPS 2023 poster
- Readers: Everyone
Scaling Laws for Generative Mixed-Modal Language Models
Armen Aghajanyan, LILI YU, Alexis Conneau, Wei-Ning Hsu, Karen Hambardzumyan, Susan Zhang, Stephen Roller, Naman Goyal, Omer Levy, Luke Zettlemoyer
- ICML 2023 Poster
- Readers: Everyone
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R. Brown, Adam Santoro, Aditya Gupta, Adrià Garriga-Alonso, Agnieszka Kluska, Aitor Lewkowycz, Akshat Agarwal, Alethea Power, Alex Ray, Alex Warstadt, Alexander W. Kocurek, Ali Safaya, Ali Tazarv, Alice Xiang et al. (430 additional authors not shown)
- Accepted by TMLR
- Readers: Everyone
SpanBERT: Improving Pre-training by Representing and Predicting Spans
Mandar Joshi, Danqi Chen, Yinhan Liu, Daniel S Weld, Luke Zettlemoyer, Omer Levy
- 24 Jun 2021
- OpenReview Archive Direct Upload
- Readers: Everyone

View all 104 publications

Co-Authors

View all 591 co-authors