Quentin Gregory Anthony

Principal Researcher, Model Training, Zyphra Technologies

Principal Researcher, HPC, EleutherAI

Joined

February 2022

Names

Quentin Gregory Anthony (Preferred)

Emails

****@gmail.com (Confirmed)

****@buckeyemail.osu.edu (Confirmed)

****@osu.edu (Confirmed)

****@zyphra.com (Confirmed)

****@eleuther.ai (Confirmed)

Personal Links

Homepage

Google Scholar

ORCID

Career & Education History

Principal Researcher

Model Training, Zyphra Technologies (zyphra.com)

2023 – Present

Principal Researcher

HPC, EleutherAI (eleuther.ai)

2021 – Present

PhD student

Computer Science and Engineering, Ohio State University, Columbus (osu.edu)

2019 – 2025

Advisors, Relations & Conflicts

PhD Advisor

Dhabaleswar K. Panda

2019 – 2025

Expertise

Artificial intelligence

2019 – Present

Deep learning

2019 – Present

Distributed systems

2019 – Present

Publications

Deep Ignorance: Filtering Pretraining Data Builds Tamper-Resistant Safeguards into Open-Weight LLMs
Kyle O'Brien, Stephen Casper, Quentin Gregory Anthony, Tomek Korbak, Robert Kirk, Xander Davies, Ishan Mishra, Geoffrey Irving, Yarin Gal, Stella Biderman
- ICLR 2026 Poster
- Readers: Everyone
Deep Ignorance: Filtering Pretraining Data Builds Tamper-Resistant Safeguards into Open-Weight LLMs
Kyle O'Brien, Stephen Casper, Quentin Gregory Anthony, Tomek Korbak, Robert Kirk, Xander Davies, Ishan Mishra, Geoffrey Irving, Yarin Gal, Stella Biderman
- BioSafe GenAI 2025 Oral
- Readers: Everyone
PyLO: Towards Accessible Learned Optimizers in Pytorch
Paul Janson, Benjamin Thérien, Quentin Gregory Anthony, Xiaolong Huang, Abhinav Moudgil, Eugene Belilovsky
- CODEML@ICML25
- Readers: Everyone
Robin: a Suite of Multi-Scale Vision-Language Models and the CHIRP Evaluation Benchmark
Alexis Roger, Daniel Z Kaplan, Prateek Humane, Kshitij Gupta, Qi Sun, George Adamopoulos, Jonathan Siu Chi Lim, Quentin Gregory Anthony, Edwin Fennell, Irina Rish
- ICLR 2025 Conference Withdrawn Submission
- Readers: Everyone
Tree Attention: Topology-Aware Decoding for Long-Context Attention
Jonathan Pilault, Vasudev Shyam, Emily Shepperd, Quentin Gregory Anthony, Beren Millidge
- Submitted to ICLR 2025
- Readers: Everyone
Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence
Bo Peng, Daniel Goldstein, Quentin Gregory Anthony, Alon Albalak, Eric Alcaide, Stella Biderman, Eugene Cheah, Xingjian Du, Teddy Ferdinan, Haowen Hou, Przemyslaw Kazienko, Kranthi Kiran GV, Jan Kocon, Bartłomiej Koptyra, Satyapriya Krishna, Ronald McClelland Jr., Niklas Muennighoff, Fares Obeid, Atsushi Saito, Guangyu Song et al. (8 additional authors not shown)
- OpenReview Archive Direct Upload
- Readers: Everyone
Rwkv: Reinventing rnns for the transformer era
Bo Peng, Eric Alcaide, Quentin Gregory Anthony, Alon Albalak, Samuel Arcadinho, Stella Biderman, Huanqi Cao, Xin Cheng, Michael Chungyoun, Matteo Grella, Kranthi Kiran GV, Xuzheng He, Haowen Hou, Jiaju Lin, Przemyslaw Kazienko, Jan Kocon, Jiaming Kong, Bartłomiej Koptyra, Hayden Lau, Krishna Sri Ipsit Mantri et al. (14 additional authors not shown)
- OpenReview Archive Direct Upload
- Readers: Everyone
RedPajama: an Open Dataset for Training Large Language Models
Maurice Weber, Daniel Y Fu, Quentin Gregory Anthony, Yonatan Oren, Shane Adams, Anton Alexandrov, Xiaozhong Lyu, Huu Nguyen, Xiaozhe Yao, Virginia Adams, Ben Athiwaratkun, Rahul Chalamala, Kezhen Chen, Max Ryabinin, Tri Dao, Percy Liang, Christopher Re, Irina Rish, Ce Zhang
- NeurIPS 2024 Track Datasets and Benchmarks Spotlight
- Readers: Everyone
Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence
Bo Peng, Daniel Goldstein, Quentin Gregory Anthony, Alon Albalak, Eric Alcaide, Stella Biderman, Eugene Cheah, Teddy Ferdinan, Kranthi Kiran GV, Haowen Hou, Satyapriya Krishna, Ronald McClelland Jr., Niklas Muennighoff, Fares Obeid, Atsushi Saito, Guangyu Song, Haoqin Tu, Ruichong Zhang, Bingchen Zhao, Qihang Zhao et al. (2 additional authors not shown)
- COLM
- Readers: Everyone
Simple and Scalable Strategies to Continually Pre-train Large Language Models
Adam Ibrahim, Benjamin Thérien, Kshitij Gupta, Mats Leon Richter, Quentin Gregory Anthony, Eugene Belilovsky, Timothée Lesort, Irina Rish
- Accepted by TMLR
- Readers: Everyone

View all 16 publications

Co-Authors

View all 118 co-authors