Alexander A Alemi

Researcher, Google Deepmind

Joined

November 2016

Names

Alexander A Alemi (Preferred)

Alexander A. Alemi

Alex A Alemi

Alex Alemi

Emails

****@google.com (Confirmed)

****@cornell.edu

****@gmail.com (Confirmed)

Personal Links

Homepage

Google Scholar

DBLP

Career & Education History

Researcher

Google Deepmind (google.com)

2024 – Present

Research Scientist

Google (google.com)

2018 – 2024

Software Engineer

Google (google.com)

2016 – 2018

Postdoc

Disney Research, Disney (disneyresearch.com)

2015 – 2015

PhD student

Cornell University (cornell.edu)

2009 – 2015

Advisors, Relations & Conflicts

No relations added

Expertise

Variational Information Bottleneck

Present

Deep Learning

Present

Information Theory

Present

Publications

PAC^m-Bayes: Narrowing the Empirical Risk Gap in the Misspecified Bayesian Regime
Joshua V. Dillon, Warren Richard Morningstar, Alexander A Alemi
- AISTATS
- Readers: Everyone
Training LLMs over Neurally Compressed Text
Brian Lester, Jaehoon Lee, Alexander A Alemi, Jeffrey Pennington, Adam Roberts, Jascha Sohl-Dickstein, Noah Constant
- Accepted by TMLR
- Readers: Everyone
Training Language Models on the Knowledge Graph: Insights on Hallucinations and Their Detectability
Jiri Hron, Laura A Culp, Gamaleldin Fathy Elsayed, Rosanne Liu, Jasper Snoek, Simon Kornblith, Alex Rizkowsky, Isabelle Simpson, Jascha Sohl-Dickstein, Noah Fiedel, Aaron T Parisi, Alexander A Alemi, Azade Nova, Ben Adlam, Bernd Bohnet, Gaurav Mishra, Hanie Sedghi, Izzeddin Gur, Jaehoon Lee, John D Co-Reyes et al. (11 additional authors not shown)
- COLM
- Readers: Everyone
Scaling Exponents Across Parameterizations and Optimizers
Katie E Everett, Lechao Xiao, Mitchell Wortsman, Alexander A Alemi, Roman Novak, Peter J Liu, Izzeddin Gur, Jascha Sohl-Dickstein, Leslie Pack Kaelbling, Jaehoon Lee, Jeffrey Pennington
- ICML 2024 Poster
- Readers: Everyone
Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models
Avi Singh, John D Co-Reyes, Rishabh Agarwal, Ankesh Anand, Piyush Patil, Xavier Garcia, Peter J Liu, James Harrison, Jaehoon Lee, Kelvin Xu, Aaron T Parisi, Abhishek Kumar, Alexander A Alemi, Alex Rizkowsky, Azade Nova, Ben Adlam, Bernd Bohnet, Gamaleldin Fathy Elsayed, Hanie Sedghi, Igor Mordatch et al. (20 additional authors not shown)
- Accepted by TMLR
- Readers: Everyone
Small-scale proxies for large-scale Transformer training instabilities
Mitchell Wortsman, Peter J Liu, Lechao Xiao, Katie E Everett, Alexander A Alemi, Ben Adlam, John D Co-Reyes, Izzeddin Gur, Abhishek Kumar, Roman Novak, Jeffrey Pennington, Jascha Sohl-Dickstein, Kelvin Xu, Jaehoon Lee, Justin Gilmer, Simon Kornblith
- ICLR 2024 oral
- Readers: Everyone
Speed Limits for Deep Learning
Inbar Seroussi, Alexander A Alemi, Moritz Helias, Zohar Ringel
- Submitted to ICLR 2024
- Readers: Everyone
Variational Prediction
Alexander A Alemi, Ben Poole
- Published: 20 Jun 2023, Last Modified: 18 Jul 2023
- AABI 2023
- Readers: Everyone
Trajectory ensembling for fine tuning - performance gains without modifying training
Louise Anderson-Conway, Vighnesh Birodkar, Saurabh Singh, Hossein Mobahi, Alexander A Alemi
- Published: 20 Oct 2022, Last Modified: 05 May 2023
- HITY Workshop NeurIPS 2022
- Readers: Everyone
Weighted Ensemble Self-Supervised Learning
Yangjun Ruan, Saurabh Singh, Warren Richard Morningstar, Alexander A Alemi, Sergey Ioffe, Ian Fischer, Joshua V. Dillon
- Published: 01 Feb 2023, Last Modified: 14 Jan 2026
- ICLR 2023 poster
- Readers: Everyone

View all 61 publications

Co-Authors

View all 124 co-authors