Roman Novak

Research Scientist, Google Deepmind

Joined

October 2017

Names

Roman Novak (Preferred)

Emails

****@polytechnique.edu (Confirmed)

****@google.com (Confirmed)

****@gmail.com (Confirmed)

Personal Links

Career & Education History

Research Scientist

Google Deepmind (google.com)

2023 – Present

Research Scientist

Google Brain (google.com)

2016 – 2023

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

Training Language Models on the Knowledge Graph: Insights on Hallucinations and Their Detectability
Jiri Hron, Laura A Culp, Gamaleldin Fathy Elsayed, Rosanne Liu, Jasper Snoek, Simon Kornblith, Alex Rizkowsky, Isabelle Simpson, Jascha Sohl-Dickstein, Noah Fiedel, Aaron T Parisi, Alexander A Alemi, Azade Nova, Ben Adlam, Bernd Bohnet, Gaurav Mishra, Hanie Sedghi, Izzeddin Gur, Jaehoon Lee, John D Co-Reyes et al. (11 additional authors not shown)
- COLM
- Readers: Everyone
Scaling Exponents Across Parameterizations and Optimizers
Katie E Everett, Lechao Xiao, Mitchell Wortsman, Alexander A Alemi, Roman Novak, Peter J Liu, Izzeddin Gur, Jascha Sohl-Dickstein, Leslie Pack Kaelbling, Jaehoon Lee, Jeffrey Pennington
- ICML 2024 Poster
- Readers: Everyone
Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models
Avi Singh, John D Co-Reyes, Rishabh Agarwal, Ankesh Anand, Piyush Patil, Xavier Garcia, Peter J Liu, James Harrison, Jaehoon Lee, Kelvin Xu, Aaron T Parisi, Abhishek Kumar, Alexander A Alemi, Alex Rizkowsky, Azade Nova, Ben Adlam, Bernd Bohnet, Gamaleldin Fathy Elsayed, Hanie Sedghi, Igor Mordatch et al. (20 additional authors not shown)
- Accepted by TMLR
- Readers: Everyone
Small-scale proxies for large-scale Transformer training instabilities
Mitchell Wortsman, Peter J Liu, Lechao Xiao, Katie E Everett, Alexander A Alemi, Ben Adlam, John D Co-Reyes, Izzeddin Gur, Abhishek Kumar, Roman Novak, Jeffrey Pennington, Jascha Sohl-Dickstein, Kelvin Xu, Jaehoon Lee, Justin Gilmer, Simon Kornblith
- ICLR 2024 oral
- Readers: Everyone
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R. Brown, Adam Santoro, Aditya Gupta, Adrià Garriga-Alonso, Agnieszka Kluska, Aitor Lewkowycz, Akshat Agarwal, Alethea Power, Alex Ray, Alex Warstadt, Alexander W. Kocurek, Ali Safaya, Ali Tazarv, Alice Xiang et al. (430 additional authors not shown)
- Accepted by TMLR
- Readers: Everyone
Fast Neural Kernel Embeddings for General Activations
Insu Han, Amir Zandieh, Jaehoon Lee, Roman Novak, Lechao Xiao, Amin Karbasi
- Published: 31 Oct 2022, Last Modified: 08 Feb 2026
- NeurIPS 2022 Accept
- Readers: Everyone
Fast Finite Width Neural Tangent Kernel
Roman Novak, Jascha Sohl-Dickstein, Samuel Stern Schoenholz
- Published: 29 Jan 2022, Last Modified: 20 Apr 2025
- AABI 2022 Poster
- Readers: Everyone
Fast Finite Width Neural Tangent Kernel
Roman Novak, Jascha Sohl-Dickstein, Samuel Stern Schoenholz
- Published: 28 Jan 2022, Last Modified: 12 Oct 2025
- ICLR 2022 Submitted
- Readers: Everyone
Dataset Distillation with Infinitely Wide Convolutional Networks
Timothy Nguyen, Roman Novak, Lechao Xiao, Jaehoon Lee
- Published: 09 Nov 2021, Last Modified: 26 May 2025
- NeurIPS 2021 Poster
- Readers: Everyone
Dataset Distillation with Infinitely Wide Convolutional Networks
Timothy Nguyen, Roman Novak, Lechao Xiao, Jaehoon Lee
- Published: 09 Nov 2021, Last Modified: 26 May 2025
- NeurIPS 2021 Poster
- Readers: Everyone

View all 11 publications

Co-Authors

View all 490 co-authors