Samuel Stern Schoenholz

Research Scientist, Google

Joined

November 2016

Names

Samuel Stern Schoenholz (Preferred)

Samuel S. Schoenholz

Emails

****@google.com (Confirmed)

****@gmail.com

Personal Links

Homepage

Google Scholar

DBLP

Career & Education History

Research Scientist

Google (google.com)

2017 – Present

Brain Resident

Google (google.com)

2016 – 2017

Postdoc

Harvard University (harvard.edu)

2015 – 2016

PhD student

University of Pennsylvania (upenn.edu)

2010 – 2015

Undergrad student

Swarthmore College (swarthmore.edu)

2006 – 2010

Advisors, Relations & Conflicts

No relations added

Expertise

Deep Learning

2015 – Present

Statistical Physics

2006 – Present

Kernel Methods

2012 – 2016

Publications

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R. Brown, Adam Santoro, Aditya Gupta, Adrià Garriga-Alonso, Agnieszka Kluska, Aitor Lewkowycz, Akshat Agarwal, Alethea Power, Alex Ray, Alex Warstadt, Alexander W. Kocurek, Ali Safaya, Ali Tazarv, Alice Xiang et al. (430 additional authors not shown)
- Accepted by TMLR
- Readers: Everyone
Temperature check: theory and practice for training models with softmax-cross-entropy losses
Atish Agarwala, Samuel Stern Schoenholz, Jeffrey Pennington, Yann Dauphin
- Accepted by TMLR
- Readers: Everyone
Fast Finite Width Neural Tangent Kernel
Roman Novak, Jascha Sohl-Dickstein, Samuel Stern Schoenholz
- Published: 29 Jan 2022, Last Modified: 20 Apr 2025
- AABI 2022 Poster
- Readers: Everyone
Fast Finite Width Neural Tangent Kernel
Roman Novak, Jascha Sohl-Dickstein, Samuel Stern Schoenholz
- Published: 28 Jan 2022, Last Modified: 12 Oct 2025
- ICLR 2022 Submitted
- Readers: Everyone
Finite Versus Infinite Neural Networks: an Empirical Study
Jaehoon Lee, Samuel Stern Schoenholz, Jeffrey Pennington, Ben Adlam, Lechao Xiao, Roman Novak, Jascha Sohl-Dickstein
- 13 May 2021 (modified: 13 May 2021)
- OpenReview Archive Direct Upload
- Readers: Everyone
Whitening and second order optimization both destroy information about the dataset, and can make generalization impossible
Neha S. Wadia, Daniel Duckworth, Samuel Stern Schoenholz, Ethan Dyer, Jascha Sohl-Dickstein
- 28 Sept 2020 (modified: 05 May 2023)
- ICLR 2021 Conference Blind Submission
- Readers: Everyone
Temperature check: theory and practice for training models with softmax-cross-entropy losses
Atish Agarwala, Samuel Stern Schoenholz, Jeffrey Pennington, Yann Dauphin
- 28 Sept 2020 (modified: 05 May 2023)
- ICLR 2021 Conference Blind Submission
- Readers: Everyone
Slice, Dice, and Optimize: Measuring the Dimension of Neural Network Class Manifolds
Stanislav Fort, Ekin Dogus Cubuk, Surya Ganguli, Samuel Stern Schoenholz
- 28 Sept 2020 (modified: 05 May 2023)
- ICLR 2021 Conference Blind Submission
- Readers: Everyone
Dynamical Isometry and a Mean Field Theory of CNNs: How to Train 10, 000-Layer Vanilla Convolutional Neural Networks
Lechao Xiao, Yasaman Bahri, Jascha Sohl-Dickstein, Samuel S. Schoenholz, Jeffrey Pennington
- 2018 (modified: 11 Nov 2022)
- ICML 2018
- Readers: Everyone
Dynamical Isometry and a Mean Field Theory of RNNs: Gating Enables Signal Propagation in Recurrent Neural Networks
Minmin Chen, Jeffrey Pennington, Samuel S. Schoenholz
- 2018 (modified: 11 Nov 2022)
- ICML 2018
- Readers: Everyone

View all 13 publications

Co-Authors

View all 464 co-authors