Vaishaal Shankar

Researcher, Apple

Joined

May 2019

Names

Vaishaal Shankar (Preferred)

vaishaal naanny shankar

Vaishaal Naanny Shankar

Emails

****@berkeley.edu (Confirmed)

****@gmail.com (Confirmed)

****@apple.com (Confirmed)

Personal Links

Homepage

DBLP

Career & Education History

Researcher

Apple (apple.com)

2022 – Present

PhD student

University of California Berkeley (berkeley.edu)

2015 – 2020

Advisors, Relations & Conflicts

No relations added

Expertise

Machine Learning

robustness

multimodal

kernels

Present

Publications

OpenThoughts: Data Recipes for Reasoning Models
Etash Kumar Guha, Ryan Marten, Sedrick Keh, Negin Raoof, Georgios Smyrnis, Hritik Bansal, Marianna Nezhurina, Jean Mercat, Trung Vu, Zayne Rea Sprague, Ashima Suvarna, Benjamin Feuer, Leon Liangyu Chen, Zaid Khan, Eric Frankel, Sachin Grover, Caroline Choi, Niklas Muennighoff, Shiye Su, Wanjia Zhao et al. (31 additional authors not shown)
- ICLR 2026 Oral
- Readers: Everyone
OpenThoughts: Data Recipes for Reasoning Models
Etash Kumar Guha, Ryan Marten, Sedrick Keh, Negin Raoof, Georgios Smyrnis, Hritik Bansal, Marianna Nezhurina, Jean Mercat, Trung Vu, Zayne Rea Sprague, Ashima Suvarna, Benjamin Feuer, Leon Liangyu Chen, Zaid Khan, Eric Frankel, Sachin Grover, Caroline Choi, Niklas Muennighoff, Shiye Su, Wanjia Zhao et al. (30 additional authors not shown)
- FoRLM 2025
- Readers: Everyone
Datasets, Documents, and Repetitions: The Practicalities of Unequal Data Quality
Alex Fang, Hadi Pouransari, Matt Jordan, Alexander T Toshev, Vaishaal Shankar, Ludwig Schmidt, Tom Gunter
- NeurIPS 2025 poster
- Readers: Everyone
MobileCLIP2: Improving Multi-Modal Reinforced Training
Fartash Faghri, Pavan Kumar Anasosalu Vasu, Cem Koc, Vaishaal Shankar, Alexander T Toshev, Oncel Tuzel, Hadi Pouransari
- Accepted by TMLR
- Readers: Everyone
TiC-LM: A Multi-Year Benchmark for Continual Pretraining of Language Models
Jeffrey Li, Mohammadreza Armandpour, Seyed Iman Mirzadeh, Sachin Mehta, Vaishaal Shankar, Raviteja Vemulapalli, Samy Bengio, Oncel Tuzel, Mehrdad Farajtabar, Hadi Pouransari, Fartash Faghri
- Submitted to ICLR 2025
- Readers: Everyone
Language models scale reliably with over-training and on downstream tasks
Samir Yitzhak Gadre, Georgios Smyrnis, Vaishaal Shankar, Suchin Gururangan, Mitchell Wortsman, Rulin Shao, Jean Mercat, Alex Fang, Jeffrey Li, Sedrick Keh, Rui Xin, Marianna Nezhurina, Igor Vasiljevic, Luca Soldaini, Jenia Jitsev, Alex Dimakis, Gabriel Ilharco, Pang Wei Koh, Shuran Song, Thomas Kollar et al. (5 additional authors not shown)
- ICLR 2025 Poster
- Readers: Everyone
TiC-LM: A Multi-Year Benchmark for Continual Pretraining of Language Models
Jeffrey Li, Mohammadreza Armandpour, Seyed Iman Mirzadeh, Sachin Mehta, Vaishaal Shankar, Raviteja Vemulapalli, Oncel Tuzel, Mehrdad Farajtabar, Hadi Pouransari, Fartash Faghri
- Continual FoMo Oral
- Readers: Everyone
DataComp-LM: In search of the next generation of training sets for language models
Jeffrey Li, Alex Fang, Georgios Smyrnis, Maor Ivgi, Matt Jordan, Samir Yitzhak Gadre, Hritik Bansal, Etash Kumar Guha, Sedrick Keh, Kushal Arora, Saurabh Garg, Rui Xin, Niklas Muennighoff, Reinhard Heckel, Jean Mercat, Mayee F Chen, Suchin Gururangan, Mitchell Wortsman, Alon Albalak, Yonatan Bitton et al. (39 additional authors not shown)
- NeurIPS 2024 Track Datasets and Benchmarks Poster
- Readers: Everyone
Dataset Decomposition: Faster LLM Training with Variable Sequence Length Curriculum
Hadi Pouransari, Chun-Liang Li, Jen-Hao Rick Chang, Pavan Kumar Anasosalu Vasu, Cem Koc, Vaishaal Shankar, Oncel Tuzel
- NeurIPS 2024 poster
- Readers: Everyone
Interpreting CLIP: Insights on the Robustness to ImageNet Distribution Shifts
Jonathan Crabbé, Pau Rodriguez, Vaishaal Shankar, Luca Zappella, Arno Blaas
- Accepted by TMLR
- Readers: Everyone

View all 25 publications

Co-Authors

View all 138 co-authors