Shivalika Singh

Researcher, Cohere Labs

Joined

December 2021

Names

Shivalika Singh (Preferred)

Emails

****@gmail.com (Confirmed)

****@cohere.com (Confirmed)

Personal Links

Career & Education History

Researcher

Cohere Labs (cohere.com)

2024 – Present

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

Kaleidoscope: In-language Exams for Massively Multilingual Vision Evaluation
Israfel Salazar, Manuel Fernández Burda, Shayekh Bin Islam, Arshia Soltani Moakhar, Shivalika Singh, Fabian Farestam, Angelika Romanou, Danylo Boiko, Dipika Khullar, Mike Zhang, Dominik Krzemiński, Jekaterina Novikova, Luísa Shimabucoro, Joseph Marvin Imperial, Rishabh Maheshwary, Sharad Duwal, Alfonso Amayuelas, Swati Rajwal, Jebish Purbey, Ahmed Ruby et al. (25 additional authors not shown)
- ICLR 2026 Poster
- Readers: Everyone
Aya Vision: Advancing the Frontier of Multilingual Multimodality
Saurabh Dash, Yiyang Nan, John Dang, Arash Ahmadian, Shivalika Singh, Madeline Smith, Bharat Venkitesh, Vladyslav Shmyhlo, Viraat Aryabumi, Walter Beller-Morales, Jeremy Pekmez, Jason Ozuzu, Pierre Harvey Richemond, Acyr Locatelli, Nicholas Frosst, Phil Blunsom, Aidan Gomez, Ivan Zhang, Marzieh Fadaee, Manoj Govindassamy et al. (5 additional authors not shown)
- Submitted to ICLR 2026
- Readers: Everyone
The Leaderboard Illusion
Shivalika Singh, Yiyang Nan, Alex Wang, Daniel D'souza, Sayash Kapoor, Ahmet Üstün, Sanmi Koyejo, Yuntian Deng, Shayne Longpre, Noah A. Smith, Beyza Ermis, Marzieh Fadaee, Sara Hooker
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
Aya Vision: Advancing the Frontier of Multilingual Multimodality
Saurabh Dash, Yiyang Nan, John Dang, Arash Ahmadian, Shivalika Singh, Madeline Smith, Bharat Venkitesh, Vladyslav Shmyhlo, Viraat Aryabumi, Walter Beller-Morales, Jeremy Pekmez, Jason Ozuzu, Pierre Harvey Richemond, Acyr Locatelli, Nicholas Frosst, Phil Blunsom, Aidan Gomez, Ivan Zhang, Marzieh Fadaee, Manoj Govindassamy et al. (5 additional authors not shown)
- Submitted to NeurIPS 2025
- Readers: Everyone
INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledge
Angelika Romanou, Negar Foroutan, Anna Sotnikova, Sree Harsha Nelaturu, Shivalika Singh, Rishabh Maheshwary, Micol Altomare, Zeming Chen, Mohamed A. Haggag, Snegha A, Alfonso Amayuelas, Azril Hafizi Amirudin, Danylo Boiko, Michael Chang, Jenny Chim, Gal Cohen, Aditya Kumar Dalmia, Abraham Diress, Sharad Duwal, Daniil Dzenhaliou et al. (37 additional authors not shown)
- ICLR 2025 Spotlight
- Readers: Everyone

Co-Authors

View all 107 co-authors