Bharat Venkitesh

Member of Technical Staff, Cohere

Joined

May 2021

Names

Bharat Venkitesh (Preferred)

Emails

****@gmail.com (Confirmed)

****@cohere.ai (Confirmed)

Personal Links

Google Scholar

DBLP

Career & Education History

Member of Technical Staff

Cohere (cohere.ai)

2021 – Present

Machine Learning Engineer

Cohere (cohere.ai)

2020 – 2021

Machine Learning Engineer

Huawei Technologies Ltd. (huawei.com)

2018 – 2020

MS student

University of Waterloo (uwaterloo.ca)

2016 – 2018

Undergrad student

Indian Institute of Technology Hyderabad (iith.ac.in)

2010 – 2014

Advisors, Relations & Conflicts

No relations added

Expertise

deep learning

nlp

model compression

2020 – Present

deep learning

speech recognition

nlp

2018 – 2020

Publications

Aya Vision: Advancing the Frontier of Multilingual Multimodality
Saurabh Dash, Yiyang Nan, John Dang, Arash Ahmadian, Shivalika Singh, Madeline Smith, Bharat Venkitesh, Vladyslav Shmyhlo, Viraat Aryabumi, Walter Beller-Morales, Jeremy Pekmez, Jason Ozuzu, Pierre Harvey Richemond, Acyr Locatelli, Nicholas Frosst, Phil Blunsom, Aidan Gomez, Ivan Zhang, Marzieh Fadaee, Manoj Govindassamy et al. (5 additional authors not shown)
- Submitted to ICLR 2026
- Readers: Everyone
Rope to Nope and Back Again: A New Hybrid Attention Strategy
Bowen Yang, Bharat Venkitesh, Dwaraknath Gnaneshwar, Hangyu Lin, David Cairuz, Phil Blunsom, Acyr Locatelli
- NeurIPS 2025 poster
- Readers: Everyone
Aya Vision: Advancing the Frontier of Multilingual Multimodality
Saurabh Dash, Yiyang Nan, John Dang, Arash Ahmadian, Shivalika Singh, Madeline Smith, Bharat Venkitesh, Vladyslav Shmyhlo, Viraat Aryabumi, Walter Beller-Morales, Jeremy Pekmez, Jason Ozuzu, Pierre Harvey Richemond, Acyr Locatelli, Nicholas Frosst, Phil Blunsom, Aidan Gomez, Ivan Zhang, Marzieh Fadaee, Manoj Govindassamy et al. (5 additional authors not shown)
- Submitted to NeurIPS 2025
- Readers: Everyone
BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts
Qizhen Zhang, Nikolas Gritsch, Dwaraknath Gnaneshwar, Simon Guo, David Cairuz, Bharat Venkitesh, Jakob Nicolaus Foerster, Phil Blunsom, Sebastian Ruder, Ahmet Üstün, Acyr Locatelli
- ES-FoMo-II 2024 Poster
- Readers: Everyone
BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts
Qizhen Zhang, Nikolas Gritsch, Dwaraknath Gnaneshwar, Simon Guo, David Cairuz, Bharat Venkitesh, Jakob Nicolaus Foerster, Phil Blunsom, Sebastian Ruder, Ahmet Üstün, Acyr Locatelli
- NeurIPS 2024 poster
- Readers: Everyone
SnapKV: LLM Knows What You are Looking for Before Generation
Yuhong Li, Yingbing Huang, Bowen Yang, Bharat Venkitesh, Acyr Locatelli, Hanchen Ye, Tianle Cai, Patrick Lewis, Deming Chen
- NeurIPS 2024 poster
- Readers: Everyone
Intriguing Properties of Quantization at Scale
Arash Ahmadian, Saurabh Dash, Hongyu Chen, Bharat Venkitesh, Zhen Stephen Gou, Phil Blunsom, Ahmet Üstün, Sara Hooker
- NeurIPS 2023 poster
- Readers: Everyone
Exploring Low Rank Training of Deep Neural Networks
Siddhartha Rao Kamalakara, Acyr Locatelli, Bharat Venkitesh, Jimmy Ba, Yarin Gal, Aidan N. Gomez
- Published: 01 Jan 2022, Last Modified: 17 May 2023
- CoRR 2022
- Readers: Everyone
Predicting Twitter Engagement With Deep Language Models
Maksims Volkovs, Zhaoyue Cheng, Mathieu Ravaut, Hojin Yang, Kevin Shen, Jin Peng Zhou, Anson Wong, Saba Zuberi, Ivan Zhang, Nick Frosst, Helen Ngo, Carol Chen, Bharat Venkitesh, Stephen Gou, Aidan N. Gomez
- 2020 (modified: 17 Jul 2021)
- RecSys Challenge 2020
- Readers: Everyone
Fully Quantizing a Simplified Transformer for End-to-end Speech Recognition
Alex Bie, Bharat Venkitesh, Joao Monteiro, Md. Akmal Haidar, Mehdi Rezagholizadeh
- Published: 01 Jan 2019, Last Modified: 17 May 2023
- CoRR 2019
- Readers: Everyone

View all 12 publications

Co-Authors

View all 64 co-authors