Ramesh Nallapati

Senior Principal Scientist, Amazon Web Services

Joined

July 2019

Names

Ramesh Nallapati

Emails

****@amazon.com (Confirmed)

Personal Links

DBLP

Career & Education History

Senior Principal Scientist

Amazon Web Services (amazon.com)

2022 – Present

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

Bifurcated Attention for Single-Context Large-Batch Sampling
Ben Athiwaratkun, Sujan Kumar Gonugondla, Sanjay Krishna Gouda, Haifeng Qian, Hantian Ding, Qing Sun, Jun Wang, Jiacheng Guo, Liangfu Chen, Parminder Bhatia, Ramesh Nallapati, Sudipta Sengupta, Bing Xiang
- ICML 2024 Poster
- Readers: Everyone
Exploring Continual Learning for Code Generation Models
Prateek Yadav, Qing Sun, Hantian Ding, Xiaopeng Li, Ming Tan, Xiaofei Ma, Parminder Bhatia, Ramesh Nallapati, Murali Krishna Ramanathan, Mohit Bansal, Bing Xiang
- 28 Sept 2023
- OpenReview Archive Direct Upload
- Readers: Everyone
Token Alignment via Character Matching for Subword Completion
Ben Athiwaratkun, Shiqi Wang, Mingyue Shang, YUCHEN TIAN, Zijian Wang, Sujan Kumar Gonugondla, Sanjay Krishna Gouda, Robert Kwiatkowski, Ramesh Nallapati, Bing Xiang
- Submitted to ICLR 2024
- Readers: Everyone
CODE REPRESENTATION LEARNING AT SCALE
Dejiao Zhang, Wasi Uddin Ahmad, Ming Tan, Hantian Ding, Ramesh Nallapati, Dan Roth, Xiaofei Ma, Bing Xiang
- ICLR 2024 poster
- Readers: Everyone
CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion
Yangruibo Ding, Zijian Wang, Wasi Uddin Ahmad, Hantian Ding, Ming Tan, Nihal Jain, Murali Krishna Ramanathan, Ramesh Nallapati, Parminder Bhatia, Dan Roth, Bing Xiang
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
On IO-Efficient Attention Mechanisms: Context-Aware Bifurcated Attention and the Generalized Multi-Group Attention
Ben Athiwaratkun, Sujan Kumar Gonugondla, Sanjay Krishna Gouda, Haifeng Qian, Hantian Ding, Qing Sun, Jun Wang, Liangfu Chen, Jiacheng Guo, Parminder Bhatia, Ramesh Nallapati, Sudipta Sengupta, Bing Xiang
- ES-FoMO 2023 Oral
- Readers: Everyone
ReCode: Robustness Evaluation of Code Generation Models
Shiqi Wang, Zheng Li, Haifeng Qian, Chenghao Yang, Zijian Wang, Mingyue Shang, Varun Kumar, Samson Tan, Baishakhi Ray, Parminder Bhatia, Ramesh Nallapati, Murali Krishna Ramanathan, Dan Roth, Bing Xiang
- 23 Jan 2023
- OpenReview Archive Direct Upload
- Readers: Everyone
CoCoMIC: Code Completion By Jointly Modeling In-file and Cross-file Context
Yangruibo Ding, Zijian Wang, Wasi Uddin Ahmad, Murali Krishna Ramanathan, Ramesh Nallapati, Parminder Bhatia, Dan Roth, Bing Xiang
- 23 Jan 2023 (modified: 23 Jan 2023)
- OpenReview Archive Direct Upload
- Readers: Everyone
DQ-BART: Efficient Sequence-to-Sequence Model via Joint Distillation and Quantization
Zheng Li, Zijian Wang, Ming Tan, Ramesh Nallapati, Parminder Bhatia, Andrew Arnold, Bing Xiang, Dan Roth
- 04 Oct 2022
- OpenReview Archive Direct Upload
- Readers: Everyone
ContraGen: Effective Contrastive Learning For Causal Language Model
Nihal Jain, Dejiao Zhang, Wasi Uddin Ahmad, Zijian Wang, Feng Nan, Xiaopeng Li, Ming Tan, Ramesh Nallapati, Baishakhi Ray, Parminder Bhatia, Xiaofei Ma, Bing Xiang
- Published: 01 Feb 2023, Last Modified: 14 Jan 2026
- Submitted to ICLR 2023
- Readers: Everyone

View all 24 publications

Co-Authors

View all 62 co-authors