Ayush Jain

PhD student, Robotics Institute, CMU, Carnegie Mellon University

Joined

May 2021

Names

Ayush Jain (Preferred)

Emails

****@andrew.cmu.edu (Confirmed)

****@meta.com (Confirmed)

Personal Links

Homepage

Google Scholar

Career & Education History

PhD student

Robotics Institute, CMU, Carnegie Mellon University (andrew.cmu.edu)

2023 – Present

Researcher

Facebook (meta.com)

2025 – 2025

MS student

Robotics Institute, CMU, Carnegie Mellon University (andrew.cmu.edu)

2021 – 2023

Undergrad student

Computer Science, BITS Pilani, Pilani Campus (bits-pilani.ac.in)

2017 – 2021

Advisors, Relations & Conflicts

Coworker

Adam W Harley

2025 – Present

PhD Advisor

Katerina Fragkiadaki

2023 – Present

Coauthor

Katerina Fragkiadaki

2020 – 2023

Expertise

3D Computer Vision

Point Tracking

Language+Vision

Embodied AI

Robotics

2020 – Present

Publications

Training Active Vision Reasoners with Multi-Turn Reinforcement Learning
Yifan Liu, Gabriel Herbert Sarch, Ayush Jain, Naitik Khandelwal, Katerina Fragkiadaki
- Submitted to ICLR 2026
- Readers: Everyone
Grounded Reinforcement Learning for Visual Reasoning
Gabriel Herbert Sarch, Snigdha Saha, Naitik Khandelwal, Ayush Jain, Michael J. Tarr, Aviral Kumar, Katerina Fragkiadaki
- NeurIPS 2025 poster
- Readers: Everyone
LOCATE 3D: Real-World Object Localization via Self-Supervised Learning in 3D
Paul McVay, Sergio Arnaud, Ada Martin, Arjun Majumdar, Krishna Murthy Jatavallabhula, Phillip Thomas, Ruslan Partsey, Daniel Dugas, Abha Gejji, Alexander Sax, Vincent-Pierre Berges, Mikael Henaff, Ayush Jain, Ang Cao, Ishita Prasad, Mrinal Kalakrishnan, Michael Rabbat, Nicolas Ballas, Mido Assran, Oleksandr Maksymets et al. (2 additional authors not shown)
- ICML 2025 spotlightposter
- Readers: Everyone
From Thousands to Billions: 3D Visual Language Grounding via Render-Supervised Distillation from 2D VLMs
Ang Cao, Sergio Arnaud, Oleksandr Maksymets, Jianing Yang, Ayush Jain, Ada Martin, Vincent-Pierre Berges, Paul McVay, Ruslan Partsey, Aravind Rajeswaran, Franziska Meier, Justin Johnson, Jeong Joon Park, Alexander Sax
- ICML 2025 poster
- Readers: Everyone
Unifying 2D and 3D Vision-Language Understanding
Ayush Jain, Alexander Swerdlow, Yuzhou Wang, Sergio Arnaud, Ada Martin, Alexander Sax, Franziska Meier, Katerina Fragkiadaki
- ICML 2025 poster
- Readers: Everyone
RODIN: Injecting 2D Foundational Features to 3D Vision Language Understanding
Ayush Jain, Alexander Swerdlow, Yuzhou Wang, Alexander Sax, Franziska Meier, Katerina Fragkiadaki
- Submitted to ICLR 2025
- Readers: Everyone
Energy-based Models are Zero-Shot Planners for Compositional Scene Rearrangement
Nikolaos Gkanatsios, Ayush Jain, Zhou Xian, Yunchu Zhang, Christopher G Atkeson, Katerina Fragkiadaki
- CORR, CVPR 2024 Oral
- Readers: Everyone
Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous Driving and Zero-Shot Instruction Following
Brian Yang, Huangyuan Su, Nikolaos Gkanatsios, Tsung-Wei Ke, Ayush Jain, Jeff Schneider, Katerina Fragkiadaki
- CoRR 2024
- Readers: Everyone
ODIN: A Single Model for 2D and 3D Perception
Ayush Jain, Pushkal Katara, Nikolaos Gkanatsios, Adam W. Harley, Gabriel Sarch, Kriti Aggarwal, Vishrav Chaudhary, Katerina Fragkiadaki
- CoRR 2024
- Readers: Everyone
Energy-based Models are Zero-Shot Planners for Compositional Scene Rearrangement
Nikolaos Gkanatsios, Ayush Jain, Zhou Xian, Yunchu Zhang, Christopher G Atkeson, Katerina Fragkiadaki
- Published: 13 Jun 2023, Last Modified: 15 Jan 2026
- RSS-23 LTAMP Poster
- Readers: Everyone

View all 20 publications

Co-Authors

View all 135 co-authors