Nikhil J Joshi

Researcher, Research, Google

Joined

December 2022

Names

Nikhil J Joshi (Preferred)

Emails

****@gmail.com (Confirmed)

****@google.com (Confirmed)

Personal Links

Google Scholar

Career & Education History

Researcher

Research, Google (research.google.com)

2017 – Present

Postdoc

EPFL - EPF Lausanne (epfl.ch)

2013 – 2014

Postdoc

California Institute of Technology (caltech.edu)

2011 – 2013

PhD student

Tata Institute of Fundamental Research (tifr.res.in)

2004 – 2010

Advisors, Relations & Conflicts

No relations added

Expertise

Physics

Present

Machine Learning

Present

Robotics

2021 – Present

Publications

Vid2Robot: End-to-end Video-conditioned Policy Learning with Cross-Attention Transformers
Vidhi Jain, Maria Attarian, Nikhil J Joshi, Ayzaan Wahid, Danny Driess, Quan Vuong, Pannag R Sanketi, Pierre Sermanet, Stefan Welker, Christine Chan, Igor Gilitschenski, Yonatan Bisk, Debidatta Dwibedi
- Robotics: Science and Systems 2024, Delft, Netherlands
- Readers: Everyone
VADER: Visual Affordance Detection and Error Recovery for Multi Robot Human Collaboration
Anthony Gerald Francis, Michael Ahn, Montserrat Gonzalez Arenas, Matthew Bennice, Noah Brown, Christine Chan, Nikhil J Joshi, Tsang-Wei Edward Lee, sharath maddineni, Dorsa Sadigh, Pannag R Sanketi, Leila Takayama, Fei Xia
- Preprint
- Readers: Everyone
AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents
Michael Ahn, Debidatta Dwibedi, Chelsea Finn, Montserrat Gonzalez Arenas, Keerthana Gopalakrishnan, Karol Hausman, brian ichter, Alex Irpan, Nikhil J Joshi, Ryan Julian, Sean Kirmani, Isabel Leal, Tsang-Wei Edward Lee, Sergey Levine, Yao Lu, sharath maddineni, Kanishka Rao, Dorsa Sadigh, Pannag R Sanketi, Pierre Sermanet et al. (7 additional authors not shown)
- VLMNM 2024
- Readers: Everyone
Learning to Learn Faster from Human Feedback with Language Model Predictive Control
Jacky Liang, Fei Xia, Wenhao Yu, Andy Zeng, Montserrat Gonzalez Arenas, Maria Attarian, Maria Bauza Villalonga, Matthew Bennice, Alex Bewley, Adil Dostmohamed, Chuyuan Fu, Nimrod Gileadi, Marissa Giustina, Keerthana Gopalakrishnan, Leonard Hasenclever, Jan Humplik, Jasmine Hsu, Nikhil J Joshi, Ben Jyenis, J Chase Kew et al. (30 additional authors not shown)
- VLMNM 2024
- Readers: Everyone
Open X-Embodiment: Robotic Learning Datasets and RT-X Models
Quan Vuong, Sergey Levine, Homer Rich Walke, Karl Pertsch, Anikait Singh, Ria Doshi, Charles Xu, Jianlan Luo, Liam Tan, Dhruv Shah, Chelsea Finn, Max Du, Moo Jin Kim, Alexander Khazatsky, Jonathan Heewon Yang, Tony Z. Zhao, Ken Goldberg, Ryan Hoque, Lawrence Yunliang Chen, Simeon Adebola et al. (154 additional authors not shown)
- LangRob @ CoRL 2023 Poster
- Readers: Everyone
Open X-Embodiment: Robotic Learning Datasets and RT-X Models
Quan Vuong, Sergey Levine, Homer Rich Walke, Karl Pertsch, Anikait Singh, Ria Doshi, Charles Xu, Jianlan Luo, Liam Tan, Dhruv Shah, Chelsea Finn, Max Du, Moo Jin Kim, Alexander Khazatsky, Jonathan Heewon Yang, Tony Z. Zhao, Ken Goldberg, Ryan Hoque, Lawrence Yunliang Chen, Simeon Adebola et al. (154 additional authors not shown)
- CoRL 2023 Workshop TGR Oral
- Readers: Everyone
RoboVQA: Multimodal Long-Horizon Reasoning for Robotics
Pierre Sermanet, Tianli Ding, Jeffrey Zhao, Fei Xia, Debidatta Dwibedi, Keerthana Gopalakrishnan, Christine Chan, Gabriel Dulac-Arnold, sharath maddineni, Nikhil J Joshi, Pete Florence, Wei Han, Robert Baruch, Yao Lu, Suvir Mirchandani, Peng Xu, Pannag R Sanketi, Karol Hausman, Izhak Shafran, brian ichter et al. (1 additional authors not shown)
- LangRob @ CoRL 2023 Oral
- Readers: Everyone
AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents
Michael Ahn, Debidatta Dwibedi, Chelsea Finn, Montserrat Gonzalez Arenas, Keerthana Gopalakrishnan, Karol Hausman, brian ichter, Alex Irpan, Nikhil J Joshi, Ryan Julian, Sean Kirmani, Isabel Leal, Tsang-Wei Edward Lee, Sergey Levine, Yao Lu, Sharath Maddineni, Kanishka Rao, Dorsa Sadigh, Pannag R Sanketi, Pierre Sermanet et al. (7 additional authors not shown)
- Submitted to ICLR 2024
- Readers: Everyone
RoboVQA: Multimodal Long-Horizon Reasoningfor Robotics
Pierre Sermanet, Tianli Ding, Jeffrey Zhao, Fei Xia, Debidatta Dwibedi, Keerthana Gopalakrishnan, Christine Chan, Gabriel Dulac-Arnold, sharath maddineni, Nikhil Joshi, Pete Florence, Wei Han, Robert Baruch, Yao Lu, Suvir Mirchandani, Peng Xu, Pannag Sanketi, Karol Hausman, Izhak Shafran, brian ichter et al. (1 additional authors not shown)
- FMDM@NeurIPS2023
- Readers: Everyone
RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control
Brianna Zitkovich, Tianhe Yu, Sichun Xu, Peng Xu, Ted Xiao, Fei Xia, Jialin Wu, Paul Wohlhart, Stefan Welker, Ayzaan Wahid, Quan Vuong, Vincent Vanhoucke, Huong Tran, Radu Soricut, Anikait Singh, Jaspiar Singh, Pierre Sermanet, Pannag R Sanketi, Grecia Salazar, Michael S Ryoo et al. (34 additional authors not shown)
- Published: 30 Aug 2023, Last Modified: 15 Jan 2026
- CoRL 2023 Poster
- Readers: Everyone

Co-Authors

View all 228 co-authors