NeurIPS 2023 Workshop FMDM Submissions

GPT-Driver: Learning to Drive with GPT
Jiageng Mao, Yuxi Qian, Junjie Ye, Hang Zhao, Yue Wang
- Published: 07 Nov 2023, Last Modified: 05 Dec 2023
- FMDM@NeurIPS2023
- Readers: Everyone
Benchmarking Large Language Models as AI Research Agents
Qian Huang, Jian Vora, Percy Liang, Jure Leskovec
- Published: 07 Nov 2023, Last Modified: 17 Nov 2023
- FMDM@NeurIPS2023
- Readers: Everyone
Voyager: An Open-Ended Embodied Agent with Large Language Models
Guanzhi Wang, Yuqi Xie, Yunfan Jiang, Ajay Mandlekar, Chaowei Xiao, Yuke Zhu, Linxi Fan, Anima Anandkumar
- Published: 07 Nov 2023, Last Modified: 21 Nov 2023
- FMDM@NeurIPS2023
- Readers: Everyone
Reason for Future, Act for Now: A Principled Architecture for Autonomous LLM Agents
Zhihan Liu, Hao Hu, Shenao Zhang, Hongyi Guo, Shuqi Ke, Boyi Liu, Zhaoran Wang
- Published: 07 Nov 2023, Last Modified: 30 Nov 2023
- FMDM@NeurIPS2023
- Readers: Everyone
Synapse: Trajectory-as-Exemplar Prompting with Memory for Computer Control
Longtao Zheng, Rundong Wang, Xinrun Wang, Bo An
- Published: 07 Nov 2023, Last Modified: 01 Dec 2023
- FMDM@NeurIPS2023
- Readers: Everyone
D$^3$Fields: Dynamic 3D Descriptor Fields for Zero-Shot Generalizable Robotic Manipulation
Yixuan Wang, Zhuoran Li, Mingtong Zhang, Katherine Rose Driggs-Campbell, Jiajun Wu, Li Fei-Fei, Yunzhu Li
- Published: 07 Nov 2023, Last Modified: 07 Dec 2023
- FMDM@NeurIPS2023
- Readers: Everyone
Pairwise Proximal Policy Optimization: Harnessing Relative Feedback for LLM Alignment
Tianhao Wu, Banghua Zhu, Ruoyu Zhang, Zhaojin Wen, Kannan Ramchandran, Jiantao Jiao
- Published: 07 Nov 2023, Last Modified: 08 Nov 2023
- FMDM@NeurIPS2023
- Readers: Everyone
WebArena: A Realistic Web Environment for Building Autonomous Agents
Shuyan Zhou, Frank F. Xu, Hao Zhu, Xuhui Zhou, Robert Lo, Abishek Sridhar, Xianyi Cheng, Tianyue Ou, Yonatan Bisk, Daniel Fried, Uri Alon, Graham Neubig
- Published: 07 Nov 2023, Last Modified: 28 Nov 2023
- FMDM@NeurIPS2023
- Readers: Everyone
AdaPlanner: Adaptive Planning from Feedback with Language Models
Haotian Sun, Yuchen Zhuang, Lingkai Kong, Bo Dai, Chao Zhang
- Published: 07 Nov 2023, Last Modified: 04 Dec 2023
- FMDM@NeurIPS2023
- Readers: Everyone
Creative Robot Tool Use with Large Language Models
Mengdi Xu, Wenhao Yu, Peide Huang, Shiqi Liu, Xilun Zhang, Yaru Niu, Tingnan Zhang, Fei Xia, Jie Tan, Ding Zhao
- Published: 07 Nov 2023, Last Modified: 11 Dec 2023
- FMDM@NeurIPS2023
- Readers: Everyone
Agnostic Architecture for Heterogeneous Multi-Environment Reinforcement Learning
Kukjin Kim, Changhee Joo
- Published: 07 Nov 2023, Last Modified: 04 Dec 2023
- FMDM@NeurIPS2023
- Readers: Everyone
Large Language Models as Commonsense Knowledge for Large-Scale Task Planning
Zirui Zhao, Wee Sun Lee, David Hsu
- Published: 07 Nov 2023, Last Modified: 21 Nov 2023
- FMDM@NeurIPS2023
- Readers: Everyone
Towards End-to-End Embodied Decision Making with Multi-modal Large Language Model: Explorations with GPT4-Vision and Beyond
Liang Chen, Yichi Zhang, Shuhuai Ren, Haozhe Zhao, Zefan Cai, Yuchi Wang, Tianyu Liu, Baobao Chang
- Published: 07 Nov 2023, Last Modified: 21 Nov 2023
- FMDM@NeurIPS2023
- Readers: Everyone
LLMs-Augmented Contextual Bandit
Ali Baheri, Cecilia Alm
- Published: 07 Nov 2023, Last Modified: 05 Dec 2023
- FMDM@NeurIPS2023
- Readers: Everyone
Language Model Agents Suffer from Compositional Generalization in Web Automation
Hiroki Furuta, Yutaka Matsuo, Aleksandra Faust, Izzeddin Gur
- Published: 07 Nov 2023, Last Modified: 30 Nov 2023
- FMDM@NeurIPS2023
- Readers: Everyone
Unleashing the Power of Pre-trained Language Models for Offline Reinforcement Learning
Ruizhe Shi, Yuyao Liu, Yanjie Ze, Simon Shaolei Du, Huazhe Xu
- Published: 07 Nov 2023, Last Modified: 27 Nov 2023
- FMDM@NeurIPS2023
- Readers: Everyone
Strategic Reasoning with Language Models
Kanishk Gandhi, Dorsa Sadigh, Noah Goodman
- Published: 07 Nov 2023, Last Modified: 17 Nov 2023
- FMDM@NeurIPS2023
- Readers: Everyone
TAIL: Task-specific Adapters for Imitation Learning with Large Pretrained Models
Zuxin Liu, Jesse Zhang, Kavosh Asadi, Yao Liu, Ding Zhao, Shoham Sabach, Rasool Fakoor
- Published: 07 Nov 2023, Last Modified: 17 Nov 2023
- FMDM@NeurIPS2023
- Readers: Everyone
Free from Bellman Completeness: Trajectory Stitching via Model-based Return-conditioned Supervised Learning
Zhaoyi Zhou, Chuning Zhu, Runlong Zhou, Qiwen Cui, Abhishek Gupta, Simon Shaolei Du
- Published: 07 Nov 2023, Last Modified: 22 Nov 2023
- FMDM@NeurIPS2023
- Readers: Everyone
Towards General-Purpose In-Context Learning Agents
Louis Kirsch, James Harrison, C. Daniel Freeman, Jascha Sohl-Dickstein, Jürgen Schmidhuber
- Published: 07 Nov 2023, Last Modified: 08 Dec 2023
- FMDM@NeurIPS2023
- Readers: Everyone
$\mathcal{B}$-Coder: On Value-Based Deep Reinforcement Learning for Program Synthesis
Zishun Yu, Yunzhe Tao, Liyu Chen, Tao Sun, Hongxia Yang
- Published: 07 Nov 2023, Last Modified: 04 Dec 2023
- FMDM@NeurIPS2023
- Readers: Everyone
LASER: LLM Agent with State-Space Exploration for Web Navigation
Kaixin Ma, Hongming Zhang, Hongwei Wang, Xiaoman Pan, Dong Yu
- Published: 07 Nov 2023, Last Modified: 17 Nov 2023
- FMDM@NeurIPS2023
- Readers: Everyone
Vision-and-Language Navigation in Real World using Foundation Models
Chengguang Xu, Hieu Trung Nguyen, Christopher Amato, Lawson L.S. Wong
- Published: 07 Nov 2023, Last Modified: 17 Nov 2023
- FMDM@NeurIPS2023
- Readers: Everyone
Selective Perception: Learning Concise State Descriptions for Language Model Actors
Kolby Nottingham, Yasaman Razeghi, Kyungmin Kim, JB Lanier, Pierre Baldi, Roy Fox, Sameer Singh
- Published: 07 Nov 2023, Last Modified: 04 Dec 2023
- FMDM@NeurIPS2023
- Readers: Everyone
TD-MPC2: Scalable, Robust World Models for Continuous Control
Nicklas Hansen, Hao Su, Xiaolong Wang
- Published: 07 Nov 2023, Last Modified: 24 Nov 2023
- FMDM@NeurIPS2023
- Readers: Everyone