NeurIPS 2023 Workshop R0-FoMo Submissions

Trained Transformers Learn Linear Models In-Context
Ruiqi Zhang, Spencer Frei, Peter Bartlett
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Spotlight
- Readers: Everyone
OverPrompt: Enhancing ChatGPT through Efficient In-Context Learning
Jiazheng Li, Runcong Zhao, Yongxin Yang, Yulan He, Lin Gui
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Poster
- Readers: Everyone
Zero-shot Clustering of Embeddings with Pretrained and Self-Supervised Learnt Encoders
Scott C Lowe, Joakim Bruslund Haurum, Sageev Oore, Thomas B. Moeslund, Graham W. Taylor
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Poster
- Readers: Everyone
What’s important here?: Opportunities and Challenges of LLM in retrieving information from Web Interface
Faria Huq, Jeffrey P. Bigham, Nikolas Martelaro
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Poster
- Readers: Everyone
Flexible visual prompts for in context learning in computer vision
Thomas Foster, Ioana Croitoru, Robert Dorfman, Christoffer Edlund, Thomas Varsavsky, Jon Almazán
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Poster
- Readers: Everyone
Estimating Uncertainty in Multimodal Foundation Models using Public Internet Data
Shiladitya Dutta, Hongbo Wei, Lars van der Laan, Ahmed Alaa
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Spotlight
- Readers: Everyone
How Capable Can a Transformer Become? A Study on Synthetic, Interpretable Tasks
Rahul Ramesh, Mikail Khona, Robert P. Dick, Hidenori Tanaka, Ekdeep Singh Lubana
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Poster
- Readers: Everyone
Analyzing Zero-Shot Abilities of Vision-Language Models on Video Understanding Tasks
Avinash Madasu, Anahita Bhiwandiwalla, Vasudev Lal
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Poster
- Readers: Everyone
Zero-shot Conversational Summarization Evaluations with small Large Language Models
Ramesh Manuvinakurike, Saurav Sahay, Sangeeta Manepalli, Lama Nachman
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Poster
- Readers: Everyone
Lag-Llama: Towards Foundation Models for Time Series Forecasting
Kashif Rasul, Arjun Ashok, Andrew Robert Williams, Arian Khorasani, George Adamopoulos, Rishika Bhagwatkar, Marin Biloš, Hena Ghonia, Nadhir Hassen, Anderson Schneider, Sahil Garg, Alexandre Drouin, Nicolas Chapados, Yuriy Nevmyvaka, Irina Rish
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Poster
- Readers: Everyone
Image Clustering Conditioned on Text Criteria
Sehyun Kwon, Jaeseung Park, Minkyu Kim, Jaewoong Cho, Ernest K. Ryu, Kangwook Lee
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Poster
- Readers: Everyone
How does fine-tuning affect your model? Mechanistic analysis on procedural tasks
Samyak Jain, Robert Kirk, Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka, Tim Rocktäschel, Edward Grefenstette, David Krueger
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Poster
- Readers: Everyone
Task Arithmetic with LoRA for Continual Learning
Rajas Chitale, Ankit Vaidya, Aditya Kane, Archana Santosh Ghotkar
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Poster
- Readers: Everyone
One shot localization and segmentation of medical images with Foundation Models
Deepa Anand, Gurunath Reddy, Vanika Singhal, Dattesh D. Shanbhag, Shriram KS, Uday Patil, Chitresh Bhushan, Kavitha Manickam, Dawei Gui, Rakesh Mullick, Avinash Gopal, Parminder Bhatia, Taha Kass-Hout
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Poster
- Readers: Everyone
HART: Efficient Adaptation via Regularized Autoregressive Parameter Generation
Chen Liang, Nikos Karampatziakis, Tuo Zhao, Weizhu Chen
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Poster
- Readers: Everyone
Efficient Online Data Mixing For Language Model Pre-Training
Alon Albalak, Liangming Pan, Colin Raffel, William Yang Wang
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Spotlight
- Readers: Everyone
Latent Skill Discovery for Chain-of-Thought Reasoning
Zifan Xu, Haozhu Wang, Dmitriy Bespalov, Peter Stone, Yanjun Qi
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Poster
- Readers: Everyone
Jailbreaking Black Box Large Language Models in Twenty Queries
Patrick Chao, Alexander Robey, Edgar Dobriban, Hamed Hassani, George J. Pappas, Eric Wong
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Poster
- Readers: Everyone
Improving Few-Shot Generalization by Exploring and Exploiting Auxiliary Data
Alon Albalak, Colin Raffel, William Yang Wang
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Poster
- Readers: Everyone
Benchmarking Robustness of Text-Image Composed Retrieval
Shitong Sun, Jindong Gu, Shaogang Gong
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Poster
- Readers: Everyone
JAB: Joint Adversarial Prompting and Belief Augmentation
Ninareh Mehrabi, Palash Goyal, Anil Ramakrishna, Jwala Dhamala, Shalini Ghosh, Richard Zemel, Kai-Wei Chang, Aram Galstyan, Rahul Gupta
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Poster
- Readers: Everyone
Predicting the Performance of Foundation Models via Agreement-on-the-line
Rahul Saxena, Aman Mehra, Taeyoun Kim, Christina Baek, J Zico Kolter, Aditi Raghunathan
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Poster
- Readers: Everyone
Automatic Hallucination Assessment for Aligned Large Language Models via Transferable Adversarial Attacks
Xiaodong Yu, Hao Cheng, Xiaodong Liu, Dan Roth, Jianfeng Gao
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Poster
- Readers: Everyone
SELF-EXPLAIN: Teaching Large Language Models to Reason Complex Questions by Themselves
Jiachen ZHAO, Zonghai Yao, zhichao Yang, hong yu
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Poster
- Readers: Everyone
TART: A plug-and-play Transformer module for task-agnostic reasoning
Kush Bhatia, Avanika Narayan, Christopher De Sa, Christopher Re
- Published: 01 Nov 2023, Last Modified: 12 Dec 2023
- R0-FoMo Spotlight
- Readers: Everyone