NeurIPS 2023 Workshop Instruction Submissions

Delve into PPO: Implementation Matters for Stable RLHF
Rui Zheng, Shihan Dou, Songyang Gao, Yuan Hua, Wei Shen, Binghai Wang, Yan Liu, Senjie Jin, Yuhao Zhou, Limao Xiong, Lu Chen, Zhiheng Xi, Nuo Xu, Wenbin Lai, Minghao Zhu, Haoran Huang, Tao Gui, Qi Zhang, Xuanjing Huang
- Published: 28 Oct 2023, Last Modified: 26 Nov 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone
Group Preference Optimization: Few-Shot Alignment of Large Language Models
Siyan Zhao, John Dang, Aditya Grover
- Published: 28 Oct 2023, Last Modified: 26 Nov 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone
For Distillation, Tokens Are Not All You Need
Mrigank Raman, Pranav Mani, Davis Liang, Zachary Lipton
- Published: 28 Oct 2023, Last Modified: 26 Nov 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone
Tensor Trust: Interpretable Prompt Injection Attacks from an Online Game
Sam Toyer, Olivia Watkins, Ethan Mendes, Justin Svegliato, Luke Bailey, Tiffany Wang, Isaac Ong, Karim Elmaaroufi, Pieter Abbeel, Trevor Darrell, Alan Ritter, Stuart Russell
- Published: 28 Oct 2023, Last Modified: 26 Nov 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone
Reflection-Tuning: Recycling Data for Better Instruction-Tuning
Ming Li, Lichang Chen, Jiuhai Chen, Shwai He, Tianyi Zhou
- Published: 28 Oct 2023, Last Modified: 26 Nov 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone
Automatic Construction of a Korean Toxic Instruction Dataset for Ethical Tuning of Large Language Models
SungJoo Byun, Dongjun Jang, Hyemi Jo, Hyopil Shin
- Published: 28 Oct 2023, Last Modified: 26 Nov 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone
Exploring and Improving the Spatial Reasoning Abilities of Large Language Models
Manasi Sharma
- Published: 28 Oct 2023, Last Modified: 26 Nov 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone
DialogCC: An Automated Pipeline for Creating High-Quality Multi-modal Dialogue Datasets
Young-Jun Lee, Byungsoo Ko, Han-Gyu Kim, Jonghwan Hyeon, Ho-Jin Choi
- Published: 28 Oct 2023, Last Modified: 26 Nov 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone
URIAL: Tuning-Free Instruction Learning and Alignment for Untuned LLMs
Bill Yuchen Lin, Abhilasha Ravichander, Ximing Lu, Nouha Dziri, Melanie Sclar, Khyathi Chandu, Chandra Bhagavatula, Yejin Choi
- Published: 28 Oct 2023, Last Modified: 26 Nov 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone
Instruction-tuned LLMs with World Knowledge are More Aligned to the Human Brain
Khai Loong Aw, Syrielle Montariol, Badr AlKhamissi, Martin Schrimpf, Antoine Bosselut
- Published: 28 Oct 2023, Last Modified: 26 Nov 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone
Chain of Natural Language Inference for Reducing Large Language Model Hallucinations
Deren Lei, Yaxi Li, Mengya Hu, Mingyu Wang, Xi Yun
- Published: 28 Oct 2023, Last Modified: 26 Nov 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone
Balancing Multiple Objectives for Efficient Metaprompts for Data Labeling Tasks with Extensive Guidelines
Tobias Schnabel, Jennifer Neville
- Published: 28 Oct 2023, Last Modified: 26 Nov 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone
Interactive Planning Using Large Language Models for Partially Observable Robotics Tasks
Lingfeng Sun, Devesh K. Jha, Chiori Hori, Siddarth Jain, Radu Corcodel, Xinghao Zhu, Masayoshi Tomizuka, Diego Romeres
- Published: 28 Oct 2023, Last Modified: 10 Dec 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone
Verbosity Bias in Preference Labeling by Large Language Models
Keita Saito, Akifumi Wachi, Koki Wataoka, Youhei Akimoto
- Published: 28 Oct 2023, Last Modified: 26 Nov 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone
Let's Reinforce Step by Step
Sarah Pan, Vladislav Lialin, Sherin Muckatira, Anna Rumshisky
- Published: 28 Oct 2023, Last Modified: 26 Nov 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone
How Long Can Context Length of Open-Source LLMs truly Promise?
Dacheng Li, Rulin Shao, Anze Xie, Ying Sheng, Lianmin Zheng, Joseph Gonzalez, Ion Stoica, Xuezhe Ma, Hao Zhang
- Published: 28 Oct 2023, Last Modified: 26 Nov 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone
Platypus: Quick, Cheap, and Powerful Refinement of LLMs
Ariel Lee, Cole Hunter, Nataniel Ruiz
- Published: 28 Oct 2023, Last Modified: 26 Nov 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone
Supervised Fine-Tuning of Large Language Models on Human Demonstrations Through the Lens of Memorization
Yubin Ge, Devamanyu Hazarika, Yang Liu, Mahdi Namazifar
- Published: 28 Oct 2023, Last Modified: 26 Nov 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone
Instruction-following Evaluation through Verbalizer Manipulation
Shiyang Li, Jun Yan, Hai Wang, Zheng Tang, Xiang Ren, Vijay Srinivasan, Hongxia Jin
- Published: 28 Oct 2023, Last Modified: 26 Nov 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone
FinGPT: Democratizing Internet-scale Data for Financial Large Language Models
Xiao-Yang Liu, Guoxuan Wang, Hongyang Yang, Daochen Zha
- Published: 28 Oct 2023, Last Modified: 26 Nov 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone
A Case Study of Instruction Tuning with Mixture of Parameter-Efficient Experts
Oleksiy Ostapenko, Lucas Caccia, Zhan Su, Nicolas Le Roux, Laurent Charlin, Alessandro Sordoni
- Published: 28 Oct 2023, Last Modified: 26 Nov 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone
Grounding Code Generation with Input-Output Specifications
Yeming Wen, Pengcheng Yin, Kensen Shi, Henryk Michalewski, Swarat Chaudhuri, Alex Polozov
- Published: 28 Oct 2023, Last Modified: 26 Nov 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone
NexusRaven: a commercially-permissive Language Model for function calling
Venkat Krishna Srinivasan, Zhen Dong, Banghua Zhu, Brian Yu, Hanzi Mao, Damon Mosk-Aoyama, Kurt Keutzer, Jiantao Jiao, Jian Zhang
- Published: 28 Oct 2023, Last Modified: 26 Nov 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone
Chain-of-Thought Reasoning is a Policy Improvement Operator
Hugh Zhang, David Parkes
- Published: 28 Oct 2023, Last Modified: 26 Nov 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone
Simulating Iterative Human-AI Interaction in Programming with LLMs
Hussein Mozannar, Valerie Chen, Dennis Wei, Prasanna Sattigeri, Manish Nagireddy, Subhro Das, Ameet Talwalkar, David Sontag
- Published: 28 Oct 2023, Last Modified: 26 Nov 2023
- Instruction Workshop @ NeurIPS 2023
- Readers: Everyone