ICML 2024 Workshop MFHAIA Submissions

Scalable Oversight by Accounting for Unreliable Feedback
Shivam Singhal, Cassidy Laidlaw, Anca Dragan
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Oral
- Readers: Everyone
Relatively Rational: Learning Utilities and Rationalities Jointly from Pairwise Preferences
Taku Yamagata, Tobias Oberkofler, Timo Kaufmann, Viktor Bengs, Eyke Hüllermeier, Raul Santos-Rodriguez
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Poster
- Readers: Everyone
Comparing Comparisons: Informative and Easy Human Feedback with Distinguishability Queries
Xuening Feng, Zhaohui JIANG, Timo Kaufmann, Eyke Hüllermeier, Paul Weng, Yifei Zhu
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Poster
- Readers: Everyone
DPO Meets PPO: Reinforced Token Optimization for RLHF
Han Zhong, Guhao Feng, Wei Xiong, Xinle Cheng, Li Zhao, Di He, Jiang Bian, Liwei Wang
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Poster
- Readers: Everyone
PIPER: Primitive-Informed Preference-based Hierarchical Reinforcement Learning via Hindsight Relabeling
Utsav Singh, Wesley A. Suttle, Brian M. Sadler, Vinay P. Namboodiri, Amrit Singh Bedi
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Poster
- Readers: Everyone
Learning the eye of the beholder: Statistical modeling and estimation for personalized color perception
Xuanzhou Chen, Austin Xu, Jingyan Wang, Ashwin Pananjady
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Poster
- Readers: Everyone
Towards Aligning Language Models with Textual Feedback
Saüc Abadal Lloret, Shehzaad Dhuliawala, Keerthiram Murugesan, Mrinmaya Sachan
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Poster
- Readers: Everyone
DPM: Dual Preferences-based Multi-Agent Reinforcement Learning
Sehyeok Kang, Yongsik Lee, Se-Young Yun
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Poster
- Readers: Everyone
Free-Energy Equilibria: Toward a Theory of Interactions Between Boundedly-Rational Agents
David Hyland, Tomáš Gavenčiak, Lancelot Da Costa, Conor Heins, Vojtech Kovarik, Julian Gutierrez, Michael J. Wooldridge, Jan Kulveit
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Poster
- Readers: Everyone
Is a Good Description Worth a Thousand Pictures? Reducing Multimodal Alignment to Text-Based, Unimodal Alignment
Amin Memarian, Touraj Laleh, Irina Rish, Ardavan S. Nobandegani
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Poster
- Readers: Everyone
MultiScale Policy Learning for Alignment with Long Term Objectives
Richa Rastogi, Yuta Saito, Thorsten Joachims
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Poster
- Readers: Everyone
Reinforcement Learning from Human Text Feedback: Learning a Reward Model from Human Text Input
Belen Martin Urcelay, Andreas Krause, Giorgia Ramponi
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Poster
- Readers: Everyone
Revisiting Successor Features for Inverse Reinforcement Learning
Arnav Kumar Jain, Harley Wiltzer, Jesse Farebrother, Irina Rish, Glen Berseth, Sanjiban Choudhury
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Poster
- Readers: Everyone
Efficient Inverse Reinforcement Learning without Compounding Errors
Nicolas Espinosa Dice, Gokul Swamy, Sanjiban Choudhury, Wen Sun
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Poster
- Readers: Everyone
Aligning Large Language Models with Representation Editing: A Control Perspective
Lingkai Kong, Haorui Wang, Wenhao Mu, Yuanqi Du, Yuchen Zhuang, Yifei Zhou, Yue Song, Rongzhi Zhang, Kai Wang, Chao Zhang
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Poster
- Readers: Everyone
Scalably Solving Assistance Games
Cassidy Laidlaw, Eli Bronstein, Timothy Guo, Dylan Feng, Lukas Berglund, Justin Svegliato, Stuart Russell, Anca Dragan
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Poster
- Readers: Everyone
Accelerating Best-of-N via Speculative Rejection
Ruiqi Zhang, Momin Haider, Ming Yin, Jiahao Qiu, Mengdi Wang, Peter Bartlett, Andrea Zanette
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Poster
- Readers: Everyone
Learning to Assist Humans without Inferring Rewards
Vivek Myers, Evan Ellis, Benjamin Eysenbach, Sergey Levine, Anca Dragan
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Poster
- Readers: Everyone
Off-Policy Evaluation from Logged Human Feedback
Aniruddha Bhargava, Lalit K Jain, Branislav Kveton, Ge Liu, Subhojyoti Mukherjee
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Poster
- Readers: Everyone
Optimal Design for Human Feedback
Subhojyoti Mukherjee, Anusha Lalitha, Kousha Kalantari, Aniket Anand Deshmukh, Ge Liu, Yifei Ma, Branislav Kveton
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Poster
- Readers: Everyone
Regularized Best-of-N Sampling to Mitigate Reward Hacking for Language Model Alignment
Yuu Jinnai, Tetsuro Morimura, Kaito Ariu, Kenshi Abe
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Poster
- Readers: Everyone
Beyond Thumbs Up/Down: Untangling Challenges of Fine-Grained Feedback for Text-to-Image Generation
Katherine M. Collins, Najoung Kim, Yonatan Bitton, Verena Rieser, Shayegan Omidshafiei, Yushi Hu, Sherol Chen, Senjuti Dutta, Minsuk Chang, Kimin Lee, Youwei Liang, Georgina Evans, Sahil Singla, Gang Li, Adrian Weller, Junfeng He, Deepak Ramachandran, Krishnamurthy Dj Dvijotham
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Poster
- Readers: Everyone
Is poisoning a real threat to LLM alignment? Maybe more so than you think
Pankayaraj Pathmanathan, Souradip Chakraborty, Xiangyu Liu, Yongyuan Liang, Furong Huang
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Poster
- Readers: Everyone
AMBER: An Entropy Maximizing Environment Design Algorithm for Inverse Reinforcement Learning
Paul Nitschke, Lars Lien Ankile, Eura Nofshin, Siddharth Swaroop, Finale Doshi-Velez, Weiwei Pan
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Poster
- Readers: Everyone
A Theoretical Framework for Partially Observed Reward-States in RLHF
Chinmaya Kausik, Mirco Mutti, Aldo Pacchiano, Ambuj Tewari
- Published: 17 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop MHFAIA Poster
- Readers: Everyone