NeurIPS 2024 Workshop SoLaR Submissions

Report Cards: Qualitative Evaluation of LLMs Using Natural Language Summaries
Blair Yang, Fuyang Cui, Keiran Paster, Jimmy Ba, Pashootan Vaezipoor, Silviu Pitis, Michael R. Zhang
- Published: 09 Oct 2024, Last Modified: 04 Dec 2024
- SoLaR Spotlight
- Readers: Everyone
Levels of Autonomy: Liability in the age of AI Agents
Lisa Soder, Julia Smakman, Connor Dunlop, Weiwei Pan, Siddharth Swaroop, Noam Kolt
- Published: 09 Oct 2024, Last Modified: 13 Dec 2024
- SoLaR Poster
- Readers: Everyone
Linear Probe Penalties Reduce LLM Sycophancy
Henry Papadatos, Rachel Freedman
- Published: 09 Oct 2024, Last Modified: 04 Dec 2024
- SoLaR Poster
- Readers: Everyone
Position Paper: Model Access should be a Key Concern in AI Governance
Edward Kembery
- Published: 09 Oct 2024, Last Modified: 04 Dec 2024
- SoLaR Poster
- Readers: Everyone
Emergence of Steganography Between Large Language Models
Yohan Mathew, Robert McCarthy, Joan Velja, Ollie Matthews, Nandi Schoots, Dylan Cope
- Published: 09 Oct 2024, Last Modified: 04 Dec 2024
- SoLaR Poster
- Readers: Everyone
Century: A Dataset of Sensitive Historical Images
Canfer Akbulut, Kevin Robinson, Maribeth Rauh, Isabela Albuquerque, Olivia Wiles, Laura Weidinger, Verena Rieser, Yana Hasson, Nahema Marchal, Iason Gabriel, William Isaac, Lisa Anne Hendricks
- Published: 09 Oct 2024, Last Modified: 04 Dec 2024
- SoLaR Poster
- Readers: Everyone
Toxic Neurons Aren’t Enough to Explain DPO: A Mechanistic Analysis for Toxicity Reduction
Yushi Yang, Filip Sondej, Harry Mayne, Adam Mahdi
- Published: 09 Oct 2024, Last Modified: 04 Dec 2024
- SoLaR Poster
- Readers: Everyone
Analyzing Probabilistic Methods for Evaluating Agent Capabilities
Axel Højmark, Govind Pimpale, Arjun Panickssery, Marius Hobbhahn, Jérémy Scheurer
- Published: 09 Oct 2024, Last Modified: 04 Dec 2024
- SoLaR Poster
- Readers: Everyone
SafetyAnalyst: Interpretable, transparent, and steerable LLM safety moderation
Jing-Jing Li, Valentina Pyatkin, Max Kleiman-Weiner, Liwei Jiang, Nouha Dziri, Anne Collins, Jana Schaich Borg, Maarten Sap, Yejin Choi, Sydney Levine
- Published: 09 Oct 2024, Last Modified: 04 Dec 2024
- SoLaR Poster
- Readers: Everyone
SocialStigmaQA Spanish and Japanese - Towards Multicultural Adaptation of Social Bias Benchmarks
Clara Higuera Cabañes, Ryo Iwaki, Beñat San Sebastian, Rosario Uceda Sosa, Manish Nagireddy, Hiroshi Kanayama, Mikio Takeuchi, Gakuto Kurata, Karthikeyan Natesan Ramamurthy
- Published: 09 Oct 2024, Last Modified: 04 Dec 2024
- SoLaR Poster
- Readers: Everyone
Detection of Partially-Synthesized LLM Text
Eric Lei, Hsiang Hsu, Chun-Fu Chen
- Published: 09 Oct 2024, Last Modified: 04 Dec 2024
- SoLaR Poster
- Readers: Everyone
GPAI Evaluations Standards Taskforce: towards effective AI governance
Patricia Paskov, Lukas Berglund, Everett Thornton Smith, Lisa Soder
- Published: 09 Oct 2024, Last Modified: 04 Dec 2024
- SoLaR Poster
- Readers: Everyone
ReFeR: A Hierarchical Framework of Models as Evaluative and Reasoning Agents
Yaswanth Narsupalli, Abhranil Chandra, Sreevatsa Muppirala, Manish Gupta, Pawan Goyal
- Published: 09 Oct 2024, Last Modified: 04 Dec 2024
- SoLaR Poster
- Readers: Everyone
Latent Adversarial Training Improves Robustness to Persistent Harmful Behaviors in LLMs
Aidan Ewart, Abhay Sheshadri, Phillip Huang Guo, Aengus Lynch, Cindy Wu, Vivek Hebbar, Henry Sleight, Asa Cooper Stickland, Ethan Perez, Dylan Hadfield-Menell, Stephen Casper
- Published: 09 Oct 2024, Last Modified: 04 Dec 2024
- SoLaR Poster
- Readers: Everyone
LLM Hallucination Reasoning with Zero-shot Knowledge Test
Seongmin Lee, Hsiang Hsu, Chun-Fu Chen
- Published: 09 Oct 2024, Last Modified: 04 Dec 2024
- SoLaR Poster
- Readers: Everyone
Plentiful Jailbreaks with String Compositions
Brian R.Y. Huang
- Published: 09 Oct 2024, Last Modified: 04 Dec 2024
- SoLaR Poster
- Readers: Everyone
I Think, Therefore I am: Benchmarking Awareness of Large Language Models Using AwareBench
Yuan Li, Yue Huang, Yuli Lin, Siyuan Wu, Yao Wan, Lichao Sun
- Published: 09 Oct 2024, Last Modified: 04 Dec 2024
- SoLaR Poster
- Readers: Everyone
Position: Governments Need to Increase and Interconnect Post-Deployment Monitoring of AI
Merlin Stein, Jamie Bernardi, Connor Dunlop
- Published: 09 Oct 2024, Last Modified: 04 Dec 2024
- SoLaR Poster
- Readers: Everyone
Ways Forward for Global AI Benefit Sharing
Sam Manning, Claire Dennis, Stephen Clare
- Published: 09 Oct 2024, Last Modified: 04 Dec 2024
- SoLaR Poster
- Readers: Everyone
THaMES: An End-to-End Tool for Hallucination Mitigation and Evaluation in Large Language Models
Mengfei Liang, Archish Arun, Zekun Wu, CRISTIAN ENRIQUE MUNOZ VILLALOBOS, Jonathan Lutch, Emre Kazim, Adriano Koshiyama, Philip Colin Treleaven
- Published: 09 Oct 2024, Last Modified: 04 Dec 2024
- SoLaR Poster
- Readers: Everyone
LLM Alignment Using Soft Prompt Tuning: The Case of Cultural Alignment
Reem I. Masoud, Martin Ferianc, Philip Colin Treleaven, Miguel R. D. Rodrigues
- Published: 09 Oct 2024, Last Modified: 04 Dec 2024
- SoLaR Poster
- Readers: Everyone
Mitigating Downstream Model Risks via Model Provenance
Keyu Wang, Scott Schaffter, Abdullah Norozi Iranzad, Doina Precup, Jonathan Lebensold, Meg Risdal
- Published: 09 Oct 2024, Last Modified: 04 Dec 2024
- SoLaR Poster
- Readers: Everyone
The Impact of Large Language Models in Academia: from Writing to Speaking
Mingmeng Geng, Caixi Chen, Yanru Wu, Dongping Chen, Yao Wan, Pan Zhou
- Published: 09 Oct 2024, Last Modified: 04 Dec 2024
- SoLaR Poster
- Readers: Everyone
Monitoring Human Dependence On AI Systems With Reliance Drills
Rosco Hunter, Richard Moulange, Jamie Bernardi, Merlin Stein
- Published: 09 Oct 2024, Last Modified: 04 Dec 2024
- SoLaR Poster
- Readers: Everyone
On Adversarial Robustness of Language Models in Transfer Learning
Bohdan Turbal, Anastasiia Mazur, Jiaxu Zhao, Mykola Pechenizkiy
- Published: 09 Oct 2024, Last Modified: 04 Dec 2024
- SoLaR Poster
- Readers: Everyone