Bertie Vidgen

Visiting Researcher, Alan Turing Institute

Joined

January 2022

Names

Bertie Vidgen (Preferred)

Emails

****@turing.ac.uk (Confirmed)

****@rewire.online (Confirmed)

Personal Links

Homepage

Google Scholar

ACL Anthology

Career & Education History

Visiting Researcher

Alan Turing Institute (turing.ac.uk)

2022 – Present

Evaluation lead

MLCommons (mlcommons.org)

2024 – 2024

AI Product Lead

ActiveFence (activefence.com)

2023 – 2023

CEO

Rewire Online (rewire.online)

2021 – 2023

Visiting researcher

University of Oxford (ox.ac.uk)

2019 – 2023

Head of Online Safety

Alan Turing Institute (turing.ac.uk)

2021 – 2022

Researcher

Open University (open.ac.uk)

2018 – 2019

Advisors, Relations & Conflicts

PhD Advisor

Taha Yasseri

Present

PhD Advisor

Helen Margetts

Present

Expertise

online safety

2015 – 2022

computational social science

2015 – 2022

Publications

Evaluating LLM-as-a-Judge under Multilingual, Multimodal and Multi-domain Constraints
Shreyansh Padarha, Elizaveta Semenova, Bertie Vidgen, Adam Mahdi, Scott A. Hale
- NeurIPS 2025 LLM Evaluation Workshop Poster
- Readers: Everyone
Introducing v0.5 of the AI Safety Benchmark from MLCommons
Bertie Vidgen, Sean McGregor, Peter Mattson, Joaquin Vanschoren
- arXiv
- Readers: Everyone
XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models
Paul Röttger, Hannah Rose Kirk, Bertie Vidgen, Giuseppe Attanasio, Federico Bianchi, Dirk Hovy
- NAACL 2024 Main
- Readers: Everyone
The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources
Shayne Longpre, Stella Biderman, Alon Albalak, Hailey Schoelkopf, Daniel McDuff, Sayash Kapoor, Kevin Klyman, Kyle Lo, Gabriel Ilharco, Nay San, Maribeth Rauh, Aviya Skowron, Bertie Vidgen, Laura Weidinger, Arvind Narayanan, Victor Sanh, David Ifeoluwa Adelani, Percy Liang, Rishi Bommasani, Peter Henderson et al. (3 additional authors not shown)
- Accepted by TMLR
- Readers: Everyone
The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Models
Hannah Rose Kirk, Alexander Whitefield, Paul Röttger, Andrew Michael Bean, Katerina Margatina, Rafael Mosquera, Juan Manuel Ciro, Max Bartolo, Adina Williams, He He, Bertie Vidgen, Scott A. Hale
- NeurIPS 2024 Track Datasets and Benchmarks Oral
- Readers: Everyone
WorkBench: a Benchmark Dataset for Agents in a Realistic Workplace Setting
Olly Styles, Sam Miller, Patricio Cerda-Mardini, Tanaya Guha, Victor Sanchez, Bertie Vidgen
- COLM
- Readers: Everyone
Position: Near to Mid-term Risks and Opportunities of Open-Source Generative AI
Francisco Eiras, Aleksandar Petrov, Bertie Vidgen, Christian Schroeder de Witt, Fabio Pizzati, Katherine Elkins, Supratik Mukhopadhyay, Adel Bibi, Botos Csaba, Fabro Steibel, Fazl Barez, Genevieve Smith, Gianluca Guadagni, Jon Chun, Jordi Cabot, Joseph Marvin Imperial, Juan A. Nolazco-Flores, Lori Landay, Matthew Thomas Jackson, Paul Rottger et al. (4 additional authors not shown)
- ICML 2024 Oral
- Readers: Everyone
Position: TrustLLM: Trustworthiness in Large Language Models
Yue Huang, Lichao Sun, Haoran Wang, Siyuan Wu, Qihui Zhang, Yuan Li, Chujie Gao, Yixin Huang, Wenhan Lyu, Yixuan Zhang, Xiner Li, Hanchi Sun, Zhengliang Liu, Yixin Liu, Yijue Wang, Zhikun Zhang, Bertie Vidgen, Bhavya Kailkhura, Caiming Xiong, Chaowei Xiao et al. (51 additional authors not shown)
- ICML 2024 Poster
- Readers: Everyone
The Empty Signifier Problem: Towards Clearer Paradigms for Operationalising "Alignment'' in Large Language Models
Hannah Kirk, Bertie Vidgen, Paul Rottger, Scott Hale
- SoLaR Poster
- Readers: Everyone
The Past, Present and Better Future of Feedback Learning in Large Language Models for Subjective Human Preferences and Values
Hannah Rose Kirk, Andrew Michael Bean, Bertie Vidgen, Paul Rottger, Scott A. Hale
- EMNLP 2023 Main
- Readers: Everyone

Co-Authors

View all 139 co-authors