Daniel Paleka

PhD student, Department of Computer Science, ETHZ - ETH Zurich

Joined

September 2022

Names

Daniel Paleka (Preferred)

Emails

****@gmail.com (Confirmed)

****@inf.ethz.ch (Confirmed)

****@gmail.com (Confirmed)

Personal Links

Homepage

DBLP

Career & Education History

PhD student

Department of Computer Science, ETHZ - ETH Zurich (inf.ethz.ch)

2022 – Present

Advisors, Relations & Conflicts

PhD Advisor

Florian Tramer

2022 – Present

Expertise

safety

robustness

evaluation

large language models

security

Present

Publications

Large-scale online deanonymization with LLMs
Simon Lermen, Daniel Paleka, Joshua Swanson, Michael Aerni, Nicholas Carlini, Florian Tramèr
- ICLR 2026 AIWILD
- Readers: Everyone
Pitfalls in Evaluating Language Model Forecasters
Daniel Paleka, Shashwat Goel, Jonas Geiping, Florian Tramèr
- ICLR 2026 Poster
- Readers: Everyone
Evaluating Forecasting is More Difficult than Other LLM Evaluations
Daniel Paleka, Shashwat Goel, Jonas Geiping, Florian Tramèr
- ICML 2025 World Models Workshop
- Readers: Everyone
Consistency Checks for Language Model Forecasters
Daniel Paleka, Abhimanyu Pallavi Sudhir, Alejandro Alvarez, Vineeth Bhat, Adam Shen, Evan Wang, Florian Tramèr
- ICLR 2025 Oral
- Readers: Everyone
Consistency Checks for Language Model Forecasters
Abhimanyu Pallavi Sudhir, Alejandro Alvarez, Adam Shen, Daniel Paleka
- Agentic Markets @ ICML'24 Oral
- Readers: Everyone
Consistency Checks for Language Model Forecasters
Abhimanyu Pallavi Sudhir, Alejandro Alvarez, Adam Shen, Daniel Paleka
- NextGenAISafety 2024 Poster
- Readers: Everyone
Refusal in Language Models Is Mediated by a Single Direction
Andy Arditi, Oscar Balcells Obeso, Aaquib Syed, Daniel Paleka, Nina Panickssery, Wes Gurnee, Neel Nanda
- ICML 2024 MI Workshop Poster
- Readers: Everyone
Dataset and Lessons Learned from the 2024 SaTML LLM Capture-the-Flag Competition
Edoardo Debenedetti, Javier Rando, Daniel Paleka, Silaghi Fineas Florin, Dragos Albastroiu, Niv Cohen, Yuval Lemberg, Reshmi Ghosh, Rui Wen, Ahmed Salem, Giovanni Cherubin, Santiago Zanella-Beguelin, Robin Schmid, Victor Klemm, Takahiro Miki, Chenhao Li, Stefan Kraft, Mario Fritz, Florian Tramèr, Sahar Abdelnabi et al. (1 additional authors not shown)
- NeurIPS 2024 Track Datasets and Benchmarks Spotlight
- Readers: Everyone
Refusal in Language Models Is Mediated by a Single Direction
Andy Arditi, Oscar Balcells Obeso, Aaquib Syed, Daniel Paleka, Nina Rimsky, Wes Gurnee, Neel Nanda
- NeurIPS 2024 poster
- Readers: Everyone
Foundational Challenges in Assuring Alignment and Safety of Large Language Models
Usman Anwar, Abulhair Saparov, Javier Rando, Daniel Paleka, Miles Turpin, Peter Hase, Ekdeep Singh Lubana, Erik Jenner, Stephen Casper, Oliver Sourbut, Benjamin L. Edelman, Zhaowei Zhang, Mario Günther, Anton Korinek, Jose Hernandez-Orallo, Lewis Hammond, Eric J Bigelow, Alexander Pan, Lauro Langosco, Tomasz Korbak et al. (22 additional authors not shown)
- Accepted by TMLR
- Readers: Everyone

View all 19 publications

Co-Authors

View all 104 co-authors