Parker Riley

Researcher, Google

Joined

July 2019

Names

Parker Riley (Preferred)

Emails

****@cs.rochester.edu (Confirmed)

****@gmail.com (Confirmed)

****@google.com (Confirmed)

Personal Links

Google Scholar

DBLP

Semantic Scholar

Career & Education History

Researcher

Google (google.com)

2021 – Present

PhD student

Department of Computer Science, University of Rochester (cs.rochester.edu)

2016 – 2021

Undergrad student

University of Kansas, Lawrence (ku.edu)

2012 – 2016

Advisors, Relations & Conflicts

PhD Advisor

Daniel Gildea

2016 – 2021

Expertise

machine translation

multilinguality

Present

Publications

Distribution-Calibrated Inference Time Compute for Thinking LLM-as-a-Judge
Hamid Dadkhahi, Firas Trabelsi, Parker Riley, Juraj Juraska, Mehdi Mirzazadeh
- ICLR 2026 Conference Desk Rejected Submission
- Readers: Everyone
Searching for Difficult-to-Translate Test Examples at Scale
Wenda Xu, Vilém Zouhar, Parker Riley, Mara Finkelstein, Markus Freitag, Daniel Deutsch
- Submitted to ICLR 2026
- Readers: Everyone
From Jack of All Trades to Master of One: Specializing LLM-based Autoraters to a Test Set
Mara Finkelstein, Daniel Deutsch, Parker Riley, Juraj Juraska, Geza Kovacs, Markus Freitag
- ICML 2025 poster
- Readers: Everyone
Finding Replicable Human Evaluations via Stable Ranking Probability
Parker Riley, Daniel Deutsch, George F. Foster, Viresh Ratnakar, Ali Dabirmoghaddam, Markus Freitag
- CoRR 2024
- Readers: Everyone
XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languages
Sebastian Ruder, Jonathan H. Clark, Alexander Gutkin, Mihir Kale, Min Ma, Massimo Nicosia, Shruti Rijhwani, Parker Riley, Jean Michel Amath Sarr, Xinyi Wang, John Frederick Wieting, Nitish Gupta, Anna Katanova, Christo Kirov, Dana L Dickinson, Brian Roark, Bidisha Samanta, Connie Tao, David Ifeoluwa Adelani, Vera Axelrod et al. (7 additional authors not shown)
- EMNLP 2023 Findings
- Readers: Everyone
FRMT: A Benchmark for Few-Shot Region-Aware Machine Translation
Parker Riley, Timothy Dozat, Jan A. Botha, Xavier Garcia, Dan Garrette, Jason Riesa, Orhan Firat, Noah Constant
- Trans. Assoc. Comput. Linguistics 2023
- Readers: Everyone
The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation
Patrick Fernandes, Daniel Deutsch, Mara Finkelstein, Parker Riley, André Martins, Graham Neubig, Ankush Garg, Jonathan H. Clark, Markus Freitag, Orhan Firat
- WMT 2023
- Readers: Everyone
The Devil is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation
Patrick Fernandes, Daniel Deutsch, Mara Finkelstein, Parker Riley, André F. T. Martins, Graham Neubig, Ankush Garg, Jonathan H. Clark, Markus Freitag, Orhan Firat
- CoRR 2023
- Readers: Everyone
XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languages
Sebastian Ruder, Jonathan H. Clark, Alexander Gutkin, Mihir Kale, Min Ma, Massimo Nicosia, Shruti Rijhwani, Parker Riley, Jean Michel A. Sarr, Xinyi Wang, John Wieting, Nitish Gupta, Anna Katanova, Christo Kirov, Dana L. Dickinson, Brian Roark, Bidisha Samanta, Connie Tao, David Ifeoluwa Adelani, Vera Axelrod et al. (7 additional authors not shown)
- Published: 01 Jan 2023, Last Modified: 16 Feb 2024
- CoRR 2023
- Readers: Everyone

View all 21 publications

Co-Authors

View all 63 co-authors