John J Nay

Researcher, Stanford University

Joined

June 2023

Names

John J Nay (Preferred)

Emails

****@gmail.com (Confirmed)

,

****@nyu.edu (Confirmed)

Personal Links

Career & Education History

Researcher

Stanford University (stanford.edu)

2022 – Present

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

ARB: Advanced Reasoning Benchmark for Large Language Models
Tomohiro Sawada, Daniel Paleka, Alexander Havrilla, Pranav Tadepalli, Paula Vidas, Alexander Kranias, John Nay, Kshitij Gupta, Aran Komatsuzaki
- MATH-AI 23 Poster
- Readers: Everyone
ARB: Advanced Reasoning Benchmark for Large Language Models
Tomohiro Sawada, Daniel Paleka, Alexander Havrilla, Pranav Tadepalli, Paula Vidas, Alexander Perikles Kranias, John J Nay, Kshitij Gupta, Aran Komatsuzaki
- Submitted to ICLR 2024
- Readers: Everyone
LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Models
Neel Guha, Julian Nyarko, Daniel E. Ho, Christopher Re, Adam Chilton, Aditya Narayana, Alex Chohlas-Wood, Austin Peters, Brandon Waldon, Daniel Rockmore, Diego Zambrano, Dmitry Talisman, Enam Hoque, Faiz Surani, Frank Fagan, Galit Sarfaty, Gregory M. Dickinson, Haggai Porat, Jason Hegland, Jessica Wu et al. (20 additional authors not shown)
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone

Co-Authors

View all 47 co-authors