Shivani Upadhyay

PhD student, David R. Cheriton School of Computer Science, University of Waterloo

Joined

December 2023

Names

Shivani Upadhyay (Preferred)

Emails

****@uwaterloo.ca (Confirmed)

Personal Links

DBLP

Semantic Scholar

Career & Education History

PhD student

David R. Cheriton School of Computer Science , University of Waterloo (uwaterloo.ca)

2023 – 2028

Advisors, Relations & Conflicts

PhD Advisor

Jimmy Lin

2023 – 2025

Expertise

No areas of expertise listed

Publications

Search Arena Meets Nuggets: Towards Explanations and Diagnostics in the Evaluation of LLM Responses
Sahel Sharifymoghaddam, Shivani Upadhyay, Nandan Thakur, Ronak Pradeep, Jimmy Lin
- ICLR 2026 Conference Withdrawn Submission
- Readers: Everyone
On the Comprehensibility of Multi-structured Financial Documents using LLMs and Pre-processing Tools
Shivani Upadhyay, Messiah Ataey, Shariyar Murtuza, Yifan Nie, Jimmy Lin
- CoRR 2025
- Readers: Everyone
The Great Nugget Recall: Automating Fact Extraction and RAG Evaluation with Large Language Models
Ronak Pradeep, Nandan Thakur, Shivani Upadhyay, Daniel Campos, Nick Craswell, Jimmy Lin
- CoRR 2025
- Readers: Everyone
Support Evaluation for the TREC 2024 RAG Track: Comparing Human versus LLM Judges
Nandan Thakur, Ronak Pradeep, Shivani Upadhyay, Daniel Campos, Nick Craswell, Jimmy Lin
- CoRR 2025
- Readers: Everyone
Chatbot Arena Meets Nuggets: Towards Explanations and Diagnostics in the Evaluation of LLM Responses
Sahel Sharifymoghaddam, Shivani Upadhyay, Nandan Thakur, Ronak Pradeep, Jimmy Lin
- CoRR 2025
- Readers: Everyone
Assessing Support for the TREC 2024 RAG Track: A Large-Scale Comparative Study of LLM and Human Evaluations
Nandan Thakur, Ronak Pradeep, Shivani Upadhyay, Daniel Campos, Nick Craswell, Ian Soboroff, Hoa Trang Dang, Jimmy Lin
- SIGIR 2025
- Readers: Everyone
The Great Nugget Recall: Automating Fact Extraction and RAG Evaluation with Large Language Models
Ronak Pradeep, Nandan Thakur, Shivani Upadhyay, Daniel Campos, Nick Craswell, Ian Soboroff, Hoa Trang Dang, Jimmy Lin
- SIGIR 2025
- Readers: Everyone
A Large-Scale Study of Relevance Assessments with Large Language Models Using UMBRELA
Shivani Upadhyay, Ronak Pradeep, Nandan Thakur, Daniel Campos, Nick Craswell, Ian Soboroff, Jimmy Lin
- ICTIR 2025
- Readers: Everyone
UniRAG: Universal Retrieval Augmentation for Large Vision Language Models
Sahel Sharifymoghaddam, Shivani Upadhyay, Wenhu Chen, Jimmy Lin
- NAACL (Findings) 2025
- Readers: Everyone
Towards Robust QA Evaluation via Open LLMs
Ehsan Kamalloo, Shivani Upadhyay, Jimmy Lin
- SIGIR 2024
- Readers: Everyone

View all 16 publications