OpenReview.net

Login

Back to NeurIPS

NeurIPS 2025 Datasets and Benchmarks Track Submissions

Loading

About OpenReview
Hosting a Venue
All Venues

Contact
Sponsors
Donate

FAQ
Terms of Use / Privacy Policy
News

About OpenReview
Hosting a Venue
All Venues
Sponsors
News

FAQ
Contact
Donate
Terms of Use
Privacy Policy

OpenReview is a long-term project to advance science through improved peer review with legal nonprofit status. We gratefully acknowledge the support of the OpenReview Sponsors. © 2025 OpenReview

DGCBench: A Deep Graph Clustering Benchmark
Benyu Wu, Yue Liu, Qiaoyu Tan, Xinwang Liu, Wei Du, Jun Wang, Guoxian Yu
- Published: 18 Sept 2025, Last Modified: 30 Oct 2025
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
FGBench: A Dataset and Benchmark for Molecular Property Reasoning at Functional Group-Level in Large Language Models
Xuan Liu, Siru Ouyang, Xianrui Zhong, Jiawei Han, Huimin Zhao
- Published: 18 Sept 2025, Last Modified: 30 Oct 2025
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
ResearchCodeBench: Benchmarking LLMs on Implementing Novel Machine Learning Research Code
Tianyu Hua, Harper Hua, Violet Xiang, Benjamin Klieger, Sang T. Truong, Weixin Liang, Fan-Yun Sun, Nick Haber
- Published: 18 Sept 2025, Last Modified: 30 Oct 2025
- NeurIPS 2025 Datasets and Benchmarks Track spotlight
- Readers: Everyone
Fantastic Bugs and Where to Find Them in AI Benchmarks
Sang T. Truong, Yuheng Tu, Michael Hardy, Anka Reuel, Zeyu Tang, Jirayu Burapacheep, Jonathan Jude Perera, Chibuike Uwakwe, Benjamin W. Domingue, Nick Haber, Sanmi Koyejo
- Published: 18 Sept 2025, Last Modified: 30 Oct 2025
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
BackdoorDM: A Comprehensive Benchmark for Backdoor Learning on Diffusion Model
Weilin Lin, Nanjun Zhou, Yanyun Wang, Jianze Li, Hui Xiong, Li Liu
- Published: 18 Sept 2025, Last Modified: 30 Oct 2025
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
AHa-Bench: Benchmarking Audio Hallucinations in Large Audio-Language Models
Xize Cheng, Dongjie Fu, Chenyuhao Wen, Shannon Yu, Zehan Wang, Shengpeng Ji, Siddhant Arora, Tao Jin, Shinji Watanabe, Zhou Zhao
- Published: 18 Sept 2025, Last Modified: 30 Oct 2025
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
UMU-Bench: Closing the Modality Gap in Multimodal Unlearning Evaluation
Chengye Wang, Yuyuan Li, XiaoHua Feng, Chaochao Chen, Xiaolin Zheng, Jianwei Yin
- Published: 18 Sept 2025, Last Modified: 30 Oct 2025
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
$\texttt{AVROBUSTBENCH}$: Benchmarking the Robustness of Audio-Visual Recognition Models at Test-Time
Sarthak Kumar Maharana, Saksham Singh Kushwaha, Baoming Zhang, Adrian Rodriguez, Songtao Wei, Yapeng Tian, Yunhui Guo
- Published: 18 Sept 2025, Last Modified: 30 Oct 2025
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
Massive Sound Embedding Benchmark (MSEB)
Georg Heigold, Ehsan Variani, Tom Bagby, Cyril Allauzen, Ji Ma, Shankar Kumar, Michael Riley
- Published: 18 Sept 2025, Last Modified: 30 Oct 2025
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
ReinAD: Towards Real-world Industrial Anomaly Detection with a Comprehensive Contrastive Dataset
Xu Wang, Jingyuan Zhuo, Zhiyuan You, Zhiyu Tan, Yikuan Yu, Siyu Wang, Xinyi Le
- Published: 18 Sept 2025, Last Modified: 30 Oct 2025
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
MergeBench: A Benchmark for Merging Domain-Specialized LLMs
Yifei He, Siqi Zeng, Yuzheng Hu, Rui Yang, Tong Zhang, Han Zhao
- Published: 18 Sept 2025, Last Modified: 30 Oct 2025
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
MLE-Dojo: Interactive Environments for Empowering LLM Agents in Machine Learning Engineering
Rushi Qiang, Yuchen Zhuang, Yinghao Li, Dingu Sagar V K, Rongzhi Zhang, ChangHao Li, Ian Shu-Hei Wong, Sherry Yang, Percy Liang, Chao Zhang, Bo Dai
- Published: 18 Sept 2025, Last Modified: 30 Oct 2025
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
RoFt-Mol: Benchmarking Robust Fine-tuning with Molecular Graph Foundation Models
Shikun Liu, Deyu Zou, Nima Shoghi, Victor Fung, Kai Liu, Pan Li
- Published: 18 Sept 2025, Last Modified: 11 Dec 2025
- NeurIPS 2025 Datasets and Benchmarks Track spotlight
- Readers: Everyone
PUO-Bench: A Panel Understanding and Operation Benchmark with A Privacy-Preserving Framework
Wei Lin, Yiwei Zhou, Junkai Zhang, Rui Shao, Zhiyuan Zhao, Junyu Gao, Antoni B. Chan, Xuelong Li
- Published: 18 Sept 2025, Last Modified: 30 Oct 2025
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
Seeking and Updating with Live Visual Knowledge
Mingyang Fu, Yuyang Peng, Dongping Chen, Zetong Zhou, Benlin Liu, Yao Wan, Zhou Zhao, Philip S. Yu, Ranjay Krishna
- Published: 18 Sept 2025, Last Modified: 30 Oct 2025
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
ClinBench: A Standardized Multi-Domain Framework for Evaluating Large Language Models in Clinical Information Extraction
Ismael Villanueva-Miranda, Zifan Gu, Donghan Yang, Kuroush Nezafati, Jingwei Huang, Peifeng Ruan, Xiaowei Zhan, Guanghua Xiao, Yang Xie
- Published: 18 Sept 2025, Last Modified: 30 Oct 2025
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
STARC-9: A Large-scale Dataset for Multi-Class Tissue Classification for CRC Histopathology
Barathi Subramanian, Rathinaraja Jeyaraj, Mitchell Nevin Peterson, Terry Guo, Nigam Shah, Curtis Langlotz, Andrew Y. Ng, Jeanne Shen
- Published: 18 Sept 2025, Last Modified: 11 Dec 2025
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
MyoChallenge 2024: A New Benchmark for Physiological Dexterity and Agility in Bionic Humans
Cheryl Wang, Chun Kwang Tan, Balint K Hodossy, Shirui Lyu, Pierre Schumacher, James Heald, Kai Biegun, Samo Hromadka, Maneesh Sahani, Gunwoo Park, Beomsoo Shin, JongHyun Park, SEUNGBUM KOO, Chenhui Zuo, Chengtian Ma, Yanan Sui, Nicklas Hansen, Stone Tao, Yuan Gao, Hao Su et al. (6 additional authors not shown)
ClinicalLab: Aligning Agents for Multi-Departmental Clinical Diagnostics in the Real World
Weixiang Yan, Haitian Liu, Tengxiao Wu, Qian Chen, Wen Wang, Haoyuan Chai, Jiayi Wang
- Published: 18 Sept 2025, Last Modified: 30 Oct 2025
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
MORALISE: A Structured Benchmark for Moral Alignment in Visual Language Models
Xiao Lin, Zhining Liu, Ze Yang, Gaotang Li, Ruizhong Qiu, Shuke Wang, Hui Liu, Haotian Li, Sumit Keswani, Vishwa Pardeshi, Huijun Zhao, Wei Fan, Hanghang Tong
- 11 May 2025 (modified: 30 Oct 2025)
- Submitted to NeurIPS 2025 Datasets and Benchmarks Track
- Readers: Everyone
Sudoku-Bench: Evaluating creative reasoning with Sudoku variants
Jeffrey Seely, Yuki Imajuku, Tianyu Zhao, Edoardo Cetin, Llion Jones
- 11 May 2025 (modified: 30 Oct 2025)
- Submitted to NeurIPS 2025 Datasets and Benchmarks Track
- Readers: Everyone
TAPAS: Datasets for Learning the Learning with Errors Problem
Eshika Saxena, Alberto Alfarano, Francois Charton, Emily Wenger, Kristin E. Lauter
- Published: 18 Sept 2025, Last Modified: 30 Oct 2025
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
QCircuitBench: A Large-Scale Dataset for Benchmarking Quantum Algorithm Design
Rui Yang, Ziruo Wang, Yuntian Gu, Yitao Liang, Tongyang Li
- Published: 18 Sept 2025, Last Modified: 16 Dec 2025
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
SECODEPLT: A Unified Benchmark for Evaluating the Security Risks and Capabilities of Code GenAI
Yuzhou Nie, Zhun Wang, Yu Yang, Ruizhe Jiang, Yuheng Tang, Xander Davies, Yarin Gal, Bo Li, Wenbo Guo, Dawn Song
- Published: 18 Sept 2025, Last Modified: 30 Oct 2025
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
Benchmarking Retrieval-Augmented Multimomal Generation for Document Question Answering
Kuicai Dong, Yujing Chang, Shijie Huang, Yasheng Wang, Ruiming Tang, Yong Liu
- Published: 18 Sept 2025, Last Modified: 30 Oct 2025
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone

«
‹
4
5
6
7
8
9
10
11
12
13
›
»

Published: 18 Sept 2025, Last Modified: 30 Oct 2025
NeurIPS 2025 Datasets and Benchmarks Track poster
Readers: Everyone