NeurIPS 2023 Track Datasets and Benchmarks Submissions

FELM: Benchmarking Factuality Evaluation of Large Language Models
Shiqi Chen, Yiran Zhao, Jinghan Zhang, I-Chun Chern, Siyang Gao, Pengfei Liu, Junxian He
- Published: 26 Sept 2023, Last Modified: 10 Jan 2024
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
TWIGMA: A dataset of AI-Generated Images with Metadata From Twitter
Yiqun T. Chen, James Zou
- Published: 26 Sept 2023, Last Modified: 16 Jan 2024
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
ASL Citizen: A Community-Sourced Dataset for Advancing Isolated Sign Language Recognition
Aashaka Desai, Lauren Berger, Fyodor O Minakov, Vanessa Milan, Chinmay Singh, Kriston L Pumphrey, Richard Ladner, Hal Daumé III, Alex Xijie Lu, Naomi Caselli, Danielle Bragg
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
Wyze Rule: Federated Rule Dataset for Rule Recommendation Benchmarking
Mohammad Mahdi Kamani, Yuhang Yao, Hanjia Lyu, Zhongwei Cheng, Lin Chen, Liangju Li, Carlee Joe-Wong, Jiebo Luo
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
CSMeD: Bridging the Dataset Gap in Automated Citation Screening for Systematic Literature Reviews
Wojciech Kusa, Oscar E. Mendoza, Matthias Samwald, Petr Knoth, Allan Hanbury
- Published: 26 Sept 2023, Last Modified: 16 Jan 2024
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
Mesogeos: A multi-purpose dataset for data-driven wildfire modeling in the Mediterranean
Spyros Kondylatos, Ioannis Prapas, Gustau Camps-Valls, Ioannis Papoutsis
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Oral
- Readers: Everyone
YouTubePD: A Multimodal Benchmark for Parkinson’s Disease Analysis
Andy Zhou, Samuel Li, Pranav Sriram, Xiang Li, Jiahua Dong, Ansh Sharma, Yuanyi Zhong, Shirui Luo, Maria Jaromin, Volodymyr Kindratenko, Joerg Heintz, Christopher Zallek, Yu-Xiong Wang
- Published: 26 Sept 2023, Last Modified: 16 Jan 2024
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
BEDD: The MineRL BASALT Evaluation and Demonstrations Dataset for Training and Benchmarking Agents that Solve Fuzzy Tasks
Stephanie Milani, Anssi Kanervisto, Karolis Ramanauskas, Sander V Schulhoff, Brandon Houghton, Rohin Shah
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Oral
- Readers: Everyone
Knowledge-based in silico models and dataset for the comparative evaluation of mammography AI for a range of breast characteristics, lesion conspicuities and doses
Elena Sizikova, Niloufar Saharkhiz, Diksha Sharma, Miguel Lago, Berkman Sahiner, Jana Gut Delfino, Aldo Badano
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
$\mathbf{\mathbb{E}^{FWI}}$: Multiparameter Benchmark Datasets for Elastic Full Waveform Inversion of Geophysical Properties
Shihang Feng, Hanchen Wang, Chengyuan Deng, Yinan Feng, Yanhua Liu, Min Zhu, Peng Jin, Yinpeng Chen, Youzuo Lin
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents
Hugo Laurençon, Lucile Saulnier, Leo Tronchon, Stas Bekman, Amanpreet Singh, Anton Lozhkov, Thomas Wang, Siddharth Karamcheti, Alexander M Rush, Douwe Kiela, Matthieu Cord, Victor Sanh
- Published: 26 Sept 2023, Last Modified: 27 Dec 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
RL4CO: an Extensive Reinforcement Learning for Combinatorial Optimization Benchmark
Federico Berto, Chuanbo Hua, Junyoung Park, Minsu Kim, Hyeonah Kim, Jiwoo Son, Haeyeon Kim, Joungho Kim, Jinkyoo Park
- 01 Jun 2023 (modified: 12 Dec 2023)
- Submitted to NeurIPS 2023 Datasets and Benchmarks
- Readers: Everyone
BoardgameQA: A Dataset for Natural Language Reasoning with Contradictory Information
Mehran Kazemi, Quan Yuan, Deepti Bhatia, Najoung Kim, Xin Xu, Vaiva Imbrasaite, Deepak Ramachandran
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
MedSat: A Public Health Dataset for England Featuring Medical Prescriptions and Satellite Imagery
Sanja Scepanovic, Ivica Obadic, Sagar Joglekar, Laura GIUSTARINI, Cristiano Nattero, Daniele Quercia, Xiao Xiang Zhu
- Published: 26 Sept 2023, Last Modified: 27 Dec 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
GenEval: An object-focused framework for evaluating text-to-image alignment
Dhruba Ghosh, Hannaneh Hajishirzi, Ludwig Schmidt
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
CHAMMI: A benchmark for channel-adaptive models in microscopy imaging
Zitong Chen, Chau Pham, Siqi Wang, Michael Doron, Nikita Moshkov, Bryan A. Plummer, Juan C Caicedo
- Published: 26 Sept 2023, Last Modified: 27 Dec 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
Imagine the Unseen World: A Benchmark for Systematic Generalization in Visual World Models
Yeongbin Kim, Gautam Singh, Junyeong Park, Caglar Gulcehre, Sungjin Ahn
- Published: 26 Sept 2023, Last Modified: 10 Jan 2024
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
CAPP-130: A Corpus of Chinese Application Privacy Policy Summarization and Interpretation
Pengyun Zhu, Long Wen, Jinfei Liu, Feng Xue, Jian Lou, Zhibo Wang, Kui Ren
- Published: 26 Sept 2023, Last Modified: 05 Jan 2024
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
FLOP: Tasks for Fitness Landscapes Of Protein wildtypes
Peter Mørch Groth, Richard Michael, Jesper Salomon, Pengfei Tian, Wouter Boomsma
- 01 Jun 2023 (modified: 12 Dec 2023)
- Submitted to NeurIPS 2023 Datasets and Benchmarks
- Readers: Everyone
OpenSTL: A Comprehensive Benchmark of Spatio-Temporal Predictive Learning
Cheng Tan, Siyuan Li, Zhangyang Gao, Wenfei Guan, Zedong Wang, Zicheng Liu, Lirong Wu, Stan Z. Li
- Published: 26 Sept 2023, Last Modified: 15 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
OpenGSL: A Comprehensive Benchmark for Graph Structure Learning
Zhiyao Zhou, Sheng Zhou, Bochao Mao, Xuanyi Zhou, Jiawei Chen, Qiaoyu Tan, Daochen Zha, Yan Feng, Chun Chen, Can Wang
- Published: 26 Sept 2023, Last Modified: 15 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
Consensus and Subjectivity of Skin Tone Annotation for ML Fairness
Candice Schumann, Gbolahan Oluwafemi Olanubi, Auriel Wright, Ellis Monk, Courtney Heldreth, Susanna Ricco
- Published: 26 Sept 2023, Last Modified: 02 Jan 2024
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
HyPoradise: An Open Baseline for Generative Speech Recognition with Large Language Models
CHEN CHEN, Yuchen Hu, Chao-Han Huck Yang, Sabato Marco Siniscalchi, Pin-Yu Chen, EngSiong Chng
- Published: 26 Sept 2023, Last Modified: 06 May 2024
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
ProteinInvBench: Benchmarking Protein Inverse Folding on Diverse Tasks, Models, and Metrics
Zhangyang Gao, Cheng Tan, Yijie Zhang, Xingran Chen, Lirong Wu, Stan Z. Li
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
MLFMF: Data Sets for Machine Learning for Mathematical Formalization
NeurIPS 2023 Track Datasets and Benchmarks Submission825 Authors
- Published: 26 Sept 2023, Last Modified: 02 Feb 2024
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone