NeurIPS 2023 Track Datasets and Benchmarks Submissions

Synthcity: a benchmark framework for diverse use cases of tabular synthetic data
Zhaozhi Qian, Rob Davis, Mihaela van der Schaar
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
IMP-MARL: a Suite of Environments for Large-scale Infrastructure Management Planning via MARL
Pascal Leroy, Pablo G. Morato, Jonathan Pisane, Athanasios Kolios, Damien Ernst
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
Reimagining Synthetic Tabular Data Generation through Data-Centric AI: A Comprehensive Benchmark
Lasse Hansen, Nabeel Seedat, Mihaela van der Schaar, Andrija Petrovic
- Published: 26 Sept 2023, Last Modified: 11 Jan 2024
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric Xing, Hao Zhang, Joseph E. Gonzalez, Ion Stoica
- Published: 26 Sept 2023, Last Modified: 28 Dec 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
${\rm EFO}_k$-CQA: Towards Knowledge Graph Complex Query Answering beyond Set Operation
Hang Yin, Zihao Wang, Fei Weizhi, Yangqiu Song
- 30 May 2023 (modified: 12 Dec 2023)
- Submitted to NeurIPS 2023 Datasets and Benchmarks
- Readers: Everyone
Stable Bias: Evaluating Societal Representations in Diffusion Models
NeurIPS 2023 Track Datasets and Benchmarks Submission344 Authors
- Published: 26 Sept 2023, Last Modified: 02 Feb 2024
- NeurIPS 2023 Datasets and Benchmarks Spotlight
- Readers: Everyone
RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatars
Dongwei Pan, Long Zhuo, Jingtan Piao, Huiwen Luo, Wei Cheng, Yuxin WANG, Siming Fan, Shengqi Liu, Lei Yang, Bo Dai, Ziwei Liu, Chen Change Loy, Chen Qian, Wayne Wu, Dahua Lin, Kwan-Yee Lin
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
Revisiting the Evaluation of Image Synthesis with GANs
Mengping Yang, Ceyuan Yang, Yichi Zhang, Qingyan Bai, Yujun Shen, Bo Dai
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
NeuroEvoBench: Benchmarking Evolutionary Optimizers for Deep Learning Applications
Robert Tjarko Lange, Yujin Tang, Yingtao Tian
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
EHRSHOT: An EHR Benchmark for Few-Shot Evaluation of Foundation Models
Michael Wornow, Rahul Thapa, Ethan Steinberg, Jason Alan Fries, Nigam Shah
- Published: 26 Sept 2023, Last Modified: 27 Dec 2023
- NeurIPS 2023 Datasets and Benchmarks Spotlight
- Readers: Everyone
Seeing is not always believing: Benchmarking Human and Model Perception of AI-Generated Images
Zeyu Lu, Di Huang, LEI BAI, Jingjing Qu, Chengyue Wu, Xihui Liu, Wanli Ouyang
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
UDC-SIT: A Real-World Dataset for Under-Display Cameras
Kyusu Ahn, Byeonghyun Ko, HyunGyu Lee, Chanwoo Park, Jaejin Lee
- Published: 26 Sept 2023, Last Modified: 15 Jan 2024
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editing
Kai Zhang, Lingbo Mo, Wenhu Chen, Huan Sun, Yu Su
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
A benchmark of categorical encoders for binary classification
Federico Matteucci, Vadim Arzamasov, Klemens Böhm
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
OV-PARTS: Towards Open-Vocabulary Part Segmentation
Meng Wei, Xiaoyu Yue, Wenwei Zhang, Shu Kong, Xihui Liu, Jiangmiao Pang
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
Benchmark of Machine Learning Force Fields for Semiconductor Simulations: Datasets, Metrics, and Comparative Analysis
Geonu Kim, Byunggook Na, Gunhee Kim, Hyuntae Cho, Seungjin Kang, Hee Sun Lee, Saerom Choi, Heejae Kim, Seungwon Lee, Yongdeok Kim
- Published: 26 Sept 2023, Last Modified: 16 Jan 2024
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
Mr. HiSum: A Large-scale Dataset for Video Highlight Detection and Summarization
NeurIPS 2023 Track Datasets and Benchmarks Submission315 Authors
- Published: 26 Sept 2023, Last Modified: 03 Feb 2024
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
Stanford-ORB: A Real-World 3D Object Inverse Rendering Benchmark
Zhengfei Kuang, Yunzhi Zhang, Hong-Xing Yu, Samir Agarwala, Shangzhe Wu, Jiajun Wu
- Published: 26 Sept 2023, Last Modified: 15 Jan 2024
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
REASONER: An Explainable Recommendation Dataset with Comprehensive Labeling Ground Truths
Xu Chen, Jingsen Zhang, Lei Wang, Quanyu Dai, Zhenhua Dong, Ruiming Tang, Rui Zhang, Li Chen, Xin Zhao, Ji-Rong Wen
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
Learning Human Action Recognition Representations Without Real Humans
Howard Zhong, Samarth Mishra, Donghyun Kim, SouYoung Jin, Rameswar Panda, Hilde Kuehne, Leonid Karlinsky, Venkatesh Saligrama, Aude Oliva, Rogerio Feris
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Models
Yuzhen Huang, Yuzhuo Bai, Zhihao Zhu, Junlei Zhang, Jinghan Zhang, Tangjun Su, Junteng Liu, Chuancheng Lv, Yikai Zhang, jiayi lei, Yao Fu, Maosong Sun, Junxian He
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
EasyTPP: Towards Open Benchmarking the Temporal Point Processes
Siqiao Xue, Xiaoming Shi, Zhixuan Chu, Yan Wang, Hongyan Hao, Caigao JIANG, Chen Pan, James Y. Zhang, Qingsong Wen, JUN ZHOU, Hongyuan Mei
- 30 May 2023 (modified: 12 Dec 2023)
- Submitted to NeurIPS 2023 Datasets and Benchmarks
- Readers: Everyone
Cola: A Benchmark for Compositional Text-to-image Retrieval
Arijit Ray, Filip Radenovic, Abhimanyu Dubey, Bryan A. Plummer, Ranjay Krishna, Kate Saenko
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
AQuA: A Benchmarking Tool for Label Quality Assessment
Mononito Goswami, Vedant Sanil, Arjun Choudhry, Arvind Srinivasan, Chalisa Udompanyawit, Artur Dubrawski
- Published: 26 Sept 2023, Last Modified: 16 Jan 2024
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
ProofNet: Autoformalizing and Formally Proving Undergraduate-Level Mathematics
Zhangir Azerbayev, Bartosz Piotrowski, Hailey Schoelkopf, Edward W. Ayers, Dragomir Radev, Jeremy Avigad
- 29 May 2023 (modified: 12 Dec 2023)
- Submitted to NeurIPS 2023 Datasets and Benchmarks
- Readers: Everyone