NeurIPS 2021 Track Datasets and Benchmarks Round1 Submissions

VISIOCITY: A New Benchmarking Dataset and Evaluation Framework Towards Realistic Video Summarization
Vishal Kaushal, Suraj Nandkishor Kothawade, Rishabh K Iyer, Ganesh Ramakrishnan
- 08 Jun 2021 (modified: 24 May 2023)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Arena: A Scalable and Configurable Benchmark for Policy Learning
Sirui Xu, Shuang Liu, Tongzhou Mu, Zhiwei Jia, Yiran Wu, Hao Su
- 08 Jun 2021 (modified: 24 May 2023)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Variance-Aware Machine Translation Test Sets
Runzhe Zhan, Xuebo Liu, Derek F. Wong, Lidia S. Chao
- Published: 29 Jul 2021, Last Modified: 22 Oct 2023
- NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
The PAIR-R24M Dataset for Multi-animal 3D Pose Estimation
Jesse D Marshall, Ugne Klibaite, amanda gellis, Diego E Aldarondo, Bence Olveczky, Timothy W DUNN
- Published: 29 Jul 2021, Last Modified: 24 May 2023
- NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Rail-5k: a Real-World Dataset for Rail Surface Defects Detection
Zihao Zhang, Shaozuo Yu, Siwei Yang, Bingchen Zhao, Yu Zhou
- 08 Jun 2021 (modified: 22 Oct 2023)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Towards a universal dataset and metrics for training and evaluating table extraction models
Brandon Smock, Rohith Pesala, Robin Abraham
- 08 Jun 2021 (modified: 24 May 2023)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Three million images and morphological profiles of cells treated with matched chemical and genetic perturbations
Srinivas Niranj Chandrasekaran, Beth A Cimini, Amy Goodale, Lisa Miller, Maria Kost-Alimova, Nasim Jamali, John Doench, Briana Fritchman, Adam Skepner, Michelle Melanson, Daniel Kuhn, Desiree Hernandez, Jim Berstler, Hamdah Shafqat-Abbasi, David Root, Susanne E Swalley, Shantanu Singh, Anne E Carpenter
- 08 Jun 2021 (modified: 24 May 2023)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
HiRID-ICU-Benchmark --- A Comprehensive Machine Learning Benchmark on High-resolution ICU Data
Hugo Yèche, Rita Kuznetsova, Marc Zimmermann, Matthias Hüser, Xinrui Lyu, Martin Faltys, Gunnar Ratsch
- Published: 29 Jul 2021, Last Modified: 24 May 2023
- NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Multimodal AutoML on Tables with Text Fields
Xingjian Shi, Jonas Mueller, Nick Erickson, Mu Li, Alex Smola
- 08 Jun 2021 (modified: 24 May 2023)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
MiniHack the Planet: A Sandbox for Open-Ended Reinforcement Learning Research
Mikayel Samvelyan, Robert Kirk, Vitaly Kurin, Jack Parker-Holder, Minqi Jiang, Eric Hambro, Fabio Petroni, Heinrich Kuttler, Edward Grefenstette, Tim Rocktäschel
- Published: 29 Jul 2021, Last Modified: 24 May 2023
- NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
PASS: An ImageNet replacement for self-supervised pretraining without humans
Yuki M Asano, Christian Rupprecht, Andrew Zisserman, Andrea Vedaldi
- Published: 29 Jul 2021, Last Modified: 24 May 2023
- NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Design-Bench: Benchmarks for Data-Driven Offline Model-Based Optimization
Brandon Trabucco, Xinyang Geng, Aviral Kumar, Sergey Levine
- 08 Jun 2021 (modified: 22 Oct 2023)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Indian-COVID-19 CT Dataset and Analysis of Chest CT Scans of COVID-19 Patients Using Lightweight CNN
S Suba, Nita Parekh, Ramesh Loganathan, Vikram Pudi, Chinnababu Sunkavalli
- 08 Jun 2021 (modified: 24 May 2023)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
The Medkit-Learn(ing) Environment: Medical Decision Modelling through Simulation
Alex Chan, Ioana Bica, Alihan Hüyük, Daniel Jarrett, Mihaela van der Schaar
- 08 Jun 2021 (modified: 24 May 2023)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
A2X: An Agent and Environment Interaction Benchmark for Multimodal Human Trajectory Prediction
Samuel S. Sohn, Mihee Lee, Seonghyeon Moon, Gang Qiao, Usman Muhammad, Sejong Yoon, vladimir pavlovic, Mubbasir Kapadia
- 08 Jun 2021 (modified: 24 May 2023)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
New Zealand Open Environmental Science Data sets
Nick Jin Sean Lim, Jacob Montiel, Albert Bifet
- 08 Jun 2021 (modified: 24 May 2023)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
NeoRL: A Near Real-World Benchmark for Offline Reinforcement Learning
Rong-Jun Qin, Xingyuan Zhang, Songyi Gao, Zhen Xu, Shengkai Huang, Zewen Li, Weinan Zhang, Yang Yu
- 08 Jun 2021 (modified: 24 May 2023)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
NAS-Bench-360: Benchmarking Diverse Tasks for Neural Architecture Search
Renbo Tu, Mikhail Khodak, Nicholas Carl Roberts, Nina Balcan, Ameet Talwalkar
- 08 Jun 2021 (modified: 22 Oct 2023)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Towards a robust experimental framework and benchmark for lifelong language learning
Aman Hussain, Nithin Holla, Pushkar Mishra, Helen Yannakoudakis, Ekaterina Shutova
- Published: 29 Jul 2021, Last Modified: 24 May 2023
- NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
The Argoverse Trajectory Retrieval Benchmark
Eric Zhan, Jagjeet Singh, Yisong Yue, Andrew Hartnett
- 08 Jun 2021 (modified: 24 May 2023)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks
Curtis G Northcutt, Anish Athalye, Jonas Mueller
- Published: 29 Jul 2021, Last Modified: 24 May 2023
- NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
DABS: a Domain-Agnostic Benchmark for Self-Supervised Learning
Alex Tamkin, Vincent Liu, Rongfei Lu, Daniel Fein, Colin Schultz, Noah Goodman
- Published: 29 Jul 2021, Last Modified: 22 Oct 2023
- NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Empirical Study of Off-Policy Policy Evaluation for Reinforcement Learning
Cameron Voloshin, Hoang Minh Le, Nan Jiang, Yisong Yue
- Published: 29 Jul 2021, Last Modified: 22 Oct 2023
- NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Particulate Matter Dataset Collected with Vehicle Mounted IoT Devices in Delhi-NCR
Ishan Nangia, Chinmay Degwekar, Sagar Gaddam, Saswat Kumar Pujari, Ismi Abidi, Vedant Vijay, Ajay Kumar Soni, Sayan Ranu, Rijurekha Sen
- 08 Jun 2021 (modified: 24 May 2023)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Benchmark for Compositional Text-to-Image Synthesis
Dong Huk Park, Samaneh Azadi, Xihui Liu, Trevor Darrell, Anna Rohrbach
- Published: 29 Jul 2021, Last Modified: 24 May 2023
- NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone