NeurIPS 2021 Track Datasets and Benchmarks Round1 Submissions

ATOM3D: Tasks on Molecules in Three Dimensions
Raphael John Lamarre Townshend, Martin Vögele, Patricia Adriana Suriana, Alexander Derry, Alexander Powers, Yianni Laloudakis, Sidhika Balachandar, Bowen Jing, Brandon M. Anderson, Stephan Eismann, Risi Kondor, Russ Altman, Ron O. Dror
- Published: 29 Jul 2021, Last Modified: 25 Nov 2024
- NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
A Benchmark of Discovering Drug-Target Interaction from Biomedical Literature
Yutai Hou, Yingce Xia, Lijun Wu, Shufang Xie, Yang Fan, Jinhua Zhu, Wanxiang Che, Tao Qin, Tie-Yan Liu
- 08 Jun 2021 (modified: 24 May 2023)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
A Large-Scale Database for Graph Representation Learning
Scott Freitas, Yuxiao Dong, Joshua Neil, Duen Horng Chau
- Published: 17 Aug 2021, Last Modified: 25 Nov 2024
- NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
StudentSADD: Mobile Depression and Suicidal Ideation Screening of College Students during the Coronavirus Pandemic
ML Tlachac, Ricardo Flores, Miranda Reisch, Rimsha Kayastha, Nina Taurich, Veronica Melican, Connor Bruneau, Hunter Caouette, Ermal Toto, Elke Rundensteiner
- 08 Jun 2021 (modified: 24 May 2023)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
GitTables: A Large-Scale Corpus of Relational Tables
Madelon Hulsebos, Çağatay Demiralp, Paul Groth
- 08 Jun 2021 (modified: 25 Nov 2024)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Teach Me to Explain: A Review of Datasets for Explainable Natural Language Processing
Sarah Wiegreffe, Ana Marasovic
- Published: 29 Jul 2021, Last Modified: 25 Nov 2024
- NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
LiRo: Benchmark and leaderboard for Romanian language tasks
Stefan Daniel Dumitrescu, Petru Rebeja, Beata Lorincz, Mihaela Gaman, Andrei Avram, Mihai Ilie, Andrei Pruteanu, Adriana Stan, Lorena Rosia, Cristina Iacobescu, Luciana Morogan, George Dima, Gabriel Marchidan, Traian Rebedea, Madalina Chitez, Dani Yogatama, Sebastian Ruder, Radu Tudor Ionescu, Razvan Pascanu, Viorica Patraucean
- Published: 29 Jul 2021, Last Modified: 24 May 2023
- NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Benchmarking Bias Mitigation Algorithms in Representation Learning through Fairness Metrics
Charan Reddy, Deepak Sharma, Soroush Mehri, Adriana Romero-Soriano, Samira Shabanian, Sina Honari
- Published: 29 Jul 2021, Last Modified: 24 May 2023
- NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
EEGEyeNet: a Simultaneous Electroencephalography and Eye-tracking Dataset and Benchmark for Eye Movement Prediction
Ard Kastrati, Martyna Beata Plomecka, Damian Pascual, Lukas Wolf, Victor Gillioz, Roger Wattenhofer, Nicolas Langer
- Published: 29 Jul 2021, Last Modified: 25 Nov 2024
- NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
VALUE: A Multi-Task Benchmark for Video-and-Language Understanding Evaluation
Linjie Li, Jie Lei, Zhe Gan, Licheng Yu, Yen-Chun Chen, Rohit Pillai, Yu Cheng, Luowei Zhou, Xin Eric Wang, William Yang Wang, Tamara Lee Berg, Mohit Bansal, Jingjing Liu, Lijuan Wang, Zicheng Liu
- Published: 29 Jul 2021, Last Modified: 25 Nov 2024
- NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Reinforcement Learning Benchmarks for Traffic Signal Control
James Ault, Guni Sharon
- Published: 29 Jul 2021, Last Modified: 24 May 2023
- NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Q-Pain: A Question Answering Dataset to Measure Social Bias in Pain Management
Cécile Logé, Emily Ross, David Yaw Amoah Dadey, Saahil Jain, Adriel Saporta, Andrew Y. Ng, Pranav Rajpurkar
- Published: 29 Jul 2021, Last Modified: 24 May 2023
- NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Chest ImaGenome Dataset for Clinical Reasoning
Joy T Wu, Nkechinyere Nneka Agu, Ismini Lourentzou, Arjun Sharma, Joseph Alexander Paguio, Jasper Seth Yao, Edward Christopher Dee, William G Mitchell, Satyananda Kashyap, Andrea Giovannini, Leo Anthony Celi, Mehdi Moradi
- 07 Jun 2021 (modified: 24 May 2023)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Automatic Construction of Evaluation Suites for Natural Language Generation Datasets
Simon Mille, Kaustubh Dhole, Saad Mahamood, Laura Perez-Beltrachini, Varun Gangal, Mihir Kale, Emiel van Miltenburg, Sebastian Gehrmann
- Published: 29 Jul 2021, Last Modified: 25 Nov 2024
- NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
OmniPrint: A Configurable Printed Character Synthesizer
Haozhe Sun, Wei-Wei Tu, Isabelle M Guyon
- Published: 29 Jul 2021, Last Modified: 25 Nov 2024
- NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
The Benchmark Lottery
Mostafa Dehghani, Yi Tay, Alexey A. Gritsenko, Zhe Zhao, Neil Houlsby, Fernando Diaz, Donald Metzler, Oriol Vinyals
- 07 Jun 2021 (modified: 25 Nov 2024)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Challenging America: Digitized Newspapers as a Source of Machine Learning Challenges
Filip Graliński, Jakub Pokrywka, Krzysztof Jassem, Krzysztof Jan Jurkiewicz, Piotr Wierzchon, Karol Kaczmarek
- 07 Jun 2021 (modified: 24 May 2023)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
RealCause: Realistic Causal Inference Benchmarking
Brady Neal, Chin-Wei Huang, Sunand Raghupathi
- 07 Jun 2021 (modified: 25 Nov 2024)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Robustness Disparities in Commercial Face Detection
Samuel Dooley, Tom Goldstein, John P Dickerson
- 07 Jun 2021 (modified: 25 Nov 2024)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Systematic Evaluation of Causal Discovery in Visual Model Based Reinforcement Learning
Nan Rosemary Ke, Aniket Rajiv Didolkar, Sarthak Mittal, Anirudh Goyal, Guillaume Lajoie, Stefan Bauer, Danilo Jimenez Rezende, Michael Curtis Mozer, Yoshua Bengio, Christopher Pal
- 07 Jun 2021 (modified: 25 Nov 2024)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
JECC: Commonsense Reasoning Tasks Derived fromInteractive Fictions
Mo Yu, Xiaoxiao Guo, Yufei Feng, Yi Gu, Xiaodan Zhu, Michael Greenspan, Murray Campbell, Chuang Gan
- 07 Jun 2021 (modified: 24 May 2023)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Pl@ntNet-300K: a new plant image dataset for the evaluation of set-valued classifiers
Camille Garcin, alexis joly, Pierre Bonnet, Antoine Affouard, Jean-Christophe Lombardo, Mathias Chouet, Maximilien Servajean, Joseph Salmon
- 07 Jun 2021 (modified: 24 May 2023)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Natural Adversarial Objects
Felix Lau, Sasha Harrison, Nishant Subramani, Aerin Kim, Elliot Branson, Rosanne Liu
- 07 Jun 2021 (modified: 24 May 2023)
- Submitted to NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
It's COMPASlicated: The Messy Relationship between RAI Datasets and Algorithmic Fairness Benchmarks
Michelle Bao, Angela Zhou, Samantha A Zottola, Brian Brubach, Sarah Desmarais, Aaron Seth Horowitz, Kristian Lum, Suresh Venkatasubramanian
- Published: 29 Jul 2021, Last Modified: 24 May 2023
- NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone
Addressing "Documentation Debt" in Machine Learning: A Retrospective Datasheet for BookCorpus
Jack Bandy, Nicholas Vincent
- Published: 29 Jul 2021, Last Modified: 25 Nov 2024
- NeurIPS 2021 Datasets and Benchmarks Track (Round 1)
- Readers: Everyone