NeurIPS 2023 Track Datasets and Benchmarks Submissions

Species196: A One-Million Semi-supervised Dataset for Fine-grained Species Recognition
Wei He, Kai Han, Ying Nie, Chengcheng Wang, Yunhe Wang
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
VisAlign: Dataset for Measuring the Alignment between AI and Humans in Visual Perception
Jiyoung Lee, Seungho Kim, Seunghyun Won, Joonseok Lee, Marzyeh Ghassemi, James Thorne, Jaeseok Choi, O-Kil Kwon, Edward Choi
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
WCLD: Curated Large Dataset of Criminal Cases from Wisconsin Circuit Courts
Elliott Ash, Naman Goel, Nianyun Li, Claudia Marangon, Peiyao Sun
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
A Comprehensive Study on Text-attributed Graphs: Benchmarking and Rethinking
Hao Yan, Chaozhuo Li, Ruosong Long, Chao Yan, Jianan Zhao, Wenwen Zhuang, Jun Yin, Peiyan Zhang, Weihao Han, Hao Sun, Weiwei Deng, Qi Zhang, Lichao Sun, Xing Xie, Senzhang Wang
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
Physion++: Evaluating Physical Scene Understanding that Requires Online Inference of Different Physical Properties
NeurIPS 2023 Track Datasets and Benchmarks Submission735 Authors
- Published: 26 Sept 2023, Last Modified: 02 Feb 2024
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
StressID: a Multimodal Dataset for Stress Identification
Hava Chaptoukaev, Valeriya Strizhkova, Michele Panariello, Bianca Dalpaos, Aglind Reka, Valeria Manera, Susanne Thummler, Esma ISMAILOVA, Nicholas Evans, Francois Bremond, Massimiliano Todisco, Maria A Zuluaga, Laura M. Ferrari
- Published: 26 Sept 2023, Last Modified: 27 Jun 2024
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
GUARD: A Safe Reinforcement Learning Benchmark
Weiye Zhao, Rui Chen, Yifan Sun, Ruixuan Liu, Tianhao Wei, Changliu Liu
- 01 Jun 2023 (modified: 12 Dec 2023)
- Submitted to NeurIPS 2023 Datasets and Benchmarks
- Readers: Everyone
Quilt-1M: One Million Image-Text Pairs for Histopathology
Wisdom Oluchi Ikezogwo, Mehmet Saygin Seyfioglu, Fatemeh Ghezloo, Dylan Stefan Chan Geva, Fatwir Sheikh Mohammed, Pavan Kumar Anand, Ranjay Krishna, Linda Shapiro
- Published: 26 Sept 2023, Last Modified: 16 Jan 2024
- NeurIPS 2023 Datasets and Benchmarks Oral
- Readers: Everyone
EMBERSim: A Large-Scale Databank for Boosting Similarity Search in Malware Analysis
Dragos Georgian Corlatescu, Alexandru Dinu, Mihaela Gaman, Paul Sumedrea
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
The Drunkard’s Odometry: Estimating Camera Motion in Deforming Scenes
David Recasens, Martin R. Oswald, Marc Pollefeys, Javier Civera
- Published: 26 Sept 2023, Last Modified: 30 Dec 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
Into the Single Cell Multiverse: an End-to-End Dataset for Procedural Knowledge Extraction in Biomedical Texts
Ruth Dannenfelser, Jeffrey Zhong, Ran Zhang, Vicky Yao
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Spotlight
- Readers: Everyone
PlanBench: An Extensible Benchmark for Evaluating Large Language Models on Planning and Reasoning about Change
Karthik Valmeekam, Matthew Marquez, Alberto Olmo, Sarath Sreedharan, Subbarao Kambhampati
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
MVDoppler: Unleashing the Power of Multi-View Doppler for MicroMotion-based Gait Classification
Soheil Hor, Shubo Yang, Jae-Ho Choi, Amin Arbabian
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
SynMob: Creating High-Fidelity Synthetic GPS Trajectory Dataset for Urban Mobility Analysis
Yuanshao Zhu, Yongchao Ye, Ying Wu, Xiangyu Zhao, James Yu
- Published: 26 Sept 2023, Last Modified: 15 Jan 2024
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
M$^{2}$SODAI: Multi-Modal Maritime Object Detection Dataset With RGB and Hyperspectral Image Sensors
Jonggyu Jang, Sangwoo Oh, Youjin Kim, Dongmin Seo, Youngchol Choi, Hyun Jong Yang
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedback
John Yang, Akshara Prabhakar, Karthik R Narasimhan, Shunyu Yao
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion
Yangruibo Ding, Zijian Wang, Wasi Uddin Ahmad, Hantian Ding, Ming Tan, Nihal Jain, Murali Krishna Ramanathan, Ramesh Nallapati, Parminder Bhatia, Dan Roth, Bing Xiang
- Published: 26 Sept 2023, Last Modified: 16 Jan 2024
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
ClimateLearn: Benchmarking Machine Learning for Weather and Climate Modeling
Tung Nguyen, Jason Kyle Jewik, Hritik Bansal, Prakhar Sharma, Aditya Grover
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
SpokenWOZ: A Large-Scale Speech-Text Benchmark for Spoken Task-Oriented Dialogue Agents
Shuzheng Si, Wentao Ma, Haoyu Gao, Yuchuan Wu, Ting-En Lin, Yinpei Dai, Hangyu Li, Rui Yan, Fei Huang, Yongbin Li
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
Minigrid & Miniworld: Modular & Customizable Reinforcement Learning Environments for Goal-Oriented Tasks
Maxime Chevalier-Boisvert, Bolun Dai, Mark Towers, Rodrigo De Lazcano Perez-Vicente, Lucas Willems, Salem Lahlou, Suman Pal, Pablo Samuel Castro, J K Terry
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
DISCS: A Benchmark for Discrete Sampling
Katayoon Goshvadi, Haoran Sun, Xingchao Liu, Azade Nova, Ruqi Zhang, Will Sussman Grathwohl, Dale Schuurmans, Hanjun Dai
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
SugarCrepe: Fixing Hackable Benchmarks for Vision-Language Compositionality
Cheng-Yu Hsieh, Jieyu Zhang, Zixian Ma, Aniruddha Kembhavi, Ranjay Krishna
- Published: 26 Sept 2023, Last Modified: 16 Jan 2024
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
OpenProteinSet: Training data for structural biology at scale
Gustaf Ahdritz, Nazim Bouatta, Sachin Kadyan, Lukas Jarosch, Dan Berenberg, Ian Fisk, Andrew Martin Watkins, Stephen Ra, Richard Bonneau, Mohammed AlQuraishi
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
Intelligent Knee Sleeves: A Real-time Multimodal Dataset for 3D Lower Body Motion Estimation Using Smart Textile
Wenwen Zhang, Arvin Tashakori, Zenan Jiang, Amir Servati, Harishkumar Narayana, Saeid Soltanian, Rou Yi Yeap, Menghan Ma, Lauren Toy, Peyman Servati
- Published: 26 Sept 2023, Last Modified: 06 Jan 2024
- NeurIPS 2023 Datasets and Benchmarks Poster
- Readers: Everyone
DataComp: In search of the next generation of multimodal datasets
Samir Yitzhak Gadre, Gabriel Ilharco, Alex Fang, Jonathan Hayase, Georgios Smyrnis, Thao Nguyen, Ryan Marten, Mitchell Wortsman, Dhruba Ghosh, Jieyu Zhang, Eyal Orgad, Rahim Entezari, Giannis Daras, Sarah M Pratt, Vivek Ramanujan, Yonatan Bitton, Kalyani Marathe, Stephen Mussmann, Richard Vencu, Mehdi Cherti et al. (14 additional authors not shown)
- Published: 26 Sept 2023, Last Modified: 02 Nov 2023
- NeurIPS 2023 Datasets and Benchmarks Oral
- Readers: Everyone