DMLR Submissions

MONSTER: Monash Scalable Time Series Evaluation Repository
Angus Dempster, Navid Mohammadi Foumani, Chang Wei Tan, Lynn Miller, Amish Mishra, Mahsa Salehi, Charlotte Pelletier, Daniel F. Schmidt, Geoffrey I. Webb
- Published: 06 Jun 2025, Last Modified: 06 Jun 2025
- Accepted by DMLR
- Readers: Everyone
FlowBench: A Large Scale Benchmark for Flow Simulation over Complex Geometries
Ronak Tali, Ali Rabeh, Cheng-Hau Yang, Mehdi Shadkhah, Samundra Karki, Abhisek Upadhyaya, Suriya Dhakshinamoorthy, Marjan Saadati, Soumik Sarkar, Adarsh Krishnamurthy, Chinmay Hegde, Aditya Balu, Baskar Ganapathysubramanian
- Published: 25 Apr 2025, Last Modified: 25 Apr 2025
- Accepted by DMLR
- Readers: Everyone
Deep Learning for Accurate Diagnosis of Viral Infections through scRNA-seq Analysis: A Comprehensive Benchmark Study
Ziwei Yang, Xuxi Chen, Biqing Zhu, Tianlong Chen, Zhangyang Wang
- Published: 21 Feb 2025, Last Modified: 21 Feb 2025
- Accepted by DMLR
- Readers: Everyone
Constructing Confidence Intervals for “the” Generalization Error – a Comprehensive Benchmark Study
Hannah Schulz-Kümpel, Sebastian Felix Fischer, Roman Hornung, Anne-Laure Boulesteix, Thomas Nagler, Bernd Bischl
- Published: 15 Jan 2025, Last Modified: 15 Jan 2025
- Accepted by DMLR
- Readers: Everyone
SuperBench: A Super-Resolution Benchmark Dataset for Scientific Machine Learning
Pu Ren, N. Benjamin Erichson, Junyi Guo, Shashank Subramanian, Omer San, Zarija Lukic, Michael W. Mahoney
- Published: 04 Feb 2025, Last Modified: 04 Feb 2025
- Accepted by DMLR
- Readers: Everyone
Evaluating Durability: Benchmark Insights into Image and Text Watermarking
Jielin Qiu, William Han, Xuandong Zhao, Shangbang Long, Christos Faloutsos, Lei Li
- Published: 30 Nov 2024, Last Modified: 30 Nov 2024
- Accepted by DMLR
- Readers: Everyone
Towards impactful challenges: post-challenge paper, benchmarks and other dissemination actions
David Rousseau, Antoine Marot, Zhen Xu
- Published: 24 Jan 2025, Last Modified: 24 Jan 2025
- Accepted by DMLR
- Readers: Everyone
Text Quality-Based Pruning for Efficient Training of Language Models
Vasu Sharma, Karthik Padthe, Newsha Ardalani, Kushal Tirumala, Russell Howes, Hu Xu, Po-Yao Huang, Daniel Li Chen, Armen Aghajanyan, Gargi Ghosh, Luke Zettlemoyer
- Published: 09 Apr 2025, Last Modified: 09 Apr 2025
- Accepted by DMLR
- Readers: Everyone
When is Off-Policy Evaluation (Reward Modeling) Useful in Contextual Bandits? A Data-Centric Perspective
Hao Sun, Alex James Chan, Nabeel Seedat, Alihan Hüyük, Mihaela van der Schaar
- Published: 23 Sept 2024, Last Modified: 23 Sept 2024
- Accepted by DMLR
- Readers: Everyone
Benchmarking Edge Regression on Temporal Networks
Muberra Ozmen, Florence Regol, Thomas Markovich
- Published: 19 Sept 2024, Last Modified: 19 Sept 2024
- Accepted by DMLR
- Readers: Everyone
Data Acquisition: A New Frontier in Data-centric AI
Lingjiao Chen, Bilge Acun, Newsha Ardalani, Yifan Sun, Feiyang Kang, Hanrui Lyu, Yongchan Kwon, Ruoxi Jia, Carole-Jean Wu, Matei Zaharia, James Zou
- Published: 16 Feb 2025, Last Modified: 16 Feb 2025
- Accepted by DMLR
- Readers: Everyone
Potion: Towards Poison Unlearning
Stefan Schoepf, Jack Foster, Alexandra Brintrup
- Published: 11 Sept 2024, Last Modified: 11 Sept 2024
- Accepted by DMLR
- Readers: Everyone
Challenge design roadmap
Hugo Jair Escalante, Isabelle Guyon, Addison Howard, Walter Reade, Sebastien Treguer
- Published: 13 Feb 2025, Last Modified: 13 Feb 2025
- Accepted by DMLR
- Readers: Everyone
On Catastrophic Inheritance of Large Foundation Models
Hao Chen, Bhiksha Raj, Xing Xie, Jindong Wang
- Published: 19 Sept 2024, Last Modified: 19 Sept 2024
- Accepted by DMLR
- Readers: Everyone
ComPile: A Large IR Dataset from Production Sources
Aiden Grossman, Ludger Paehler, Konstantinos Parasyris, Tal Ben-Nun, Jacob Hegna, William S. Moses, Jose M Monsalve Diaz, Mircea Trofin, Johannes Doerfert
- Published: 13 Sept 2024, Last Modified: 13 Sept 2024
- Accepted by DMLR
- Readers: Everyone
Forecasting Electric Vehicle Charging Station Occupancy: Smarter Mobility Data Challenge
Yvenn Amara-Ouali, Yannig Goude, Nathan Doumèche, Pascal Veyret, Alexis Thomas, Daniel Hebenstreit, Thomas Wedenig, Arthur SATOUF, Aymeric Jan, Yannick Deleuze, Paul Berhaut, Sebastien Treguer
- Published: 28 Aug 2024, Last Modified: 09 Sept 2024
- Accepted by DMLR
- Readers: Everyone
Properties of Alternative Data for Fairer Credit Risk Predictions
Jung Youn Lee, Joonhyuk Yang
- Published: 22 Oct 2024, Last Modified: 22 Oct 2024
- Accepted by DMLR
- Readers: Everyone
GlycoNMR: Dataset and Benchmark of Carbohydrate-Specific NMR Chemical Shift for Machine Learning Research
Zizhang Chen, Ryan Paul Badman, Bethany Lachele Foley, Robert J Woods, Pengyu Hong
- Published: 10 Jul 2024, Last Modified: 09 Sept 2024
- Accepted by DMLR
- Readers: Everyone
You can't handle the (dirty) truth: Data-centric insights improve pseudo-labeling
Nabeel Seedat, Nicolas Huynh, Fergus Imrie, Mihaela van der Schaar
- Published: 14 Jun 2024, Last Modified: 14 Jun 2024
- Accepted by DMLR
- Readers: Everyone
NAFlora-1M: Continental-Scale High-Resolution Fine-Grained Plant Classification Dataset
John Park, Riccardo de Lutio, Brendan Rappazzo, Barbara Ambrose, Fabian Michelangeli, Kimberly Watson, Serge Belongie, Damon Little
- Published: 09 Jun 2024, Last Modified: 09 Jun 2024
- Accepted by DMLR
- Readers: Everyone
VALUED - Vision and Logical Understanding Evaluation Dataset
Soumadeep Saha, Saptarshi Saha, Utpal Garain
- Published: 27 Jul 2024, Last Modified: 27 Jul 2024
- Accepted by DMLR
- Readers: Everyone
FedAIoT: A Federated Learning Benchmark for Artificial Intelligence of Things
Samiul Alam, Tuo Zhang, Tiantian Feng, Hui Shen, Zhichao Cao, Dong Zhao, Jeonggil Ko, Kiran Somasundaram, Shrikanth Narayanan, Salman Avestimehr, Mi Zhang
- Published: 21 Aug 2024, Last Modified: 21 Aug 2024
- Accepted by DMLR
- Readers: Everyone
Highlighting Challenges of State-of-the-Art Semantic Segmentation with HAIR - A Dataset of Historical Aerial Images
Saeid Shamsaliei, Odd Erik Gundersen, Knut Tore Alfredsen, Jo Halvard Halleraker, anders foldvik
- Published: 31 May 2024, Last Modified: 11 Jun 2024
- Accepted by DMLR
- Readers: Everyone
Deep Neural Network Benchmarks for Selective Classification
Andrea Pugnana, Lorenzo Perini, Jesse Davis, Salvatore Ruggieri
- Published: 01 Sept 2024, Last Modified: 01 Sept 2024
- Accepted by DMLR
- Readers: Everyone
ATCO2 corpus: A Large-Scale Dataset for Research on Automatic Speech Recognition and Natural Language Understanding of Air Traffic Control Communications
Juan Pablo Zuluaga Gomez, Karel Veselý, Igor Szöke, Alexander Blatt, Petr Motlicek, Martin Kocour, Khalid Choukri, Iuliia Nigmatulina, Claudia Cevenini, Allan Tart, Jan Cernocký, Dietrich Klakow
- Published: 06 Dec 2024, Last Modified: 06 Dec 2024
- Accepted by DMLR
- Readers: Everyone