Tube Loss: A Novel Approach for High Quality Prediction Interval Estimation

Pritam Anand, Tathagata Bandyopadhyay, Harshkumar Mukeshbhai Savaliya, Suresh Chandra

Primary Area: probabilistic methods (Bayesian methods, variational inference, sampling, UQ, etc.)

Code Of Ethics: I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.

Keywords: Prediction Interval Estimation, Neural Network, Loss Function, Kernel Machine

Submission Guidelines: I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2024/AuthorGuide.

Abstract: This paper proposes a continuous loss function termed 'tube loss' for Prediction Interval (PI) estimation. The minimizer of the proposed tube loss is a pair of functions $\mu_1(x)$ and $\mu_2(x)$ such that the interval $[\mu_1(x),\mu_2(x)]$ contains $t$ fraction of $y_i$ values. The tube loss function also facilitates an upward or downward movement of the PI tube so that the estimated PI may cover the densest regions of response values, thus allowing the sharpening of the width of PI, especially when the distribution of the response is skewed. The tube loss function-based machine learning models also have the privilege of trading off the calibration error and the width of PI by solving a single optimization problem. We have illustrated the use of tube loss functions in kernel machines, neural networks, and sequential deep learning models. Our numerical experiments show that the tube loss function is effective in yielding narrow and more accurate PIs compared to the existing methods.

Anonymous Url: I certify that there is no URL (e.g., github page) that could be used to find authors' identity.

No Acknowledgement Section: I certify that there is no acknowledgement section in this submission for double blind review.

Submission Number: 7514