Empirical Bayes Trend Filtering Through a Variational Inference Framework
Abstract: This paper introduces a novel framework for Bayesian trend filtering using an empirical Bayes approach and a variational inference algorithm. Trend filtering is a nonparametric regression technique that has gained popularity for its simple formulation and local adaptability. Bayesian adaptations of trend filtering have been proposed as an alternative method, while they often rely on computationally intensive sampling-based methods for posterior inference. We propose an empirical Bayes trend filtering (EBTF) that leverages shrinkage priors, estimated through an empirical Bayes procedure by maximizing the marginal likelihood. To address the computational challenges posed by large datasets, we implement a variational inference algorithm for posterior computation, ensuring scalability and efficiency. Our framework is flexible, allowing the incorporation of various shrinkage priors, and optimizes the level of smoothness directly from the data. We also discuss alternative formulations of the EBTF model, along with their pros and cons. We demonstrate the performance of our EBTF method through comprehensive simulations and real-world data applications, highlighting its ability to maintain computational efficiency while providing accurate trend estimation.
Submission Length: Regular submission (no more than 12 pages of main content)
Changes Since Last Submission: 1. Changed all theorem/lemma statements to inline math within the text, in both the main body and appendix.
2. Changed to camera-ready format.
3. Added GitHub link to the code in the main text.
Assigned Action Editor: ~Trevor_Campbell1
Submission Number: 3949
Loading