NeurIPS 2024 Workshop OPT Submissions

Differentially Private Random Block Coordinate Descent
Arto Maranjyan, Abdurakhmon Sadiev, Peter Richtárik
- Published: 10 Oct 2024, Last Modified: 07 Dec 2024
- NeurIPS 2024 Workshop
- Readers: Everyone
Dueling in the Dark: An Efficient and Optimal Mirror Descent Approach for Online Optimization with Adversarial Preferences
Aadirupa Saha, Yonathan Efroni, Barry-John Theobald
- Published: 10 Oct 2024, Last Modified: 07 Dec 2024
- NeurIPS 2024 Workshop
- Readers: Everyone
Improving Deep Learning Speed and Performance through Synaptic Neural Balance
Antonios Alexos, Ian Domingo, Pierre Baldi
- Published: 10 Oct 2024, Last Modified: 16 Apr 2025
- NeurIPS 2024 Workshop
- Readers: Everyone
Local Curvature Descent: Squeezing More Curvature out of Standard and Polyak Gradient Descent
Peter Richtárik, Simone Maria Giancola, Dymitr Lubczyk, Robin Yadav
- Published: 10 Oct 2024, Last Modified: 07 Dec 2024
- NeurIPS 2024 Workshop
- Readers: Everyone
How Does Critical Batch Size Scale in Pre-training?
Hanlin Zhang, Depen Morwani, Nikhil Vyas, Jingfeng Wu, Difan Zou, Udaya Ghai, Dean Foster, Sham M. Kakade
- Published: 10 Oct 2024, Last Modified: 07 Dec 2024
- NeurIPS 2024 Workshop
- Readers: Everyone
$\mu$LO: Compute-Efficient Meta-Generalization of Learned Optimizers
Benjamin Thérien, Charles-Étienne Joseph, Boris Knyazev, Edouard Oyallon, Irina Rish, Eugene Belilovsky
- Published: 10 Oct 2024, Last Modified: 07 Dec 2024
- NeurIPS 2024 Workshop
- Readers: Everyone
Dense Backpropagation Improves Routing for Sparsely-Gated Mixture-of-Experts
Ashwinee Panda, Vatsal Baherwani, Zain Sarwar, Benjamin Thérien, Stephen Rawls, Sambit Sahu, Supriyo Chakraborty, Tom Goldstein
- Published: 10 Oct 2024, Last Modified: 07 Dec 2024
- NeurIPS 2024 Workshop
- Readers: Everyone
Old Optimizer, New Norm: An Anthology
Jeremy Bernstein, Laker Newhouse
- Published: 10 Oct 2024, Last Modified: 07 Dec 2024
- NeurIPS 2024 Workshop
- Readers: Everyone
Memory Efficient Adaptive Stochastic Optimization via Subset-Norm
Thien Hang Nguyen, Huy Nguyen
- Published: 10 Oct 2024, Last Modified: 07 Dec 2024
- NeurIPS 2024 Workshop
- Readers: Everyone
Tight Lower Bounds and Improved Convergence in Performative Prediction
Pedram Khorsandi, Rushil Gupta, Mehrnaz Mofakhami, Simon Lacoste-Julien, Gauthier Gidel
- Published: 10 Oct 2024, Last Modified: 07 Dec 2024
- NeurIPS 2024 Workshop
- Readers: Everyone
Langevin Dynamics: A Unified Perspective on Optimization via Lyapunov Potentials
August Y Chen, Ayush Sekhari, Karthik Sridharan
- Published: 10 Oct 2024, Last Modified: 07 Dec 2024
- NeurIPS 2024 Workshop
- Readers: Everyone
In the Search for Optimal Portfolios of Counterstrategies in the Large Imperfect Information Games
Karolina Drabent, David Milec, Ondrej Kubicek, Viliam Lisý
- Published: 10 Oct 2024, Last Modified: 07 Dec 2024
- NeurIPS 2024 Workshop
- Readers: Everyone
On the Inherent Privacy of Two Point Zeroth Order Projected Gradient Descent
Devansh Gupta, Meisam Razaviyayn, Vatsal Sharan
- Published: 10 Oct 2024, Last Modified: 07 Dec 2024
- NeurIPS 2024 Workshop
- Readers: Everyone
Structured Regularization on the SPD Manifold
Andrew Nicholas Cheng, Melanie Weber
- Published: 10 Oct 2024, Last Modified: 07 Dec 2024
- NeurIPS 2024 Workshop
- Readers: Everyone
Understanding Adam Requires Better Rotation Dependent Assumptions
Tianyue H. Zhang, Lucas Maes, Alexia Jolicoeur-Martineau, Ioannis Mitliagkas, Damien Scieur, Simon Lacoste-Julien, Charles Guille-Escuret
- Published: 10 Oct 2024, Last Modified: 07 Dec 2024
- NeurIPS 2024 Workshop
- Readers: Everyone
Policy Optimization for Strictly Batch Imitation Learning
Rishabh Agrawal, Nathan Dahlin, Rahul Jain, Ashutosh Nayyar
- Published: 10 Oct 2024, Last Modified: 07 Dec 2024
- NeurIPS 2024 Workshop
- Readers: Everyone
Fast Convergence of Softmax Policy Mirror Ascent for Bandits & Tabular MDPs
Reza Asad, Reza Babanezhad Harikandeh, Issam H. Laradji, Nicolas Le Roux, Sharan Vaswani
- Published: 10 Oct 2024, Last Modified: 07 Dec 2024
- NeurIPS 2024 Workshop
- Readers: Everyone
Consensus Based Optimization Accelerates Gradient Descent
Anagha Satish, Ricardo Baptista, Franca Hoffmann
- Published: 10 Oct 2024, Last Modified: 07 Dec 2024
- NeurIPS 2024 Workshop
- Readers: Everyone
BlockLLM: Memory-Efficient Adaptation of LLMs by Selecting and Optimizing the Right Coordinate Blocks
Amrutha Varshini Ramesh, Vignesh Ganapathiraman, Issam H. Laradji, Mark Schmidt
- Published: 10 Oct 2024, Last Modified: 07 Dec 2024
- NeurIPS 2024 Workshop
- Readers: Everyone
Pseudo-Asynchronous Local SGD: Robust and Efficient Data-Parallel Training
Hiroki Naganuma, Xinzhi Zhang, Man-Chung Yue, Ioannis Mitliagkas, Russell J. Hewett, Philipp Andre Witte, Yin Tat Lee
- Published: 10 Oct 2024, Last Modified: 07 Dec 2024
- NeurIPS 2024 Workshop
- Readers: Everyone
Scaling Collapse Reveals Universal Dynamics in Compute-Optimally Trained Neural Networks
Shikai Qiu, Atish Agarwala, Jeffrey Pennington, Lechao Xiao
- Published: 10 Oct 2024, Last Modified: 07 Dec 2024
- NeurIPS 2024 Workshop
- Readers: Everyone
SICNN: Sparsity-induced Input Convex Neural Network for Optimal Transport
Peter Chen, Yue Xie, Qingpeng Zhang
- Published: 10 Oct 2024, Last Modified: 07 Dec 2024
- NeurIPS 2024 Workshop
- Readers: Everyone
On the Convergence of FedProx with Extrapolation and Inexact Prox
Hanmin Li, Peter Richtárik
- Published: 10 Oct 2024, Last Modified: 07 Dec 2024
- NeurIPS 2024 Workshop
- Readers: Everyone
Learning Morphisms with Gauss-Newton Approximation for Growing Networks
Neal Gregory Lawton, Aram Galstyan, Greg Ver Steeg
- Published: 10 Oct 2024, Last Modified: 07 Dec 2024
- NeurIPS 2024 Workshop
- Readers: Everyone
Revisiting the Initial Steps in Adaptive Gradient Descent Optimization
Abulikemu Abuduweili, Changliu Liu
- Published: 10 Oct 2024, Last Modified: 07 Dec 2024
- NeurIPS 2024 Workshop
- Readers: Everyone