What Can Linear Interpolation of Neural Network Loss Landscapes Tell Us?

Tiffany J. Vlaar, Jonathan Frankle

Abstract: Studying neural network loss landscapes provides insights into the nature of the underlying optimization problems. Unfortunately, loss landscapes are notoriously difficult to visualize in a human-c...