Non-differentiable saddle points and sub-optimal local minima exist for deep ReLU networks

Bo Liu, Zhaoying Liu, Ting Zhang, Tongtong Yuan