Time-Agnostic Prediction: Predicting Predictable Video Frames

Dinesh Jayaraman, Frederik Ebert, Alexei A. Efros, Sergey Levine

Abstract: In visual prediction tasks, letting your predictive model choose which times to predict does two things: (i) improves prediction quality, and (ii) leads to semantically coherent "bottleneck state" predictions, which are useful for planning.