Overcoming Catastrophic Forgetting with Hard Attention to the Task

Joan Serrà, Didac Suris, Marius Miron, Alexandros Karatzoglou

Abstract: Catastrophic forgetting occurs when a neural network loses the information learned in a previous task after training on subsequent tasks. This problem remains a hurdle for artificial intelligence s...