It's Time to Move On: Primacy Bias and Why It Helps to Forget

ICLR 2024 BlogPosts Submission19 Authors

Published: 16 Feb 2024, Last Modified: 28 Mar 2024BT@ICLR2024EveryoneRevisionsBibTeXCC BY 4.0
Keywords: Deep Reinforcement Learning, Primacy Bias
Blogpost Url: https://iclr-blogposts.github.io/2024/blog/primacy-bias-and-why-it-helps-to-forget/
Abstract: 'The Primacy Bias in Deep Reinforcement Learning' (Nikishin et al. 2022) demonstrates how the first experiences of a deep learning model can cause catastrophic memorization and how this can be prevented. In this post we describe primacy bias, summarize the authors' key findings, and present a simple environment to experiment with primacy bias.
Ref Papers: https://arxiv.org/pdf/2205.07802.pdf
Id Of The Authors Of The Papers: ~Evgenii_Nikishin1, ~Max_Schwarzer1, ~Pierluca_D%27Oro1
Conflict Of Interest: None.
Submission Number: 19