How does the inductive bias influence the generalization capability of neural networks?

Charlotte Barth, Thomas Goerttler, Klaus Obermayer

Keywords: overparameterization, generalization, deep neural networks

Abstract: Deep neural networks are a commonly used machine learning technique that have proven to be effective for many different use cases. However, their ability to generalize from training data is not well understood. In this blog post, we will explore the paper “Identity Crisis: Memorization and Generalization under Extreme Overparameterization” by Zhang et al. [2020], which aims to shed light on the question of why neural networks are able to generalize and how inductive biases influence their generalization capabilities.

Blogpost Url: https://iclr-blogposts.github.io/2023/blog/2023/how-does-the-inductive-bias-influence-the-generalization-capability-of-neural-networks/

ICLR Papers: https://openreview.net/forum?id=B1l6y0VFPr

ID Of The Authors Of The ICLR Paper: ~Chiyuan_Zhang1

Conflict Of Interest: No