Rich Feature Construction for the Optimization-Generalization Dilemma

Jianyu Zhang, David Lopez-Paz, Léon Bottou

Abstract: There often is a dilemma between ease of optimization and robust out-of-distribution (OoD) generalization. For instance, many OoD methods rely on penalty terms whose optimization is challenging. Th...