Sequoia: A Software Framework to Unify Continual Learning Research

Fabrice Normandin, Oleksiy Ostapenko, Pau Rodriguez, Florian Golemo, Ryan Lindeborg, Matthew D Riemer, Lucas Cecchi, Timothee LESORT, Khimya Khetarpal, David Vazquez, Laurent Charlin, Irina Rish, Massimo Caccia

Keywords: Continual Learning, Reinforcement Learning, Software Engineering, Deep learning

Abstract: The field of Continual Learning (CL) seeks to develop algorithms that accumulate knowledge and skills over time through interaction with non-stationary environments. In practice, a plethora of evaluation procedures (settings) and algorithmic solutions (methods) exist, each with their own potentially disjoint set of assumptions. This variety makes measuring progress in CL difficult. We propose a taxonomy of settings, where each setting is described as a set of assumptions. A tree-shaped hierarchy emerges from this view, where more general settings become the parents of those with more restrictive assumptions. This makes it possible to use inheritance to share and reuse research, as developing a method for a given setting also makes it directly applicable onto any of its children. We instantiate this idea as a publicly available software framework called Sequoia, which features a wide variety of settings from both the Continual Supervised Learning (CSL) and Continual Reinforcement Learning (CRL) domains. Sequoia also includes a growing suite of methods which are easy to extend and customize, in addition to more specialized methods from external libraries. We hope that this new paradigm and its first implementation can help unify and accelerate research in CL. You can help us grow the tree by visiting (this GitHub URL).

One-sentence Summary: Sequoia is a unifying (software) framework featuring nearly all the research settings and methods from the fields of Continual Reinforcement and Continual Supervised Learning.

Community Implementations: [ 3 code implementations](https://www.catalyzex.com/paper/arxiv:2108.01005/code)