Few-Shot Regression via Learned Basis Functions

Yi Loo, Swee Kiat Lim, Gemma Roig, Ngai-Man Cheung

Keywords: Few-Shot Leaning, Regression, Learning Basis Functions, Few-Shot Regression

TL;DR: We propose a few-shot learning model that is tailored specifically for regression tasks

Abstract:

The recent rise in popularity of few-shot learning algorithms has enabled models to quickly adapt to new tasks based on only a few training samples. Previous few-shot learning works have mainly focused on classification and reinforcement learning.
In this paper, we propose a few-shot meta-learning system that focuses exclusively on regression tasks. Our model is based on the idea that the degree of freedom of the unknown function can be significantly reduced if it is represented as a linear combination of a set of appropriate basis functions. This enables a few labelled samples to approximate the function. We design a Feature Extractor network to encode basis functions for a task distribution, and a Weights Generator to generate the weight vector for a novel task. We show that our model outperforms the current state of the art meta-learning methods in various regression tasks.