TabNet: Attentive Interpretable Tabular Learning

Sercan O. Arik, Tomas Pfister

TL;DR: We propose a novel high-performance interpretable deep tabular data learning network.

Abstract: We propose a novel high-performance interpretable deep tabular data learning network, TabNet. TabNet utilizes a sequential attention mechanism that softly selects features to reason from at each decision step and then aggregates the processed information to make a final prediction decision. By explicitly selecting sparse features, TabNet learns very efficiently as the model capacity at each decision step is fully utilized for the most relevant features, resulting in a high performance model. This sparsity also enables more interpretable decision making through the visualization of feature selection masks. We demonstrate that TabNet outperforms other neural network and decision tree variants on a wide range of tabular data learning datasets and yields interpretable feature attributions and insights into the global model behavior.

Code: https://drive.google.com/file/d/1oLQRgKygAEVRRmqCZTPwno7gyTq22wbb/view?usp=sharing

Keywords: Tabular data, interpretable neural networks, attention models

Community Implementations: [ 7 code implementations](https://www.catalyzex.com/paper/arxiv:1908.07442/code)