Abstract: Highlights•A classification method based on minimum description length principle is proposed.•The proposed method offered a good trade-off between complexity and predictive power.•The proposed method is lightweight, multiclass, and offers incremental learning.•Experiments were performed using sixteen datasets on two online learning scenarios.•The proposed method outperformed most of the compared online learning methods.