An empirical analysis of feature fusion task heads of ViT pre-trained models on OOD classification tasks

Mingxing Zhang, Jun Ai, Tao Shi

Abstract: Highlights•Complex task heads should be applied to larger datasets.•The task head’s structure impacts model performance and generalization.•The fusion middle-layer location affects the backbone network characteristics.•Attention mechanism makes the task head more convex and stable.