Abstract: Highlights•We empirically study using adapters to debias visual question answering models.•A single linear layer can shift a model from in-distribution to out-of-distribution performance.•Different debiasing techniques require different placement of adapters for best performance.•Debiased adapters can be used as a diagnosis tool for future works.
Loading