End-to-end Adversarial Sample Generation for Data Augmentation

Tianyuan Liu, YUQING SUN

Submission Type: Regular Long Paper

Submission Track: Machine Learning for NLP

Submission Track 2: Efficient Methods for NLP

Keywords: adversarial sample, data augmentation

Abstract:

Adversarial samples pose a significant challenge to neural inference models.
In this paper, we propose a novel enhancing approach A3 for the robustness of the neural NLP models, which combines the adversarial training and data augmentation.
We propose an adversarial sample generator that consists of a conditioned paraphrasing model and a condition generator.
The latter aims to generate conditions which guides the paraphrasing model to generate adversarial samples.
A pretrained discriminator is introduced to help the adversarial sample generator adapt to the data characteristics for different tasks.
We adopt a weighted loss to incorporate the generated adversarial samples with the original samples for augmented training.
Compared to existing methods, our approach is much efficient since the generation process is independent to the target model and the generated samples are reusable for different models.
Experimental results on several tasks show that our approach improves the overall performance of the trained model. Specially, the enhanced model is robust for various attacking techniques.

Submission Number: 3318