On the Effectiveness of Sentence Encoding for Intent Detection Meta-LearningDownload PDF


08 Mar 2022, 17:31 (modified: 02 May 2022, 09:31)NAACL 2022 Conference Blind SubmissionReaders: Everyone
Abstract: Recent studies on few-shot intent detection have attempted to formulate the task as a meta-learning problem, where a meta-learning model is trained with a certain capability to quickly adapt to newly specified few-shot tasks with potentially unseen intent categories. Prototypical networks have been commonly used in this setting, with the hope that good prototypical representations could be learned to capture the semantic similarity between the query and a few labeled instances. This intuition naturally leaves a question of whether or not a good sentence representation scheme could suffice for the task without further domain-specific adaptation. In this paper, we conduct empirical studies on a number of general-purpose sentence embedding schemes, showing that good sentence embeddings without any fine-tuning on intent detection data could produce a non-trivially strong performance. Inspired by the results from our qualitative analysis, we propose a frustratingly easy modification, which leads to consistent improvements over all sentence encoding schemes, including those from the state-of-the-art prototypical network variants with task-specific fine-tuning.
Paper Link: https://openreview.net/forum?id=e_K7EoYi-y
Paper Type: Long paper (up to eight pages of content + unlimited references and appendices)
Presentation Mode: This paper will be presented virtually
Virtual Presentation Timezone: UTC+8
Copyright Consent Signature (type Name Or NA If Not Transferrable): Tingting Ma
Copyright Consent Name And Address: Harbin Institute of Technology, China
0 Replies