Detection of Error-Prone Cases for Word Sense Disambiguation

Yong-Jin Han, Sang-Jo Lee, Se-Young Park, Seong-Bae Park

Abstract: Word sense disambiguation (WSD) is essential for natural language understanding applications such as machine translation, question & answering, and natural language interface, since the performance of such applications depends on the senses of lexicons. Thus, it is natural to consider lexicons as the most crucial features in WSD. However, due to the extensiveness of lexical space, WSD methods based on machine learning techniques with lexical features suffer from the sparse data problem. To tackle this problem, this paper proposes a hybrid approach which separately copes with an error-prone data due to sparsity. A data is regarded as error-prone if its nearest neighbors are relatively distant and their senses are uniformly distributed. Then, our hybrid approach focuses on such an error-prone data without tuning of a base method. In the experiments, the k-nearest neighbor method is used as a base method. If a data is determined as an error-prone case, it is processed by a prototype based method. The prototype based method takes an advantage from overall training examples rather than depends on only several neighbors. The experimental results on Senseval-3 nouns show that an error-prone data is effectively detected by the proposed method and our hybrid approach outperforms the ordinary k-nearest neighbor method and the prototype based method.