An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks

Kyubyong Park, Joohong Lee, Seongbo Jang, Dawoon Jung

Abstract: Kyubyong Park, Joohong Lee, Seongbo Jang, Dawoon Jung. Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing. 2020.