RAR: Retrieval-augmented retrieval for code generation in low resource languages

Download PDF
Open Webpage

Avik Dutta, Mukul Singh, Gust Verbruggen, Sumit Gulwani, Vu Le

Published: 01 Jan 2024, Last Modified: 08 Oct 2025EMNLP 2024EveryoneRevisionsBibTeXCC BY-SA 4.0
Abstract: Language models struggle in generating code for low-resource programming languages, since these are underrepresented in training data. Either examples or documentation are commonly used for improved code generation. We propose to use both types of information together and present retrieval augmented retrieval (RAR) as a two-step method for selecting relevant examples and documentation. Experiments on three low-resource languages (Power Query M, OfficeScript and Excel formulas) show that RAR outperforms independently example and grammar retrieval (+2.81–26.14%). Interestingly, we show that two-step retrieval selects better examples and documentation when used independently as well.