Exploration of the CycleGN Framework for Low-Resource Languages

Sören Dreano, Derek Molloy, Noel Murphy

Abstract: CycleGN is a Neural Machine Translation framework relying on the Transformer architecture. The foundational concept of our research posits that in an ideal scenario, retro-translations of generated translations should revert to the original source sentences. Consequently, a pair of models can be trained using a Cycle Consistency Loss only, with one model translating in one direction and the second model in the opposite direction.