Real Time English Speech to British Sign Language Translation for Accessible Banking

Abhishek Bharadwaj Varanasi, Manjira Sinha, Tirthankar Dasgupta, Charudatta Jadhav

Abstract: This paper presents a mobile-based framework for real-time English Speech-to-British Sign Language (BSL) translation, focused on accessible banking. Using a transformer based encoder-decoder model, the system converts English speech into BSL gloss HamNoSys for avatar animation, optimized for handheld devices. A parallel dataset was created for experimentation, covering multiple domains. The model achieved a 73.87% ROUGE-L score in speech-togloss HamNoSys translation and underwent user-based evaluation with BSL experts, offering valuable insights into its effectiveness and cross-domain performance.