Assessing Latency in ASR Systems: A Methodological Perspective for Real-Time Use.

Carlos Arriaga, Alejandro Pozo, Javier Conde, Alvaro Alonso

Published: 01 Jan 2025, Last Modified: 08 Jan 2026IEEE Internet ComputingEveryoneRevisionsCC BY-SA 4.0
Abstract: Automatic Speech Recognition (ASR) systems generate real-time transcriptions, but often miss nuances that human interpreters capture. While ASR is useful in many contexts, interpreters - who already use ASR tools such as Dragon - add critical value, especially in sensitive settings such as diplomatic meetings where subtle language is key. Human interpreters not only perceive these nuances but can adjust in real-time, improving accuracy, while ASR handles basic transcription tasks. However, ASR systems introduce a delay that does not align with real-time interpretation needs. The user-perceived latency (UPL) of ASR systems differs from that of interpretation because it measures the time between speech and transcription delivery. To address this, we propose a new approach to measuring delay in ASR systems and validate if they are usable in live interpretation scenarios.
Loading