Reducing total latency in online real-time inference and decoding via combined context window and model smoothing latencies

Chandrashekhar Lavania, Jeff A. Bilmes