Deterministic Model for Distributed Speculative Stream Processing

Download PDF
Open Webpage

Igor E. Kuralenok, Artem Trofimov, Nikita Marshalkin, Boris Novikov

Published: 2018, Last Modified: 16 Jan 2026ADBIS 2018EveryoneRevisionsBibTeXCC BY-SA 4.0
Abstract: Users of modern distributed stream processing systems have to choose between non-deterministic computations and high latency due to a need in excessive buffering. We introduce a speculative model based on MapReduce-complete set of operations that allows us to achieve determinism and low-latency. Experiments show that our prototype can outperform existing solutions due to low overhead of optimistic synchronization.