Dyn-YCSB: Benchmarking Adaptive Frameworks

Subhajit Sidhanta, Supratik Mukhopadhyay, Wojciech M. Golab

Abstract: We demonstrate Dyn-YCSB, a tool that builds upon YCSB (Yahoo Cloud Serving Benchmark suite) to assist users in simulating dynamic variations in workloads. Dyn-YCSB automatically varies the parameters in YCSB workloads over time according to user-specified time series functions, without requiring users to manually change the workload configuration in individual nodes each time the workload parameters needs to be modified. The dynamic workload variations simulated with Dyn-YCSB can be used to evaluate the adaptability of such frameworks to changing workload characteristics. We demonstrate the ability of Dyn-YCSB to evaluate the adaptability of OptCon, an automated framework, that tunes the consistency settings of Cassandra with respect to the latency and staleness thresholds in an SLA.