tBench

Richard T. Snodgrass, Stephen W. Thomas, Rui Zhang

Abstract:

Benchmark; Benchmark framework; tBench; Temporal benchmark
τ Bench [14] is a benchmark framework consisting of ten individual benchmarks, spanning XML, XQuery, XML Schema, and PSM, along with temporal extensions to each, realized by iteratively changing one individual benchmark into another, by modifying the data format, adding schema constraints, or instantiating a different workload.
A benchmark is a collection of data, workload, and metrics. Individual benchmarks allow applications and algorithms to be compared and evaluated in a standard, consistent setting, giving researchers and practitioners invaluable guidance as to the relative performance of the systems under consideration [8]. A benchmark may include a data model, a data definition language, a schema, data, a data manipulation language, a workload, metrics, context, documentation, and tools.

A benchmark familyis a set of loosely related benchmarks. A benchmark family is often...