Principles for the Design of Online A/B Metrics

Widad Machmouchi, Georg Buscher

Abstract: In this paper, we describe principles for designing metrics in the context of A/B experiments. We share some issues that comes up in designing such experiments and provide solutions to avoid such pitfalls.