CrowdOp: Query optimization for declarative crowdsourcing systems

Ju Fan, Meihui Zhang, Stanley Kok, Meiyu Lu, Beng Chin Ooi

Abstract: We propose CROWDOP, a cost-based query optimization approach for declarative crowdsourcing systems. CROWDOP considers both cost and latency in the query optimization objectives and generates query plans that provide a good balance between the cost and latency. We develop efficient algorithms in CROWDOP for optimizing three types of queries: selection, join and complex selection-join queries. We validate our approach via extensive experiments by simulation as well as with the real crowd on Amazon Mechanical Turk.