A framework for exploring and evaluating mechanics in human computation games

Kristin Siu, Alexander Zook, Mark O. Riedl

Abstract: Human computation games (HCGs) are a crowdsourcing approach to solving computationally-intractable tasks using games. We outline a formal representation of the mechanics in HCGs, providing a structural breakdown to visualize, compare, and explore the space of HCG mechanics. We present a methodology based on small-scale design experiments using fixed tasks while varying game elements to observe effects on both the player experience and the human computation task completion. Ultimately, we wish enable easier exploration and development of HCGs, letting these games provide meaningful experiences to players while solving difficult problems.