Distinguishing Question Subjectivity from Difficulty for Improved Crowdsourcing

Yuan Jin, Mark J. Carman, Ye Zhu, Wray L. Buntine

Abstract: The questions in a crowdsourcing task typically exhibit varying degrees of <em>difficulty</em> and <em>subjectivity</em>. Their joint effects give rise to the variation in responses to the same que...