Truth Discovery Against Disguised Attack Mechanism in Crowdsourcing

Xiu Fang, Yating Tang, Guohao Sun, Chenling Shen, Hao Chen

Abstract: Crowdsourcing is an effective paradigm for recruiting online workers to perform intelligent tasks that are difficult for computers to complete. More and more attacks bring challenges to crowdsourcing systems. Although the truth discovery method can defend against common attacks to a certain extent, the real scene is much more complex. Malicious workers can not only improve their reliability by agreeing with normal workers on tasks that are unlikely to be overturned, but also gather together to launch more effective attacks on tasks that are easily overturned. This disguised attack is smarter and harder to defend. To solve this problem, we propose a new defense framework TD-DA (Truth Discovery against Disguised Attack) composed of truth discovery and task allocation. In the truth discovery phase, we quantify the aggressiveness and reliability of workers on the golden task based on the sigmoid function. In the task allocation phase, the Weighted Arithmetic Mean (WAM) is used to estimate the allocation probability of golden tasks to avoid the shortage of golden tasks. Extensive experiments on real-world datasets and synthetic datasets demonstrate that our method is effective against disguised attacks.

External IDs:dblp:conf/apweb/FangTSSC23