Please use this identifier to cite or link to this item:
Title: MELODY : a long-term dynamic quality-aware incentive mechanism for crowdsourcing
Authors: Wang, HW
Guo, S 
Cao, JN 
Guo, MY
Keywords: Crowdsourcing
Incentive mechanism
Quality control
Approximation algorithm
Inference and learning
Issue Date: 2018
Publisher: Institute of Electrical and Electronics Engineers
Source: IEEE transactions on parallel and distributed systems, Apr. 2018, v. 29, no. 4, p. 901-914 How to cite?
Journal: IEEE transactions on parallel and distributed systems 
Abstract: Crowdsourcing allows requesters to allocate tasks to a group of workers on the Internet to make use of their collective intelligence. Quality control is a key design objective in incentive mechanisms for crowdsourcing as requesters aim at obtaining high-quality answers under a limited budget. However, when measuring workers' long-term quality, existing mechanisms either fail to utilize workers' historical information, or treat workers' quality as stable and ignore its temporal characteristics, hence performing poorly in a long run. In this paper we propose MELODY, a long-term dynamic quality-aware incentive mechanism for crowdsourcing. MELODY models interaction between requesters and workers as reverse auctions that run continuously. In each run of MELODY, we design a truthful, individual rational, budget feasible and quality-aware algorithm for task allocation with polynomial-time computation complexity and O(1) performance ratio. Moreover, taking into consideration the long-term characteristics of workers' quality, we propose a novel framework in MELODY for quality inference and parameters learning based on Linear Dynamical Systems at the end of each run, which takes full advantage of workers' historical information and predicts their quality accurately. Through extensive simulations, we demonstrate that MELODY outperforms existing work in terms of both quality estimation (reducing estimation error by 17: 6% similar to 24: 2%) and social performance (increasing requester's utility by 18: 2% similar to 46: 6%) in long-term scenarios.
ISSN: 1045-9219
EISSN: 1558-2183
DOI: 10.1109/TPDS.2017.2775232
Appears in Collections:Journal/Magazine Article

View full-text via PolyU eLinks SFX Query
Show full item record


Citations as of Jan 5, 2019


Citations as of Jan 14, 2019

Google ScholarTM



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.