Access the full text.
Sign up today, get DeepDyve free for 14 days.
Chien-Ju Ho, Jennifer Vaughan (2012)
Online Task Assignment in Crowdsourcing MarketsProceedings of the AAAI Conference on Artificial Intelligence
Xuan Liu, Meiyu Lu, B. Ooi, Yanyan Shen, Sai Wu, Meihui Zhang (2012)
CDAS: A Crowdsourcing Data Analytics SystemArXiv, abs/1207.0143
Han Yu, C. Miao, Bo An, Zhiqi Shen, Cyril Leung (2014)
Reputation-aware task allocation for human trustees
Han Yu, Zhiqi Shen, C. Miao, Cyril Leung, Yiqiang Chen, Simon Fauvel, Jun Lin, Li-zhen Cui, Zhengxiang Pan, Qiang Yang (2017)
A dataset of human decision-making in teamwork managementScientific Data, 4
Han Yu, Xinjia Yu, Sufang Lim, Jun Lin, Zhiqi Shen, C. Miao (2014)
A multi-agent game for studying human decision-making
Anna Aljanaki, F. Wiering, R. Veltkamp (2016)
Studying emotion induced by music through a crowdsourcing gameInf. Process. Manag., 52
C. Watkins, P. Dayan (2004)
Technical Note: Q-LearningMachine Learning, 8
Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence A Reputation Management Approach for Resource Constrained Trustee Agents
David Silver, Aja Huang, Chris Maddison, A. Guez, L. Sifre, George Driessche, Julian Schrittwieser, Ioannis Antonoglou, Vedavyas Panneershelvam, Marc Lanctot, S. Dieleman, Dominik Grewe, John Nham, Nal Kalchbrenner, Ilya Sutskever, T. Lillicrap, M. Leach, K. Kavukcuoglu, T. Graepel, D. Hassabis (2016)
Mastering the game of Go with deep neural networks and tree searchNature, 529
Steven Whang, P. Lofgren, H. Garcia-Molina (2013)
Question Selection for Crowd Entity ResolutionProc. VLDB Endow., 6
Nuno Luz, Nuno Silva, P. Novais (2015)
A survey of task-oriented crowdsourcingArtificial Intelligence Review, 44
Srikanth Jagabathula, L. Subramanian, Ashwin Venkataraman (2014)
Reputation-based Worker Filtering in Crowdsourcing
C. Miao, Han Yu, Zhiqi Shen, Cyril Leung (2016)
Balancing quality and budget considerations in mobile crowdsourcingDecis. Support Syst., 90
Long Tran-Thanh, T. Huynh, A. Rosenfeld, S. Ramchurn, N. Jennings (2014)
BudgetFix: budget limited crowdsourcing for interdependent task allocation with quality guarantees
Volodymyr Mnih, K. Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, Martin Riedmiller (2013)
Playing Atari with Deep Reinforcement LearningArXiv, abs/1312.5602
T. Galla, J. Farmer, K. Wachter (2011)
Complex dynamics in learning complicated gamesProceedings of the National Academy of Sciences, 110
Han Yu, Zhiqi Shen, C. Miao, Bo An (2013)
A reputation-aware decision-making approach for improving the efficiency of crowdsourcing systems
yu (0)
1315Proceedings of the 12th International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS'13)
Z. Man, Kevin Lee, Dianhui Wang, Z. Cao, C. Miao (2011)
A new robust training algorithm for a class of single-hidden layer feedforward neural networksNeurocomputing, 74
Kathryn Macarthur, Ruben Stranders, S. Ramchurn, N. Jennings (2011)
A Distributed Anytime Algorithm for Dynamic Task Allocation in Multi-Agent SystemsProceedings of the AAAI Conference on Artificial Intelligence
D. Thomas (2019)
Crowdsourcing in software engineering: models, motivations, and challenges
(2012)
Imagenet classi fi cation with deep convolutional neural networks ”
tran-thanh (0)
901Proceedings of the 12th International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS'13)
Han Yu, Han Lin, Sufang Lim, Jun Lin, Zhiqi Shen, C. Miao (2015)
Empirical Analysis of Reputation-aware Task Delegation by Humans from a Multi-agent Game
Ritu Khare, Benjamin Good, Robert Leaman, A. Su, Zhiyong Lu (2016)
Crowdsourcing in biomedicine: challenges and opportunitiesBriefings in bioinformatics, 17 1
Long Tran-Thanh, M. Venanzi, A. Rogers, N. Jennings (2013)
Efficient budget allocation with accuracy guarantees for crowdsourcing classification tasks
Han Yu, Zhiqi Shen, C. Miao, Bo An (2012)
Challenges and Opportunities for Trust Management in Crowdsourcing2012 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology, 2
A. Goh (1995)
Back-propagation neural networks for modeling complex systemsArtif. Intell. Eng., 9
Ken Chen, Shoujian Yang, C. Batur (2012)
Effect of multi-hidden-layer structure on performance of BP neural network: Probe2012 8th International Conference on Natural Computation
Han Yu, C. Miao, Zhiqi Shen, Cyril Leung (2015)
Quality and Budget Aware Task Allocation for Spatial Crowdsourcing
A. Jøsang, Roslan Ismail, C. Boyd (2007)
A survey of trust and reputation systems for online service provisionDecis. Support Syst., 43
Swaprava Nath, Balakrishnan Narayanaswamy (2014)
Productive output in hierarchical crowdsourcing
Han Yu, C. Miao, Zhiqi Shen, Cyril Leung, Yiqiang Chen, Qiang Yang (2015)
Efficient Task Sub-Delegation for Crowdsourcing
Alessio Trivella, David Pisinger (2016)
The load-balanced multi-dimensional bin-packing problemComput. Oper. Res., 74
Bilal Kartal, Ernesto Nunes, Julio Godoy, Maria Gini (2016)
Monte Carlo Tree Search for Multi-Robot Task Allocation
Siyuan Liu, C. Miao, Y. Liu, Han Yu, Jie Zhang, Cyril Leung (2015)
An Incentive Mechanism to Elicit Truthful Opinions for Crowdsourced Multiple Choice Consensus Tasks2015 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT), 2
A. Krizhevsky, Ilya Sutskever, Geoffrey Hinton (2012)
ImageNet classification with deep convolutional neural networksCommunications of the ACM, 60
tran-thanh (0)
477Proceedings of the 1st International Conference on Autonomous Agents and Multi-Agent Systems
Han Yu, Zhiqi Shen, C. Miao, Cyril Leung, D. Niyato (2010)
A Survey of Trust and Reputation Management Systems in Wireless CommunicationsProceedings of the IEEE, 98
Han Yu, C. Miao, Cyril Leung, Yiqiang Chen, Simon Fauvel, V. Lesser, Qiang Yang (2016)
Mitigating Herding in Hierarchical Crowdsourcing Networks.Scientific reports, 6 1
PurposeAllocation of complex crowdsourcing tasks, which typically include heterogeneous attributes such as value, difficulty, skill required, effort required and deadline, is still a challenging open problem. In recent years, agent-based crowdsourcing approaches focusing on recommendations or incentives have emerged to dynamically match workers with diverse characteristics to tasks to achieve high collective productivity. However, existing approaches are mostly designed based on expert knowledge grounded in well-established theoretical frameworks. They often fail to leverage on user-generated data to capture the complex interaction of crowdsourcing participants’ behaviours. This paper aims to address this challenge.Design/methodology/approachThe paper proposes a policy network plus reputation network (PNRN) approach which combines supervised learning and reinforcement learning to imitate human task allocation strategies which beat artificial intelligence strategies in this large-scale empirical study. The proposed approach incorporates a policy network for the selection of task allocation strategies and a reputation network for calculating the trends of worker reputation fluctuations. Then, by iteratively applying the policy network and reputation network, a multi-round allocation strategy is proposed.FindingsPNRN has been trained and evaluated using a large-scale real human task allocation strategy data set derived from the Agile Manager game with close to 500,000 decision records from 1,144 players in over 9,000 game sessions. Extensive experiments demonstrate the validity and efficiency of computational complex crowdsourcing task allocation strategy learned from human participants.Originality/valueThe paper can give a better task allocation strategy in the crowdsourcing systems.
International Journal of Crowd Science – Emerald Publishing
Published: Jun 12, 2017
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.