Abstract
Crowdsourcing is a growing topic that has proved to be capable and cost effective solution for various tasks. Over the last decade it has been applied to numerous domains, both in research and enterprise contexts. Though there are several issues that remain open and challenging in crowdsourcing, here we address the issues of quality control and motivation. In this paper we present an ongoing work which explores the use of gamification in crowdsourcing settings, as means to: improve the task assignment and performance, incentivize people to participate and control the quality of their work. The developed crowdsourcing hybrid mobile application is applied to data within cultural heritage domain.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Yuen, M.C., King, I., Leung, K.S.: A survey of crowdsourcing systems. In: IEEE Third International Conference on Social Computing (2011)
Ren, J., Zhang, Y., Zhang, K., Shen, X.: Exploiting mobile crowdsourcing for pervasive cloud services: challenges and solutions. IEEE Commun. Mag. (2015)
Ipeirotis, P.G., Provost, F., Wang, J.: Quality management on amazon mechanical turk. In: Proceedings of the ACM SIGKDD Workshop on Human Computation, HCOMP 2010. ACM (2010)
Li, H., Yu, B., Zhou, D.: Error rate bounds in crowdsourcing models. ArXiv e-prints arXiv:1307.2674 (2013)
Garcia-Molina, H., Joglekar, M., Marcus, A., Parameswaran, A., Verroios, V.: Challenges in data crowdsourcing. IEEE Trans. Knowl. Data Eng. (2016)
Oleson, D., Sorokin, A., Laughlin, G., Hester, V., Le, J., Biewald, L.: Programmatic gold: targeted and scalable quality assurance in crowdsourcing. In: Proceedings of the 11th AAAI Conference on Human Computation. AAAI Press (2011)
Daltayanni, M., de Alfaro, L., Papadimitriou, P.: Workerrank: using employer implicit judgements to infer worker reputation. In: Proceedings of the Eighth ACM International Conference on Web Search and Data Mining (2015)
von Ahn, L., Dabbish, L.: Designing games with a purpose. Commun. ACM 51(8), 58–67 (2008)
von Ahn, L.: Duolingo: learn a language for free while helping to translate the web. In: Proceedings of the International Conference on Intelligent User Interfaces. ACM (2013)
Lee, T.Y., Dugan, C., Geyer, W., Ratchford, T., Rasmussen, J., Shami, N.S., Lupushor, S.: Experiments on motivational feedback for crowdsourced workers. In: International AAAI Conference on Web and Social Media (2013)
Morschheuser, B., Hamari, J., Koivisto, J.: Gamification in crowdsourcing: a review. In: 49th Hawaii International Conference on System Sciences (HICSS) (2016)
Acknowledgement
This work was partly funded by the Hasler Foundation in the context of the project City-Stories. We are grateful to “Médiathèque Valais”, “Digital Valais Wallis” and “Archives de l’Etat du Valais” for providing the data.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Shabani, S., Sokhn, M. (2017). Gaming as a Gateway: Ensuring Quality Control for Crowdsourced Data. In: Luo, Y. (eds) Cooperative Design, Visualization, and Engineering. CDVE 2017. Lecture Notes in Computer Science(), vol 10451. Springer, Cham. https://doi.org/10.1007/978-3-319-66805-5_9
Download citation
DOI: https://doi.org/10.1007/978-3-319-66805-5_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-66804-8
Online ISBN: 978-3-319-66805-5
eBook Packages: Computer ScienceComputer Science (R0)