Skip to main content

AI-enchanced Crowdsourcing as an Element of Information Systems Development

  • Conference paper
  • First Online:
Information Technology and Systems (ICITS 2023)

Abstract

The Information Systems Development process consists of a few elements, which may look contradictory at first sight. On one hand, we reached huge progress in automated software development. It is possible to make a priori correct large-scale distributed software using formal methods. On other hand, the enthusiasts of crowdsourcing and the participants of open source projects emphasize the importance of the human factor. The authors of this paper believe that in computer science the composition of crowdsourcing and automated software development is possible as in other sciences where two or more former competitive theories eventually complement each other. Moreover, it leads to synergy. The conceptual framework of the methodology for crowdsourcing-based software development incorporating artificial intelligence elements is discussed in this paper.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Abhari K, Davidson EJ (2016) Creative co-production: the adaption of an open innovation model in creative industries, pp 119–130. Springer, Cham

    Google Scholar 

  2. Aghayi E, LaToza TD, Surendra P, Abolghasemi S (2021) Crowdsourced behavior-driven development. J Syst Softw 171:110840

    Article  Google Scholar 

  3. Alyahya S (2020) Crowdsourced software testing: a systematic literature review. Inf Softw Technol 127:106363

    Article  Google Scholar 

  4. Batarseh FA, Mohod R, Kumar A, Bui J (2020) The application of artificial intelligence in software engineering: a review challenging conventional wisdom. In: Batarseh FA, Yang R (eds) Data Democracy, pp 179–232. Academic Press

    Google Scholar 

  5. Beck S, Brasseur TM, Poetz M, Sauermann H (2022) Crowdsourcing research questions in science. Res Policy 51(4):104491

    Article  Google Scholar 

  6. Abhigna BS, Soni N, Dixit S (2018) Crowdsourcing - a step towards advanced machine learning. Procedia Comput Sci 132:632–642, International Conference on Computational Intelligence and Data Science

    Google Scholar 

  7. CodeOcean I (2021) Computational research PLatform. https://codeocean.com/. Accessed 14 May 2022

  8. Füller J, Hutter K, Kröger N (2021) Crowdsourcing as a service - from pilot projects to sustainable innovation routines. Int J Project Manag 39(2):183–195, managing Open and User Innovation by Projects

    Google Scholar 

  9. Garrigos-Simon FJ, service SO (2015) Advances in Crowdsourcing. Springer, Cham

    Google Scholar 

  10. Giedrimas V, Sakalauskas L, Neimantas M, Žilinskas K, Barauskas N, Valciukas R (2016) Wiki-based stochastic programming and statistical modeling system for the cloud. Int J Adv Comput Sci Appl 7(3):218–223

    Google Scholar 

  11. GitHub I (2022) GitHub copilot - Your AI pair programmer. https://github.com/features/copilot. Accessed 1 July 2022

  12. Guo S, Chen R, Li H, Gao J, Liu Y (2018) Crowdsourced web application testing under real-time constraints. Int J Softw Eng Knowl Eng 28(06):751–779

    Article  Google Scholar 

  13. Jones C (2018) Software Methodologies: A Quantitative Guide. Auerbach Publications, Boca Raton (2018)

    Google Scholar 

  14. Kalech M, Abreu R, Last M (2021) Artificial Intelligence Methods for Software Engineering. World Scientific, Singapore (2021)

    Google Scholar 

  15. Kamar E, Hacker S, Horvitz E (2012) Combining human and machine intelligence in large-scale crowdsourcing. In: Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2012, vol 1. pp 467–474. International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC (2012)

    Google Scholar 

  16. LaToza TD, Ben Towne W, van der Hoek A, Herbsleb JD (2013) Crowd development. In: 2013 6th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE), pp 85–88. https://doi.org/10.1109/CHASE.2013.6614737

  17. Machado L, Prikladnicki R, Meneguzzi F, de Souza CRB, Carmel E (2016) Task allocation for crowdsourcing using Ai planning

    Google Scholar 

  18. Mao K, Capra L, Harman M, Jia Y (2017) A survey of the use of crowdsourcing in software engineering. J Syst Softw 126:57–84

    Article  Google Scholar 

  19. Molnár B, Frigó J (1991) Application of AI in software and information engineering. Eng Appl Artif Intell 4(6):439–443

    Article  Google Scholar 

  20. Neto MC, Rego JS (2019) Urban intelligence for sustainability. In: Ramos I, Quaresma R, Silva P, Oliveira T (eds) Information Systems for Industry 4.0, pp 139–159. LNISO, Springer, Cham (2019)

    Google Scholar 

  21. Nevolin I (2017) Crowdsourcing opportunities for research information systems. Procedia Comput Sci 106:19–24, 13th International Conference on Current Research Information Systems, CRIS2016, Communicating and Measuring Research Responsibly: Profiling, Metrics, Impact,Interoperability

    Google Scholar 

  22. O’Leary DE (2014) Embedding AI and crowdsourcing in the big data lake. IEEE Intell Syst 29(5):70–73. https://doi.org/10.1109/MIS.2014.82

    Article  Google Scholar 

  23. Orkin JD (2013) Collective artificial intelligence: simulated role-playing from crowdsourced data. Ph.D. thesis, Massachusetts Institute of Technology

    Google Scholar 

  24. Ponzanelli L, Bacchelli A, Lanza M (2013) Seahawk: stack overflow in the ide. In: 2013 35th International Conference on Software Engineering (ICSE), pp 1295–1298

    Google Scholar 

  25. Roy D, Orkin J (2013) Collective artificial intelligence: simulated role-playing from crowdsourced data

    Google Scholar 

  26. Saremi RL, Yang Y (2015) Dynamic simulation of software workers and task completion. In: Proceedings of the Second International Workshop on CrowdSourcing in Software Engineering, CSI-SE 2015, pp 17–23. IEEE Press

    Google Scholar 

  27. Sarı A, Tosun A, Alptekin GI (2019) A systematic literature review on crowdsourcing in software engineering. J Syst Softw 153:200–219

    Article  Google Scholar 

  28. Schall D (2012) Service-Oriented Crowdsourcing: Architecture. Protocols and Algorithms. Springer, New York

    Google Scholar 

  29. Sparkes M (2022) Deepmind has made software-writing AI that rivals an average human coder. New Sci 253(3373):10

    Article  Google Scholar 

  30. Stair RM, Reynolds GW (2018) Fundamentals of information systems

    Google Scholar 

  31. Stol KJ, LaToza T, Bird C (2017) Crowdsourcing for software engineering. IEEE Softw 34:30–36. https://doi.org/10.1109/MS.2017.52

  32. Szela̧gowski M, Lupeikiene A (2020) Business process management systems: evolution and development trends. Informatica 31(3):579–595

    Google Scholar 

  33. Tahvili S, Hatvani L (July 2022) Artificial Intelligence Methods for Optimization of the Software Testing Process With Practical Examples and Exercises. Elsevier

    Google Scholar 

  34. Tunio M, Luo H, Wang C, Zhao F, Shao W, Pathan Z (2018) Crowdsourcing software development: task assignment using pddl artificial intelligence planning. J Inf Proc Syst 14:129–139

    Google Scholar 

  35. Wallace P (2021) Introduction to Information Systems, 4th Edition. Pearson, London

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Vaidas Giedrimas .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Giedrimas, V. et al. (2023). AI-enchanced Crowdsourcing as an Element of Information Systems Development. In: Rocha, Á., Ferrás, C., Ibarra, W. (eds) Information Technology and Systems. ICITS 2023. Lecture Notes in Networks and Systems, vol 692. Springer, Cham. https://doi.org/10.1007/978-3-031-33261-6_27

Download citation

Publish with us

Policies and ethics