Ramtin Jabbari
ABSTRACT
Context: DevOps, the combination of Development and Operations, is a new way of thinking in the software engineering domain that recently received much attention. Given that DevOps is a new term and novel concept recently introduced, no common understanding of what it entails has been achieved yet. Consequently, definitions of DevOps often only represent a part that is relevant to the concept.
Objective:This study aims to characterize DevOps by exploring central components of DevOps definitions reported in the literature, specifying practices explicitly proposed for DevOps and investigating the similarities and differences between DevOps and other existing methods in software engineering.
Method: A systematic mapping study was conducted that used six electronic databases: IEEE, ACM, Inspec, Scopus, Wiley Online Library and Web of Science.
Result: 44 studies have been selected that report a definition of DevOps, 15 studies explicitly stating DevOps practices, and 15 studies stating how DevOps is related to other existing methods. Papers in some cases stated a combination of a definition, practices, and relations to other methods, the total number of primary studies was 49.
Conclusion: We proposed a definition for DevOps which may overcome inconsistencies over the various existing definitions of individual research studies. In addition, the practices explicitly proposed for DevOps have been presented as well as the relation to other software development methods.
- A. Abran, J. W. Moore, P. Bourque, R. Dupuis, and L. Tripp. Guide to the software engineering body of knowledge: 2004 version. IEEE Computer Society, 1, 2004.Google Scholar
- N. B. Ali and K. Petersen. Evaluating strategies for study selection in systematic literature studies. In Proceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM '14, 2014. Google ScholarDigital Library
- N. B. Ali, K. Petersen, and C. Wohlin. A systematic literature review on the industrial use of software process simulation. Journal of Systems and Software, 97:65--85, 2014. Google ScholarDigital Library
- P. Austel, H. Chen, T. A. Mikalsen, I. Rouvellou, U. Sharma, I. Silva-Lepe, and R. Subramanian. Continuous delivery of composite solutions: A case for collaborative software defined paas environments. In Proceedings of the 2nd International Workshop on Software-Defined Ecosystems, BigSystem 2015, Portland, Oregon, USA, June 16, 2015, pages 3--6, 2015. Google ScholarDigital Library
- S. K. Bang, S. Chung, Y. Choh, and M. Dupuis. A grounded theory analysis of modern web applications: Knowledge, skills, and abilities for devops. In Proceedings of the 2Nd Annual Conference on Research in Information Technology, RIIT '13, 2013. Google ScholarDigital Library
- L. Bass, D. R. Jeffery, H. Wada, I. Weber, and L. Zhu. Eliciting operations requirements for applications. In Proceedings of the 1st International Workshop on Release Engineering, RELENG 2013, San Francisco, California, USA, May 20, 2013, pages 5--8, 2013. Google ScholarDigital Library
- D. Bruneo, T. Fritz, S. Keidar-Barner, P. Leitner, F. Longo, C. C. Marquezan, A. Metzger, K. Pohl, A. Puliafito, D. Raz, A. Roth, E. Salant, I. Segall, M. Villari, Y. Wolfsthal, and C. Woods. Cloudwave: Where adaptive cloud management meets devops. In IEEE Symposium on Computers and Communications, ISCC 2014, Funchal, Madeira, Portugal, June 23-26, 2014, pages 1--6, 2014.Google ScholarCross Ref
- C. A. Cois, J. Yankel, and A. Connell. Modern devops: Optimizing software development through effective system interactions. In 2014 IEEE International Professional Communication Conference, IPCC 2014, Pittsburgh, PA, USA, October 13-15, 2014, pages 1--7, 2014.Google ScholarCross Ref
- A. Császár, W. John, M. Kind, C. Meirosu, G. Pongrácz, D. Staessens, A. Takács, and F. Westphal. Unifying cloud and carrier network: EU FP7 project UNIFY. In IEEE/ACM 6th International Conference on Utility and Cloud Computing, UCC 2013, Dresden, Germany, December 9-12, 2013, pages 452--457, 2013. Google ScholarDigital Library
- M. de Bayser, L. G. Azevedo, and R. F. G. Cerqueira. Researchops: The case for devops in scientific applications. In IFIP/IEEE International Symposium on Integrated Network Management, IM 2015, Ottawa, ON, Canada, 11-15 May, 2015, pages 1398--1404, 2015.Google Scholar
- A. Dyck, R. Penners, and H. Lichter. Towards definitions for release engineering and devops. In 3rd IEEE/ACM International Workshop on Release Engineering, RELENG 2015, Florence, Italy, May 19, 2015, page 3, 2015. Google ScholarDigital Library
- E. Engström and K. Petersen. Mapping software testing practice with software testing research - serp-test taxonomy. In Eighth IEEE International Conference on Software Testing, Verification and Validation, ICST 2015 Workshops, Graz, Austria, April 13-17, 2015, pages 1--4, 2015.Google ScholarCross Ref
- F. Erich, C. Amrit, and M. Daneva. Cooperation between information system development and operations: a literature review. In Proceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, page 69, 2014. Google ScholarDigital Library
- F. Erich, C. Amrit, and M. Daneva. Cooperation between information system development and operations: a literature review. In 2014 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM '14, Torino, Italy, September 18-19, 2014, page 69:1, 2014. Google ScholarDigital Library
- F. Erich, C. Amrit, and M. Daneva. A mapping study on cooperation between information system development and operations. In Product-Focused Software Process Improvement, pages 277--280. 2014.Google Scholar
- B. Farroha and D. Farroha. A framework for managing mission needs, compliance, and trust in the devops environment. In Military Communications Conference (MILCOM), 2014 IEEE, 2014. Google ScholarDigital Library
- D. G. Feitelson, E. Frachtenberg, and K. L. Beck. Development and deployment at facebook. IEEE Internet Computing, 17(4):8--17, 2013. Google ScholarDigital Library
- B. Fitzgerald and K. Stol. Continuous software engineering and beyond: trends and challenges. In 1st International Workshop on Rapid Continuous Software Engineering, RCoSE 2014, Hyderabad, India, June 3, 2014, pages 1--9, 2014. Google ScholarDigital Library
- B. Fitzgerald and K.-J. Stol. Continuous software engineering: A roadmap and agenda. Journal of Systems and Software, 2015.Google Scholar
- G. Fox, J. Qiu, S. Kamburugamuve, S. Jha, and A. Luckow. HPC-ABDS high performance computing enhanced apache big data stack. In 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGrid 2015, Shenzhen, China, May 4-7, 2015, pages 1057--1066, 2015.Google ScholarDigital Library
- A. Fuggetta and E. Di Nitto. Software process. In Proceedings of the on Future of Software Engineering, pages 1--12, 2014. Google ScholarDigital Library
- K. Gohil, N. Alapati, and S. Joglekar. Towards behavior driven operations (bdops). In Advances in Recent Technologies in Communication and Computing (ARTCom 2011), 3rd International Conference on, 2011.Google Scholar
- W. Gottesheim. Challenges, benefits and best practices of performance focused devops. In Proceedings of the 4th International Workshop on Large-Scale Testing, LT'15, Austin, TX, USA, February 1, 2015, page 3, 2015. Google ScholarDigital Library
- M. Guerriero, M. Ciavotta, G. P. Gibilisco, and D. Ardagna. Space4cloud: a devops environment for multi-cloud applications. In Proceedings of the 1st International Workshop on Quality-Aware DevOps, QUDOS 2015, Bergamo, Italy, September 1, 2015, pages 29--30, 2015. Google ScholarDigital Library
- S. Hosono. A devops framework to shorten delivery time for cloud applications. IJCSE, 7(4):329--344, 2012. Google ScholarDigital Library
- S. Hosono and Y. Shimomura. Application lifecycle kit for mass customization on paas platforms. In Eighth IEEE World Congress on Services, SERVICES 2012, Honolulu, HI, USA, June 24-29, 2012, pages 397--398, 2012. Google ScholarDigital Library
- S. Hussaini. Strengthening harmonization of development (dev) and operations (ops) silos in it environment through systems approach. In Intelligent Transportation Systems (ITSC), 2014 IEEE 17th International Conference on, 2014.Google ScholarCross Ref
- K. R. Jayaram. Towards explicitly elastic programming frameworks. In 37th IEEE/ACM International Conference on Software Engineering, ICSE 2015, Florence, Italy, May 16-24, 2015, Volume 2, pages 619--622, 2015. Google ScholarDigital Library
- X. Ju, L. Soares, K. G. Shin, K. D. Ryu, and D. D. Silva. On fault resilience of openstack. In ACM Symposium on Cloud Computing, SOCC '13, Santa Clara, CA, USA, October 1-3, 2013, pages 2:1--2:16, 2013. Google ScholarDigital Library
- S. Keele. Guidelines for performing systematic literature reviews in software engineering. In Technical report, Ver. 2.3 EBSE Technical Report. EBSE. 2007.Google Scholar
- T. Kilamo, M. Leppänen, and T. Mikkonen. The social developer: Now, then, and tomorrow. In Proceedings of the 7th International Workshop on Social Software Engineering, SSE 2015, 2015. Google ScholarDigital Library
- J. Kim. Preparing the end-to-end virtualized networking over software-defined infrastrure. In Optical Internet 2014 (COIN), 2014 12th International Conference on, 2014.Google Scholar
- J. Kim, C. Meirosu, I. Papafili, R. Steinert, S. Sharma, F. Westphal, M. Kind, A. Shukla, F. Németh, and A. Manzalini. Service provider devops for large scale modern network services. In IFIP/IEEE International Symposium on Integrated Network Management, IM 2015, Ottawa, ON, Canada, 11-15 May, 2015, pages 1391--1397, 2015.Google ScholarCross Ref
- B. Kitchenham and P. Brereton. A systematic review of systematic review process research in software engineering. Information & Software Technology, 55(12):2049--2075, 2013. Google ScholarDigital Library
- B. A. Kitchenham. What's up with software metrics? - A preliminary mapping study. Journal of Systems and Software, 83(1):37--51, 2010. Google ScholarDigital Library
- N. Kurapati, V. S. C. Manyam, and K. Petersen. Agile software development practice adoption survey. In Agile Processes in Software Engineering and Extreme Programming - 13th International Conference, XP 2012, Malmö, Sweden, May 21-25, 2012. Proceedings, pages 16--30, 2012.Google Scholar
- T. Leesatapornwongsa, M. Hao, P. Joshi, J. F. Lukman, and H. S. Gunawi. SAMC: semantic-aware model checking for fast discovery of deep bugs in cloud systems. In 11th USENIX Symposium on Operating Systems Design and Implementation, OSDI '14, Broomfield, CO, USA, October 6-8, 2014., pages 399--414, 2014. Google ScholarDigital Library
- L. Lemus ZÃžÃśiga, N. Pintos, E. Pardo, A. Garza, and J. MontaÃśana Aliaga. Assessment and intervention with wii fit in the elderly. In G. Jezic, R. J. Howlett, and L. C. Jain, editors, Agent and Multi-Agent Systems: Technologies and Applications, volume 38 of Smart Innovation, Systems and Technologies. Springer International Publishing, 2015.Google Scholar
- M. A. McCarthy, L. M. Herger, S. M. Khan, and B. M. Belgodere. Composable devops: Automated ontology based devops maturity analysis. In 2015 IEEE International Conference on Services Computing, SCC 2015, New York City, NY, USA, June 27-July 2, 2015, pages 600--607, 2015. Google ScholarDigital Library
- M. Miglierina. Application deployment and management in the cloud. In 16th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing, SYNASC 2014, Timisoara, Romania, September 22-25, 2014, pages 422--428, 2014.Google ScholarCross Ref
- S. Murphy, S. Gallant, C. Gaughan, and M. Diego. U.S. army modeling and simulation executable architecture deployment cloud virtualization strategy. In 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGrid 2012, Ottawa, Canada, May 13-16, 2012, pages 880--885, 2012. Google ScholarDigital Library
- J. Obstfeld, S. Knight, E. Kern, Q. S. Wang, T. Bryan, and D. Bourque. VIRL: the virtual internet routing lab. In ACM SIGCOMM 2014 Conference, SIGCOMM'14, Chicago, IL, USA, August 17-22, 2014, pages 577--578, 2014. Google ScholarDigital Library
- M. Olszewska and M. A. Waldén. Devops meets formal modelling in high-criticality complex systems. In Proceedings of the 1st International Workshop on Quality-Aware DevOps, QUDOS 2015, Bergamo, Italy, September 1, 2015, pages 7--12, 2015. Google ScholarDigital Library
- S. Park, B. Cha, and J. Kim. Preparing and inter-connecting hyper-converged smartx boxes for iot-cloud testbed. In 29th IEEE International Conference on Advanced Information Networking and Applications, AINA 2015, Gwangju, South Korea, March 24-27, 2015, pages 695--697, 2015.Google ScholarCross Ref
- D. L. Parnas. Stop the numbers game. Commun. ACM, 50(11):19--21, 2007. Google ScholarDigital Library
- J. F. Pérez, W. Wang, and G. Casale. Towards a devops approach for software quality engineering. In Proceedings of the 2015 Workshop on Challenges in Performance Methods for Software Development, WOSP-C'15, Austin, TX, USA, January 31, 2015, pages 5--10, 2015. Google ScholarDigital Library
- K. Petersen, S. Vakkalanka, and L. Kuzniarz. Guidelines for conducting systematic mapping studies in software engineering: An update. Information and Software Technology, 64:1--18, 2015. Google ScholarDigital Library
- J. Roche. Adopting devops practices in quality assurance. Commun. ACM, 56(11):38--43, 2013. Google ScholarDigital Library
- J. Scheuner, J. Cito, P. Leitner, and H. C. Gall. Cloud workbench: Benchmarking iaas providers based on infrastructure-as-code. In Proceedings of the 24th International Conference on World Wide Web Companion, WWW 2015, Florence, Italy, May 18-22, 2015 - Companion Volume, pages 239--242, 2015. Google ScholarDigital Library
- A. Sill. Factors in development and adoption of new cloud software and standards. IEEE Cloud Computing, 1(4):10--13, 2014.Google ScholarCross Ref
- J. Smeds, K. Nybom, and I. Porres. Devops: a definition and perceived adoption impediments. In Agile Processes, in Software Engineering, and Extreme Programming, pages 166--177. 2015.Google Scholar
- D. Smite, C. Wohlin, Z. Galvina, and R. Prikladnicki. An empirically based terminology and taxonomy for global software engineering. Empirical Software Engineering, 19(1):105--153, 2014. Google ScholarDigital Library
- D. Spinellis. Package management systems. IEEE Software, 29(2):84--86, 2012. Google ScholarDigital Library
- T. Ustinova and P. Jamshidi. Modelling multi-tier enterprise applications behaviour with design of experiments technique. In Proceedings of the 1st International Workshop on Quality-Aware DevOps, QUDOS 2015, Bergamo, Italy, September 1, 2015, pages 13--18, 2015. Google ScholarDigital Library
- M. Virmani. Understanding devops bridging the gap from continuous integration to continuous delivery. In Innovative Computing Technology (INTECH), 2015 Fifth International Conference on, 2015.Google ScholarCross Ref
- W. Wang, J. F. Pérez, and G. Casale. Filling the gap: a tool to automate parameter estimation for software performance models. In Proceedings of the 1st International Workshop on Quality-Aware DevOps, QUDOS 2015, Bergamo, Italy, September 1, 2015, pages 31--32, 2015. Google ScholarDigital Library
- J. Wettinger. Streamlining devops automation for cloud applications using {TOSCA} as standardized metamodel. Future Generation Computer Systems, 2015. Google ScholarDigital Library
- J. Wettinger, V. Andrikopoulos, and F. Leymann. Automated capturing and systematic usage of devops knowledge for cloud applications. In 2015 IEEE International Conference on Cloud Engineering, IC2E 2015, Tempe, AZ, USA, March 9-13, 2015, pages 60--65, 2015. Google ScholarDigital Library
- J. Wettinger, M. Behrendt, T. Binz, U. Breitenbücher, G. Breiter, F. Leymann, S. Moser, I. Schwertle, and T. Spatzier. Integrating configuration management with model-driven cloud management based on TOSCA. In CLOSER 2013 - Proceedings of the 3rd International Conference on Cloud Computing and Services Science, Aachen, Germany, 8-10 May, 2013, pages 437--446, 2013.Google Scholar
- J. Wettinger, T. Binz, U. Breitenbücher, O. Kopp, F. Leymann, and M. Zimmermann. Unified invocation of scripts and services for provisioning, deployment, and management of cloud applications based on TOSCA. In CLOSER 2014 -- Proceedings of the 4th International Conference on Cloud Computing and Services Science, Barcelona, Spain, April 3-5, 2014., pages 559--568, 2014. Google ScholarDigital Library
- J. Wettinger, U. Breitenbücher, and F. Leymann. Compensation-based vs. convergent deployment automation for services operated in the cloud. In Service-Oriented Computing - 12th International Conference, ICSOC 2014, Paris, France, November 3-6, 2014. Proceedings, pages 336--350, 2014.Google Scholar
- J. Wettinger, U. Breitenbücher, and F. Leymann. Devopslang - bridging the gap between development and operations. In Service-Oriented and Cloud Computing - Third European Conference, ESOCC 2014, Manchester, UK, September 2-4, 2014. Proceedings, pages 108--122, 2014.Google ScholarCross Ref
- J. Wettinger, U. Breitenbücher, and F. Leymann. Compensation and convergence - comparing and combining deployment automation approaches. Int. J. Cooperative Inf. Syst., 24(3), 2015.Google ScholarCross Ref
- J. Wettinger, U. Breitenbucher, and F. Leymann. Dyn Tail - Dynamically Tailored Deployment Engines for Cloud Applications. In Cloud Computing (CLOUD), 2015 IEEE 8th International Conference on, June 2015. Google ScholarDigital Library
- S. A. Wright and D. Druta. Open source and standards: The role of open source in the dialogue between research and standardization. In 2014 IEEE GLOBECOM Workshops, Austin, TX, USA, December 8-12, 2014, pages 650--655, 2014.Google ScholarCross Ref
- What is DevOps?: A Systematic Mapping Study on Definitions and Practices
Recommendations
Security practices in DevOps
HotSos '16: Proceedings of the Symposium and Bootcamp on the Science of SecurityDevOps focuses on collaboration between different teams in an organization to achieve rapid deployment of software and services to end-users by automating the software delivery infrastructure. According to Dyck et al. [1] DevOps is a software process ...
CMMI guided process improvement for DevOps projects: an exploratory case study
ICSSP '16: Proceedings of the International Conference on Software and Systems ProcessVery recently, an increasing number of software companies adopted DevOps to adapt themselves to the ever-changing business environment. While it is important to mature adoption of the DevOps for these companies, no dedicated maturity models for DevOps ...
Comments