Abstract
Thanks to the incredible speed of the development of Information and Communication Technologies, a huge amount of information is generated in the world today that is increasing with every day. Since such a large amount of data could not be stored and processed (in real or reasonable time) using conventional methods of storing and processing data, a new paradigm of storage, processing and managing of large quantities, variety and data processing speed called the Big Data concept appeared. The aim of this paper is to try to explain the need and significance of the Big Data concept, the changes in data manifestations from the Big Data concept and the role of Hadoop technology as a whole and its components individually in the practical realization of this concept. Since the practical realization of the Big Data concept would not be possible without the corresponding components of Hadoop technology, the paper will deal with the aspects of economics and productivity of storage, processing and data analysis.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Mayer-Schönberger, V., Cukier, K.: Big Data: A Revolution that will Transform How we Live, Work, and Think. Houghton Mifflin Harcourt, Boston (2013)
Manyika, J., Knobaluch, M.: Internet users send 204 million emails per minute. https://mashable.com/2014/04/23/data-online-every-minute/#MBzXmZxc6gqB
Berman, J.J.: Principles of Great Data: Preparing Sharing and Analyzing Complex Information, p. 201. Elsevier, Morgan Kaufman, Amsterdam (2013)
Manyika, J., Chui, M., Brown, B., Bughin, J., Dobbs, R., Roxburgh, C., Byers, A.H.: Big Data: the next frontier for innovation, competition, and productivity. Report by McKinsey Global Institute (2011). https://cdda.cs.stonybrook.edu/sites/default/files/cddafiles/CDDA_University%20Consortium.pdf. Accessed 3 Dec 2017
Gantz, J., Reinsel, D.: Extracting Value from Chaos. IDC iView. Sponsored by EMC (2011). http://www.emc.com/collateral/analyst-reports/idc-extracting-value-from-chaos-ar.pdf. Accessed 3 Dec 2017
Zhang, L.: How structured data helps in big data analysis -expand patent data with linked data cloud. Electrical Engineering and Computer Sciences, University of California, Berkeley (2013). http://www.eecs.berkeley.edu/Pubs/TechRpts/2013/EECS-2013-96.pdf. Accessed 17 Nov 2015
Kocijan, K.: Big Data: how we got to the big data and where are they leading us. Komunikacijski obrasci i informacijska znanost, Zagreb, IIS, pp. 37–62 (2014)
Ward, J.S., Barker, A.: Undefined by data: a survey of big data definitions. School of Computer Science, University of St Andrews (2013)
Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters, In: Sixth Symposium on Operating System Design and Implementation, OSDI 2004, San Francisco, CA, December 2004
Cutting, D., Cafarella, M.: What is it and why does it matter? SAS Institute Inc, Hadoop (2014). http://www.sas.com/en_us/insights/big-data/hadoop.html. Accessed 27 Jan 2018
ApacheTM Hadoop®: What is Appache Hadoop. Apache Hadoop Org. http://hadoop.apache.org/. Accessed 27 Jan 2018
Perera, S., Gunarathne, T.: Hadoop MapReduce Cookbook. Packt Publishing, UK (2013)
Bakshi, A.: MapReduce tutorial – fundamentals of MapReduce with MapReduce example. Edureca (2016). https://www.edureka.co/blog/mapreduce-tutorial/#mapreduce_word_count_example. Accessed 27 Jan 2018
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Stupar, S., Bičo Ćar, M., Šahić, E. (2019). The Role of Hadoop Technology in the Implementation of Big Data Concept. In: Karabegović, I. (eds) New Technologies, Development and Application. NT 2018. Lecture Notes in Networks and Systems, vol 42. Springer, Cham. https://doi.org/10.1007/978-3-319-90893-9_31
Download citation
DOI: https://doi.org/10.1007/978-3-319-90893-9_31
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-90892-2
Online ISBN: 978-3-319-90893-9
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)