Skip to main content

The Role of Hadoop Technology in the Implementation of Big Data Concept

  • Conference paper
  • First Online:
New Technologies, Development and Application (NT 2018)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 42))

Abstract

Thanks to the incredible speed of the development of Information and Communication Technologies, a huge amount of information is generated in the world today that is increasing with every day. Since such a large amount of data could not be stored and processed (in real or reasonable time) using conventional methods of storing and processing data, a new paradigm of storage, processing and managing of large quantities, variety and data processing speed called the Big Data concept appeared. The aim of this paper is to try to explain the need and significance of the Big Data concept, the changes in data manifestations from the Big Data concept and the role of Hadoop technology as a whole and its components individually in the practical realization of this concept. Since the practical realization of the Big Data concept would not be possible without the corresponding components of Hadoop technology, the paper will deal with the aspects of economics and productivity of storage, processing and data analysis.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Mayer-Schönberger, V., Cukier, K.: Big Data: A Revolution that will Transform How we Live, Work, and Think. Houghton Mifflin Harcourt, Boston (2013)

    Google Scholar 

  2. Manyika, J., Knobaluch, M.: Internet users send 204 million emails per minute. https://mashable.com/2014/04/23/data-online-every-minute/#MBzXmZxc6gqB

  3. Berman, J.J.: Principles of Great Data: Preparing Sharing and Analyzing Complex Information, p. 201. Elsevier, Morgan Kaufman, Amsterdam (2013)

    Google Scholar 

  4. Manyika, J., Chui, M., Brown, B., Bughin, J., Dobbs, R., Roxburgh, C., Byers, A.H.: Big Data: the next frontier for innovation, competition, and productivity. Report by McKinsey Global Institute (2011). https://cdda.cs.stonybrook.edu/sites/default/files/cddafiles/CDDA_University%20Consortium.pdf. Accessed 3 Dec 2017

  5. Gantz, J., Reinsel, D.: Extracting Value from Chaos. IDC iView. Sponsored by EMC (2011). http://www.emc.com/collateral/analyst-reports/idc-extracting-value-from-chaos-ar.pdf. Accessed 3 Dec 2017

  6. Zhang, L.: How structured data helps in big data analysis -expand patent data with linked data cloud. Electrical Engineering and Computer Sciences, University of California, Berkeley (2013). http://www.eecs.berkeley.edu/Pubs/TechRpts/2013/EECS-2013-96.pdf. Accessed 17 Nov 2015

  7. Kocijan, K.: Big Data: how we got to the big data and where are they leading us. Komunikacijski obrasci i informacijska znanost, Zagreb, IIS, pp. 37–62 (2014)

    Google Scholar 

  8. Ward, J.S., Barker, A.: Undefined by data: a survey of big data definitions. School of Computer Science, University of St Andrews (2013)

    Google Scholar 

  9. Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters, In: Sixth Symposium on Operating System Design and Implementation, OSDI 2004, San Francisco, CA, December 2004

    Google Scholar 

  10. Cutting, D., Cafarella, M.: What is it and why does it matter? SAS Institute Inc, Hadoop (2014). http://www.sas.com/en_us/insights/big-data/hadoop.html. Accessed 27 Jan 2018

  11. ApacheTM Hadoop®: What is Appache Hadoop. Apache Hadoop Org. http://hadoop.apache.org/. Accessed 27 Jan 2018

  12. Perera, S., Gunarathne, T.: Hadoop MapReduce Cookbook. Packt Publishing, UK (2013)

    Google Scholar 

  13. Bakshi, A.: MapReduce tutorial – fundamentals of MapReduce with MapReduce example. Edureca (2016). https://www.edureka.co/blog/mapreduce-tutorial/#mapreduce_word_count_example. Accessed 27 Jan 2018

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Savo Stupar .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Stupar, S., Bičo Ćar, M., Šahić, E. (2019). The Role of Hadoop Technology in the Implementation of Big Data Concept. In: Karabegović, I. (eds) New Technologies, Development and Application. NT 2018. Lecture Notes in Networks and Systems, vol 42. Springer, Cham. https://doi.org/10.1007/978-3-319-90893-9_31

Download citation

Publish with us

Policies and ethics