Skip to main content

Real-World Applications of Data Analytics, Big Data, and Machine Learning

  • Chapter
  • First Online:
Data Analytics and Machine Learning

Abstract

In the era of digitalization, we stand on the cusp of a data revolution. A staggering volume of data, sourced from manufacturing, banking, social media, e-commerce, healthcare records, and more, collectively known as Big Data, has inundated our world. Concerning the intelligent analysis of extensive datasets and the development of advanced applications for diverse domains, the crucial foundation lies in artificial intelligence (AI), placing specific emphasis on machine learning (ML) and deep learning (DL). The scale of data generation today is staggering, and the capabilities of these technologies are equally remarkable. In the realm of healthcare, they facilitate early disease detectionn customized treatments for patients, fundamentally transforming healthcare delivery. In the financial sector, analytics are shaping investment strategies, while in agriculture, they optimize resource allocation and crop yields. With data-driven insights enhancing transportation, energy management, and infrastructure systems in urban planning. These cutting-edge technologies collectively empower us to unlock valuable insights, reduce costs, streamline operations, and make data-driven decisions, across technical applications. This chapter conducts a comprehensive exploration of the profound impact of Data Analytics, Big Data, and AI in harnessing this data wealth across real-world applications and delves into various algorithms and techniques employed in ML, DL, and analytics.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Sarker, I.H.: Machine learning: algorithms, real-world applications and research directions. Sn Comput. Sci. 2, 160 (2021). https://doi.org/10.1007/s42979-021-00592-x

    Article  Google Scholar 

  2. Cao, L.: Data science: a comprehensive overview. ACM Comput. Surv. (CSUR) 50(3), 43 (2017). https://doi.org/10.1145/3076253

    Article  Google Scholar 

  3. Sarker, I.H.: Ai-driven cybersecurity: an overview, security intelligence modeling and research directions. SN Comput. Sci. (2021). https://doi.org/10.1007/s42979-021-00557-0

    Article  Google Scholar 

  4. Sarker, I.H.: Deep cybersecurity: a comprehensive overview from neural network and deep learning perspective. SN Comput. Sci. (2021)

    Google Scholar 

  5. Lepenioti, K., Bousdekis, A., Apostolou, D., Mentzas, G.: Prescriptive analytics: literature review and research challenges. Int. J. Inf. Manage. 50, 57–70 (2020)

    Article  Google Scholar 

  6. Mohammed, M., Khan, M.B., Bashier Mohammed, B.E.: Machine Learning: Algorithms and Applications. CRC Press (2016)

    Google Scholar 

  7. Aiken, E., Bellue, S., Karlan, D., et al.: Machine learning and phone data can improve targeting of humanitarian aid. Nature 603, 864–870 (2022). https://doi.org/10.1038/s41586-022-04484-9

    Article  Google Scholar 

  8. Sureja, N., Mehta, K., Shah, V., Patel, G.: Machine learning in wearable healthcare devices. In: Joshi, N., Kushvaha, V., Madhushri, P. (eds.) Machine Learning for Advanced Functional Materials. Springer, Singapore (2023). https://doi.org/10.1007/978-981-99-0393-1_13

  9. Witten, I.H., Frank, E.: Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann (2005)

    Google Scholar 

  10. Andina, D., Voulodimos, A., Doulamis, N., Doulamis, A., Protopapadakis, E.: Deep learning for computer vision: a brief review. Comput. Intell. Neurosci. 2018, 7068349 (2018). https://doi.org/10.1155/2018/7068349

    Article  Google Scholar 

  11. Lalor, J., Wu, H., Yu, H.: Improving Machine Learning Ability with Fine-Tuning (2017)

    Google Scholar 

  12. Ślusarczyk, B.: Industry 4.0: are we ready? Polish J. Manag. Stud. 17 (2018)

    Google Scholar 

  13. Mostajabi, F., Safaei, A.A., Sahafi, A.: A systematic review of data models for the big data problem. IEEE Access 9, 128889–128904 (2021). https://doi.org/10.1109/ACCESS.2021.3112880

    Article  Google Scholar 

  14. Praveen, S., Chandra, U.: Influence of structured, semi- structured, unstructured data on various data models. Int. J. Sci. Eng. Res. 8, 67–69 (2020)

    Google Scholar 

  15. Saravanan, R., Sujatha, P.: A state of art techniques on machine learning algorithms: a perspective of supervised learning approaches in data classification. In 2018 Second international conference on intelligent computing and control systems (ICICCS), pp. 945–949. IEEE (2018, June)

    Google Scholar 

  16. Han, J., Pei, J., Kamber, M.: Data mining: concepts and techniques. Elsevier, Amsterdam (2011)

    Google Scholar 

  17. Kaelbling, L.P., Littman, M.L., Moore, A.W.: Reinforcement learning: a survey. Journal of Artificial Intelligence Research 4, 237–285 (1996)

    Article  Google Scholar 

  18. Xuanxuan, Z.: Multivariate linear regression analysis on online image study for IoT. Cogn. Syst. Res. 52, 312–316 (2018)

    Article  Google Scholar 

  19. Tibshirani, R.: Regression shrinkage and selection via the lasso. J. Roy. Stat. Soc.: Ser. B (Methodol.) 58(1), 267–288 (1996)

    MathSciNet  Google Scholar 

  20. Zou, H., Hastie, T.: Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 67(2), 301–320 (2005)

    Article  MathSciNet  Google Scholar 

  21. Hoerl, A.E., Kennard, R.W.: Ridge regression: Biased estimation for nonorthogonal problems. Technometrics 12(1), 55–67 (1970)

    Article  Google Scholar 

  22. Agresti, A.: An Introduction to Categorical Data Analysis. John Wiley & Sons (2018)

    Google Scholar 

  23. Altman, N.S.: An introduction to Kernel and nearest-neighbor nonparametric regression. Am. Stat. 46(3), 175–185 (1992)

    Article  MathSciNet  Google Scholar 

  24. Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)

    Article  Google Scholar 

  25. Schölkopf, B., Smola, A.J., Müller, K.-R.: Nonlinear component analysis as a Kernel eigenvalue problem. Neural Comput. 10(5), 1299–1319 (1997)

    Article  Google Scholar 

  26. Breiman, L.: Classification and Regression Trees. Routledge (2017)

    Book  Google Scholar 

  27. Breiman, L.: Random forests. Mach. Learn. 45(1), 5–32 (2001)

    Article  Google Scholar 

  28. Dietterich, T.G.: Ensemble methods in machine learning. In: Multiple classifier systems, pp. 1–15. Springer (2000).

    Google Scholar 

  29. LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)

    Article  Google Scholar 

  30. Nanga, S., Bawah, A., Acquaye, B., Billa, M., Baeta, F., Odai, N., Obeng, S., Nsiah, A.: Review of dimension reduction methods. Journal of Data Analysis and Information Processing 9, 189–231 (2021). https://doi.org/10.4236/jdaip.2021.93013

    Article  Google Scholar 

  31. Berisha, V., Krantsevich, C., Hahn, P.R., et al.: Digital medicine and the curse of dimensionality. npj Digit. Med. 4, 153 (2021). https://doi.org/10.1038/s41746-021-00521-5

  32. Pearson, K.: On lines and planes of closest fit to systems of points in space. Phil. Mag. 2(11), 559–572 (1901)

    Article  Google Scholar 

  33. Laurens van der Maaten’s homepage. Retrieved from https://lvdmaaten.github.io/tsne/(n.d.)

  34. Jain, A.K., Murty, M.N., Flynn, P.J.: Data clustering: a review. ACM Comput. Surv. (CSUR) 31(3), 264–323 (1999)

    Article  Google Scholar 

  35. Arthur, D., Vassilvitskii, S.: K-means++: The advantages of careful seeding. In Proceedings of the eighteenth annual ACM-SIAM symposium on Discrete algorithms, pp. 1027–1035 (2007)

    Google Scholar 

  36. Kaufman, L., Rousseeuw, P.J.: Finding GROUPS in Data: An Introduction to Cluster Analysis. John Wiley & Sons (1990)

    Google Scholar 

  37. Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. The MIT Press (2018)

    Google Scholar 

  38. Watkins, C., Dayan, P.: Technical note: Q-Learning. Mach. Learn. 8, 279–292 (1992). https://doi.org/10.1007/BF00992698

    Article  Google Scholar 

  39. Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A.A., Veness, J., Bellemare, M.G., … & Hassabis, D. Human-level control through deep reinforcement learning. Nature. 518(7540), 529–533 (2015)

    Google Scholar 

  40. Paolanti, M., Romeo, L., Felicetti, A., Mancini, A., Frontoni, E., Loncarski, J.: “Machine Learning approach for Predictive Maintenance in Industry 4.0,” 2018 14th IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications (MESA), Oulu, Finland, pp. 1–6. (2018). doi: https://doi.org/10.1109/MESA.2018.8449150

  41. Suzuki, Y., Iwashita, S., Sato, T., Yonemichi, H., Moki, H., Moriya, T.: “Machine Learning Approaches for Process Optimization,” 2018 International Symposium on Semiconductor Manufacturing (ISSM), Tokyo, Japan, 2018, pp. 1–4. https://doi.org/10.1109/ISSM.2018.8651142

  42. Peres, R.S., Barata, J., Leitao, P., Garcia, G.: Multistage quality control using machine learning in the automotive industry. IEEE Access 7, 79908–79916 (2019). https://doi.org/10.1109/ACCESS.2019.2923405

    Article  Google Scholar 

  43. Verhoef, P.C., Neslin, S.A., Vroomen, B.: Multichannel customer management: understanding the research-shopper phenomenon. Int. J. Res. Mark. 24(2), 129–148 (2007)

    Article  Google Scholar 

  44. Fader, P.S., Hardie, B.G.S.: Customer-base valuation in a contractual setting: the perils of ignoring heterogeneity. Mark. Sci. 24(1), 66–79 (2005)

    Google Scholar 

  45. Lewis, K., Reiley, D.H.: Online ads and offline sales: measuring the effects of retail advertising via a controlled experiment on Yahoo. Econ. J. 124(576), 419–443 (2014)

    Google Scholar 

  46. Esteva, A., Kuprel, B., Novoa, R.A., Ko, J., Swetter, S.M., Blau, H.M., Thrun, S.: Dermatologist-level classification of skin cancer with deep neural networks. Nature 542(7639), 115–118 (2017)

    Article  Google Scholar 

  47. Stokes, J.M., Yang, K., Swanson, K., Jin, W., Cubillos-Ruiz, A., Donghia, N.M., … & Church, G.M.: A deep learning approach to antibiotic discovery. Cell. 180(4), 688–702 (2020)

    Google Scholar 

  48. : Schork, N.J.: Artificial intelligence and personalized medicine. Precision medicine in Cancer therapy, 265–283 (2019).

    Google Scholar 

  49. Sen, J., Sen, R., Dutta, A.: Introductory chapter: machine learning in finance-emerging trends and challenges. Algorithms, Models and Applications, 1 (2021)

    Google Scholar 

  50. Romanyuk, K.: Game theoretic approach for applying artificial intelligence in the credit industry. In 2018 Fifth HCT Information Technology Trends (ITT), pp. 1–6. IEEE (2018, November)

    Google Scholar 

  51. Amarasinghe, T., Aponso, A., Krishnarajah, N.: Critical analysis of machine learning based approaches for fraud detection in financial transactions. In Proceedings of the 2018 International Conference on Machine Learning Technologies, pp. 12–17 (2018, May)

    Google Scholar 

  52. Mohanty, S.P., Hughes, D.P., Salathé, M.: Using deep learning for image-based plant disease detection. Front. Plant Sci. 7, 1419 (2016)

    Article  Google Scholar 

  53. Minasny, B., McBratney, A.B., Malone, B.P.: Digital soil assessment. In Digital Soil Assessments and Beyond, pp. 1–24. Springer (2016)

    Google Scholar 

  54. Matese, A., Toscano, P., Di Gennaro, S.F., Genesio, L., Vaccari, F.P., Primicerio, J., … & Zaldei, A.: Intercomparison of UAV, aircraft and satellite remote sensing platforms for precision agriculture. Remote Sensing, 7(3), 2971–2990 (2015)

    Google Scholar 

  55. Doshi-Velez, F., Kim, B.: Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608(2017)

  56. Diakopoulos, N.: Accountability in algorithmic decision making: a framework and key questions. Data Discrim. Collect. Essays 2(2017), 10 (2016)

    Google Scholar 

  57. McMahan, H.B., Ramage, D., Talwar, K. Zhang, L., Zhu, M.: Communication-efficient learning of deep networks from decentralized data. arXiv preprint arXiv:1602.05629(2017)

  58. Biesialska, M., Biesialska, K., Costa-Jussa, M.R.: Continual lifelong learning in natural language processing: A survey. arXiv preprint arXiv:2012.09823 (2020)

  59. Conneau, A., et al.: Unsupervised Cross-lingual Representation Learning at Scale. arXiv:1911.02116 (2019)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Prince Shiva Chaudhary .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Chaudhary, P.S., Khurana, M.R., Ayalasomayajula, M. (2024). Real-World Applications of Data Analytics, Big Data, and Machine Learning. In: Singh, P., Mishra, A.R., Garg, P. (eds) Data Analytics and Machine Learning. Studies in Big Data, vol 145. Springer, Singapore. https://doi.org/10.1007/978-981-97-0448-4_12

Download citation

Publish with us

Policies and ethics