Welcome to the InfoSci Platform
Challenges in Big Data Analysis

Challenges in Big Data Analysis

M. Govindarajan
Copyright: © 2021 |Pages: 9
ISBN13: 9781799834793|ISBN10: 1799834794|EISBN13: 9781799834809
DOI: 10.4018/978-1-7998-3479-3.ch041
Cite Chapter Cite Chapter

MLA

Govindarajan, M. "Challenges in Big Data Analysis." Encyclopedia of Information Science and Technology, Fifth Edition, edited by Mehdi Khosrow-Pour D.B.A., IGI Global, 2021, pp. 577-585. https://doi.org/10.4018/978-1-7998-3479-3.ch041

APA

Govindarajan, M. (2021). Challenges in Big Data Analysis. In M. Khosrow-Pour D.B.A. (Ed.), Encyclopedia of Information Science and Technology, Fifth Edition (pp. 577-585). IGI Global. https://doi.org/10.4018/978-1-7998-3479-3.ch041

Chicago

Govindarajan, M. "Challenges in Big Data Analysis." In Encyclopedia of Information Science and Technology, Fifth Edition, edited by Mehdi Khosrow-Pour D.B.A., 577-585. Hershey, PA: IGI Global, 2021. https://doi.org/10.4018/978-1-7998-3479-3.ch041

Export Reference

Mendeley
Favorite

Abstract

Big data brings new opportunities to modern society and challenges to data scientists. On one hand, big data holds great promises for discovering subtle population patterns and heterogeneities that are not possible with small-scale data. On the other hand, the massive sample size and high dimensionality of big data introduce unique computational and statistical challenges, including scalability and storage bottleneck, noise accumulation, spurious correlation, incidental endogeneity, and measurement errors. These challenges are distinguished and require new computational and statistical paradigm. Prior to data analysis, data must be well constructed. However, considering the variety of datasets in big data, the efficient representation, access, and analysis of unstructured or semi-structured data are still challenging. Understanding the method by which data can be preprocessed is important to improve data quality and the analysis results. The purpose of this chapter is to highlight the big data challenges and also provide a brief description of each challenge.

Request Access

You do not own this content. Please login to recommend this title to your institution's librarian or purchase it from the IGI Global bookstore.