Abstract
In recent years, Online learning systems have met big challenges, especially due to rapid changes in technology, the gigantic amounts of data to be stored and manipulated, the large number of learners and the diversity of educational resources. As a result, e-learning platforms must change their mechanisms for data processing and storage to be smarter. In this context, big data is the relevant paradigm for the distributed and parallel processing of large data sets through thousands of clusters. It also offers a rich set of tools in order to improve data collection, storage, analysis, processing, optimization, and visualization. This article introduces the big data concept, its characteristics, and focuses in particular on the integration of it in a computing environment for human learning dedicated to online learning systems, and how the new methods, technologies, and tools of big data can enhance the future of online learning. Moreover, it proposes an approach for smoothly adapting the traditional e-learning systems to be suitable for big data ecosystems in cloud computing. Furthermore, it provides a methodology and architecture to incorporate the e-learning storage and computing in a Hadoop software library. Finally, the benefits and advantages associated with implementing big data in future online learning systems are discussed.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Notes
ESTenLigne project is supported by the EST Network of Morocco and the Eomed association (http://www.eomed.org).
References
Adhikari, B. K., Zuo, W., & Maharjan, R. (2017). A performance analysis of openstack cloud vs real system on hadoop clusters (pp. 194–201). IEEE. https://doi.org/10.1109/IEEE.EDGE.2017.34.
Anshari, M., Alas, Y., Sabtu, N. I. P. H., & Hamid, M. H. S. A. (2016). Online learning: trends, issues and challenges in the big data era. Journal of E-Learning and Knowledge Society, 12(1):121–134.
Apache Flume. (2018). Retrieved from: https://flume.apache.org/. Accessed 7 February 2018.
Apache Sqoop. (2018). Retrieved from: http://sqoop.apache.org/. Accessed 7 February 2018.
Ashraf, A., El-Bakry, H., M. Abd El-razek, S., & El-Mashad, Y. (2015). Handling big data in e-learning. International Journal of Advanced Research in Computer Science & Technology (IJARCST 2015), pp. 47–51.
Birjali, M., Beni-Hssane, A., & Erritali, M. (2018). Learning with big data technology: The future of education. In A. Abraham, A. Haqiq, A. Ella Hassanien, V. Snasel, & A. M. Alimi (Eds.), Proceedings of the Third International Afro-European Conference for Industrial Advancement — AECIA 2016 (Vol. 565, pp. 209–217). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-319-60834-1_22.
Buyya, R., Calheiros, R. N., & Dastjerdi, A. V. (2016). Big data: Principles and paradigms. Cambridge: Elsevier/Morgan Kaufmann.
Calheiros, R. N. (2016). Big data: principles and paradigms (1st ed.). Cambridge: Elsevier.
Dahdouh, K., Dakak, A., & Oughdir, L. (2017). Integration of the cloud environment in E-learning systems. Transactions on Machine Learning and Artificial Intelligence, 5(4). https://doi.org/10.14738/tmlai.54.2973.
Dean, J., & Ghemawat, S. (2008). MapReduce: simplified data processing on large clusters. Communications of the ACM, 51, 107.
Duygu, S. T., Demirezen, U., & Sagiroglu, S. (2016). Evaluations of big data processing. Services Transactions on Big Data.
Fortino, G., Badica, C., Malgeri, M., & Unland, R. (2012). Proceedings of the 6th International Symposium on Intelligent Distributed Computing, Calabria, Italy, (1st ed.). Springer. https://doi.org/10.1007/978-3-642-32524-3.
Frequent Pattern Mining, FP-growth (2018). https://spark.apache.org/docs/2.3.0/mllib-frequent-pattern-mining.html
Hadoop. (2018). Retrieved from: http://hadoop.apache.org/. Accessed 30 April 2018.
HDFS. (2018). Retrieved from: https://hadoop.apache.org/docs/r1.2.1/hdfs_design.html. Accessed 7 February 2018.
Hive. (2018). Retrieved from: https://hive.apache.org/. Accessed 7 February 2018.
Hwang, K. (2017). Big-data analytics for cloud, IoT and cognitive learning [electronic resource] (1st ed.). Wiley.
Lin, H.-M., Chen, W.-J., & Nien, S.-F. (2014). The study of achievement and motivation by e-learning–a case study. International Journal of Information and Education Technology, 4(5), 421–425. https://doi.org/10.7763/IJIET.2014.V4.442.
NIST Big Data Public Working Group Definitions and Taxonomies Subgroup. (2015). NIST Big Data Interoperability Framework: Volume 1, Definitions (No. NIST SP 1500–1). National Institute of Standards and Technology. https://doi.org/10.6028/NIST.SP.1500-1.
Pappas, C. (2014). Big Data in eLearning: The Future of eLearning Industry. (2014, July 24). eLearning Industry. Retrieved from: https://elearningindustry.com/big-data-in-elearning-future-of-elearning-industry. Accessed 6 February 2018.
Podesta, J., Pritzker, P., Moniz, E., Holdren, J., & Zients, J. (2014). Big data: seizing opportunities, preserving values. Executive office of the president. Washington, D.C: The White House Office of Science & Technology.
Scott, T. (2017). Using big data to improve workplace learning. eLearning Industry. Retrieved from: https://elearningindustry.com/use-big-data-to-improve-workplace-learning. Accessed 1 May 2018.
Spark. (2018). Retrieved from: https://spark.apache.org/. Accessed 7 February 2018.
YARN. (2018). Retrieved from: http://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/YARN.html. Accessed 7 February 2018.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Dahdouh, K., Dakkak, A., Oughdir, L. et al. Big data for online learning systems. Educ Inf Technol 23, 2783–2800 (2018). https://doi.org/10.1007/s10639-018-9741-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10639-018-9741-3