Abstract
During Covid-19, most of the university courses have been transited to distance education and online teaching. It is unfortunate but true that most of this distance teaching lacks the active participation of learners, thus failing to keep their attention throughout the teaching time. According to “Dale’s Cone of Learning,” students only remember 20 percent of the lecture without the involvement of any active participation. So it has become critical to find ways to engage these distance learners actively. The online discussion forum can be utilized as the primary tool to intrigue the active engagement of the learners. Therefore, it is also necessary to measure the students’ active engagement in online course discussion forums. Digitalization of the teaching process allows access to a large amount of data representing learners’ behavior. Every click can be observed and analyzed, which allows automating the assessment of the learning process. This paper aims to employ an existing approach introduced by the authors in previous work to translate learner’s engagement quantitatively based on their online discussion activity, which can be further utilized for assessment and understanding the interaction dynamics within the course. The discussion forum data from three cohorts of an online course on “Systematic Creativity and TRIZ basics” at LUT University, Finland, is analyzed via employing Social Network Analysis and natural language processing (NLP). Learners’ engagement in the discussion forums is assessed by focusing on two main criteria: the number of meaningful words used and the centrality measure of network analysis. As a result, the assessment of 50+ students’ discussion forum activity depicts a strong correlation between the meaningful words used by the students and their interaction (degree centrality and eigenvector centrality).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Adamopoulos, P. (2013) ‘What Makes a Great MOOC? An Interdisciplinary Analysis of Student Retention in Online Courses’, in International Conference on Information Systems, ICIS 2013.
Barthélemy, M. (2004) ‘Betweenness Centrality in Large Complex Networks’, European Physical Journal B, 38(2), pp. 163–168. https://doi.org/10.1140/epjb/e2004-00111-4.
Bonacich, P. (2002) ‘Power and Centrality: A Family of Measures’, American Journal of Sociology. https://doi.org/10.1086/228631.
Bonacich, P. (2007) ‘Some Unique Properties of Eigenvector Centrality’, Social Networks, 29(4), pp. 555–564. https://doi.org/10.1016/j.socnet.2007.04.002.
Bryson, C. and Hand, L. (2007) ‘The Role of Engagement in Inspiring Teaching and Learning’, Innovations in Education and Teaching International, 44(4), pp. 349–362. https://doi.org/10.1080/14703290701602748.
Dekker, A. (2002) ‘Applying Social Network Analysis Concepts to Military C4ISR Architectures’, Connections.
Dorfner, N. and Zakerzadeh, R. (2021) ‘Academic Games as a Form of Increasing Student Engagement in Remote Teaching’, Biomedical Engineering Education. doi: https://doi.org/10.1007/s43683-021-00048-x.
Early, S. L. (2011) ‘Book Review Student Engagement Techniques: A Handbook for College Faculty’, Journal of the Scholarship of Teaching and Learning, 11(1), pp. 155–157.
Faust, K. and Wasserman, S. (1995) Social Network Analysis Methods and Applications Structural Analysis in the Social Sciences: Methods and Applications, Structural Analysis in the Social Sciences.
Ferguson, R. (2013) ‘Learning Analytics: Drivers, Developments and Challenges’, International Journal of Technology Enhanced Learning, 4(5/6), p. 304. doi: https://doi.org/10.1504/ijtel.2012.051816.
Ferrara, E. (2018) ‘Measurement and Analysis of Online Social Networks Systems’, in Encyclopedia of Social Network Analysis and Mining. https://doi.org/10.1007/978-1-4939-7131-2_242.
Hanneman, R. A. and Riddle, M. (1998) ‘Introduction to Social Network Methods’, Network. https://doi.org/10.1109/78.700969.
Hayati, H., Khalidi Idrissi, M. and Bennani, S. (2017) ‘Applying Text Mining to Predict Learners’ Cognitive Engagement’, in ACM International Conference Proceeding Series. https://doi.org/10.1145/3175628.3175655.
Khan, A. I. et al. (2020) ‘Analysis of Students’ Performance in an Online Discussion Forum: A Social Network Approach’, in Lecture Notes in Networks and Systems. https://doi.org/10.1007/978-3-030-34983-7_66.
Kigundu, S. (2014) ‘Engaging e-Learning in Higher Education: Issues and Challenges’, International Journal of Educational Sciences. https://doi.org/10.1080/09751122.2014.11890125.
Lazega, E., Wasserman, S. and Faust, K. (2006) ‘Social Network Analysis: Methods and Applications’, Revue Française de Sociologie. https://doi.org/10.2307/3322457.
Moore, R. L., Oliver, K. M. and Wang, C. (2019) ‘Setting the Pace: Examining Cognitive Processing in MOOC Discussion Forums with Automatic Text Analysis’, Interactive Learning Environments. https://doi.org/10.1080/10494820.2019.1610453.
Moreira, P., Cunha, D. and Inman, R. A. (2020) ‘An Integration of Multiple Student Engagement Dimensions into a Single Measure and Validity-Based Studies’, Journal of Psychoeducational Assessment. https://doi.org/10.1177/0734282919870973.
Rabbany, R. et al. (2014) ‘Collaborative Learning of Students in Online Discussion Forums: A Social Network Analysis Perspective’, Studies in Computational Intelligence. https://doi.org/10.1007/978-3-319-02738-8_16.
Rosvall, M. and Bergstrom, C. T. (2008) ‘Maps of Information Flow Reveal Community Structure In Complex Networks’, Proceedings of the National Academy of Sciences of the United States of America. https://doi.org/10.1073/pnas.0706851105.
Scott, J. et al. (2015) ‘Social Network Analysis: An Introduction’, in The SAGE Handbook of Social Network Analysis. https://doi.org/10.4135/9781446294413.n2.
Stewart, S. A. and Abidi, S. S. R. (2012) ‘Applying Social Network Analysis to Understand the Knowledge Sharing Behaviour of Practitioners in a Clinical Online Discussion Forum’, Journal of Medical Internet Research, 14(6). https://doi.org/10.2196/jmir.1982.
Suraj, P. and Roshni, V. S. K. (2016) ‘Social Network Analysis in Student Online Discussion Forums’, 2015 IEEE Recent Advances in Intelligent Computational Systems, RAICS 2015, (December), pp. 134–138. https://doi.org/10.1109/RAICS.2015.7488402.
Taboada, M. et al. (2011) ‘Lexicon-Based Methods for Sentiment Analysis’, Computational linguistics, 37(2), pp. 267–307. https://doi.org/10.1162/COLI_a_00049.
Wen, M., Yang, D. and Rosé, C. (2014) ‘Sentiment Analysis in MOOC Discussion Forums: What does it tell us?’, in Proceedings of 7th International Conference on Educational Data Mining (EDM2014), 4 - 7 July 2014, London, UK.
Widmer, E. D. ;Lafarg. L.-A. (1999) ‘Boudedness and Connectivity of Contemporary Families: A Case Study’, Connections.
Wise, A., Zhao, Y. and Hausknecht, S. (2013) ‘W11-Learning Analytics for Online Discussions: A Pedagogical Model for Intervention with Embedded and Extracted Analytics’, \ldots Conference on Learning Analytics \ldots. https://doi.org/10.1145/2460296.2460308.
Yin, C. and Hwang, G. J. (2018) ‘Roles and Strategies of Learning Analytics in the e-publication Era’, Knowledge Management and E-Learning. https://doi.org/10.34105/j.kmel.2018.10.028.
Acknowledgements
This work was partially supported by the CEPHEI project of ERASMUS+ EU framework, which focuses on the digitalization of industrial innovation-related contents. The authors hope to conduct further research and extend this work in the future with possible support from this project.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Khan, A.I., Kaliteevskii, V., Shnai, I., Chechurin, L. (2022). Systematic Assessment and Illustration of Students’ Online Discussion Engagement. In: Chechurin, L. (eds) Digital Teaching and Learning in Higher Education. Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-031-00801-6_7
Download citation
DOI: https://doi.org/10.1007/978-3-031-00801-6_7
Published:
Publisher Name: Palgrave Macmillan, Cham
Print ISBN: 978-3-031-00800-9
Online ISBN: 978-3-031-00801-6
eBook Packages: EducationEducation (R0)