Skip to main content

Advertisement

SpringerLink
Log in

The effect of learning analytics-based interventions in mobile learning on students' academic achievements, self-regulated learning skills, and motivations

  • Long Paper
  • Published:
Universal Access in the Information Society Aims and scope Submit manuscript

Abstract

This study examines the effects of using learning analytics (LA) in a mobile-based learning setting on students' self-regulated learning (SRL) skills, motivations, and academic achievements. For this objective, a mobile-based learning setting has been designed within the scope of the research, and LA and student data have been analyzed. The study was conducted on forty-nine university students at a state university in Eastern Europe taking a computer I course. While twenty-four students formed the control group, twenty-five students formed the experimental group of the research using random allocation. The control and experimental groups received education in mobile-based learning settings for one academic term. While the experimental group students have been given weekly LA about their learning behavior in the mobile-based learning setting as feedback, LA feedback has not been sent to the control group students. The research has been envisaged as an experimental design. The quantitative data have been collected through the SRL scale, personal information form, motivation scale, and academic achievement test. In conclusion, it has been observed that providing LA feedback with students in a mobile learning setting has created a statistically significant difference in SRL skills and academic achievement in favor of the experimental group students. Nevertheless, there was no statistical difference between experimental and control group students regarding motivation toward the lesson. Based on the research findings, what can be done in the design, use, and evaluation of feedback messages for LA-based interventions to be made to students in mobile learning environments has been discussed. It has been evaluated how LA-based interventions should be made in the context of universal access and design. In line with the findings obtained from the research, various suggestions were made for researchers and teachers regarding the educational use of LA-based interventions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Agudo-Peregrina, Á.F., Iglesias-Pradas, S., Conde-González, M.Á., Hernández-García, Á.: Can we predict success from log data in VLEs? Classification of interactions for learning analytics and their relation with performance in VLE-supported F2F and online learning. Comput. Human Behav. 31, 542–550 (2014)

    Article  Google Scholar 

  2. Aguilar, S.J., Karabenick, S.A., Teasley, S.D., Baek, C.: Associations between learning analytics dashboard exposure and motivation and self-regulated learning. Comput. Educ. 162, 104085 (2021). https://doi.org/10.1016/j.compedu.2020.104085

    Article  Google Scholar 

  3. Aljohani, N.R., Davis, H.C.: Learning analytics and formative assessment to provide immediate detailed feedback using a student centered mobile dashboard. In: 2013 Seventh International Conference on Next Generation Mobile Apps, Services and Technologies, pp. 262–267. IEEE (2013)

  4. Arnold, K.E.: Signals: applying academic analytics. Educ. Q. 33(1), n1 (2010)

    MathSciNet  Google Scholar 

  5. Atchley, W., Wingenbach, G., Akers, C.: Comparison of course completion and student performance through online and traditional courses. Int. Rev. Res. Open Dist. Learn. 14(1), 104–116 (2013)

    Google Scholar 

  6. Burton, J., Moore, M., Magliaro, S.: Behaviorism in instructional technology. In: Jonassen, D. (ed.) Handbook of Research for Educational Communications and Technology, pp. 46–73. Macmillan, New York (1996)

    Google Scholar 

  7. Buyukozturk, S., Akgun, O.E., Kahveci, O., Demirel, F.: Validity and reliability study of the Turkish form of the motivation and learning strategies scale. Educ. Sci. Theory Pract. 4(2), 207–239 (2004)

    Google Scholar 

  8. Buyukozturk, S.: Scientific Research Methods, 22nd edn. Pegem Academy, Ankara (2016)

    Google Scholar 

  9. Cicchinelli, A., Veas, E., Pardo, A., Pammer-Schindler, V., Fessl, A., Barreiros, C., Lindstädt, S.: Finding traces of SRL in activity streams. In: Proceedings of the 8th International Conference on and Knowledge, pp. 191–200. ACM (2018).

  10. Cohen, M.T.: The importance of self-regulation for college student learning. Coll. Stud. J. 46(4), 892–902 (2012)

    Google Scholar 

  11. de Quincey, E., Briggs, C., Kyriacou, T., Waller, R.: Student centred design of a system. In: Proceedings of the 9th International Conference on & Knowledge, pp. 353–362. ACM (2019).

  12. Dietz-Uhler, B., Hurn, J.E.: Using to predict (and improve) student success: a faculty perspective. J. Interact. Online Learn. 12(1), 17–26 (2013)

    Google Scholar 

  13. Dyckhoff, A.L., Lukarov, V., Muslim, A., Chatti, M.A., Schroeder, U.: Supporting action research with learning analytics. In: Proceedings of the Third International Conference on and Knowledge, pp. 220–229. ACM (2013)

  14. Fan, Y., Matcha, W., Uzir, N.A.A., Wang, Q., Gašević, D.: Learning analytics to reveal links between learning design and self-regulated learning. Int. J. Artif. Intell. Educ. 31(4), 980–1021 (2021)

    Article  Google Scholar 

  15. Fritz, J.: Classroom walls that talk: using online course activity data of successful students to raise self-awareness of underpinning peers. Internet High. Educ. 14(2), 89–97 (2011)

    Article  Google Scholar 

  16. Gašević, D., Dawson, S., Siemens, G.: Let’s not forget: are about learning. TechTrends 59(1), 64–71 (2015)

    Article  Google Scholar 

  17. Gašević, D., Dawson, S., Rogers, T., Gasevic, D.: should not promote one size fits all: the effects of instructional conditions in predicting academic success. Internet High. Educ. 28, 68–84 (2016)

    Article  Google Scholar 

  18. Haslaman, T.: The effect of online learning environment on teachers ‘and students’ self-regulating learning skills. Doctoral Dissertation, Hacettepe University (2011)

  19. Hattie, J., Timperley, H.: The power of feedback. Rev. Educ. Res. 77(1), 81–112 (2007)

    Article  Google Scholar 

  20. Heron, M., Thompson, H.: How do trainee teachers engage with a flipped learning approach? J. Digit. Learn. Teach. Educ. 35(2), 92–106 (2019)

    Article  Google Scholar 

  21. Howell, J.A., Roberts, L.D., Mancini, V.O.: Messages: impact of grade, sender, comparative information and message style on student affect and academic resilience. Comput. Hum. Behav. 89, 8–15 (2018)

    Article  Google Scholar 

  22. Jivet, I., Scheffel, M., Schmitz, M., Robbers, S., Specht, M., Drachsler, H.: From students with love: an empirical study on learner goals, self-regulated learning and sense-making of in higher education. Internet High. Educ. 47, 100758 (2020)

    Article  Google Scholar 

  23. Jovanović, J., Saqr, M., Joksimović, S., Gašević, D.: Students matter the most in learning analytics: the effects of internal and instructional conditions in predicting academic success. Comput. Educ. 172, 104251 (2021)

    Article  Google Scholar 

  24. Jivet, I., Wong, J., Scheffel, M., Valle Torre, M., Specht, M., Drachsler, H.: Quantum of Choice: how learners’ feedback monitoring decisions, goals and self-regulated learning skills are related. In: LAK21: 11th International Learning Analytics and Knowledge Conference, pp. 416–427 (2021)

  25. Jumaat, N.F., Tasir, Z.: Instructional scaffolding in online learning environment: a meta-analysis. In: 2014 International Conference on Teaching and Learning in Computing and Engineering, pp. 74–77. IEEE (2014)

  26. Karaoglan Yilmaz, F.G., Yilmaz, R.: The impact of feedback form on transactional distance and critical thinking skills in online discussions. Innov. Educ. Teach. Int. 57(1), 119–130 (2020)

    Google Scholar 

  27. Karaoglan Yilmaz, F.G., Yilmaz, R.: Learning analytics as a metacognitive tool to influence learner transactional distance and motivation in online learning environments. Innov. Educ. Teach. Int. 58(5), 575–585 (2021)

    Article  Google Scholar 

  28. Karaoglan Yilmaz, F.G.: The effect of learning analytics assisted recommendations and guidance feedback on students’ metacognitive awareness and academic achievements. J. Comput. High. Educ. (2022). https://doi.org/10.1007/s12528-021-09304-z

    Article  Google Scholar 

  29. Kayabas, I.: Development of dashboard for open and distance learning: learning cloud. Doctorate Thesis, Anadolu University (2017)

  30. Kim, D., Yoon, M., Jo, I.-H., Branch, R.M.: To support self-regulated learning in asynchronous online courses: a case study at a women’s university in South Korea. Comput. Educ. 127, 233–251 (2018)

    Article  Google Scholar 

  31. Leavy, M., Rheinschmidt, S.: How the ICCOC uses analytics to increase student success. Educ. Quart. 33, 4 (2010)

    Google Scholar 

  32. Lee, Y., Choi, J., Kim, T.: Discriminating factors between completers of and dropouts from online learning courses. Br. J. Edu. Technol. 44(2), 328–337 (2013)

    Article  Google Scholar 

  33. Li, K., Keller, J.M.: Use of the ARCS model in education: a literature review. Comput. Educ. 122, 54–62 (2018)

    Article  Google Scholar 

  34. Lim, L.A., Gasevic, D., Matcha, W., Ahmad Uzir, N.A., Dawson, S.: Impact of learning analytics feedback on self-regulated learning: Triangulating behavioural logs with students’ recall. In: LAK21: 11th International Learning Analytics and Knowledge Conference, pp. 364–374 (2021)

  35. Long, P.D., Siemens, G.: Penetrating the fog: Analytics in learning and education. EDUCAUSE Review Online (2011). http://www.educause.edu/ero/article/penetrating-fog-analytics-learning-and-education/

  36. Lonn, S., Aguilar, S.J., Teasley, S.D.: Investigating student motivation in the context of a intervention during a summer bridge program. Comput. Hum. Behav. 47, 90–97 (2015)

    Article  Google Scholar 

  37. Moore, M.G.: The theory of transactional distance. In: Handbook of Distance Education, pp. 84–103. Routledge (2013)

  38. Namoun, A., Alshanqiti, A.: Predicting student performance using data mining and learning analytics techniques: a systematic literature review. Appl. Sci. 11(1), 237 (2021)

    Article  Google Scholar 

  39. Ngan, S.C., Law, K.M.: Exploratory network analysis of learning motivation factors in e-learning facilitated computer programming courses. Asia Pac. Educ. Res. 24(4), 705–717 (2015)

    Article  Google Scholar 

  40. Olmos, M.M., Corrin, L.: Learning analytics: a case study of the process of design of visualizations. J. Asynchron. Learn. Netw. 16(3), 39–49 (2012)

    Google Scholar 

  41. Pardo, A., Jovanovic, J., Dawson, S., Gašević, D., Mirriahi, N.: Using learning analytics to scale the provision of personalised feedback. Br. J. Edu. Technol. 50(1), 128–138 (2019)

    Article  Google Scholar 

  42. Pintrich, P.R., Smith, D.A.F., Garcia, T., McKeachie, W.J.: A manual for the use of the motivated strategies for learning questionnaire (MSLQ) (Report No. 91-B-004). National Center for Research to Improve Postsecondary Teaching and Learning, Ann Arbor (1991)

  43. Reka, J., Karmen, D., Susana, F., Kinga, K.J., Edit, M., Kinga, S.: Implications of motivational factors regarding the academic success of full-time and distance learning undergraduate students: a self-determination theory perspective. Proc. Soc. Behav. Sci. 187, 50–55 (2015)

    Article  Google Scholar 

  44. Retalis, S., Papasalouros, A., Psaromiligkos, Y., Siscos, S., Kargidis, T.: Towards networked—a concept and a tool. Netw. Learn. 1–8 (2006).

  45. Schunk, D.H., Ertmer, P.A.: Self-regulated processes during computer skill acquisition: goal and self-evaluative influences. J. Educ. Psychol. 91(2), 251–260 (1999)

    Article  Google Scholar 

  46. Schumacher, C., Ifenthaler, D.: Features students really expect from learning analytics. Comput. Hum. Behav. 78, 397–407 (2018)

    Article  Google Scholar 

  47. Siemens, G.: Learning analytics: the emergence of a discipline. Am. Behav. Sci. 57(10), 1380–1400 (2013)

    Article  Google Scholar 

  48. SoLAR.: Society for research. http://www.solaresearch.org (2014). Accessed 20 Nov 2017

  49. Specker, K.: Student experience of as a factor in motivation in online courses. Doctoral Dissertations, Northcentral University (2015)

  50. Tabuenca, B., Kalz, M., Drachsler, H., Specht, M.: Time will tell: the role of mobile in self-regulated learning. Comput. Educ. 89, 53–74 (2015)

    Article  Google Scholar 

  51. Tempelaar, D., Rienties, B., Mittelmeier, J., Nguyen, Q.: Student profiling in a dispositional application using formative assessment. Comput. Hum. Behav. 78, 408–420 (2018)

    Article  Google Scholar 

  52. Van Laer, S., Elen, J.: The effect of cues for calibration on learners' self-regulated learning through changes in learners’ learning behaviour and outcomes. Comput. Educ. 135, 30–48 (2019)

    Article  Google Scholar 

  53. Verbert, K., Ochoa, X., De Croon, R., Dourado, R.A., De Laet, T.: Learning analytics dashboards: the past, the present and the future. In: Proceedings of the Tenth International Conference on Learning Analytics & Knowledge, pp. 35–40 (2020)

  54. Viberg, O., Wasson, B., Kukulska-Hulme, A.: Mobile-assisted language learning through for self-regulated learning (MALLAS): a conceptual framework. Australas. J. Educ. Technol. 36(6), 34–52 (2020)

    Article  Google Scholar 

  55. Wright, M.C., McKay, T., Hershock, C., Miller, K., Tritz, J.: Better than expected: using to promote student success in gateway science. Change 46(1), 28–34 (2014)

    Article  Google Scholar 

  56. Yoo, M., Jin, S.H.: Development and evaluation of learning analytics dashboards to support online discussion activities. Educ. Technol. Soc. 23(2), 1–18 (2020)

    Google Scholar 

  57. Yu, T., Jo, I.H.: Educational technology approach toward learning analytics: relationship between student online behavior and learning performance in higher education. In: Proceedings of the Fourth International Conference on and Knowledge, pp. 269–270. ACM (2014)

  58. Zimmerman, B.J.: A social cognitive view of self-regulated academic learning. J. Educ. Psychol. 81(3), 329 (1989)

    Article  Google Scholar 

  59. Zheng, J., Huang, L., Li, S., Lajoie, S.P., Chen, Y., Hmelo-Silver, C.E.: Self-regulation and emotion matter: a case study of instructor interactions with a learning analytics dashboard. Comput. Educ. 161, 104061 (2021)

    Article  Google Scholar 

Download references

Funding

This research was supported by the Scientific Research Projects Commission of Bartın University, Turkey (Project No: 2017-SOS-CY-012).

Author information

Authors and Affiliations

  1. Graduate School, Bartin University, Bartin, Turkey

    Cigdem Cavus Ezin

  2. Faculty of Science, Computer Technology and Information Systems, Bartin University, Bartin, Turkey

    Ramazan Yilmaz

Authors
  1. Cigdem Cavus Ezin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ramazan Yilmaz
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ramazan Yilmaz.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cavus Ezin, C., Yilmaz, R. The effect of learning analytics-based interventions in mobile learning on students' academic achievements, self-regulated learning skills, and motivations. Univ Access Inf Soc 22, 967–982 (2023). https://doi.org/10.1007/s10209-022-00905-8

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10209-022-00905-8

Keywords

Search

Navigation