Skip to main content
SpringerLink
Log in

Measuring the success of information systems in higher education – a systematic review

  • Published:
Education and Information Technologies Aims and scope Submit manuscript

Abstract

Higher education institutions (HEIs) are encountering numerous challenges in today's era of globalization and internationalization. Among these challenges, digital transformation stands out as one of the most demanding, as it involves using ICT to transform business processes. The successful implementation of such systems and related services requires careful management and measurement. To gain deeper insights into the present state of information systems (IS) and digital services in higher education and relevant theory-based models, a systematic literature review and bibliometric analysis were conducted. After the search and screening, this paper systematically reviewed 63 publications to identify various ISs and classify the research conducted to date. This paper highlights a critical gap in the investigation of ISs beyond learning activities, emphasizing the under-researched area of administrative digital services. Furthermore, the paper contributes by highlighting the prevalent use of DeLone and McLean's success model, particularly in combination with TAM/UTAUT, for empirically measuring IS success in higher education. Results also identify a need for greater consistency and rigor in the use of indicators across studies, since there is no evident agreement on indicators used for measuring the success dimensions. Bibliometric analysis on 1791 records underscores the evolving research landscape, with a shift towards evaluating the quality dimension emphasizing the significance of success evaluation. By achieving its primary objective of examining and organizing the relevant scientific literature on IS in higher education, this study contributes to the existing body of knowledge and offers foundational resources researchers and HEIs seeking to implement new ISs or improve their current systems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Data availability

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

References

The publications included in the SLR have been marked with the star*

  • Abad-Segura, E., González-Zamar, M. D., Infante-Moro, J. C., & García, G. R. (2020). Sustainable management of digital transformation in higher education: Global research trends. Sustainability (Switzerland), 12(5). https://doi.org/10.3390/su12052107

  • Abazi Chaushi, B., Chaushi, A., Dika, Z., & Ismaili, F. (2018). Investigation of higher education ERP implementation factors. Proceedings of the 19th International Conference on Computer Systems and Technologies, pp. 81–87. https://doi.org/10.1145/3274005.3274008

  • Abdellatif, H. (2014). ERP in higher education: A deeper look on developing countries. 2014 International Conference on Education Technologies and Computers, ICETC 2014, February, 73–78. https://doi.org/10.1109/ICETC.2014.6998905

  • Adamko, A. (2018). Building Smart University Using Innovative Technology and Architecture., 70, 191–224. https://doi.org/10.1007/978-3-319-59454-5

    Article  Google Scholar 

  • Ahi, P., & Searcy, C. (2015). Measuring social issues in sustainable supply chains. Measuring Business Excellence, 19, 33–45. https://doi.org/10.1108/MBE-11-2014-0041

    Article  Google Scholar 

  • Akhrif, O., El Idrissi, Y. E. B., & Hmina, N. (2018). Smart university: SOC-based study. ACM International Conference Proceeding Series. https://doi.org/10.1145/32866063286798

    Article  Google Scholar 

  • *Al-Adwan, A. S., Albelbisi, N. A., Hujran, O., Al-Rahmi, W. M., & Alkhalifah, A. (2021). Developing a holistic success model for sustainable e-learning: A structural equation modeling approach. Sustainability (Switzerland), 13(16). https://doi.org/10.3390/su13169453

  • *Al-Adwan, A. S., Nofal, M., Akram, H., Albelbisi, N. A., & Al-Okaily, M. (2022). TOWARDS A SUSTAINABLE ADOPTION OF E-LEARNING SYSTEMS: THE ROLE OF SELF-DIRECTED LEARNING. Journal of Information Technology Education: Research, 21, 245–267. https://doi.org/10.28945/4980

  • *Alajmi, M. A., & Alotaibi, J. H. (2020). Reconceptualization of system use in the context of the digital library: what are the roles of UTAUT and IS success models? In Journal of Electronic Resources Librarianship (Vol. 32, Issue 3, pp. 151–181). https://doi.org/10.1080/1941126X.2020.1790943

  • *Alatawi, S. S. T., Miskon, S., Abdullah, N. S., Ghabban, F., Saeed, F., Alfadli, I., & Ameerbakhsh, O. (2021). A New Model for Enhancing Student Portal Usage in Saudi Arabia Universities. Engineering, Technology & Applied Science Research, 11(3), 7158–7171. https://doi.org/10.48084/etasr.4132

  • *Al-Azawei, A. (2019). What drives successful social media in education and e-learning? A comparative study on Facebook and moodle. Journal of Information Technology Education: Research, 18, 253–274. https://doi.org/10.28945/4360

  • *Albashrawi, M. A., Turner, L., & Balasubramanian, S. (2020). Adoption of Mobile ERP in Educational Environment: Computer Self-Efficacy and System Security. International Journal of Enterprise Information Systems, 16(4), 185–200.https://doi.org/10.4018/IJEIS.2020100109

  • *Al-Debei, M. M. (2014). The quality and acceptance of websites: An empirical investigation in the context of higher education. International Journal of Business Information Systems, 15(2), 170–188. https://doi.org/10.1504/IJBIS.2014.059252

  • *Aldholay, A., Abdullah, Z., Isaac, O., & Mutahar, A. M. (2019). Perspective of Yemeni students on use of online learning: Extending the information systems success model with transformational leadership and compatibility. Information Technology and People, Mayhttps://doi.org/10.1108/ITP-02-2018-0095

  • *Alfaki, I. A. (2021). DeLone and McLean Information Systems Success Model in A Blended-Learning Context. International Journal of Information and Communication Technology Education, 17(4), 0–0. https://doi.org/10.4018/ijicte.20211001oa22

  • *Al-Fraihat, D., Joy, M., Masa’deh, R., & Sinclair, J. (2020). Evaluating E-learning systems success: An empirical study. Computers in Human Behavior, 102(March 2019), 67–86. https://doi.org/10.1016/j.chb.2019.08.004

  • Al-Ghonmein, A. M., Al-Moghrabi, K. G., & Alrawashdeh, T. (2023). Students’ satisfaction with the service quality of academic advising systems. Indonesian Journal of Electrical Engineering and Computer Science, 30(3), 1838–1845. https://doi.org/10.11591/ijeecs.v30.i3.pp1838-1845

  • Al-Hunaiyyan, A., Alhajri, R., Alghannam, B., & Al-Shaher, A. (2021). Student Information System: Investigating User Experience (UX). International Journal of Advanced Computer Science and Applications, 12(2), 80–87. https://doi.org/10.14569/IJACSA.2021.0120210

  • Almaiah, M. A., Jalil, M. A., & Man, M. (2016). Extending the TAM to examine the effects of quality features on mobile learning acceptance. Journal of Computers in Education, 3(4), 453–485. https://doi.org/10.1007/s40692-016-0074-1

    Article  Google Scholar 

  • *Almaiah, M. A., & Al Mulhem, A. (2019). Analysis of the essential factors affecting of intention to use of mobile learning applications: A comparison between universities adopters and non-adopters. In Education and Information Technologies (Vol. 24, Issue 2). Education and Information Technologies. https://doi.org/10.1007/s10639-018-9840-1

  • *Almaiah, M. A., Jalil, M. @. M. A., & Man, M. (2016a). Empirical investigation to explore factors that achieve high quality of mobile learning system based on students’ perspectives. Engineering Science and Technology, an International Journal, 19(3), 1314–1320. https://doi.org/10.1016/j.jestch.2016.03.004

  • Almarashdeh, I. A., Sahari, N., Zin, N. A. M., & Alsmadi, M. (2010). The success of learning management system among distance learners in Malaysian universities. Journal of Theoretical and Applied Information Technology, 21(2), 80–91.

    Google Scholar 

  • *Althunibat, A., Almaiah, M. A., & Altarawneh, F. (2021). Examining the factors influencing the mobile learning applications usage in higher education during the covid-19 pandemic. Electronics (Switzerland), 10(21). https://doi.org/10.3390/electronics10212676

  • Alzahrani, A. I., Mahmud, I., Ramayah, T., Alfarraj, O., & Alalwan, N. (2019). Modelling digital library success using the DeLone and McLean information system success model. Journal of Librarianship and Information Science, 51(2), 291–306. https://doi.org/10.1177/0961000617726123

    Article  Google Scholar 

  • Anttila, J., & Jussila, K. (2018). Universities and smart cities: The challenges to high quality. Total Quality Management and Business Excellence, 29(9–10), 1058–1073. https://doi.org/10.1080/14783363.2018.1486552

    Article  Google Scholar 

  • Arkhipova, M. V., Belova, E. E., Gavrikova, Y. A., Pleskanyuk, T. N., & Arkhipov, A. N. (2019). Reaching generation Z. attitude toward technology among the newest generation of school students. In Advances in Intelligent Systems and Computing (Vol. 726, pp. 1026–1032). https://doi.org/10.1007/978-3-319-90835-9_114

  • *Badwelan, A., & Bahaddad, A. A. (2021). Functional Requirements to Increase Acceptance of M-Learning Applications among University Students in the Kingdom of Saudi Arabia (KSA). International Journal of Computer Science & Network Security, 21(2), 21–39. https://doi.org/10.22937/IJCSNS.2021.21.2.4

  • *Bello, H., & Abdullah, N. A. (2021). Investigating the influence of quality factors on user satisfaction with summative computer-based assessment. In Electronic Journal of e-Learning (Vol. 19, Issue 6, pp. 490–503). https://doi.org/10.34190/ejel.19.6.2487

  • Benavides, L. M. C., Arias, J. A. T., Serna, M. D. A., Bedoya, J. W. B., & Burgos, D. (2020). Digital transformation in higher education institutions: A systematic literature review. Sensors (switzerland), 20(11), 1–23. https://doi.org/10.3390/s20113291

    Article  Google Scholar 

  • *Bessadok, A. (2022). Analyzing student aspirations factors affecting e-learning system success using a structural equation model. Education and Information Technologies, 27(7), 9205–9230. https://doi.org/10.1007/s10639-022-11015-6

  • Beverungen, D., Matzner, M., & Janiesch, C. (2017). Information systems for smart services. Information Systems and E-Business Management, 15(4), 781–787. https://doi.org/10.1007/s10257-017-0365-8

    Article  Google Scholar 

  • Bhattacherjee, A. (2001). Understanding information systems continuance: An expectation-confirmation model. MIS Quarterly, 25(3), 351–370. https://doi.org/10.2307/3250921

    Article  Google Scholar 

  • Biedermann, D., Kalbfell, L., Schneider, J., & Drachsles, H. (2019). Stakeholders attitudes towards digitalization in higher education institutions. 187–192. https://doi.org/10.18420/delfi2019

  • Bond, M., Marín, V. I., Dolch, C., Bedenlier, S., & Zawacki-Richter, O. (2018). Digital transformation in German higher education: Student and teacher perceptions and usage of digital media. International Journal of Educational Technology in Higher Education, 15(1), 1–20. https://doi.org/10.1186/s41239-018-0130-1

    Article  Google Scholar 

  • Branch, J. W., Burgos, D., Serna, M. D. A., & Ortega, G. P. (2020). Digital Transformation in Higher Education Institutions: Between Myth and Reality. In D. Burgos (Ed.), Radical Solutions and eLearning: Practical Innovations and Online Educational Technology (pp. 41–50). Springer Singapore. https://doi.org/10.1007/978-981-15-4952-6_3

  • Bušelić, V., & Banek Zorica, M. (2020). Informacijska pismenost i dipmantska zapošljivost. Vjesnik Bibliotekara Hrvatske, 63(1–2), 635–654.

    Google Scholar 

  • Caushi, B., & Dika, Z. (2018). Higher education information systems: An overview of the latest trends and issues. VIIIth Annual International Meeting of Alb-Science Institute, March 2018.

  • *Chaudhry, I. S., Paquibut, R., Islam, A. R., & Chabchoub, H. (2021). Testing the success of real-time online delivery channel adopted by higher education institutions in the United Arab Emirates during the Covid-19 pandemic. International Journal of Educational Technology in Higher Education, 18(1). https://doi.org/10.1186/s41239-021-00283-w

  • *Chen, Y. H., & Chengalur-Smith, I. (2015). Factors influencing students’ use of a library Web portal: Applying course-integrated information literacy instruction as an intervention. Internet and Higher Education, 26, 42–55. https://doi.org/10.1016/j.iheduc.2015.04.005

  • *Cidral, W. A., Oliveira, T., Di Felice, M., & Aparicio, M. (2018). E-learning success determinants: Brazilian empirical study. Computers and Education, 122, 273–290. https://doi.org/10.1016/j.compedu.2017.12.001

  • Creswell, J. W., & Creswell, J. D. (2018). Research design (5th ed.). SAGE Publications.

  • *Daghan, G., & Akkoyunlu, B. (2016). Modeling the continuance usage intention of online learning environments. Computers in Human Behavior, 60, 198–211. https://doi.org/10.1016/j.chb.2016.02.066

  • *Davarpanah, A., & Mohamed, N. (2020). Human resources information systems implementation and influences in higher education: Evidence from Malaysia. International Journal of Asian Business and Information Management, 11(3), 65–84. https://doi.org/10.4018/IJABIM.2020070105

  • DeLone, W. H., & McLean, E. R. (2016). Information Systems Success Measurement. Foundations and Trends® in Information Systems, 2(1), 1–116. https://doi.org/10.1561/2900000005

  • Delone, W. H., & McLean, E. R. (1992). Information systems success: The quest for the dependent variable. Information System Research, 3(1), 60–95.

    Article  Google Scholar 

  • DeLone, W. H., & McLean, E. R. (2003). The DeLone and McLean model of information systems success: A ten-year update. Journal of Management Information Systems, 19(4), 9–30. https://doi.org/10.1080/07421222.2003.11045748

    Article  Google Scholar 

  • *Demirkol, D., Seneler, C., Daim, T., & Shaygan, A. (2020). Measuring emotional reactions of university students towards a Student Information System (SIS): A Turkish university case. In Technology in Society (Vol. 63). https://doi.org/10.1016/j.techsoc.2020.101412

  • Díaz, O. P., Ribes-Giner, G., & Perello-Marin, M. R. (2016). The impact of cocreation on the student satisfaction: Analysis through structural equation modeling. Abstract and Applied Analysis, 2016. https://doi.org/10.1155/2016/3729791

  • Díaz-Méndez, M., Paredes, M. R., & Saren, M. (2019). Improving society by improving education through service-dominant logic: Reframing the role of students in higher education. Sustainability (Switzerland), 11(19). https://doi.org/10.3390/su11195292

  • Dorobat, I., Corbea, A. M. I., & Muntean, M. (2019). Integrating Student Trust in a Conceptual Model for Assessing Learning Management System Success in Higher Education: An Empirical Analysis. IEEE Access, 7, 69202–69214. https://doi.org/10.1109/ACCESS.2019.2919100

    Article  Google Scholar 

  • Duarte, D., & Martins, P. V. (2011). A maturity model for higher education institutions. CEUR Workshop Proceedings, 731, 25–45.

    Google Scholar 

  • *Efiloğlu Kurt, Ö. (2019). Examining an e-learning system through the lens of the information systems success model: Empirical evidence from Italy. Education and Information Technologies, 24(2), 1173–1184. https://doi.org/10.1007/s10639-018-9821-4

  • El-Bakry, H. M., & Mastorakis, N. (2009). E-Learning and Management Information Systems for E-Universities. Proceedings of the 13th WSEAS International Conference on Computers - Held as Part of the 13th WSEAS CSCC Multiconference, April 555–565.

  • *Eom, S., Ashill, N. J., Arbaugh, J. B., & Stapleton, J. L. (2012). The role of information technology in e-learning systems success. Human Systems Management, 31(3–4), 147–163. https://doi.org/10.3233/HSM-2012-0767

  • *Fadelelmoula, A. A. (2018a). The Effects of the Critical Success Factors for ERP Implementation on the Comprehensive Achievement of the Crucial Roles of Information Systems in the Higher Education. Interdisciplinary Journal of Information, Knowledge, and Management, 13, 21–44

  • *Fadelelmoula, A. A. (2018b). The impacts of the quality dimensions of the ERP system on the realization of the fundamental business objectives and perceived usefulness. International Journal of Enterprise Information Systems, 14(4), 89–107. https://doi.org/10.4018/IJEIS.2018100107

  • Fernández, A., Gómez, B., Binjaku, K., & Meçe, E. K. (2023). Digital transformation initiatives in higher education institutions: A multivocal literature review. In Education and Information Technologies (Issue 0123456789). Springer US. https://doi.org/10.1007/s10639-022-11544-0

  • *Fiati, R., Widowati, W., & Mutiara Kusumo Nugraheni, D. (2023). Service quality model analysis on the acceptance of information system users’ behavior. Indonesian Journal of Electrical Engineering and Computer Science, 30(1), 444. https://doi.org/10.11591/ijeecs.v30.i1.pp444-450

  • Fisher, S. (2006). The market for higher education at a distance: Traditional institutions and the costs of instructional technology.

  • *Gambo, Y., & Shakir, M. Z. (2022). Evaluating students’ experiences in self-regulated smart learning environment. Education and Information Technologies. https://doi.org/10.1007/s10639-022-11126-0

  • *Ghanbarzadeh, R., & Ghapanchi, A. H. (2019). Antecedents And Consequences Of User Acceptance Of Three-Dimensional Virtual Worlds In Higher Education. In Journal of Information Technology Education: Research (Vol. 19, pp. 855–859). https://doi.org/10.28945/4660

  • Ghazal, S., Al-Samarraie, H., & Aldowah, H. (2018). “i am Still Learning”: Modeling LMS Critical Success Factors for Promoting Students’ Experience and Satisfaction in a Blended Learning Environment. IEEE Access, 6, 77179–77201. https://doi.org/10.1109/ACCESS.2018.2879677

    Article  Google Scholar 

  • Gilch, H., Beise, A. S., Krempkow, R., Muller, M., Stratmann, F., & Wannemacher, K. (2019). Digitalisierung der Hochschulen: Ergebnisse einer Schwerpunktstudie für die Expertenkommission Forschung und Innovation. Issues 14–2019. Expertenkommission Forschung und Innovation (EFI). http://hdl.handle.net/10419/194284

  • Giuri, P., Munari, F., Scandura, A., & Toschi, L. (2019). The strategic orientation of universities in knowledge transfer activities. Technological Forecasting and Social Change, 138(April 2017), 261–278. https://doi.org/10.1016/j.techfore.2018.09.030

  • Givens, M. (2016). Keeping Up With... Research Information Management Systems. http://www.ala.org/acrl/publications/keeping_up_with/rims

  • González Bravo, L., Nistor, N., Castro Ramírez, B., Gutiérrez Soto, I., Varas Contreras, M., Núñez Vives, M., & Maldonado Robles, P. (2022). Higher education managers’ perspectives on quality management and technology acceptance: A tale of elders, mediators, and working bees in times of Covid-19. Computers in Human Behavior, 131. https://doi.org/10.1016/j.chb.2022.107236

  • Grajek, S. (2020). How Colleges and Universities Are Driving to Digital Transformation Today. https://er.educause.edu/-/media/files/articles/2020/1/er20sr214.pdf

  • Gupta, P., Chauhan, S., & Jaiswal, M. P. (2019). Classification of Smart City Research - a Descriptive Literature Review and Future Research Agenda. Information Systems Frontiers, 661–685. https://doi.org/10.1007/s10796-019-09911-3

  • Gürkut, C., & Nat, M. (2018). Important factors affecting student information system quality and satisfaction. Eurasia Journal of Mathematics, Science and Technology Education, 14(3), 923–932. https://doi.org/10.12973/ejmste/81147

  • Gurkut, C., & Nat, M. (2016). Student Information System satisfaction in Higher Education Institutions. 13th HONET-ICT International Symposium on Smart MicroGrids for Sustainable Energy Sources Enabled by Photonics and IoT Sensors. HONET-ICT, 2016, 113–117. https://doi.org/10.1109/HONET.2016.7753432

    Article  Google Scholar 

  • *Hagos, Y., Anteneh, S., & Garfield, M. J. (2018). A conceptual model of E-learning systems success and its implication for future research. 2018 17th International Conference on Information Technology Based Higher Education and Training, ITHET 2018, 1–9. https://doi.org/10.1109/ITHET.2018.8424771

  • Hallinger, P., & Kovačević, J. (2019). Science mapping the knowledge base in educational leadership and management: A longitudinal bibliometric analysis, 1960 to 2018. Educational Management Administration and Leadership. https://doi.org/10.1177/1741143219859002

    Article  Google Scholar 

  • *Hasan, M., Maarop, N., Samy, G. N., Mohammad, R., Azmi, N. F., Hassan, N. H., & Ghaffar, N. A. (2018). Measurement tool for assessing research information management system success. Journal of Telecommunication, Electronic and Computer Engineering, 10(3–2), 53–57

  • Hasan, N., & Rahman, A. A. (2016). Exploring factors that influence customer engagement in value co-creation in higher education institutions using online platforms. Journal of Theoretical and Applied Information Technology, 90(2), 247–260.

    Google Scholar 

  • Hernández-torrano, D., & Ibrayeva, L. (2020). Creativity and education : A bibliometric mapping of the research literature ( 1975 – 2019 ). Thinking Skills and Creativity, 35(December 2019), 100625. https://doi.org/10.1016/j.tsc.2019.100625

  • *Hii, P. K., Goh, C. F., Tan, O. K., Amran, R., & Ong, C. H. (2023). An information system success model for e-learning postadoption using the fuzzy analytic network process. Education and Information Technologies. https://doi.org/10.1007/s10639-023-11621-y

  • *Huang, Y.-M., Pu, Y.-H., Chen, T.-S., & Chiu, P.-S. (2015). Development and evaluation of the mobile library services system success model. The Electronic Librabry, 33(6), 1174–1192

  • *Hussein, L. ., & Hilmi, M. F. (2021). The influence of learning value on learning management system use. In The Electronic Journal of e-Learning (Vol. 32, Issue 6, pp. 1306–1321)

  • *Hussein, M. H., Ow, S. H., Al-Azawei, A., & Ibrahim, I. (2022). What drives students’ successful reuse of online learning in higher education? A case of Google Classroom. Australasian Journal of Educational Technology, 38(3). https://doi.org/10.14742/ajet.7335

  • Ibrahim, B., Glood, S., Bahloos, S., & Abd, S. (2021). A Meta-Analysis Review of DeLone and McLean Information System Success Model. Advances in Intelligent Systems and Computing, 1292, 195–208. https://doi.org/10.1007/978-981-33-4389-4_19

    Article  Google Scholar 

  • *Isaac, O., Aldholay, A., Abdullah, Z., & Ramayah, T. (2019). Online learning usage within Yemeni higher education: The role of compatibility and task-technology fit as mediating variables in the IS success model. Computers and Education, 136(November 2017), 113–129. https://doi.org/10.1016/j.compedu.2019.02.012

  • Jan, N., & Ludo, V. E. (2010). Software survey : VOSviewer , a computer program for bibliometric mapping. Scientometrics, 523–538. https://doi.org/10.1007/s11192-009-0146-3

  • Jan, N., & Ludo, V. E. (2022). VOSviewer Manual. Available at: https://www.vosviewer.com/documentation/Manual_VOSviewer_1.6.18.pdf

  • Jeyaraj, A. (2020). DeLone & McLean models of information system success: Critical meta-review and research directions. International Journal of Information Management, 54(November 2019), 102139. https://doi.org/10.1016/j.ijinfomgt.2020.102139

  • Kanduri, S., & Radha, B. (2023). Study on the impact of services offered on student satisfaction and the satisfaction led word of mouth by students pursuing management education. International Journal of Educational Management, 37(2), 526–538. https://doi.org/10.1108/IJEM-04-2022-0158

    Article  Google Scholar 

  • *Ke, P., & Su, F. (2018). Mediating effects of user experience usability: An empirical study on mobile library application in China. Electronic Library, 36(5), 892–909. https://doi.org/10.1108/EL-04-2017-0086

  • Khalid, J., Ram, B., & Khalee, M. (2018). Promising digital university : a pivotal need for higher education transformation Promising digital university : a pivotal need for higher education transformation Jamshed Khalid *, Braham Rahul Ram , Mohamed Soliman , Anees Janee Ali , Muhammad Khaleel a. 12(January), 13. https://www.researchgate.net/publication/324844227%0APromising

  • *Koukopoulos, Z., Koutromanos, G., Koukopoulos, D., & Gialamas, V. (2020). Factors influencing student and in-service teachers’ satisfaction and intention to use a user-participatory cultural heritage platform. In Journal of Computers in Education (Vol. 7, Issue 3, pp. 333–371). https://doi.org/10.1007/s40692-020-00159-4

  • *Lazarus, F. C., & Suryasen, R. (2022). Enhancing Users’ Perceived Significance of Academic Library with MOOC Services. Evidence Based Library and Information Practice, 17(2), 25–47. https://doi.org/10.18438/eblip30016

  • *Lee, E. Y., & Jeon, Y. J. J. (2020). The difference of user satisfaction and net benefit of a mobile learning management system according to self-directed learning: An investigation of cyber university students in hospitality. Sustainability (Switzerland), 12(7). https://doi.org/10.3390/su12072672

  • *Lwoga, E. T. (2013). Measuring the success of library 2.0 technologies in the African context: The suitability of the DeLone and McLean’s model. Campus-Wide Information Systems, 30(4), 288–307. https://doi.org/10.1108/CWIS-02-2013-0011

  • Lwoga, E. T. (2014). Integrating Web 2.0 into an academic library in Tanzania. Electronic Library, 32(2), 183–202. https://doi.org/10.1108/EL-06-2012-0058

  • Marangunić, N., & Granić, A. (2015). Technology acceptance model: A literature review from 1986 to 2013. Universal Access in the Information Society, 14(1), 81–95. https://doi.org/10.1007/s10209-014-0348-1

    Article  Google Scholar 

  • Mardiana, S., Tjakraatmadja, J. H., & Aprianingsih, A. (2015). DeLone-Mclean information system success model revisited: The separation of intention to Use - Use and the integration of technology acceptance models. International Journal of Economics and Financial Issues, 5(July), 172–182.

    Google Scholar 

  • *Marjanovic, U., Simeunovic, N., Delić, M., Bojanic, Z., & Lalic, B. (2018). Assessing the success of university social networking sites: Engineering students’ perspective. International Journal of Engineering Education, 34(4), 1363–1375

  • Marks, A., AL-Ali, M., Atassi, R., Abualkishik, A. Z., & Rezgui, Y. (2020). Digital Transformation in Higher Education: A Framework for Maturity Assessment. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 11(12), 504–513

  • Martins, J., Branco, F., Au-Yong-Oliveira, M., Gonçalves, R., & Moreira, F. (2019a). Higher education students perspective on education management information systems: An initial success model proposal. International Journal of Technology and Human Interaction, 15(2), 1–10. https://doi.org/10.4018/IJTHI.2019040101

    Article  Google Scholar 

  • Martins, J., Branco, F., Gonçalves, R., Au-Yong-Oliveira, M., Oliveira, T., Naranjo-Zolotov, M., & Cruz-Jesus, F. (2019). Assessing the success behind the use of education management information systems in higher education. Telematics and Informatics, 38, 182–193. https://doi.org/10.1016/j.tele.2018.10.001

    Article  Google Scholar 

  • *Masa’Deh, R., Almajali, D., Alrowwad, A., Alkhawaldeh, R., Khwaldeh, S., & Obeidat, B. (2023). Evaluation of factors affecting university students’ satisfaction with e-learning systems used during Covid-19 crisis: A field study in Jordanian higher education institutions. In International Journal of Data and Network Science (Vol. 7, Issue 1, pp. 199–214). https://doi.org/10.5267/j.ijdns.2022.11.003

  • Matkovic, P., Tumbas, P., Maric, M., & Rakovic, L. (2018). Digital Transformation of Research Process At Higher Education Institutions. INTED2018 Proceedings, 1(March), 9467–9472. https://doi.org/10.21125/inted.2018.2344

  • Mikheev, A., Serkina, Y., & Vasyaev, A. (2021). Current trends in the digital transformation of higher education institutions in Russia. Education and Information Technologies, 26(4), 4537–4551. https://doi.org/10.1007/s10639-021-10467-6

    Article  Google Scholar 

  • Moertini, V. S., Yuliaty, T., & Rumono, W. (2011). Academic IS for higher education institutions: The design of speedy courses registration transaction function. Proceedings of the 2011 International Conference on Electrical Engineering and Informatics, ICEEI 2011, July. https://doi.org/10.1109/ICEEI.2011.6021701

  • *Mohammed, A. A. (2021). Assessing the Success of the Perceived Usefulness for Knowledge Management Systems. In International Journal of Knowledge Management (Vol. 18, Issue 1, pp. 1–24). https://doi.org/10.4018/ijkm.291098

  • Moldagulova, A., Satybaldiyeva, R., Uskenbayeva, R., Kassymova, A., & Kalpeyeva, Z. (2020). Architecture development for certain classes of university business processes. Proceedings - 2020 IEEE 22nd Conference on Business Informatics, CBI 2020, 2, 91–95. https://doi.org/10.1109/CBI49978.2020.10064

  • *Mtebe, J. S., & Raisamo, R. (2014). A model for assessing learning management system success in higher education in sub-saharan Countries. Electronic Journal of Information Systems in Developing Countries, 61(1), 1–17. https://doi.org/10.1002/j.1681-4835.2014.tb00436.x

  • Mukti, S. K., & Rawani, A. M. (2016). ERP system success models: A literature review. ARPN Journal of Engineering and Applied Sciences, 11(3), 1861–1875.

    Google Scholar 

  • Nistor, N., Stanciu, D., Lerche, T., & Kiel, E. (2019). “I am fine with any technology, as long as it doesn’t make trouble, so that I can concentrate on my study”: A case study of university students’ attitude strength related to educational technology acceptance. British Journal of Educational Technology, 50(5), 2557–2571. https://doi.org/10.1111/bjet.12832

    Article  Google Scholar 

  • Obaid, T. (2019). Digital Transformation in Higher Education UniSZA Case Study. February.

  • Özyurt, Ö., & Özyurt, H. (2015). Learning style based individualized adaptive e-learning environments: Content analysis of the articles published from 2005 to 2014. In Computers in Human Behavior (Vol. 52, pp. 349–358). https://doi.org/10.1016/j.chb.2015.06.020

  • Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., … Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. The BMJ, 372. https://doi.org/10.1136/bmj.n71

  • *Pangarso, A., & Setyorini, R. (2023). The drivers of E-learning satisfaction during the early COVID-19 pandemic: empirical evidence from an indonesian private university. Cogent Education, 10(1). https://doi.org/10.1080/2331186X.2022.2149226

  • Pasini, A., Estevez, E., & Pesado, P. (2019). Assessment Model for Digital Services provided by Higher Education Institutions. ACM International Conference Proceeding Series, 468–477. https://doi.org/10.1145/3325112.3325268

  • Pérez-Pérez, M., Serrano-Bedia, A. M., & García-Piqueres, G. (2019). An analysis of factors affecting students´ perceptions of learning outcomes with Moodle. Journal of Further and Higher Education, 00(00), 1–16. https://doi.org/10.1080/0309877X.2019.1664730

    Article  Google Scholar 

  • Petter, S., DeLone, W., & McLean, E. (2008). Measuring Information Systems Success. European Journal of Information Systems, 17, 236–263. https://doi.org/10.4018/978-1-4666-0170-3.ch002

    Article  Google Scholar 

  • Pires, A. & Lourenço, R. (2010). Aplicabilidade do modelo de gestão por processos às Instituições de Ensino Superior.

  • Pituch, K. A., & Lee, Y. K. (2006). The influence of system characteristics on e-learning use. Computers & Education, 47(2), 222–244. https://doi.org/10.1016/j.compedu.2004.10.007

    Article  Google Scholar 

  • Platisa, G., & Balaban, N. (2009). Methodological Approaches to Evaluation of Information System’s Functionality Performances and Importance of Successfulness Factors Analysis. Management Information Systems, 4(c), 011–017. http://www.ef.uns.ac.rs/mis/archive-pdf/2009 - No2/MIS2009_2_2.pdf

  • Plotnikova, E. (2019). Digitalization of education in the leading universities of Saint Petersburg. IOP Conference Series: Materials Science and Engineering, 497(1). https://doi.org/10.1088/1757-899X/497/1/012047

  • Pour, M. J., Mesrabadi, J., & Asarian, M. (2021). Meta-analysis of the DeLone and McLean models in e-learning success: The moderating role of user type. Online Information Review, 46, 590–615.

    Article  Google Scholar 

  • *Prabowo, H., Yuniarty, & Ikhsan, R. B. (2022). Student Engagement Mechanism of Online Learning: The Effect of Service Quality on Learning Management System. In International Journal on Informatics Visualization (Vol. 6, Issue 3, pp. 681–687). https://doi.org/10.30630/joiv.6.3.1263

  • *Punjani, K. K., & Mahadevan, K. (2022). Transitioning to online learning in higher education: Influence of Awareness of COVID-19 and Self-Efficacy on Perceived Net Benefits and Intention. Education and Information Technologies, 27(1), 291–320. https://doi.org/10.1007/s10639-021-10665-2

  • *Qasem, Y. A. M., Abdullah, R., Yaha, Y., & Atana, R. (2020). Continuance use of cloud computing in higher education institutions: A conceptual model. Applied Sciences (Switzerland), 10(19). https://doi.org/10.3390/APP10196628

  • *Rafique, H., Alroobaea, R., Munawar, B. A., Krichen, M., Rubaiee, S., & Bashir, A. K. (2021). Do digital students show an inclination toward continuous use of academic library applications? A case study. Journal of Academic Librarianship, 47(2). https://doi.org/10.1016/j.acalib.2020.102298

  • *Rana, N. P., & Dwivedi, Y. K. (2018). An empirical examination of antecedents determining students’ usage of clickers in a digital marketing module. International Journal of Business Information Systems, 27(1), 86–104. https://doi.org/10.1504/IJBIS.2018.088572

  • Rodrigues, L. S. (2017). Challenges of digital transformation in higher education institutions: A brief discussion. Proceedings of the 30th International Business Information Management Association Conference, IBIMA 2017 - Vision 2020: Sustainable Economic Development, Innovation Management, and Global Growth, 2017-Janua, November 2017, 4490–4493.

  • Rof, A., Bikfalvi, A., & Marquès, P. (2020). Digital transformation for business model innovation in higher education: Overcoming the tensions. Sustainability (Switzerland), 12(12). https://doi.org/10.3390/su12124980

  • *Rokhman, F., Mukhibad, H., Bagas Hapsoro, B., & Nurkhin, A. (2022). E-learning evaluation during the COVID-19 pandemic era based on the updated of Delone and McLean information systems success model. Cogent Education, 9(1). https://doi.org/10.1080/2331186X.2022.2093490

  • *Roslina, W., Fahmy, S., & Haslinda, N. (2022). Evaluating the Success of Information Systems based on System Quality, Information Quality and User Satisfaction. International Journal of Integrated Engineering, 14(3), 175–183. https://doi.org/10.30880/ijie.2022.14.03.019

  • Ruzic-Dimitrijevic, L., & Stevic, M. (2014). Functionality Assessment and Requirements of the IT System in an Education Institution. Position Papers of the 2014 Federated Conference on Computer Science and Information Systems, 3, 229–233. https://doi.org/10.15439/2014f463

  • *Salam, M., & Farooq, M. S. (2020). Does sociability quality of web-based collaborative learning information system influence students’ satisfaction and system usage? International Journal of Educational Technology in Higher Education, 17(1). https://doi.org/10.1186/s41239-020-00189-z

  • *Salim, M., Alfansi, L., Anggarawati, S., Saputra, F. E., & Afandy, C. (2021). The role of perceived usefulness in moderating the relationship between the delone and mclean model and user satisfaction. Uncertain Supply Chain Management, 9(3), 755–766. https://doi.org/10.5267/j.uscm.2021.4.002

  • Sandkuhl, K., & Lehmann, H. (2017). Digital transformation in higher education-the role of enterprise architectures and portals. Digital enterprise computing (DEC 2017). Lecture Notes in Informatics, Bonn. pp. 49-60. Böblingen. July 11-12.

  • Santos, H., Batista, J., & Marques, R. P. (2019). Digital transformation in higher education: The use of communication technologies by students. Procedia Computer Science, 164, 123–130. https://doi.org/10.1016/j.procs.2019.12.163

    Article  Google Scholar 

  • Sastry Musti, K. S. (2019). Management information systems for higher education institutions: Challenges and opportunities. Quality Management Implementation in Higher Education: Practices, Models, and Case Studies, May, 110–131. https://doi.org/10.4018/978-1-5225-9829-9.ch006

  • Semeon, G., Negash, S., & Musa, P. (2010). The success of student information management system: The case of higher education institution in Ethiopia. 16th Americas Conference on Information Systems 2010, AMCIS 2010, January, 4522–4532.

  • Seres, L., Pavlicevic, V., & Tumbas, P. (2018). Digital Transformation of Higher Education: Competing on Analytics. INTED2018 Proceedings, 1(March), 9491–9497. https://doi.org/10.21125/inted.2018.2348

  • Shachak, A., Kuziemsky, C., & Petersen, C. (2019). Beyond TAM and UTAUT : Future directions for HIT implementation research. Journal of Biomedical Informatics, 100(July), 103315. https://doi.org/10.1016/j.jbi.2019.103315

    Article  PubMed  Google Scholar 

  • *Shaya, N., Baroudi, S., & Mohebi, L. (2023). Examining Factors Determining the Behavioral Intention to Use Mobile Learning Systems in Higher Education: An Integrative Framework during the COVID-19 Pandemic. The Journal of Educators Online, 20(1). https://doi.org/10.9743/jeo.2023.20.1.12

  • Shin, W. S., & Kang, M. (2016). The use of a mobile learning management system and academic achievement of online students. Computers and Education, 102(3), 79–89. https://doi.org/10.1016/j.compedu.2016.07.003

    Article  Google Scholar 

  • Sinoara, R. A., Antunes, J., & Rezende, S. O. (2017). Text mining and semantics: a systematic mapping study. Journal of the Brazilian Computer Society, 23(1). https://doi.org/10.1186/s13173-017-0058-7

  • Sultan, P., & Wong, H. Y. (2019). How service quality affects university brand performance, university brand image and behavioural intention: The mediating effects of satisfaction and trust and moderating roles of gender and study mode. Journal of Brand Management, 26(3), 332–347. https://doi.org/10.1057/s41262-018-0131-3

    Article  Google Scholar 

  • Sutjarittham, T., Gharakheili, H. H., Kanhere, S. S., & Sivaraman, V. (2019). Realizing a Smart University Campus: Vision, Architecture, and Implementation. International Symposium on Advanced Networks and Telecommunication Systems, ANTS, 2018-Decem. https://doi.org/10.1109/ANTS.2018.8710084

  • Tenório, T., Bittencourt, I. I., Isotani, S., & Silva, A. P. (2016). Does peer assessment in on-line learning environments work? A systematic review of the literature. In Computers in Human Behavior (Vol. 64, pp. 94–107). https://doi.org/10.1016/j.chb.2016.06.020

  • Thoring, A., Rudolph, D., & Vogl, R. (2017). Digitalization of higher education from a student’s point of view. EUNIS Paper, 47. Available at: https://eunis.org/download/2017/EUNIS_2017_paper_47.pdf

  • Thoring, A., Rudolph, D., & Vogl, R. (2018). The digital transformation of teaching in higher education from an academic’s point of view: An explorative study. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 10924 LNCS, 294–309. https://doi.org/10.1007/978-3-319-91743-6_23

  • Tømte, C. E., Fossland, T., Aamodt, P. O., & Degn, L. (2019). Digitalisation in higher education: Mapping institutional approaches for teaching and learning. Quality in Higher Education, 25(1), 98–114. https://doi.org/10.1080/13538322.2019.1603611

    Article  Google Scholar 

  • Tungpantong, C., Nilsook, P., & Wannapiroon, P. (2021). A Conceptual Framework of Factors for Information Systems Success to Digital Transformation in Higher Education Institutions. 2021 9th International Conference on Information and Education Technology, ICIET 2021, 57–62. https://doi.org/10.1109/ICIET51873.2021.9419596

  • Turban, E., & Volonino, L. (2010). Information Technology for Management: Transforming Organizations in the Digital Economy. Wiley.

  • Uskov, V. L., Bakken, J. P., Howlett, R. J., & Jain, L. C. (2018). Innovations in Smart Universities., 70, 191–224. https://doi.org/10.1007/978-3-319-59454-5

    Article  Google Scholar 

  • *Vanitha, P. S., & Alathur, S. (2021). Factors influencing E-learning adoption in India: Learners’ perspective. In Education and Information Technologies (Vol. 26, Issue 5, pp. 5199–5236). https://doi.org/10.1007/s10639-021-10504-4

  • Vargo, S. L., & Lusch, R. F. (2008). Service-Dominant Logic Continuing the Evolution. Journal of the Academy of Marketing Science, 36, 1–10. https://doi.org/10.1007/s11747-007-0069-6

    Article  Google Scholar 

  • Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User Acceptance of Information Technology: Toward a Unified View. MIS Quarterly, 27(3), 425–478. https://doi.org/10.1016/j.inoche.2016.03.015

    Article  CAS  Google Scholar 

  • Venkatesh, V., & Davis, F. D. (2000). A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies. Management Science, 46(2), 186–204. http://www.jstor.org/stable/2634758

  • Verina, N., Titko, J., & Shina, I. (2019). Digital transformation in higher education: Academic and administrative staff perception. 34th IBIMA Conference: 13–14 November 2019, Madrid, Spain.

  • Wang, W., Kurnia, S., & Linden, T. (2020). Investigating key benefits and benefit drivers of enterprise systems implementation in the higher education institution context. Proceedings of the Twenty-Third Pacific Asia Conference on Information Systems, (pp. 1–14) Dubai, UAE.

  • *Watungwa, T., & Pather, S. (2019). Identification of user satisfaction dimensions for the evaluation of university administration information systems. 15th International Conference on Intellectual Capital, Knowledge Management & Organisational Learning, January, 346–354. Retrieved from https://www.proquest.com/conference-papers-proceedings/identification-user-satisfaction-dimensions/docview/2158168548/se-2

  • Xiao, J. (2019). Digital transformation in higher education: Critiquing the five-year development plans (2016–2020) of 75 Chinese universities. Distance Education, 40(4), 515–533. https://doi.org/10.1080/01587919.2019.1680272

    Article  Google Scholar 

  • *Xu, F., & Du, J. T. (2018). Factors influencing users’ satisfaction and loyalty to digital libraries in Chinese universities. Computers in Human Behavior, 83, 64–72. https://doi.org/10.1016/j.chb.2018.01.029

  • *Xu, F., & Du, J. T. (2019). Examining differences and similarities between graduate and undergraduate students’ user satisfaction with digital libraries. Journal of Academic Librarianship, 45(6), 102072. https://doi.org/10.1016/j.acalib.2019.102072

  • *Xu, F., & Du, J. T. (2019). Examining differences and similarities between graduate and undergraduate students’ user satisfaction with digital libraries. Journal of Academic Librarianship, 45(6), 102072.

  • *Yang, Q., & Lee, Y. C. (2021). The critical factors of student performance in MOOCs for sustainable education: A case of chinese universities. Sustainability (Switzerland), 13(14). https://doi.org/10.3390/su13148089

  • *Yuniarto, D., Subiyakto, A., Firmansyah, E., Fadil, I., Sani, A., & Irfan, M. (2022). Tracer Study Information Systems Success in Private Higher Education Institution. 2022 10th International Conference on Cyber and IT Service Management, CITSM 2022. https://doi.org/10.1109/CITSM56380.2022.9935862

  • Zhang, Y., Liang, R., Shi, Z., & Ma, H. (2012). The Design and Implementation of a Process-Driven Higher Educational Administrative System. IERI Procedia, 2, 176–182. https://doi.org/10.1016/j.ieri.2012.06.071

    Article  ADS  Google Scholar 

Download references

Acknowledgements

This work has been supported by the Croatian Science Foundation under the project UIP-2017-05-7625: User-oriented process (re)design and information systems modelling – a case of smart city services.

Author information

Authors and Affiliations

  1. Faculty of Economics, Business and Tourism, University of Split, Cvite Fiskovića 5, 21000, Split, Croatia

    Tea Mijač, Mario Jadrić & Maja Ćukušić

Authors
  1. Tea Mijač
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mario Jadrić
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Maja Ćukušić
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Tea Mijač had the idea for the article. All three authors participated in conducting the systematic literature review and contributed to the writing of this manuscript. All three authors read and approved the fnal manuscript.

Corresponding author

Correspondence to Tea Mijač.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Financial interests

The authors declare they have no financial interests.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix

Appendix

Table 2.

Table 3.

Table 4.

Table 5.

Table 6.

Table 7.

Table 2 Selected studies categorised around types of ISs in HE
Full size table
Table 3 Selected studies categorised around the model used for evaluation of IS success in HE
Full size table
Table 4 System quality indicators (17)
Full size table
Table 5 Information quality indicators (11)
Full size table
Table 6 Service quality indicators (12)
Full size table
Table 7 Net benefits indicators (10)
Full size table

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mijač, T., Jadrić, M. & Ćukušić, M. Measuring the success of information systems in higher education – a systematic review. Educ Inf Technol (2024). https://doi.org/10.1007/s10639-024-12564-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10639-024-12564-8

Keywords

Search

Navigation