Journal of New Approaches in Educational Research

Articulo main

Gizeh Rangel-de Lazaro Josep M Duart

Abstract

Technological revolutionary changes have boosted mobile learning’s evolution from supplementary material for teaching to a flexible, strategic, and convenient resource, driving new paths in higher education. With global increases in wireless internet access and the advent of highly functional smartphones and tablets, which have impacted the rise in mobile device ownership, mobile learning has expanded its applications as a direct way to implement tailored learning settings. Notably, during the COVID-19 pandemic, together with other educational technologies, it became a solicited tool in remote education. In this systematic review, we will explore how educators and researchers have been documenting the development and impact of mobile learning tools in the teaching and learning process since the COVID-19 outbreak. Results show that, embedded with online higher education programs, mobile learning has empowered interaction in content creation, communication, and collaboration between learners and instructors, significantly impacting learning effectiveness. Moreover, although this technology is well established in higher education, it remains attractive for educators who actively use it because of its pedagogic potential.


Revolucionarios cambios tecnológicos han impulsado la evolución del aprendizaje con móviles. Estos dispositivos, han pasado de ser un material complementario para la enseñanza a convertirse en un recurso flexible, estratégico y práctico, impulsando nuevos caminos en la educación superior. Con el incremento global del acceso a Internet, la llegada de altamente funcionales smartphones y tabletas y el aumento de la adquisición de estos dispositivos, el aprendizaje con móviles ha ampliado sus aplicaciones como forma directa de implementar entornos educativos personalizados. En particular, desde el estallido del COVID-19, junto con otras tecnologías educativas, se convirtió en una herramienta muy utilizada en la educación a distancia. En esta revisión sistemática, exploraremos cómo los educadores e investigadores están documentando el desarrollo y el impacto de las herramientas de aprendizaje con móviles en el proceso de enseñanza durante la pandemia. Los resultados muestran que, integrado en los programas de educación superior en línea, el uso de los móviles con fines educativos potenció la interacción en la creación de contenidos, la comunicación y la colaboración entre alumnos e instructores, lo que repercutió significativamente en la eficacia del aprendizaje. Además, aunque esta tecnología está bien asentada en la enseñanza superior, sigue siendo atractiva para los educadores, que la utilizan activamente por su potencial pedagógico

Keywords
MOBILE LEARNING; PEDAGOGY; ONLINE HIGHER EDUCATION; ADAPTIVE LEARNING TECHNOLOGIES
APRENDIZAJE MÓVIL; PEDAGOGÍA; EDUCACIÓN SUPERIOR EN LÍNEA; TECNOLOGÍAS DE APRENDIZAJE ADAPTATIVO
Section
Articles

INTRODUCTION

Mobile learning (also known as m-learning) has been characterized as a multifaceted process involving theoretical-based pedagogical approaches to tackle educational requirements (Hao, Dennen, & Mei, 2017). Revolutionary changes in the 1980s, with the introduction of pocket and handheld computers, have been recognized as the first steps of what we today consider mobile learning (Educause, 2019). With time, the functional advantages of mobile devices such as smartphones and tablets, compared to laptops or desktop computers, made them a solicited resource for teaching-learning (Mâță et al., 2021). Likewise, the integration of smartphones and tablets into learning processes, the availability of powerful and intuitive mobile applications, and accelerating mobile internet connection have facilitated the creation and sharing of content (Adanır & Muhametjanova, 2021).

The responsive design of mobile learning content available on all platforms also drives its success in online higher educational contexts (Yu, Yan, & He, 2022). Understanding how to structure material for shorter attention spans, choosing optimized mobile-friendly formats, and maintaining active communication with students are key factors of faculty development (Minichiello et al., 2021; O'Connor & Andrews, 2018; Pham & Chen, 2018). These design tenets promote a more consistent user experience across platforms and devices within the academic environment.

Unquestionably, integrating mobile devices as an educational asset also exposes the gap between those who can afford to have rapid access to the internet connection and those who cannot. In 2021 nearly 15 billion mobile devices were operating worldwide (Radianti, Majchrzak, Fromm, & Wohlgenannt, 2020). However, up to 3.2 billion people did not have access to mobile internet services, even though they lived in areas with a mobile broadband network (GSMA, 2022). The usage gap is notable in low- and middle-income countries; for example, up to 40% of Latin America and the Caribbean population and 53% of the population in Sub-Saharan Africa. In contrast, North America represents 24%, and Europe and Central Asia represent 26% (Bahia & Delaporte, 2020). Moreover, there are still considerable differences in average mobile connection speeds worldwide, with the United Arab Emirates (125 Mbps), for example, being 25 times faster than Cuba (5 Mbps). Among other factors, this has a notable impact on the implementation of mobile learning initiatives, including those integrated with XR and AI resources via mobile connections (Kemp, 2022).

Mobile learning has been a resource of attraction for researchers actively investigating its academic potential for many years (Crompton & Burke, 2017; Liaw, Hatala, & Huang, 2010; Matzavela & Alepis, 2021; Motiwalla, 2007; Yu et al., 2022). Especially during the COVID-19 pandemic, mobile learning became a solicited tool in remote education (Dhawan, 2020; Muthuprasad, Aiswarya, Aditya, & Jha, 2021).

In this systematic review, we will explore how educators and researchers have been documenting the development and impact of mobile learning tools in the teaching and learning process since the COVID-19 outbreak. To that end, we have designed the following questions:

  • RQ1. What is the geographical distribution of the publications, and which languages were used?

  • RQ2. Which sources are most frequently used for publication, and who are the most cited authors in the literature?

  • RQ3.Which devices, data collection, and research design methods were set out to support mobile learning and teaching, and within which disciplines are they integrated?

  • RQ4. What is the scope and nature of mobile learning applications in online higher education?

METHODS

To address the research questions defined in this systematic review, we will localize, synthesize and analyze peer-reviewed publications with a precise, standardized, and reproducible search strategy following the Preferred Reporting Items for Systematic reviews and Meta-Analyses system (PRISMA; Page et al., 2021).

Additionally, we will employ the R program litsearchr to systematically define our search terms (Grames, Stillman, Tingley, & Elphick, 2019). In order to compile a set of keywords relevant to our review, this package will run the Rapid Automatic Keyword Extraction (RAKE) algorithm (Rose, Engel, Cramer, & Cowley, 2010), identifying keywords from the titles and abstracts from publications and extracting the author-tagged keywords.

Pipeline

A "naive search" was conducted on 6 June 2022 in Scopus, Web of Science, and EBSCO Education sources with no date restrictions to gather relevant publications, including the following terms (Figure 1): (("higher education" OR "college" OR "undergrad" OR "graduate" OR "postgrad") AND ("mobile application" OR "virtual reality" OR "augmented reality" OR "mixed reality" OR "haptic technology" OR "artificial intelligence") AND ("e-learning" OR "online learning" OR "virtual learning" OR "distance learning" OR "remote learning")). As a result, we identified records from Scopus (n = 2984), Web of Science (n = 529), and EBSCO Education sources (n = 24) and removed duplicated publications (n = 1026).

Figure 1. a. Preferred reporting items for systematic reviews and meta-analyses diagram (adapted after Page et al., 2021). b. Terms near the centre of the graph and that are linked to each other by darker lines were more relevant to our search.

Potential keywords for the systematic review were extracted from the publications retrieved using the RAKE algorithm (500) and tagged method (523). Additionally, we quantitatively assessed the strength of the keywords compiled. Relevant terms frequently appeared with other terms from the set, and non-essential ones appeared associated with others (147 keywords removed). Finally, to define the search strategy for the Boolean searches in English and Spanish, the remaining keywords were organized into three groups: Emerging technologies, Education level, and Learning setting (Table 1).

Table 1. Search string in English after the naïve search

Topic

Search terms

Education level

"higher* educ*" OR "colleg* student*" OR "univers* student*

AND

Emerging technologies

"artifici* intellig*" OR "360 video*" OR "immers* learn*" OR "machin* learn*" OR "mixed realit*" OR "virtual* realit*" OR "augment* realit*" OR "intellig* tutor*" OR "mobil* applic*" OR "mobil* devic*" OR "XR* technolog*"

AND

Learning setting

"distanc* educ*" OR "distanc* learn*" OR "onlin* educ*" OR "onlin* learn*" OR "onlin* teach*" OR "remote* learn*" OR "e-learn*" OR "onlin* cours*"

Furthermore, we collected ten key publications to test the accuracy and recall of the systematic review search strategy using Scopus, Web of Science, and EBSCO Education. We were able to retrieve the ten papers selected using the search terms defined, confirming that we could run the final search string for the systematic review.

Final Search, Screening, Coding, and Data Extraction

Based on the Boolean search terms outlined (Table 1) and the inclusion and exclusion criteria (Table 2), the final search was limited to the three abovementioned databases, including titles, abstracts, and keywords of publications. A total of 424 initial observations were identified. This list was narrowed down after removing 70 duplicates.

Two further articles were excluded because they were accessible neither through journal publications nor by contacting authors. Afterwards, publications were filtered to those peer-reviewed research articles, reviews, and book chapters submitted after the COVID-19 outbreak in March 2020 (70 articles excluded). We set further exclusion criteria by only including those focused on mobile learning (181 papers discarded) in online higher education (46 publications removed).

Fifty-five publications remained for screening on full text and coding (Figure 1). We coded articles based on a hierarchical ontology of associations between subjects (Table 2). The codes used comprised: the author's name, year of publication, source name, times cited, country of origin of the first author, type of publication (research article, review, or book chapter), the language used, data collection method, type of mobile device, research design, technology application in higher education, domain, and scope of application. Data analyses and graphics were done using the R package tidyr (Wickham, Vaughan, & Girlich, 2023), dplyr (Wickham, François, Henry, Müller, & Vaughan, 2023), tidyverse (Wickham et al., 2019), bibliometrix (Aria & Cuccurullo, 2017), maps (Becke, Wilks, Brownrigg, Minka, & Deckmyn, 2021), ggplot2 (Wickham, 2016), ggraph (Pedersen, 2021), and igraph (Csárdi & Nepusz, 2006).

Table 2. Inclusion and Exclusion criteria

Inclusion Criteria

Exclusion Criteria

Indexed in Web of Science, Scopus, or EBSCO Education.

Not indexed publication in these three platforms.

Peer-reviewed research articles, reviews, and book chapters.

Not peer-reviewed research articles, reviews, or book chapters

Publications including updated information on the application of Mobile learning in education

Publications not including updated information on the application of Mobile learning in education

Online higher education

No online higher education

Submitted after the COVID-19 outbreak in March 2020

Submitted before the COVID-19 outbreak in March 2020

In this systematic review, we defined a set of categories to code the publications. First, we wanted to know the Type of device reported in each study. We identified four groups: 1) mobile devices (used as a generic term), 2) mobile phones (also encompassing smartphones), 3) laptops, mobile phones, and tablets, and 4) mobile phones and tablets.

In terms of Research design, we considered a combination of the Creswell and Creswell (2017) and Wendler (2012) frameworks suitable for our systematic review scope, including 1) quantitative, 2) qualitative, 3) mixed methods, and 4) design-oriented research.

The Data collection method followed by the authors was distributed across eight groups assigned following Cohen, Manion, and Morrison (2018), Creswell and Creswell (2017), Wendler (2012), and Paré, Trudel, Jaana, and Kitsiou (2015). Each article screened was assigned to one of the following categories: 1) case study, 2) development, 3) experimental design, 4) focus group and interview, 5) literature review, and 6) survey, along with a combination of methods such as 7) interview and survey, and 8) literature review, interview, and survey.

Moreover, we were interested in how mobile learning was applied in online higher education. To that end, we further analyzed only the primary research extracted by customizing eight categories following Crebert, Bates, Bell, Patrick, and Cragnolini (2004), Zawacki-Richter, Marín, Bond, and Gouverneur (2019), and Radianti et al. (2020). A description can be found in Table X, and it includes 1) Adaptive learning systems and Personalization, 2) Analytical and Practical knowledge, 3) Assessment and Evaluation, 4) Behavioral and Psychological impact, 5) Best practices, 6) Communication and Collaboration, 7) Learning a language, and 8) Profile and Prediction.

Scope of Application

As part of the coding process, we aimed to assign, where possible, each article to a particular discipline. To that end, as indicated in Table 3, we followed and adapted the list of groups and fields provided by the UNESCO International Standard Classification of Education (UNESCO Institute for Statistics, 2012). Additionally, we created the category No particular domain to group those papers that, due to the interdisciplinary nature of the study or the lack of additional details, did not fall within a specific discipline.

Table 3. Scope of application of Mobile learning in higher education

Group

Field

Arts

Fine arts; Performing arts; Graphic and audio-visual arts; Design

Behavioural sciences

Psychology; Psychobiology; Anthropology; Cognitive science

Business and Administration

Accounting; Economics; Management; Public administration

Computer sciences

System design; Computer programming; Data processing;

Networks; Computer information technology; Information systems; Software development

Communication and Information

Journalism and Social Communication

Education science

Teacher training programs; Curriculum development; Educational assessment; Educational research

Engineering

Chemical engineering; Mechanical engineering; Thermal engineering; Informatics; Computer engineering; Robotics; Electric engineering; Architecture; Design and Technical Drawing; Aviation engineering; Civil engineering

Health sciences

Medicine; Nursing; Medical services

Humanities

Foreign and native languages; Cultural studies; History; Archaeology; Philosophy; Ethics

Sciences

Biology; Zoology; Astronomy; Physics; Chemistry; Mathematics

Social sciences

Political science; Sociology

Sports

Physical education; Sports

No particular domain

Including multidisciplinary research articles and those where the field of application was not specified.

RESULTS

RQ1. What is the Geographical Distribution of the Publications, and Which Languages Were Used?

From mapping the literature reviewed, we recognized a progressive increase in publications addressing mobile learning resources in higher education over the past two years. Notably, 91% of the publications retrieved were research articles, and 9% were literature reviews. We traced 55 published pieces of research across 27 countries (Figure 2). The implementation of mobile learning for teaching-learning practices in higher education was localized to four continents. Figure 2 shows that most of the publications came from Asia (62%), followed by Europe (22%), Latin America (15%) and, to a lesser extent, Africa (2%). China was the country showing the largest publication productivity in mobile learning (n = 8, e.g., Cui, 2022; Ding et al., 2020; Fan et al., 2022; Lin et al., 2021; Yu et al., 2022). This trend was followed by Spain (n = 6; e.g., Navandar et al., 2021; Romero-Rodriguez et al., 2020; Verdes et al., 2021), Saudi Arabia (e.g., Almaiah et al., 2022; Iqbal et al., 2020) and India (n = 5; e.g., Mubayrik & Alabbad, 2021; Neffati et al., 2021). On the opposite side, for countries such as Ghana (Yeboah & Nyagorme, 2022), Cyprus (Cavus, 2020), Ecuador (Rodríguez Muñoz & Mieres, 2020), and Norway (Egilsdottir et al., 2021), only one publication was retrieved for each.

Figure 2. Geographical distribution of the publications reviewed in Spanish and English.

Furthermore, in Figure 3 the yearly contribution in both languages can be seen. A large majority (93%) of the publications mapped were published in English. Most were published in 2021, closely followed by those from the following year. In contrast, only 7% of the screened papers were in Spanish, and these were issued between 2020 and 2022 (Borroto, Medina Olazabal, & Fonseca Montes E Oca, 2021; Rodríguez Muñoz & Formoso Mieres, 2020; Salas-Rueda, Ramírez-Ortega, Eslava-Cervantes, Castañeda-Martínez, & De-La-Cruz-Martínez, 2022; Vigil García et al., 2020).

Figure 3. The number of publications retrieved in English and Spanish according to the type of device used.

RQ2. Which Sources Are Most Frequently Used for Publication, and Who are the Most Cited Authors in the Literature?

Figure 4 shows the journals most frequently found in our database with articles published between 2020 and the current year. At the top of the list were Education and Information Technologies (n = 5), followed by Sustainability (n = 4) and Electronics (n = 3). With two articles each, we also found IEEE Access, International Journal of Emerging Technologies in Learning, International Journal of Interactive Mobile Technologies, Revista Conrado, and Wireless Communications and Mobile Computing. The remaining 33 sources were only represented by one article in our analysis.

To get an updated picture of the most cited authors, we returned to the online databases on 26 August and revised the number of citations received by each of the publications reviewed. In this case, two research papers published in 2020 led the way: Romero-Rodriguez et al. (2020) with 35 citations and Ding et al. (2020) with 33 citations. They were closely followed by (Akour, Alshurideh, Kurdi, Ali, & Salloum, 2021), cited 26 times. The Sankey diagram displayed in Figure 4 shows the interconnected relationship between the ten most cited authors, the keywords most frequently found in the articles, and the journals where they were published.

Figure 4. The interconnected relationship between the ten most cited authors, the keywords most frequently found in the articles, and the journals where they were published.

RQ3.Which Devices, Data Collection, and Research Design Methods Were Set Out to Support Mobile Learning and Teaching, and Within Which Disciplines Are They Integrated?

A matter relevant to this review was to identify the type of device reported in the literature analyzed. Over half of the papers reviewed (56%) indicated mobile phone use in mobile learning activities (Figure 5a). Notably, 28 of these papers specifically reported using smartphones. We also found that in 20% of the cases, authors used mobile device as a generic term without further clarification. Moreover, authors frequently combined several terms, such as mobile phones and tablets in 13% of records retrieved. Similarly, the use of laptops, mobile phones, and tablets was reported in 11% of the cases.

Figure 5. a. Type of device reported in the literature analyzed. b. The relationship between data collection and research design methods (the number of publications retrieved determines the bubble size).

Furthermore, we traced the association between data collection and research design methods according to each type of device identified (Figure 5b). A majority of the papers (45%) focused on mobile learning were quantitative-based combined with a survey approach (Akour et al., 2021; Almaiah et al., 2022; Yuan, Tan, Ooi, & Lim, 2021). The authors implemented a qualitative strategy in 25% of the studies analyzed and used the following as collection methods: surveys (Sooryah & Soundarya, 2020; Vigil García et al., 2020), literature reviews (Gupta, Khan, & Agarwal, 2021) case studies (Borroto et al., 2021; Gurevych et al., 2021), and focus groups and interview (Pramana et al., 2020). Only 7% of the publications reviewed used a mixed methods approach paired with a literature review, interviews, and surveys. Likewise, only 7% of the research was design-oriented and used development approaches for collecting data (Ding et al., 2020; Márquez-Díaz, 2020; Verdes et al., 2021; X. Zhang, 2022).

RQ4. What Is the Scope and Nature of Mobile Learning Applications in Online Higher Education?

Figure 6shows the scope of application of research articles distributed across the types of devices identified. Particularly when considering the use of mobile phones, Engineering (n = 7; e.g., Diaz-Nunez et al., 2021; Laurens-Arredondo, 2022), Humanities (n = 6; e.g., Lan, 2022; Ugur-Erdogmus & Cakir, 2022), and Business and Administration (n = 5; e.g., Thedpitak & Somphong, 2021; Voshaar et al., 2022) predominated among all disciplines analysed. By looking in detail at the chart, it can be seen that publications reporting the use of either mobile devices (in general terms) or combined applications of laptops, mobile phones, and tablets are clustered together in the centre of the radar with one or two publications each across Arts (Cui, 2022), Communication and Information (Stephens, Rudiger, & Faires, 2021), Education Science (Romero-Rodriguez et al., 2020), Sciences (Borroto et al., 2021), Social Sciences (L. Zhang & He, 2022), and Sports (Ding et al., 2020). Notably, the four series of devices categorized had research papers where no particular domain or specific discipline was outlined, as illustrated in Figure 6 (Almaiah et al., 2022; Althunibat, Almaiah, & Altarawneh, 2021; Antee, 2021).

Figure 6. Scope of mobile learning applications in higher education in the research articles coded according to the type of device used.

Further to the above, using the eight categories described in Table 4, we assessed the relationship between the scope and the nature of mobile learning applications in the 50 research articles analyzed. The nature and aim of some studies coincided in part with multiple categories. In those cases, we assigned them to the one where their applicability is most significant.

Table 4. Mobile learning technology application in highereducation

Categories

Definition

Adaptive learning systems and Personalization

A study where Mobile learning has been used to either design or implement learning content dynamically adjusted to the pace and progress of students, helping improve their performance with automated and instructor interventions. Integrating personalized learning models facilitates student guidance, knowledge, and skill-sharing between learning teams.

Analytical and Practical knowledge

A publication where emerging technologies helped students improve analytical skills, such as collecting and analyzing data, programming, or making complex decisions like designing a manufacturing system. It also includes research articles reporting the use of Mobile learning to instruct learners on performing hands-on and field-specific practical training.

Assessment and Evaluation

Mobile learning implements evaluation methods such as remotely proctored exams, measure knowledge acquisition and engagement, and provides automated grading and feedback, ensuring integrity and academic honesty.

Behavioural and Psychological impact

When Mobile learning aims to assess the behaviour of learners or the psychological impact and awareness of the pandemic on learning habits, academic performance, and mental health issues.

These tools are also be used to change perceptions, improve peer interest, and enhance engagement and learning motivation.

Best practices

When Mobile learning is implemented at the universities as a factor of change to favour teaching practices quality and improve learners' involvement, motivation, and development of skills.

Communication and Collaboration

It refers to research articles explaining the application of mobile learning to reinforce teamwork and communication skills and enhance collaboration experience and engagement.

Learning a language

Publications addressing the application of mobile learning to enhance students' foreign language skills.

Profile and Prediction

When Mobile learning is applied to assess students' progress throughout the learning process to provide feedback and recommendations in learning-related matters. It also considers the development of early warning systems detection of students at risk of failing, dropping out, or struggling with mental health issues due to the pandemic.

Adaptive Learning Systems and Personalization

Research articles within this scope accounted for a significant proportion (22%) of those analyzed. Three studies were included in Humanities (Figure 7); two focused on History-related topics (Sarkadi, Cahyana, & Paristiowati, 2020; Ugur-Erdogmus & Cakir, 2022), and the other on mobile application development to reduce difficulties in listening to lectures online in a foreign language (Sooryah & Soundarya, 2020). We retrieved two Engineering-related publications. The first presented the design of a virtual world to make student and teacher access to knowledge through mobile learning more accessible and adaptative (Márquez-Díaz, 2020). The second one reported the creation of an augmented reality platform for improving mobile e-learning in software engineering (Neffati et al., 2021). In this same line, the paper by (Cavus, 2020) tested a novel unified mobile system with instructors and students from Education, Engineering, Law, and Languages to customize interactive teaching activities.

Figure 7. Mobile learning applications in higher education are distributed into seven categories: A. Adaptive learning systems and Personalization; B. Analytical and Practical knowledge; C. Assessment and Evaluation; D. Behavioural and Psychological impact; E. Best practices; F. Communication and Collaboration; G. Learning a language; H. Profile and Prediction

A few publications supported mobile learning implemented with XR technologies. Two were in Science-related disciplines, one for teaching invertebrate zoology online (Verdes et al., 2021) and the other for learning physics (Gurevych et al., 2021). Ding et al. (2020) relied on virtual reality and mobile learning to improve physical education. Likewise, Eldokhny and Drwish (2021) assessed the effectiveness of augmented reality in online distance learning to support academic achievement in Computer Science education. Finally, an artificial neural network algorithm (X. Zhang, 2022) found that a personalized mobile learning system may supplement and optimize the learning experience compared to traditional teaching.

Best Practices

This category accounted for 14% of all research articles reviewed. The scope of the application was not specified in the three publications (Figure 7). Almaiah et al. (2022) explored quality impacting mobile learning usage. At the same time, Coskun-Setirek and Tanrikulu (2021) presented a guideline for sustainable education with mobile learning initiatives. Finally, Althunibat et al. (2021) highlighted the benefits of institutional policy, change management, and top management support in the usability of mobile learning systems.

Interestingly, the two papers retrieved within the Education Science scope focused on advancing and applying mobile applications from different perspectives and regions. The results of Salas-Rueda et al. (2022) regarding the Innovation in University Teaching diploma in Mexico revealed the positive influence on student engagement and academic activities of introducing web games and mobile devices in teaching-learning practices, while Romero-Rodriguez et al. (2020) investigated the level of implementation of mobile learning in Spanish universities and the sociodemographic features impacting the advancement of best teaching practices. Following a similar trend, Teymurova et al. (2020) examined university teacher integration levels in mobile entrepreneurial learning. The final publication coded within this category analyzed student perceptions of mobile devices in the Library and Information Science course, using this information to design a mobile-friendly training program (Stephens et al., 2021).

Profile and Prediction

14% of research papers coded fell within this category and were distributed across multiple disciplines. As illustrated in Figure 7, three articles looked at combined approaches for predicting technology acceptance and usability—the first implemented mobile learning and XR in a Psychology class (Sprenger & Schwaninger, 2021). In the second, machine learning was employed to predict the usefulness, effectiveness, efficiency, and acceptance of mobile learning, although no specific application domain was specified (Almaiah, Almomani, Al-Khasawneh, & Althunibat, 2021). The third study assessed Ghanaian distance learners' acceptance of WhatsApp as an educational tool at the University of Education during the pandemic (Yeboah & Nyagorme, 2022).

The three remaining publications addressed matters linked to Business and Administration (Herrador-Alcaide et al., 2020) and Journalism, Communication and Information (Humida, Mamun, & Keikhosrokiani, 2021). Yuan et al. (2021) reported that learning content quality, user interface, and connectivity are the leading drivers influencing students' perceptions, ease of use and experience when using mobile learning. Meanwhile, L. Zhang and He (2022) proposed a machine learning algorithm to optimize and monitor student performance in Ideological and Political Education using mobile learning during the pandemic. To a lesser extent, with only nine publications retrieved, mobile learning also appeared in higher education teaching and learning.

Behavioural and Psychological Impact

Five research articles did not centre on one specific domain. Akour et al. (2021) applied machine learning algorithms to predict the benefits of using mobile learning platforms during the pandemic (Figure 7). After analyzing a dataset of 10,000 college students, Lin et al. (2021) suggested that mobile learning and news applications positively impact academic development while playing mobile games, using social media, listening to music and watching videos, and entertainment book-reading applications have negative implications, whilse Fan et al. (2022) highlighted attitude, need, emotion, ability, and reinforcement as essential characteristics in improving mobile learning motivation in higher education students. Following this line, Alturki and Aldraiweesh (2022), using a technology acceptance model to evaluate satisfaction, behavioural intention, and perceptions, found that using mobile learning had an excellent and constructive influence on higher education students during the COVID-19 pandemic. Looking in the opposite direction, Loh et al. (2021) drew attention to the antecedents and consequences of technostress and fatigue on learners' intention to use mobile learning via social media.

The other two papers coded within this category relied on mobile learning, exploring, respectively, the drivers influencing its adoption in students from the College of Information Technology (Almaiah et al., 2022), and combining mobile learning and augmented reality to explore their positive implications for motivation and education in Engineering-related programs (Laurens-Arredondo, 2022).

Communication and Collaboration

In this category, the mapping of application domains of mobile learning was distributed across heterogenic disciplines in six research papers (Figure 7). Three articles used mobile learning as a resource for videoconferencing applications and instant messaging applications, strengthening interaction, communication and collaborative learning during teaching and learning processes in Engineering (Diaz-Nunez et al., 2021; Kumar et al., 2022) and Medicine students (Iqbal et al., 2020). One example can be taken from Diaz-Nunez et al. (2021), who found that students used mobile devices to access online learning activities and virtual classes to cope with learning and daily life during the pandemic. Similar applications were reported by Pramana et al. (2020) in a study conducted across 40 universities in Indonesia, although no specific domain was mentioned. The fifth paper added to this group investigated the effect of flipped teaching on cognitive load in online learning when using mobile devices in a graphic design course (Chen, Fan, & Fang, 2021). Rodríguez Muñoz and Formoso Mieres (2020) noticed increased knowledge sharing, reconfiguration and reorganization of learning during the pandemic when using YouTube and WhatsApp with students of Professional Ethics, Entrepreneurship and Innovation.

Learning a Language

Figure 7 displays the emerging technologies and their corresponding application domains extracted from the research papers reviewed. In terms of language learning, mobile learning was favoured by most authors in three different disciplines. Three articles were classified within the Humanities disciplines. The first one showed the positive effects of mobile-assisted pronunciation training on students majoring in English Lan (2022). The second focused on Japanese language learners, identifying three different types of students and investigating the critical factors pushing them to continue using language learning apps (Huang & Chueh, 2022). The third, Vigil García et al. (2020) embedded WhatsApp in BA Education Major Foreign Languages activities to enhance communicative, interactive and intercultural competence in the teaching-learning process of the English language. Borroto et al. (2021) reported the application of mobile learning resources for teaching Biology online in Spanish for non-Spanish Speakers. Following this trend, Thedpitak and Somphong (2021) highlighted positive attitudes toward learning English as a foreign language using mobile applications among Thai students.

Assessment and Evaluation

Online education has benefited from mobile learning assessments and evaluations during the COVID-19 pandemic, as noted in the 12 articles assigned to this category in this literature review (Figure 7). Students frequently use smartphones in their daily lives and are progressively integrating them as assessment and evaluation resources in online education. Four papers using mobile learning were coded in this category. The first introduced a mobile educational application providing theoretical knowledge and question-based tests for computer engineering undergraduate students (Kayaalp & Dinc, 2022). Singh et al. (2021) developed a progressive model calibrating the difficulty level based on learner understanding in Computer Science education, which will prepare institutions for the transition from paper-based to mobile-based online tests. Voshaar et al. (2022) measured how a gamified mobile learning application influenced exam success on a course in the field of Business and Administration Studies. The fourth study evaluated the change in undergraduate Sports Science course perception when using Instagram as a learning medium and the benefits of doing assignments via social networks (Navandar et al., 2021).

Analytical and Practical Knowledge

16% of the research articles reviewed were coded within this category. As shown in Figure 7, one study focused on improving learner programming skills in Computer Engineering education Mir and Llueca (2020). Egilsdottir et al. (2021) explored the application of mobile learning tools to enhance skills and knowledge transfer and reduce the gap between theory and practice in nursing education. Cui (2022) delved into the potential of using augmented reality and mobile applications in acquiring piano skills, providing a novel opportunity to revolutionize Arts education.

DISCUSSION

Mobile learning has progressively evolved from an in-class and asynchronous learning supportive resource to a critical part of the learning experience (Educause, 2019; Gupta et al., 2021). Mainly influenced by the global increase in wireless internet access, which has impacted the rise in mobile device ownership, mobile learning has become a direct way to implement personalized learning settings (Cavus, 2020; Neffati et al., 2021; Verdes et al., 2021).

The evidence from this systematic review indicates that an increasing number of mobile educational projects are actively being integrated into online higher education, teaching and learning, specifically since March 2020. The preferred use of mobile phones for mobile teaching and learning activities correlates with findings previously reported by Crompton and Burke (2017) and Wu et al. (2012). Moreover, the publications reviewed suggest that learners retain more knowledge and are more interested in completing the assigned exercises when they feel inspired to learn. In this sense, significant technological advances play a relevant role in contributing to elevating instructional design so that educational materials that are more specifically applicable are provided to students at their appropriate level of learning.

The advent of highly functional smartphones and tablets has increased the preference for using these devices over laptops or computers in countries with emerging economies (Diaz-Nunez et al., 2021; Márquez-Díaz, 2020; Mubayrik et al., 2021; Pramana et al., 2020; Sooryah & Soundarya, 2020). Using such devices helped learners to stay connected to academic activities and communicate with teachers and classmates during the COVID-19 pandemic. Despite the usage gap in low- and middle-income countries, there is a noticeable increase in the implementation of mobile learning resources (Borroto et al., 2021; Diaz-Nunez et al., 2021; Humida et al., 2021; Rodríguez Muñoz & Formoso Mieres, 2020).

Based on previous experience and following experiments in universities supporting distance and online learning formats, many higher education institutions have introduced (or expanded) their mobile learning courses, allowing learners to continue their academic activities while shifting from face-to-face to virtual forms. This solution has empowered interaction in content creation, communication, and collaboration between learners and instructors and significantly impacted learning effectiveness (Iqbal et al., 2020; Pramana et al., 2020).

Mobile learning has progressively evolved from supplementary material for teaching to a flexible, strategic, and convenient resource, driving new paths in higher education. Its acceptance and adoption are growing in higher education, with it being an easy, convenient, and flexible way to access learning materials anytime and anywhere (Almaiah et al., 2021; Bernacki, Crompton, & Greene, 2020; Kumar et al., 2022; Sprenger & Schwaninger, 2021).

Notably, over the past two years, efforts have been made to make learning self-paced and collaborative using key technologies. Amid the COVID-19 outbreak, many higher education institutions faced multiple challenges when transitioning from face-to-face to virtual teaching. One of them was to provide materials that are accessible, useful, effective, and efficient to learners (Almaiah et al., 2021; Herrador-Alcaide et al., 2020). In this context, mobile learning tools’ adoption, behaviour and integration into the educational process are critical factors in the training experience (Akour et al., 2021). Integrating social media platforms, such as Instagram, into the learning process has also improved self-learning, increased online contribution and facilitated active participation (Navandar et al., 2021).

The fact that educators now rely on technology to provide flexible and customized learning curricula more than ever before has led to a greater reliance on technology in the classroom. Notably, since Engineering and Humanities were the scopes of application more repeatedly reported in the literature, this allowed for a diverse appraisal. Seven of the articles reviewed describe the implementation of mobile learning in Engineering learning processes, showing the consolidation of its applicability in different categories in higher education (Diaz-Nunez et al., 2021; Kayaalp & Dinc, 2022; Kumar et al., 2022; Laurens-Arredondo, 2022; Mir & Llueca, 2020). Following this line, studies distributed in the field of Humanities were evenly focused on language learning (Huang & Chueh, 2022; Lan, 2022; Vigil García et al., 2020) and the adaptable and personalized potential (Sarkadi et al., 2020; Ugur-Erdogmus & Cakir, 2022) of this technology towards building a constructivist and activity-based education.

Nowadays, embedded with other resources supporting AI, XR and Internet of Things devices, mobile learning is expanding and becoming more active, with the expectation that educational experiences can adapt to current learner needs and academic trajectories (Chu, 2022; Laurens-Arredondo, 2022; Rangel-de Lázaro & Duart 2023). Still, co-design processes combining mobile learning with more traditional resources benefit learning. Building on co-design, new forms of collaboration between educators and researchers are developed, resulting in the development of innovations that impact teaching practice (Couso, 2016; Voogt et al., 2015). As a result, teachers and students benefit from deepening educational designs, knowledge and development of new skills (Penuel et al., 2022). Egilsdottir et al. (2021) followed this methodology to reduce the gap between theory and practice in basic physical assessment skills and knowledge transfer between university and clinical sites for nursing courses. The participants considered digital simulations with virtual patients, massive open online courses, and multimedia learning material, and evaluated their potential and benefits in academic and clinical contexts. Furthermore, these students endorsed the inclusion of multiple-choice tests and written assignments to deliver feedback and support learning progress.

Similarly, there is a continuing trend towards using XR and mobile learning to encourage academic achievement and gaining skills in virtual classrooms, as shown by Eldokhny and Drwish (2021) and Chessa and Solari (2021) when using XR in online distance learning through the pandemic. In some areas, VR seemed to be mature enough to be used for teaching procedural, practical knowledge, and declarative knowledge. Examples included Fire Safety, Surgery, Nursing, and Astronomy. In these cases, more professional VR applications were used. However, most articles indicated that VR for education is still in its experimental stages, involving prototyping and testing with students.

The literature reviewed indicates that mobile learning is a solicited resource for customizing courses and curricula to fit student needs and to encourage flexible learning to effectively impact a massive online learning experience (Verdes et al., 2021; X. Zhang, 2022). This is more noticeable in those with complex academic trajectories who require synchronous and asynchronous tools, increasingly turning to online university education for their educational needs (Herrador-Alcaide et al., 2020).

Interestingly, keeping track of and enhancing communication and collaboration in online education is also a critical concern when using mobile learning tools. Authors have relied on a vast diversity of existing platforms such as Whatsapp, Telegram, Microsoft Teams, Google Classroom, Google Meet, Zoom, and Edmodo, among many others, to investigate whether they are effective learning platforms that also facilitate engagement, collaborative learning, and ensure the wellbeing and security of students during the most critical times of COVID-19 (Iqbal et al., 2020; Kumar et al., 2022; Pramana et al., 2020).

However, beyond the many benefits mobile learning provides to higher education, attention must be paid to its downsides, such as information overload, distraction, and time-wasting. Furthermore, there is a risk of discrimination against those who cannot access these services fully. Various factors may contribute to this problem, including complex interfaces, limited access to unstable smart devices, or a low network signal. As a result, some students may find themselves alienated from communication and collaboration within the educational environment. Contrary to other studies, after comparing technology acceptance of e-lectures, classroom response systems, classroom chat, and mobile virtual reality, Sprenger and Schwaninger (2021) noticed a decrease in the perceived usefulness and behavioural intention after three months of students using mobile virtual reality. The main reasons for such poor technology acceptance feedback were mainly related to functional and technical issues of mobile virtual reality. It is clear that the problems presented above are not new. However, it highlights the necessity for a crtitical re-evaluation of the appropriate implementation of emerging technologies in terms of curriculum design, educational policies, technological resource implementation, and digital competencies and skills at all higher education levels. Likewise, X. Zhang (2022) noticed that despite challenges, students believe that the traditional face-to-face method is the best way to carry out the entire teaching and learning process and that digital platforms should be used as a supplement to facilitate the educational process.

CONCLUSIONS

Here we presented a systematic review mapping the implementation and influence on online higher education of mobile learning after the COVID-19 pandemic outbreak. In this literature analysis, only peer-reviewed publications in English or Spanish published in Scopus, Web of Sciences, and EBSCO Education were considered. Moreover, as we included papers submitted after March 2020, we acknowledged that the data provided would, in most cases, have been collected before then. Nevertheless, upon careful evaluation, we recognized that the impact of the pandemic on university agents had influenced the process of producing the selected articles.

Despite it already having been present for years, mobile learning has been embedded in higher education by the pandemic. Since its start, face-to-face learning-teaching activities have had to migrate into virtual settings, and those already working in online environments have also needed to adapt to the new circumstances. All this has resulted in a need for tailored and effective support schemes for educators and learners.

Nowadays, implementing key emerging technologies has a critical role in shaping the future of online higher education. Consequently, educators and students will see digital resources as an accessible toolbox to amplify a personalized, active, learner-centred method. While institutions are getting ready to face new forms of educational settings, future critical implications of using mobile devices are pointing towards improving data literacy and skills, data security and protection against threats to personal privacy, and continuing with the normalization of hybrid and remote learning settings.

We cannot deny that applying mobile learning to educational settings requires an economic investment. However, as these technologies become more ubiquitous, their deployment costs decrease, making them more sustainable in the long term than traditional analogue learning. Looking ahead, it is plausible that this trend will continue evolving worldwide to make access to remote education more effective and adapted to current needs.

In the future, it would be beneficial to implement the search string developed here in a larger number of databases and languages to expand the scope of this review. Further, as education evolves to meet the needs of the current times, we aim to focus future research on other critical technologies such as micro-credentials, open educational resources, and XR and AI.

AUTHORS' CONTRIBUTION

  • Conceptualization, methodology, analysis, investigation, data curation, writing-original draft, review, editing, visualization: G.R.-d.L.

  • Conceptualization, writing-review & editing: J.M.D.

  • All authors have read and agreed to the published version of the manuscript.

REFERENCES

  1. Adanır, A. & Muhametjanova, G. (2021). University students' acceptance of mobile learning: A comparative study in Turkey and Kyrgyzstan. Education and Information Technologies, 26(5), 6163–6181. https://doi.org/10.1007/S10639-021-10620-1/TABLES/5
  2. Akour, I., Alshurideh, M., Kurdi, B. A., Ali, A. & Salloum, S. (2021). Using Machine Learning Algorithms to Predict People's Intention to Use Mobile Learning Platforms During the COVID-19 Pandemic: Machine Learning Approach. JMIR Medical Education, 7(1), e24032. https://doi.org/10.2196/24032
  3. Almaiah, M. A., Almomani, O., Al-Khasawneh, A. & Althunibat, A. (2021). Predicting the Acceptance of Mobile Learning Applications During COVID-19 Using Machine Learning Prediction Algorithms. In Studies in Systems, Decision and Control. (Vol. 348, pp. 319-332) Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-030-67716-9_20
  4. Almaiah, M. A., Ayouni, S., Hajjej, F., Lutfi, A., Almomani, O. & Awad, A. B. (2022). Smart Mobile Learning Success Model for Higher Educational Institutions in the Context of the COVID-19 Pandemic. Electronics, 11(8), 1278. https://doi.org/10.3390/ELECTRONICS11081278
  5. Althunibat, A., Almaiah, M. A. & Altarawneh, F. (2021). Examining the Factors Influencing the Mobile Learning Applications Usage in Higher Education during the COVID-19 Pandemic. Electronics, 10(21). https://doi.org/10.3390/electronics10212676
  6. Alturki, U. & Aldraiweesh, A. (2022). Students' Perceptions of the Actual Use of Mobile Learning during COVID-19 Pandemic in Higher Education. Sustainability, 2022(3), 1125-1125. https://doi.org/10.3390/SU14031125
  7. Antee, A. (2021). Student perceptions and mobile technology adoption: implications for lower-income students shifting to digital. Educational Technology Research and Development, 69(1), 191–194. https://doi.org/10.1007/s11423-020-09855-5
  8. Aria, M. & Cuccurullo, C. (2017). bibliometrix: An R-tool for comprehensive science mapping analysis. Journal of Informetrics, 11(4), 959–975. https://doi.org/10.1016/J.JOI.2017.08.007
  9. Bahia, K. & Delaporte, A. (2020). The State of Mobile Internet Connectivity 2020. GSMA Reports.
  10. Becke, R. A., Wilks, A. R., Brownrigg, R., Minka, T. P. & Deckmyn, A. (2021).Draw Geographical Maps (Package ‘maps’) (3.4.0). Repository CRAN.
  11. Bernacki, M. L., Crompton, H. & Greene, J. A. (2020). Towards convergence of mobile and psychological theories of learning. Contemporary Educational Psychology, 60, 101828. https://doi.org/10.1016/J.CEDPSYCH.2019.101828c
  12. Borroto, G., Medina Olazabal, I., Sánchez Mesa, B. & Fonseca Montes E Oca, L. (2021). Online teaching tasks in the subjects biology and Spanish as a foreign language. Campus Virtuales, 10(1), 163–172.
  13. Cavus, N. (2020). Evaluation of MoblrN m-learning system: Participants' attitudes and opinions. World Journal on Educational Technology: Current Issues, 12(3), 150–164. https://doi.org/10.18844/WJET.V12I3.4978
  14. Chen, Y.-C., Fan, K.-K. & Fang, K.-T. (2021). Effect of flipped teaching on cognitive load level with mobile devices: The case of a graphic design course. Sustainability (13), 13-13. https://doi.org/10.3390/su13137092
  15. Chessa, M. & Solari, F. (2021). The sense of being there during online classes: analysis of usability and presence in web-conferencing systems and virtual reality social platforms. Behaviour & Information Technology, 40(12), 1237–1249.
  16. Chu, Y. B. (2022). A mobile augmented reality system to conduct electrical machines laboratory for undergraduate engineering students during the COVID pandemic. Education and Information Technologies. Education and Information Technologies, 27, 8519–8532.
  17. Cohen, L., Manion, L. & Morrison, K. (2018). Research Methods in Education. Routledge.
  18. Coskun-Setirek, A. & Tanrikulu, Z. (2021). M-Universities: Critical Sustainability Factors. SAGE Open, 11(1). https://doi.org/10.1177/2158244021999388
  19. Couso, D. (2016). Participatory Approaches to Curriculum Design From a Design Research Perspective. In D. Psillos, & P. Kariotoglou (Eds.), Iterative Design of Teaching-Learning Sequences. (pp. 47-71) Springer Netherlands. https://doi.org/10.1007/978-94-007-7808-5_4
  20. Crebert, G., Bates, M., Bell, B., Patrick, C. J. & Cragnolini, V. (2004). Developing generic skills at university, during work placement and in employment: Graduates' perceptions. Higher Education Research and Development, 23(2), 147–165. https://doi.org/10.1080/0729436042000206636
  21. Creswell, J. W. & Creswell, J. D. (2017).Research design: Qualitative, quantitative, and mixed methods approaches. Sage publications.
  22. Crompton, H. & Burke, D. (2017). The use of mobile learning in higher education: A systematic review. Computers and Education, 123, 53–64. https://doi.org/10.1016/j.compedu.2018.04.007
  23. Csárdi, G. N. T. & Nepusz, T. (2006). The igraph software package for complex network research. InterJournal, Complex Systems, 1695(5), 1–9.
  24. Cui, K. (2022). Artificial intelligence and creativity: piano teaching with augmented reality applications. Interactive Learning Environments, 1–12. https://doi.org/10.1080/10494820.2022.2059520
  25. Dhawan, S. (2020). Online Learning: A Panacea in the Time of COVID-19 Crisis. Journal of Educational Technology Systems, 49(1), 5–22. https://doi.org/10.1177/0047239520934018
  26. Diaz-Nunez, C., Sanchez-Cochachin, G., Ricra-Chauca, Y., Andrade-Arenas, L., Diaz-Núñez, C., Sanchez-Cochachin, G., ... Ricra-Chauca, Y. (2021). Impact of Mobile Applications for a Lima University in Pandemic. International Journal of Advanced Computer Science and Applications, 12(2), 752–758.
  27. Ding, Y., Li, Y. & Cheng, L. (2020). Application of Internet of Things and Virtual Reality Technology in College Physical Education. IEEE Access, 8, 96065–96074. https://doi.org/10.1109/ACCESS.2020.2992283
  28. Educause. (2019). 2019 EDUCAUSE Horizon Report. Higher Education Edition.
  29. Egilsdottir, H. Ö., Heyn, L. G., Brembo, E. A., Byermoen, K. R., Moen, A. & Eide, H. (2021). Configuration of mobile learning tools to support basic physical assessment in nursing education: Longitudinal participatory design approach. JMIR MHealth and UHealth, 9(1). https://doi.org/10.2196/22633
  30. Eldokhny, A. A. & Drwish, A. M. (2021). Effectiveness of Augmented Reality in Online Distance Learning at the Time of the COVID-19 Pandemic. International Journal of Emerging Technologies in Learning, 16(9), 198–218. https://doi.org/10.3991/IJET.V16I09.17895
  31. Fan, M., Ndavi, J. W., Qalati, S. A., Huang, L. & Zhengjia, P. (2022). Applying the time continuum model of motivation to explain how major factors affect mobile learning motivation: a comparison of SEM and fsQCA. Online Information Review . https://doi.org/10.1108/OIR-04-2021-0226/FULL/XML
  32. Grames, E. M., Stillman, A. N., Tingley, M. W. & Elphick, C. S. (2019). An automated approach to identifying search terms for systematic reviews using keyword co-occurrence networks. Methods in Ecology and Evolution, 10(10), 1645–1654. https://doi.org/10.1111/2041-210X.13268
  33. GSMA. (2022). The Mobile Economy 2022.
  34. Gupta, Y., Khan, F. M. & Agarwal, S. (2021). Exploring Factors Influencing Mobile Learning in Higher Education - A Systematic Review. International Journal of Interactive Mobile Technologies (IJIM), 15(12), 140-140. https://doi.org/10.3991/ijim.v15i12.22503
  35. Gurevych, R., Silveistr, A., Мokliuk, M., Shaposhnikova, I., Gordiichuk, G. & Saiapina, S. (2021). Using Augmented Reality Technology in Higher Education Institutions. Postmodern Openings, 12(2), 109–132. https://doi.org/10.18662/PO/12.2/299
  36. Hao, S., Dennen, V. P. & Mei, L. (2017). Influential factors for mobile learning acceptance among Chinese users. Educational Technology Research and Development, 65(1), 101–123. https://doi.org/10.1007/S11423-016-9465-2/TABLES/7
  37. Herrador-Alcaide, T. C., Hernández-Solís, M., Hontoria, J. F., Hernandez-Solis, M., Hontoria, J. F., Hernández-Solís, M. & Hontoria, J. F. (2020). Online Learning Tools in the Era of m-Learning: Utility and Attitudes in Accounting College Students. Sustainability. 12-12. https://doi.org/10.3390/su12125171
  38. Huang, D.-H. & Chueh, H.-E. (2022). Behavioral intention to continuously use learning apps: A comparative study from Taiwan universities. Technological Forecasting and Social Change, 177. https://doi.org/10.1016/j.techfore.2022.121531
  39. Humida, T., Mamun, M. H. A. & Keikhosrokiani, P. (2021). Predicting behavioral intention to use e-learning system: A case-study in Begum Rokeya University, Rangpur, Bangladesh. Education and Information Technologies, 27, 2241–2265. https://doi.org/10.1007/s10639-021-10707-9
  40. Iqbal, M. Z., Alradhi, H. I., Alhumaidi, A. A., Alshaikh, K. H., Alobaid, A. M., Alhashim, M. T. & Alsheikh, M. H. (2020). Telegram as a tool to supplement online medical education during covid-19 crisis. Acta Informatica Medica, 28(2), 94–97. https://doi.org/10.5455/aim.2020.28.94-97
  41. Kayaalp, F. & Dinc, F. (2022). A mobile app for algorithms learning in engineering education: Drag and drop approach. Computer Applications in Engineering Education, 30(1), 235–250.
  42. Kemp, S. (2022). Digital 2022 July Global Statshot Report.
  43. Kumar, J. A., Osman, S., Mesquita, D., Lima, R. M., Kumar, J., Osman, S., ... Rasappan, R. (2022). Mobile Learning Acceptance Post Pandemic: A Behavioural Shift among Engineering Undergraduates. Sustainability 2022, 14(6), 3197. https://doi.org/10.3390/SU14063197
  44. Lan, E.-M. (2022). A comparative study of computer and mobile-assisted pronunciation training: The case of university students in Taiwan. Education and Information Technologies, 27(2), 1559–1583. https://doi.org/10.1007/s10639-021-10647-4
  45. Laurens-Arredondo, L. (2022). Mobile augmented reality adapted to the ARCS model of motivation: a case study during the COVID-19 pandemic. Education and Information Technologies, 27, 7927–7946. https://doi.org/10.1007/S10639-022-10933-9
  46. Liaw, S. S., Hatala, M. & Huang, H. M. (2010). Investigating acceptance toward mobile learning to assist individual knowledge management: Based on activity theory approach. Computers & Education, 54(2), 446–454.
  47. Lin, Y., Liu, Y., Fan, W., Tuunainen, V. K. & Deng, S. (2021). Revisiting the relationship between smartphone use and academic performance: A large-scale study. Computers in Human Behavior, 122. https://doi.org/10.1016/j.chb.2021.106835
  48. Loh, X. K., Lee, V. H., Loh, X. M., Tan, G. W. H., Ooi, K. B. & Dwivedi, Y. K. (2021). The Dark Side of Mobile Learning via Social Media: How Bad Can It Get? Information Systems Frontiers, 24, 1887–1904. https://doi.org/10.1007/s10796-021-10202-z
  49. Mâță, L., Clipa, O., Cojocariu, V. M., Robu, V., Dobrescu, T., Hervás-Gómez, C. & Stoica, I. V. (2021). Students' Attitude towards the Sustainable Use of Mobile Technologies in Higher Education. Sustainability, 13(11), 5923. https://doi.org/10.3390/SU13115923
  50. Márquez-Díaz, J. E. (2020). Virtual World as a Complement to Hybrid and Mobile Learning. International Journal of Emerging Technologies in Learning, 15(22), 267–274.
  51. Matzavela, V. & Alepis, E. (2021). M-learning in the COVID-19 era: physical vs digital class. Education and Information Technologies, 26(6), 7183–7203. https://doi.org/10.1007/S10639-021-10572-6/FIGURES/3
  52. Minichiello, A., Armijo, D., Mukherjee, S., Caldwell, L., Kulyukin, V., Truscott, T., Elliott, J. & Bhouraskar, A. (2021). Developing a mobile application-based particle image velocimetry tool for enhanced teaching and learning in fluid mechanics: A design-based research approach. Computer Applications in Engineering Education, 29(3), 517–537. https://doi.org/10.1002/CAE.22290
  53. Mir, S. B. & Llueca, G. F. (2020). Introduction to Programming Using Mobile Phones and MIT App Inventor. Revista Iberoamericana de Tecnologias Del Aprendizaje, 15(3), 192–201. https://doi.org/10.1109/RITA.2020.3008110
  54. Motiwalla, L. F. (2007). Mobile learning: A framework and evaluation. Computers & Education, 49(3), 581–596. https://doi.org/10.1016/J.COMPEDU.2005.10.011
  55. Mubayrik, H. F., Bin, & Alabbad, A. H. (2021). Applications of Mobile Learning and Transactional Distance Theory in the Context of Higher Education during COVID-19 Pandemic. International Journal of Educational Sciences, 34(1-3), 1–10. https://doi.org/10.31901/24566322.2021/34.1-3.1190
  56. Muthuprasad, T., Aiswarya, S., Aditya, K. S. & Jha, G. K. (2021). Students' perception and preference for online education in India during COVID -19 pandemic. Social Sciences & Humanities Open, 3(1), 100101.
  57. Navandar, A., López, D. F. & Alejo, L. B. (2021). The Use of Instagram in the Sports Biomechanics Classroom. Frontiers in Psychology, 12. https://doi.org/10.3389/fpsyg.2021.711779
  58. Neffati, O. S., Setiawan, R., Jayanthi, P., Vanithamani, S., Sharma, D. K., Regin, R., Mani, D. & Sengan, S. (2021). An educational tool for enhanced mobile e-Learning for technical higher education using mobile devices for augmented reality. Microprocessors and Microsystems, 83. https://doi.org/10.1016/j.micpro.2021.104030
  59. O'Connor, S. & Andrews, T. (2018). Smartphones and mobile applications (apps) in clinical nursing education: A student perspective. Nurse Education Today, 69, 172–178. https://doi.org/10.1016/J.NEDT.2018.07.013
  60. Page, M. J., Mckenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., Mcdonald, S. & Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. Journal of Clinical Epidemiology, 134, 178–189. https://doi.org/10.1016/j.jclinepi.2021.03.001
  61. Paré, G., Trudel, M. C., Jaana, M. & Kitsiou, S. (2015). Synthesizing information systems knowledge: A typology of literature reviews. Information & Management, 52(2), 183–199. https://doi.org/10.1016/J.IM.2014.08.008
  62. Pedersen, T. L. (2021).Package “ggraph” Type Package Title An Implementation of Grammar of Graphics for Graphs and Networks..
  63. Penuel, W. R., Allen, A. R., Henson, K., Campanella, M., Patton, R., Rademaker, ... Zivic, A. (2022). Learning Practical Design Knowledge through Co-Designing Storyline Science Curriculum Units. Cognition and Instruction, 40, 148–170. https://doi.org/10.1080/07370008.2021.2010207
  64. Pham, X. L. & Chen, G. D. (2018). PACARD: A New Interface to Increase Mobile Learning App Engagement, Distributed Through App Stores. Information for Journal of Educational Computing Research, 57(3), 618–645. https://doi.org/10.1177/0735633118756298
  65. Pramana, C., Susanti, R., Violinda, Q., Yoteni, F., Rusdiana, E., Prihanto, Y. J. N., Purwoko, R. Y., Rahmah, N., Hasnawati, , Fakhrurrazi, , Yendri, O., Arkiang, F., Purwahida, R. & Haimah, (2020). Virtual learning during the covid-19 pandemic, a disruptive technology in higher education in indonesia. International Journal of Pharmaceutical Research, 12(2), 3209–3216. https://doi.org/10.31838/IJPR/2020.12.02.430
  66. Radianti, J., Majchrzak, T. A., Fromm, J. & Wohlgenannt, I. (2020). A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda. Computers and Education, 147, 103778. https://doi.org/10.1016/j.compedu.2019.103778
  67. Rangel-de Lázaro, G. & Duart J, M. (2023). You Can Handle, You Can Teach It: Systematic Review on the Use of Extended Reality and Artificial Intelligence Technologies for Online Higher Education. Sustainability, 15(4). https://doi.org/10.3390/su15043507
  68. Rodríguez Muñoz, R. & Formoso Mieres, A. A. (2020). Efectos de YouTube y WhatsApp en procesos de enseñanza - aprendizaje ante el nuevo coronavirus. Revista Conrado, 16(77), 346–353.
  69. Romero-Rodriguez, J.-M., Aznar-Diaz, I., Hinojo-Lucena, F.-J. & Gomez-Garcia, G. (2020). Mobile Learning in Higher Education: Structural Equation Model for Good Teaching Practices. IEEE Access, 8, 91761–91769.
  70. Rose, S., Engel, D., Cramer, N. & Cowley, W. (2010). Automatic key-word extraction from individual documents. In M. W. Berry, & J. Kogan (Eds.), Text mining. (pp. 1-20). John Wiley & Sons Ltd.
  71. Salas-Rueda, R.-A., Ramírez-Ortega, J., Eslava-Cervantes, A.-L., Castañeda-Martínez, R. & De-La-Cruz-Martínez, G. (2022). Percepción de los profesores sobre los juegos web y dispositivos móviles en el nivel educativo superior durante la pandemia COVID-19. Texto Livre, 15, e37074. https://doi.org/10.35699/1983-3652.2022.37074
  72. Sarkadi, A. R., Cahyana, . U. & Paristiowati, M. (2020). The Application of Mobile Learning for University Students in the Pancasila Education Modul in Developing Character of Students Empathy. Universal Journal of Educational Research, 8(9), 3825–3833. https://doi.org/10.13189/ujer.2020.080905
  73. Singh, R., Timbadia, D., Kapoor, V., Reddy, R., Churi, P. & Pimple, O. (2021). Question paper generation through progressive model and difficulty calculation on the Promexa Mobile Application. Education and Information Technologies, 26(4), 4151–4179. Retrieved from https://doi.org/10.1007/s10639-021-10461-yhttps://doi.org/10.1007/s10639-021-10461-y
  74. Sooryah, N. & Soundarya, K. R. (2020). Live Captioning for Live Lectures - An Initiative to Enhance Language Acquisition in Second Language Learners, through Mobile Learning. Webology, 17(2), 238–245. https://doi.org/10.14704/WEB/V17I2/WEB17027
  75. Sprenger, D. A. & Schwaninger, A. (2021). Technology acceptance of four digital learning technologies (classroom response system, classroom chat, e-lectures, and mobile virtual reality) after three months' usage. International Journal of Educational Technology in Higher Education, 18(1), 1–17. https://doi.org/10.1186/S41239-021-00243-4/TABLES/5
  76. Stephens, M., Rudiger, N. & Faires, D. (2021). Student Perceptions and Use of Mobile Devices for LIS Coursework: Implications for Educators. Journal of Education for Library & Information Science, 62(4), 443–459.
  77. Teymurova, V., Abdalova, M., Babayeva, S., Huseynova, V., Mammadov, E. & Islamova, N. (2020). Implementation of Mobile Entrepreneurial Learning in the Context of Flexible Integration of Traditions and Innovations. International Journal of Interactive Mobile Technologies, 14(21), 118–135. https://doi.org/10.3991/ijim.v14i21.18445
  78. Thedpitak, A. & Somphong, M. (2021). Exploring thai efl learners' attitudes toward the use of mobile applications for language learning. LEARN Journal: Language Education and Acquisition Research Network, 14(1), 370–398.
  79. Ugur-Erdogmus, F. & Cakir, R. (2022). Effect of Gamified Mobile Applications and the Role of Player Types on the Achievement of Students. Journal of Educational Computing Research, 60(4), 1063–1080. https://doi.org/10.1177/07356331211065679
  80. UNESCO Institute for Statistics. (2012). International Standard Classification of Education.
  81. Verdes, A., Navarro, C. & Álvarez-Campos, P. (2021). Mobile learning applications to improve invertebrate zoology online teaching. Invertebrate Biology, 140(1).
  82. Vigil García, P. A., Padrón R, A., Emilio, E., Betancourt, A., Dumpierrés Otero, E., Castillo O, L., ... Castillo, L. (2020). Mobile learning: el uso de Whatsapp en el aprendizaje del inglés. Revista Conrado, 16(77), 201–208.
  83. Voogt, J., Laferrière, T., Breuleux, A., Itow, R. C., Hickey, D. T. & Mckenney, S. (2015). Collaborative design as a form of professional development. Instructional Science, 43(2), 259–282. https://doi.org/10.1007/S11251-014-9340-7/TABLES/1
  84. Voshaar, J., Knipp, M., Loy, T., Zimmermann, J. & Johannsen, F. (2022). The impact of using a mobile app on learning success in accounting education. Accounting Education, 32, 222–247. https://www.tandfonline.com/doi/full/10.1080/09639284.2022.2041057
  85. Wendler, R. (2012). The maturity of maturity model research: A systematic mapping study. Information and Software Technology, 54(12), 1317–1339. https://doi.org/10.1016/J.INFSOF.2012.07.007
  86. Wickham, H. (2016). ggplot2. Springer International Publishing. Retrieved from https://doi.org/10.1007/978-3-319-24277-4
  87. Wickham, H., Averick, M., Bryan, J., Chang, W., Mcgowan, L., François, R., ... Yutani, H. (2019). Welcome to the Tidyverse. Journal of Open Source Software, 4(43), 1686. https://doi.org/10.21105/joss.01686
  88. Wickham, H., François, R., Henry, L., Müller, K. & Vaughan, D. (2023). dplyr: A Grammar of Data Manipulation. Retrieved from https://github.com/tidyverse/dplyr
  89. Wickham, H., Vaughan, D. & Girlich, M. (2023). tidyr: Tidy Messy Data.
  90. Wu , W.-H., Jim Wu, Y.-C., Chen, C.-Y., Kao, H.-Y., Lin, C.-H. & Huang, S.-H. (2012). Review of trends from mobile learning studies: A meta-analysis. Computers & Education, 59(2), 817–827. https://doi.org/10.1016/J.COMPEDU.2012.03.016
  91. Yeboah, D. & Nyagorme, P. (2022). Students' acceptance of WhatsApp as teaching and learning tool in distance higher education in sub-Saharan Africa. Cogent Education, 9(1). https://doi.org/10.1080/2331186x.2022.2077045
  92. Yu, D., Yan, Z. & He, X. (2022). Capturing knowledge trajectories of mobile learning research: A main path analysis. Education and Information Technologies, 27(5). https://doi.org/10.1007/S10639-021-10869-6/FIGURES/5
  93. Yuan, Y. P., Tan, G.-W.-H., Ooi, K. B. & Lim, W. L. (2021). Can COVID-19 pandemic influence experience response in mobile learning? Telematics and Informatics, 64, 101676. https://doi.org/10.1016/J.TELE.2021.101676
  94. Zawacki-Richter, O., Marín, V. I., Bond, M. & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education - where are the educators? International Journal of Educational Technology in Higher Education, 16(1). https://doi.org/10.1186/s41239-019-0171-0
  95. Zhang, L. & He, J. (2022). Optimization of Ideological and Political Education under the Epidemic via Mobile Learning Auxiliary Platform in the Era of Digitization. Hindawi, Special issue, 1–9. https://doi.org/10.1155/2022/6149995
  96. Zhang, X. (2022). The Influence of Mobile Learning on the Optimization of Teaching Mode in Higher Education. Wireless Communications and Mobile Computing.