COVID-19 and Disruption in Management and Education Academics: Bibliometric Mapping and Analysis

: COVID-19, What to do now? This issue has had devastating e ﬀ ects in all domains of society worldwide. Lockdowns, the lack of freedom and social distancing meant the closure of a country’s entire activity. Having e ﬀ ects at all levels, beside incalculable ones in health, it is argued that scientiﬁc activity in education, business, economics and management su ﬀ ered some of the most drastic impacts of this pandemic. This study aims to map the scientiﬁc literature in these areas in the context of COVID-19 and analyze its content through bibliometrics, which made it possible to highlight the scarcity of studies on the topic, namely empirical studies on the e ﬀ ects of this pandemic on scientiﬁc research and teaching / education. The results show there is a lack of peer-reviewed publications on this topic, with the studies covered (93) via the threads used revealing only 28 articles coming within the proposed objective. The bibliometrics corroborates that shortage. Finally, the contributions and implications for theory and practice are presented, followed by the limitations and suggestions for future research. the the The results revealed a signiﬁcant relation between the dimensions of justice and dissatisfaction with service recovery, in terms process and interpersonal justice. Satisfaction with service recovery had a signiﬁcant e ﬀ ect on all the behavioral results of the users studied. The university image had no moderating e ﬀ ect on the relation between the dimensions of justice and satisfaction with service recovery.


Introduction
The coronavirus, or COVID-19, was first detected in December 2019 in Wuhan, China, but only on 11 March 2020 did the World Health Organisation (WHO) declare that this had rapidly become a world pandemic, the first time a disease caused by a coronavirus had been considered as such [1]. In this scenario, COVID-19 had a major impact on public health, leading to an exponential growth of research in the field of medicine. For example, Di Gennaro et al. [2] developed a narrative review of COVID-19 and Asadi et al. [3] studied its transmission. Haleem et al. [4] identified 18 areas of research standing out in the context of the COVID-19 pandemic, where the field of economics is group 5, the topics addressed being the supply chain, travel and tourism, market closure, loss of income, economic recovery, poverty and hunger. However, a study to be published shortly by Myers et al. [5] shows that researchers report a relevant decline in the time spent on research, despite the number of hours spent on research being heterogeneous depending on the field of study (and depending on whether the field requires research in laboratories) and on gender. This has suggested that there is an atypical dimension with an impact on the hours spent on childcare by gender, which means that the pandemic has affected scientific human capital and could mold the scientific responses to the effects of the pandemic on science [5]. Also in terms of education, Kamal [6] studied teaching and COVID-19 in Brazil, arguing that distance education has reached students during the pandemic, thanks to the evolution of technologies and their multidimensional ways of being used. However, Carmo and Franco [7] show that in this teaching

Methodology
Carrying out a systematic literature review (SLR) means adopting stages that can be replicated, and the procedures must be transparent in all of them [42], so that the final result can be understood as critical added value [19]. Specifically, this critical aggregation should produce a descriptive summary of the literature on the topic analyzed and identify gaps and emerging directions for future research [19]. In particular, this method is based on transparency in data collection and definition of the criteria for selecting documents [43]. However, in order to achieve the required transparency, it is essential to follow the steps defined by Tranfield, Denyer and Smart [27] and by Xiao and Watso [28], which are: definition of the objective, protocols to be followed, research in the databases of literature, definitions of inclusion and quality eligibility criteria, data extraction, synthesis of the extracted data and its analysis and discussion.
Scientific mapping of the topic of analysis was performed through the bibliometric review [13][14][15][16][17][18]44], this bibliometric analysis being a statistical method allowing assessment of the qualitative and quantitative coverage of a given area of interest [20]. This analysis was carried out using Bibliometrix software [45], which joins a set of tools for exclusive processing of all the data about the publications selected for analysis. This process produces different matrices (e.g., about authors, number of publications, networks, couplings) [46], which are preceded by the normalization of similarity of publications [45]. Aria and Cuccurullo (p. 963) underlined that "the existence of substantial, effective statistical algorithms, access to high-quality numerical routines, and integrated data visualization tools are perhaps the strongest qualities to prefer R to other languages for scientific computation." Bibliometrix is a package for bibliometric analysis written in R. R is an ecosystem software meaning it operates in an integrated environment consisting of open-libraries, the open-algorithm, and open-graphical software."

Data Collection and Eligibility Criteria
It is therefore fundamental to define the criteria and key-words to be used in the process of searching for and specifying documents [47] to ensure an appropriate connection between the main topic and sub-topics and the inherent descriptive analysis [48].
It is also important to mention that this study used two online databases-Web of Science (WoS) and Scopus-widely recognized by the scientific community [49], but only the search of Web of Science (WOS) returned results. It should also be noted that WOS includes thousands of academic publications and bibliographic information about authors, affiliations and citations, with high scientific recognition in the academic world.
From the above, Table 1 shows the stages followed in this study, according to Tranfield, Denyer and Smart [50] and Xiao and Watso [51]. Table 1. Stages of the systematic literature review (SLR).

Methodological Procedures
The operationalization of stages 1 to 5, i.e., the methodological procedures, are presented in Figure 1.
The requirement followed in the data collection and the application of the eligibility criteria led to the elaboration of Figure 1, which shows the careful way in which the final database was obtained (n = 93). The procedures shown here are in accordance with those followed in several studies of systematic and bibliometric nature [32]. Based on Figure 1, the following sections show stages 5 and 6 as described in Table 1. The requirement followed in the data collection and the application of the eligibility criteria led to the elaboration of Figure 1, which shows the careful way in which the final database was obtained (n = 93). The procedures shown here are in accordance with those followed in several studies of systematic and bibliometric nature [32]. Based on Figure 1, the following sections show stages 5 and 6 as described in Table 1.

Mapping and Qualitative Analysis
The mapping of the documents included in the final database was summarized by Bibliometrix R with the information considered relevant, as shown in Table 2.

Mapping and Qualitative Analysis
The mapping of the documents included in the final database was summarized by Bibliometrix R with the information considered relevant, as shown in Table 2. A reading of this table reveals that various articles have been published recently (during 2019/2020) with citations (0.1067) and that the collaboration index rate between authors is 3.19. In addition, this search covered 48 scientific journals with 202 authors using 2813 bibliographic references. Among the articles contributing to the average citations per document (0.1067), the main ones standing out are those by Ivanov [52], analyzing the possible impacts of COVID-19 on supply chains through the simulation of a case with the limitations of this pandemic (citations in 2020 = 15), that of Dwyer and Walsh [53] exploring distance learning and the importance of critical thought; Herodotou et al. [54] notably studied the benefits of adopting Predictive Learning Analysis in online higher education. Only the article by Ivanov [52] was found to come within the COVID-19 context.
As for the country of origin of the 202 authors, it is important to compare that with the respective numbers of COVID-19 in that country (Data obtained from WHO on 27/5/2020 (https: //covid19.who.int/). The USA (40 authors) stands out, having 1,63410 confirmed cases; Ukraine (32 authors) has 21,584 confirmed cases; Brazil (17 authors) has 374,898 cases. Strangely, China, with 84,544 confirmed cases, only accounts for 11 authors. Analysis of these data reveals the interest of academics in these countries in contributing scientific evidence to understanding and addressing the effects of the global lockdown caused by the pandemic; even if research at large now focuses mainly on medicine and related areas, education, business, economics and management researchers are still active in their research, whether it is related to COVID-19 or not. In the case of China, the country where the pandemic began, few authors appear in the final database analyzed, perhaps because researchers' concerns have been mostly directed towards medicine.
Finalizing this descriptive analysis, the journal with most publications was Information Technologies and Learning Tools (n = 8), which has no impact factor (SJR) and is from Ukraine, which is logical given the number of authors originating in this country (32).

Content Analysis
Next, and also crucial in mapping the literature on a topic is content analysis of the 93 documents in the final database. This analysis aimed to identify the sub-topics studied, the objectives and the documents that are indeed related to COVID-19 in the areas of research referred to. This mapping implied integral reading of the 93 documents, in order to summarize their objective, determine the study typology, identify the sub-topic and finally identify the general conclusions. These studies were found to be of various typologies, namely: conceptual, empirical, exploratory and descriptive. Furthermore, quantitative and qualitative methodologies were used in different contexts, and sometimes jointly. However, the qualitative methodology was especially relevant, since this is a phenomenon with particular aspects, with this type of method allowing: (1) the direct source of data to be the natural environment and the researcher as the main agent involved in data collection; (2) the data gathered to be essentially of a descriptive nature; (3) researchers more interested in the process itself than in the results; (4) data analysis being performed inductively, and (5) the researcher being interested mainly in trying to understand the meaning participants attribute to their experiences [55,56]. This emphasis on qualitative research demonstrates that COVID-19 is an unknown phenomenon without precedents, where only quasi-experimentation can produce positive initial results, even if they have to be supported subsequently by quantitative research.
Finally, this content analysis identified two main sub-topics, namely: (1) Online education and (2) COVID-19's relation with the research areas of Education, Business, Economics and Management. Consequently, Appendix A presents the table with the content information of Group 1, as this is not related to COVID-19 but to distance learning in general, which is not the primary aim of this study but may suggest future research options related to this aim. Summarizing, this group of documents deals mainly with the competences of students and teachers, particularly regarding the technology [57] required in distance learning, the importance of involvement [58], communication [59] and interaction [60] between students and teachers, the use of technology [61], course completion rates [62] and the importance of feedback [63].
Concerning Group 2, related to COVID-19, this is analyzed in the following paragraphs. A significant number of documents related to Canada is noted, through the emergence of a special edition about agriculture, food and supply chains, among others [64,65]. However, these articles do not allow generalization of the results, as they are specific to the Canadian context. No less importantly, the majority of studies are exploratory and descriptive, which is understandable due to the scarcity of primary and secondary data.
As mentioned, Canada stands out in terms of (exploratory and descriptive) publications on the effects of this pandemic on management of the lockdown imposed. The effect of COVID-19 was studied in various domains and can be summarized as follows: (a) this virus altered consumer behavior in the food sector, with around 30% of the amount normally spent on eating out transferred to the retail sector [64]; (b) current agricultural policy can help farmers to manage new risks related to COVID-19 [65]; (c) pandemics are a particular risk case for the supply chain, causing a long-term interruption and a time of uncertainty, and so it was important to simulate those new impacts on the supply chain's performance following total lockdown [52]; (d) the enforced economic paralyzation reduced production [66,67], which renewed pressure on the value of agricultural land based on the duration of the recession and interest rates [67]; (e) the impact of COVID-19 on the financial wheat market has been major, causing a great volatility of prices given the uncertainty [68]; (f) food availability will be stable in the near future in the pandemic context, but there may be temporary deficits in supply and increased prices of certain food [69]; (g) this pandemic crisis requires the resilience of international supply chains, which will be neglected by consumers opting for online purchases and local chains [70,71]; (h) consumers' demand for food was changed by the pandemic (e.g., through changes in preferences, income and prices) [72], and also by the suppression of the transport system [73].
Concerning education, scientific production and academics, research related to COVID-19 is currently scarce (5 publications). Briefly, and in the area of education, Jackson et al. [74] concluded that in times of a pandemic, Twitter does not provide information in addition to other methods already used for complementary data about closed schools. This dictated the urgency to take up the challenge of setting up a new teaching method, requiring major adaptation by all involved, with the aim of using this experience of COVID-19 for future pandemics or other health emergencies [75]. The lockdown caused by the pandemic had devastating effects on Muslim women's education [76]. Concerning scientific production and academics, Wooliscroft [24] mentioned that the Conference of the Macro Marketing Society Inc. received a record amount of scientific production research, but for the first time in its history, the conference will not be held in 2020 due to COVID-19. Fernandez and Shaw [77] concluded that in times of a pandemic, good practices include a connection with people, mutual trust and clear, frequent communication between all those involved.
From a management perspective, studies are also scarce, with Grint [78] arguing that COVID-19 exposed the limits of a market-based economy and the fragilities of health systems, revealing that individuals look for charismatic or authoritarian leaders who supposedly have the management competences to defeat COVID-19 only through being positive or simply by denying evidence. The labor market also registered a major collapse. In Canada and the USA, around 50% of workers lost income due to the pandemic, with this figure being around 25% in the UK and around 45% in China [79]. A search on this topic returned two articles on the environment, namely about the global warming caused by COVID-19 [80,81]. Another study addresses the change in consumer behavior in moving to online purchases, this being linked to the effects of fear and causing swings in purchasing trends [82]. Other relevant research includes a study about the health system's financial adaptation to COVID-19 [83], another about the economic and social measures taken to reduce transmission of the virus [84], one about price speculation in medical supplies during COVID-19 [85], while Stavins [86] describes Americans' emerging expenditure due to the pandemic in terms of credit card use.
Finally, the last articles published (4) do not relate directly to these areas and studied: perceptions of the risk of COVID-19 in Vietnam [87]; the need for health professionals to have training on how to manage ventilators [88]; the importance of continuing to be physically active during times of a pandemic [89]; and a reflection on the film The POST during the COVID-19 period [90]. Note that all these studies are published in journals in the area of business, economics and management.
This descriptive analysis allowed mapping of the topics studied, as shown in Figure 2. This theoretical mapping shown in Figure 2 is a consequence of the 93 articles under analysis, which suggests that research on COVID-19 and the disruption it has caused in education and scientific research is still scarce, while the existing research did not go beyond the means used to bridge the absence of face-to-face classes, the importance of communication and the connection between academia. This may indicate that the lack of empirical data on this disruption interrupted the production of scientific knowledge, highlighting the weaknesses to which researchers and teachers are exposed. In short, the advancement of science is fundamental, so this mapping and content analysis has made explicit the importance of supporting the network of researchers and creating conditions so that the butterfly effect caused by chaos is not limiting research's investigative functions at a time when the abnormality will be the new normality in the future.
The above mapping suggests there are distinct groups of research, and so the following section identifies the clusters according to document titles and key words using Bibliometrix R.

Bibliometric Analysis
Network analysis has been widely used in bibliometric studies [91]. In this context, Bibliometrix R allows carrying out network analysis through connections between the various attributes of the database, which can be used for additional analysis [45]. These networks are analyzed to capture significant properties of the underlying research topic, and particularly, to determine the influence of bibliometric units, for example key-words and titles [45]. In accordance with the mapping above using Bibliometrix R software, Figure 3 presents the factor analysis of the 93 documents (Correspondence Analysis) in order to obtain the bipartite network of terms extracted from titles [45]). In parallel, the links between the key words of these documents are presented ( Figure 4).  This theoretical mapping shown in Figure 2 is a consequence of the 93 articles under analysis, which suggests that research on COVID-19 and the disruption it has caused in education and scientific research is still scarce, while the existing research did not go beyond the means used to bridge the absence of face-to-face classes, the importance of communication and the connection between academia. This may indicate that the lack of empirical data on this disruption interrupted the production of scientific knowledge, highlighting the weaknesses to which researchers and teachers are exposed. In short, the advancement of science is fundamental, so this mapping and content analysis has made explicit the importance of supporting the network of researchers and creating conditions so that the butterfly effect caused by chaos is not limiting research's investigative functions at a time when the abnormality will be the new normality in the future.

COVID 19 AND
The above mapping suggests there are distinct groups of research, and so the following section identifies the clusters according to document titles and key words using Bibliometrix R.

Bibliometric Analysis
Network analysis has been widely used in bibliometric studies [91]. In this context, Bibliometrix R allows carrying out network analysis through connections between the various attributes of the database, which can be used for additional analysis [45]. These networks are analyzed to capture significant properties of the underlying research topic, and particularly, to determine the influence of bibliometric units, for example key-words and titles [45]. In accordance with the mapping above using Bibliometrix R software, Figure 3 presents the factor analysis of the 93 documents (Correspondence Analysis) in order to obtain the bipartite network of terms extracted from titles [45]. In parallel, the links between the key words of these documents are presented (Figure 4).
This figure shows that most articles in Cluster 1 do not include the term COVID-19 or coronavirus (red) in their titles. This confirms the mapping of the previous section, where articles published in the area of education studied questions and concerns related to distance learning in a situation of normality. However, the contributions of these articles reveal the students and teachers' experiences of this teaching typology and can provide synergies for the possible continuity of online classes or a mixed teaching system (face-to-face and online) in the near future. For example, the literature suggested the importance of getting around the technological anxiety [92] caused by online classes, the feeling of belonging to an academic community [93,94] and feedback [63], which are new vectors for students and teachers, and also for teaching institutions. In addition, it is crucial to recognize students and teachers' remarkable adaptation to this new form of class, where physical presence was replaced by technology [95][96][97], altering the student/teacher relationship considerably [59,98,99]. Resilience was the key to this teaching typology during the pandemic, irrespective of whether teachers have the competences inherent to online teaching [57,[100][101][102]. Cluster 2 (green), which is clearly smaller, shows that publications in management and academics' research in this area demonstrated a significant negative effect, with academic literature being one of the fields with the most harmful effects, leading to the shortage of studies on COVID-19 and its effects from a management perspective and in written research. This has to do with it being a new phenomenon, with no existing knowledge on the subject, and so management scholars' first instinct was to launch numerous questionnaires about its effects on social and other networks. It is assumed that the studies involving these questionnaires are still being elaborated on or are in the peer-review process. This means that the titles of this cluster are articles about distance learning and training and the positive and negative impacts [54,94,[103][104][105][106][107], about leadership [77,102], about physical questions [89,101,108], about coronavirus [78,81,84,89] and about management [109]. Finally, Cluster 3 (blue) represents the studies about Canada analyzed in the previous section.  This figure shows that most articles in Cluster 1 do not include the term COVID-19 or coronavirus (red) in their titles. This confirms the mapping of the previous section, where articles published in the area of education studied questions and concerns related to distance learning in a situation of normality. However, the contributions of these articles reveal the students and teachers' experiences of this teaching typology and can provide synergies for the possible continuity of online classes or a mixed teaching system (face-to-face and online) in the near future. For example, the literature suggested the importance of getting around the technological anxiety [92] caused by online classes, the feeling of belonging to an academic community [93,94] and feedback [63], which are new vectors for students and teachers, and also for teaching institutions. In addition, it is crucial to recognize students and teachers' remarkable adaptation to this new form of class, where physical presence was replaced by technology [95][96][97], altering the student/teacher relationship considerably [59,98,99]. Resilience was the key to this teaching typology during the pandemic, irrespective of whether teachers have the competences inherent to online teaching [57,[100][101][102]. Cluster 2 (green), which is clearly smaller, shows that publications in management and academics' research in this area demonstrated a significant negative effect, with academic literature being one of the fields with the most harmful effects, leading to the shortage of studies on COVID-19 and its effects from a management perspective and in written research. This has to do with it being a new phenomenon,  Based on another approach, Figure 4 shows the links between the key-words of the 93 articles, where only one association between learning and COVID-19 stands out, the research by Grint [78] connecting this virus with the type of leaders looked for in this pandemic. The disruption in research on COVID-19 from a management perspective is also confirmed.
Summarizing, the bibliometrics shows that the main topic studied was education based on online constructs and distance e-learning, with Canada standing out in studies on COVID-19 and its impacts on the country's management and economy, with the areas of business, economics and management revealing little research. Based on another approach, Figure 4 shows the links between the key-words of the 93 articles, where only one association between learning and COVID-19 stands out, the research by Grint [78] connecting this virus with the type of leaders looked for in this pandemic. The disruption in research on COVID-19 from a management perspective is also confirmed.
Summarizing, the bibliometrics shows that the main topic studied was education based on online constructs and distance e-learning, with Canada standing out in studies on COVID-19 and its impacts on the country's management and economy, with the areas of business, economics and management revealing little research.

Conclusions and Contributions
The development of this article was a challenge, and simultaneously an adventure into an unknown public health phenomenon with devastating effects on health, the economy, business and its management. Initially, this research highlighted that publications in the area of health grew exponentially as opposed to those dealing with education, business, economics and management, with the cause-effect relation being dictated by the urgent need to combat the pandemic. This means that in the areas of research analyzed in this article, scholars found themselves facing drastic changes in their daily academic routines associated with a different type of family life, implying major resilience in managing this. Moreover, these changes meant that research tasks diminished drastically due to the time spent on preparing and giving classes online and on assisting students at a distance, where information and communication technology was crucial.
Given this scenario of scientific literature from a management perspective, the main contribution of this conceptual article lies in showing that management and education scholars were faced with paradigmatic situations in relation to academic tasks, with a different schedule for dealing with all of them. In other words, with no freedom of choice, they turned to online teaching and learned how to work with the platforms available in order to continue to transmit programmed content to their students, and neglected research due to a lack of time.
Other contributions concern theoretical and practical implications. In terms of theory, this research produced an original study-SLR-on an unexplored topic in the area of education and management, where mapping revealed that online education and COVID-19 and management are research flows in articles that have been published in WOS up to the present date. The first topic revealed no association with COVID-19, but various studies were conducted on the pros and cons of distance learning and teaching online for all those involved. These studies give insights into the experiences felt and identify strengths and weaknesses so that this type of teaching can be of greater quality in the future. The second group was able to respond to the objective proposed, where the

Conclusions and Contributions
The development of this article was a challenge, and simultaneously an adventure into an unknown public health phenomenon with devastating effects on health, the economy, business and its management. Initially, this research highlighted that publications in the area of health grew exponentially as opposed to those dealing with education, business, economics and management, with the cause-effect relation being dictated by the urgent need to combat the pandemic. This means that in the areas of research analyzed in this article, scholars found themselves facing drastic changes in their daily academic routines associated with a different type of family life, implying major resilience in managing this. Moreover, these changes meant that research tasks diminished drastically due to the time spent on preparing and giving classes online and on assisting students at a distance, where information and communication technology was crucial.
Given this scenario of scientific literature from a management perspective, the main contribution of this conceptual article lies in showing that management and education scholars were faced with paradigmatic situations in relation to academic tasks, with a different schedule for dealing with all of them. In other words, with no freedom of choice, they turned to online teaching and learned how to work with the platforms available in order to continue to transmit programmed content to their students, and neglected research due to a lack of time.
Other contributions concern theoretical and practical implications. In terms of theory, this research produced an original study-SLR-on an unexplored topic in the area of education and management, where mapping revealed that online education and COVID-19 and management are research flows in articles that have been published in WOS up to the present date. The first topic revealed no association with COVID-19, but various studies were conducted on the pros and cons of distance learning and teaching online for all those involved. These studies give insights into the experiences felt and identify strengths and weaknesses so that this type of teaching can be of greater quality in the future. The second group was able to respond to the objective proposed, where the topic was divided into three sub-topics, namely: Canada, scientific and academic production, business, economics and management. Standing out in these sub-topics is Canada's emphasis on the effects of COVID-19 on supply chains in the food and agriculture sector, which are uncertain and still difficult to quantify. The second sub-topic addressed the closure of schools, good educational practices and the cancellation of international conferences. Finally, the third sub-topic includes a research flow on management constructs, such as the leader profile required during pandemic periods, market questions from the supply and demand perspective and environmental questions. Another theoretical implication concerns the bibliometrics used, i.e., presenting title and key-word networks, as articles from 2020 are so recently published that there was no point in examining co-citations, for example. The clustering carried out showed three clusters closely related to the topics and sub-topics mapped in the descriptive and content analysis, corroborating the shortage of research in the areas of analysis associated with COVID-19. Moreover, in the key-word network, only one study on leadership was linked to COVID-19.
It is also important to note that chaos theory fits as an effective theoretical support, which means that the sooner the initial state of the pandemic changes due to measures to mitigate the spread, the faster the final result changes. Applying this argument to the topic studied here, the timely closure of universities, research centers and businesses generated an apparent disorder through which the rapid way in which institutions and other entities responded in order to find a viable and efficient solution, which did not let the students continue their academic year as before, which in turn led to lost opportunities for research in progress and business survival. In other words, the butterfly worked and avoided total chaos.
Clearly, this pandemic affected domains far beyond health, although with different impacts not involving the loss of life. It must therefore be recognized that the sphere of education in general and scientific research in the areas of business, education, educational research, economics and management also experienced relevant impacts. Specifically, there has been a wide range of questionnaires published on social networks regarding all types of effects of COVID-19, to obtain robust empirical evidence that is open to generalization. However, research made in these areas has not produced any theoretical and conceptual articles on what the academic world has published, corroborating Haleem et al. [4] in the simplistic mapping of research on COVID-19, so this study provides added value in that sense.
Finally, the results of this investigation provided some recommendations for the area of education, in terms of the future. Thus, educational entities should take advantage of the opportunity given by this crisis to further digitize themselves and to offer their teachers training in online education systems, for example on how to keep students connected, communicative, participatory in these classes; teachers must rethink the way they teach their content, where the use of gamification can be an asset. Also the preparation of adequate contingency plans by the relevant entities would be an asset, so that an eventual second wave does not have an impact as severe as the first in the lives of students, teachers and investigators.
Regarding the contributions and implications for practice, there is an opportunity to define a future agenda for empirical research into all the constructs implicit in people, business, scientific research, teaching methods and other areas, which are extremely important for effective assessment of the true socio-economic impact of COVID-19 on society in general, on business management and on families' lives.

Limitations and Future Avenues of Research
Similar to other investigations, this is not without limitations. The first one concerns using only the WOS database, suggesting that future research could extend to other databases, despite this one having the greatest international recognition. For example, replicating this SLR using Google Scholar could be interesting, as a quick search of the same threads revealed a great many non-indexed articles whose content could be important, and these could be classified using Publish or Perish software, which suggests future research opportunities. Another limitation concerns the researchers' subjectivity in elaborating on the articles given the absence of publications on the topic, which suggests that empirical articles carried out in the future should set out from a new SLR to have internal and external validity.
Finally, unsurprisingly, this is fertile ground for a vast amount of future research. Therefore, some suggestions are made, and others could certainly be indicated, as none of them excludes any of he others. These are as follows: (1) a study addressing the impact of COVID-19 on scientific activities in the academic sphere; (2) research into the socio-economic impact of the pandemic on firms, due to the enforced lockdown of a country's entire economic activity; (3) investigate the socio-economic effects on families to identify their typology; (4) determine the strengths and weaknesses of online teaching for lecturers and students in higher education; (5) a descriptive and comparative study of the results obtained from the previous suggestions; (6) a case study about a public institution's social responsibility and citizenship in the social domain in the pandemic context; (7) another case study on how cities, through local governments, managed the pandemic.
Author Contributions: M.R. and R.S. had the initial idea for the manuscript and wrote an original draft, as well as provided the resources for the research and M.F. participated in the formal reviews and supervision. All authors have read and agreed to the published version of the manuscript.
Funding: This research was not funded.

Acknowledgments:
The authors are grateful to the anonymous referees of the journal for their extremely useful suggestions to improve the quality of the paper. The authors gratefully acknowledge financial support from National Funds of the FCT-Portuguese Foundation for Science and Technology within the project «UIDB/04007/2020».

Conflicts of Interest:
The authors declare no conflict of interest.
Appendix A Table A1. Content information about Group 1-Online education.

Fernandes, De Oliveira Lima, Da Silva, Sales, & De
Orange [109] Empirical Investigating why health professionals should have management competences. These competences are important in providing a service of excellence. Therefore, they implemented a specialized course in management for oncologists, through "blended learning". The results obtained show these professionals' satisfaction with acquiring these additional competences, which can change their behavior regarding improved health care and its costs.

Lee [110] Conceptual
Critical review of open educational practices (OEP). Explaining that OEP courses should be opened for the most disadvantaged students.

Ortagus, Yang, Voorhees, & Riggs [111] Empirical
They aimed to determine whether the effect of the requested budgets has anything to do with the total number of students online at community universities. Concluding that the financial structure hinders that relation, although the statistical relationship between the number of students and costs is not significant.

Choi & Choi [112] Empirical
Detail the benefits and challenges for teachers in online international collaboration in courses in Korea and China, based on students' feedback and lecturers' reflections. Considered that intercultural competences were improved and that lecturers face joint challenges (e.g., scheduling classes, aligning course content, language)

Saltz & Heckman [113] Empirical
Whether the use of videos in online courses can increase performance, as long as they are improved, specifically by using the Structured Paired Activity (SPA) tool. Concluding that the introduction of SPA stimulates performance, since this tool raises student involvement and the effectiveness of the online teaching process.

Ruipérez-Valiente, Halawa, Slama, & Reich [114] Empirical
Exploring the differences in students' behavior and preferences in using the platforms of Open EDX Platform and regional Massive Open Online Course (MOOC) in Jordan. Concluding that the regional MOOC is more attractive, because the courses pay special attention to students' interests and their learning needs

Matthews & Kotzee [115] Empirical
Part-time study in the UK is in decline, and the cause of this was researched. Obtained evidence that fees and the increase in online education platforms were and will continue to be reasons for that decline.

Mapp & Boutté-Queen [116] Empirical
Analyzing baccalaureate course programmes in social work in the USA and their lecturers. Concluded that most lecturers do not have training in teaching online, which leads to the stressors of accreditation, time and monetary matters being called into question.

Authors/Year Type of Study Content Analysis
Alanazi et al. [117] Empirical Assessment of the perceived performance of students on online post-graduate courses. Considered that this has the predictors of the value of the task and the quality of the content taught, with the relation between students and technology having no significant effects on performance.

Shahzad et al. [118] Empirical
Analyzing MOOC based on the technological-organisational-environmental approach. Finding significant relations between the technological and organisational constructs, as well as attitudes towards the use of cloud computing. On the contrary, the environmental construct did not show any relations.

Zheng et al. [60] Empirical
Investigating the student-teacher relationship in online teaching.
The results obtained showed that students achieved better results if they logged in more frequently, remaining longer online; while for teachers, their influence varies according to their level of qualification.

Fernandes, De Oliveira Lima, Da Silva, Sales, & De
Orange [109] Empirical Investigating why health professionals should have management competences. These competences are important in providing a service of excellence. Therefore, they implemented a specialized course in management for oncologists, through "blended learning". The results obtained show these professionals' satisfaction with acquiring these additional competences, which can change their behavior regarding improved health care and its costs.

Lee [110] Conceptual
Critical review of open educational practices (OEP). Explaining that OEP courses should be opened for the most disadvantaged students.

Ortagus, Yang, Voorhees, & Riggs [111] Empirical
They aimed to determine whether the effect of the requested budgets has anything to do with the total number of students online at community universities. Concluding that the financial structure hinders that relation, although the statistical relationship between the number of students and costs is not significant.

Choi & Choi [112] Empirical
Detail the benefits and challenges for teachers in online international collaboration in courses in Korea and China, based on students' feedback and lecturers' reflections. Considered that intercultural competences were improved and that lecturers face joint challenges (e.g., scheduling classes, aligning course content, language)

Saltz & Heckman [113] Empirical
Whether the use of videos in online courses can increase performance, as long as they are improved, specifically by using the Structured Paired Activity (SPA) tool. Concluding that the introduction of SPA stimulates performance, since this tool raises student involvement and the effectiveness of the online teaching process.

Ruipérez-Valiente, Halawa, Slama, & Reich [114] Empirical
Exploring the differences in students' behavior and preferences in using the platforms of Open EDX Platform and regional Massive Open Online Course (MOOC) in Jordan. Concluding that the regional MOOC is more attractive, because the courses pay special attention to students' interests and their learning needs

Matthews & Kotzee [115] Empirical
Part-time study in the UK is in decline, and the cause of this was researched. Obtained evidence that fees and the increase in online education platforms were and will continue to be reasons for that decline.

Mapp & Boutté-Queen [116] Empirical
Analyzing baccalaureate course programmes in social work in the USA and their lecturers. Concluded that most lecturers do not have training in teaching online, which leads to the stressors of accreditation, time and monetary matters being called into question.

Authors/Year Type of Study Content Analysis
Alanazi et al. [117] Empirical Assessment of the perceived performance of students on online post-graduate courses. Considered that this has the predictors of the value of the task and the quality of the content taught, with the relation between students and technology having no significant effects on performance.

Shahzad et al. [118] Empirical
Analyzing MOOC based on the technological-organisational-environmental approach. Finding significant relations between the technological and organisational constructs, as well as attitudes towards the use of cloud computing. On the contrary, the environmental construct did not show any relations.

Zheng et al. [60] Empirical
Investigating the student-teacher relationship in online teaching.
The results obtained showed that students achieved better results if they logged in more frequently, remaining longer online; while for teachers, their influence varies according to their level of qualification.

Littenberg-Tobias, Valiente, & Reich [119] Empirical
Exploring the relation between monetary cost and learning behavior in MOOC. Finding that not only the financial aspect motivates students to complete the course and attend classes, with the type of information and communication technology and programme contents having a relevant effect on completion.

Forde & Gallagher [120] Empirical
Aiming to understand why continuous training in the online model is important for nurses and what the difficulties are.
Proposing that nurses are concerned about their capacity to respond to the standards defined by online courses. Despite having experienced support from other actors they are still concerned about time management.
Danka [62] Conceptual and exploratory Investigate the conclusion rates of MOOC. Despite massive enrolments on these courses, completion rates are low, possibly due to the lack of an appropriate method to assess the evolution of learning and motivational resources. Therefore, the proposal of a new theoretical framework to solve resource allocation in MOOC, where a weak student-teacher relationship persists.

Anderson & Cuttler [121] Empirical
Studying the adoption of e-books (open textbook). Finding that adoption of this type of book is less favoured than traditional books, with the cost factor having impacts on this transition.

Elizondo-Garcia & Gallardo [122] Empirical
Identifying the perceptions of students on MOOC courses about the student/teacher interaction and feedback. The empirical evidence obtained showed that most participants are willing to interact with their fellow students and participate in feedback activities. They also demonstrated that peer-assessment is more appropriate for that feedback.

Harper et al. [57] Conceptual
Analyzing digitalization of educational services from the perspective of innovation and entrepreneurship. Concluding that online courses are complex and that they are a new typology of innovation and entrepreneurship, due to implying the creation of new designs and being included in social and institutional structures that co-evolve with technological changes.

Wilhelm-Chapin & Koszalka [100] Empirical
Assessing students' interactions with online course content in higher education and their involvement, through Generative Learning Theory. Highlighting that this topic needs continuous study of the connections between resources, interaction and student involvement. They also mentioned that students would like to have access to didactic material before online classes, do more exercises and reflect on cases.

Authors/Year Type of Study Content Analysis
Williams, Martinasek, Carone, & Sanders [123] Empirical Examining the differences in perceptions between F2F and online teaching in physical education. The main deduction was that online teaching brings benefits for students also at the personal level, these being important for them.
Sinacori [124] Empirical Analyzing the experiences of nursing teachers in the transition from the classroom to an online environment. Through those experiences, it was claimed these teachers need to have their training enhanced for this transition, given the need to manage time, students' expectations and the pedagogical benefits of those courses.

Kauppi, Muukkonen, Suorsa, & Takala [95] Exploratory
Based on the feeling of a lack of human contact in online teaching, exploring the complaints/reactions of those involved. Developing a pedagogical design of a course, through the benefits and challenges in reaching the desired learning in online teaching, emphasizing the combination of joint creation of knowledge, in a virtual, flexible environment involving a multi-disciplinary group.

Gay & Betts [125] Empirical
Simulation of a real E-Meeting task in a firm on an online course.
The results revealed that this task can pro-actively increase student involvement and retention in online courses, and so the simulation was a success. Moreover, it created opportunities and gave students new competences demanded by employers (e.g., problem-solving, teamwork, communication, leadership, time management).

Roman et al. [106] Empirical
Studying ways of making online learning effective. Claiming this is possible by adopting appropriate educational instructional and technological strategies, but there are some barriers to implementation. Consequently proposing an empirically tested tool to achieve that effectiveness, which is a mediator of students' motivation, cognition and behavior.

Park & Kim [96] Empirical
Studying the possibility of creating a human presence in online teaching. Found it is challenging to promote interactions between all actors in online teaching in the same way as in face-to-face teaching. However, the inter-activity of communication tools can create a social presence and the feeling of student satisfaction in online learning, with the effects being significant and moderated by gender.

Yilmaz & Banyard [58] SLR
Analyzing trends of student involvement in distance learning. The contributions of this SLR concerned the existence of efforts to encourage that involvement to take place, despite previous research having concentrated on the institutional design and educational technology, leading to a shortage of studies in the area of education systems and distance education theories. In addition, it is necessary to pay attention to properties of the media, students' characteristics, the teaching method, course design and content, innovative techniques and lecturers' competences, besides Chickering and Gamson's principles of good practices which are so important in this student involvement.

Lee, Chang, & Bryan [126] Empirical
Studying the factors affecting the success of Ph.D. students in leadership on online courses. Concluding that relational and technological factors predict independently and interactively these students' successful learning, with it being essential to build a relation between both parties.
Skelcher, Yang, Trespalacios, & Snelson [94] Empirical Obtaining proof that online teaching affects the feeling of community in relation to the institution. From analysis of an online post-graduate course, they confirmed that feeling is very low and should be improved. As there is a proliferation of courses online, institutions should improve their forms of support. Exploring the feeling of belonging in online courses. Emphasizing that this type of teaching must give value to interaction, commitment, support and a learning culture between both parties, since these factors influence the feeling of belonging and ensure the existence of opportunities for interaction between colleagues and groups.

Ahmed, Khan, Khan, & Mujtaba [127] Empirical
Studying the importance of social capital and psychological factors of well-being in e-learning systems. Sustained by perceived social support and the use of the media as a moderator, they concluded that in online courses it is important to diagnose and prevent isolation, use software that stimulates social connection, to encourage personal blogs with students and arrange more face-to-face meetings.

Yavuzalp & Bahçivan [128] Empirical
Studying the self-efficacy of university students on online courses. Demonstrating that students' perceptions of this construct regarding online learning are not affected by gender and type of school. However, several psychological variables should be assessed simultaneously. In addition, the relations between the variables and demographic factors can be defined, and the factors affecting students' success and satisfaction can be revealed. Conjugating factors in this way facilitates universities' interventions aiming for students' success in an online learning environment.

Mubarak, Cao, & Zhang [108] Empirical
Studying low completion rates for online courses. As this is a worrying topic, they built a predictive model to forecast students at risk of dropping out, with the accuracy of that forecast rate depending on the data on students' behavior. However, these data will only be obtained on courses where there is student involvement in the learning process.

Rajagopal et al. [61] Empirical
Studying open virtual mobility in education. Concluding that on the online courses provided, virtual mobility and open education are variables affecting their quality, resulting in students' acquisition of new competences, such as autonomy, interaction, collaboration, an open mind and others.

Stuij et al. [129] Empirical
Exploring the training and development of communication competences among oncologists. In this area, online training provides these professionals with benefits, as it is essential they know how to communicate. In addition, this type of training allows accessible forms of learning, in a safe, personalized environment, especially using software that can simulate a conversation with users (Chatbot) rather than e-learning.

Sedra [130] Conceptual
Presentation of a tool to help designers produce educational content, based on the Competency-Based Approach (CBA), which allows incorporation of the desired order of competences of distance learning and interaction, according to an orchestrated plan.

Lengyel [104] Exploratory
Exploring the application of games in teaching accountancy on online courses. In these courses, learning is based on games linked to e-learning and experimental learning, which originated a greater number of active students from one semester to another, given the increasing popularity of gamification.
García-Peñalvo [131] Conceptual Development of a model of reference for universities with F2F classes to adapt to distance learning, including its structures.

Lam & Dongol [103] Conceptual
One of the important questions with online teaching platforms is the transparency of assessment and the personalization of curricula. Proposal of a theoretical platform that can increase students and lecturers' trust in universities' online services, regarding assessment procedures and others.

Authors/Year Type of Study Content Analysis
Herodotou et al. [54] Empirical Examining the adoption of Predictive Learning Analytics (PLA) in online higher education courses. Concluding that adoption includes lecturers' commitment and involvement, creating evidence, dissemination and digital literacy.
Dwyer & Walsh [53] Empirical Exploring distance learning in adults. Highlighting the importance of critical thinking and that e-learning is important for these individuals.

Shonfeld & Magen-Nagar [132] Empirical
Assessing students' intrinsic motivations in collaborative programmes online. Concluding that motivation is affected by students' level of satisfaction, which influences their attitudes to technology. Also finding that students begin to enjoy using advanced technology and gain self-confidence, which diminishes technological anxiety regarding online courses.

Hilliard, Kear, Donelan, & Heaney [92] Empirical
Studying students' anxiety regarding online courses. Finding this is caused by students having to trust in strangers, being afraid of having a negative evaluation and concern about non-active group members. This anxiety diminishes with decreasing uncertainty.

Schreiber & Jansz [63] Empirical
Studying the importance of feedback in distance learning.
Concluding that the interaction provided through feedback increased the dialogue between students and lecturers, which reduced the transactional distance.

Martin [133] Empirical
Analysis of distance learning of languages in higher education.
Concluding that distance learning of languages benefits from including training directed towards the pronunciation of that language and helps to obtain better performance.
Vershitskaya, Mikhaylova, Gilmanshina, Dorozhkin, & Epaneshnikov [134] Empirical Assessment of students' readiness for e-learning, in a management university. Considering that the implementation of e-learning, based on students and lecturers' perspectives and on existing problems with information technology, failed due to extremely poor marketing strategies and technical support.

Andoh, Appiah, & Agyei [135] Empirical
Assessing students' satisfaction with distance learning. Students' satisfaction with this teaching does not depend on age, gender or course content, but is closely related to the location of the study centre and the semester in question. These students were also impressed by the support they were given.
Said [136] Empiricaland descriptive Determining educational applications and their characteristics, followed by grouping them by category. This description allowed assessment of the performance of these applications regarding students' use and competences.

Kayser & Merz [59] Empirical
Identifying the various types of student communication in distance learning. Obtaining empirical evidence of 3 types of communication among students: powerful communicators, regular communicators and "lone wolves".

Ramlatchan & Watson [137] Empirical
The effect of multimedia elements used by lecturers in online courses and their credibility and immediacy among students. Emphasizing that there can be a balance in these students' perceptions, if the teaching they receive is a mix of online presentations, videos and seeing the lecturer, and if the presentations are good this can create an atmosphere of involvement.
Joiner, Rees, Levett, Sitnikova, & Townsend [138] Empirical Exploring the effectiveness of online learning by professionals throughout their life. Through elaborating a comparative study of teaching pedagogies regarding their effectiveness for critical thought in online work, they argued that forums are more effective than direct exchange of this critical sense. Study students' silence in distance learning, through the phenomenological approach. Concluding that students' silence can have various facets: on purpose; absorption of students' silence; silence used as demarcation; experiencing silence; use of deliberate, complex strategies when participating; hearing in a trusting community. This means this phenomenon has implications for all actors in distance learning.

Zimmerman [105] Empirical
Study of how to create knowledge-exchange activities in distance learning. The use of recorded conversations and reflections to help distance learning encouraged interactions and critical dialogue among participants, where the language was important for that different form of learning.

Krasnova & Shurygin [101] Empirical
Assessing the competences required of lecturers to teach online. Highlighting the technological competences required of lecturers, despite finding a tendency for the use of information and communication technology in education to facilitate learning, whatever the age of users.
Villalpando et al. [139] Exploratory and descriptive Comparing the motivation statistics of mathematics students involved in mixed teaching systems -F2F and F2F +e-learning -.
Demonstrating that F2F students had better performance in interest, perception and self-efficacy, while those in the mixed system highlighted the financial cost associated with the choice of teaching type.

Kilinc, Yazici, Gunsoy, & Gunsoy [107] Empirical
Study of distance learning in Turkey. Distance learning has had positive effects in Turkey regarding levels of employment (before and after), levels of income and socio-economic well-being.

Faisal & Kisman [140] Empirical
Exploring the effects of using Moodle in distance learning. The empirical evidence indicates that learning through an educational system at a distance can simplify and accelerate work, and allow more accurate and efficient work, due to this platform being interactive and easy to use.

Lee, Lim, & Lai [102] Empirical
Aim to examine teacher training in advanced training at a distance. These programmes last 4 years, with online classes at the weekend and 5 face-to-face meetings. By assessing the performance of these teachers' practical competences, they argued that they still needed more training to be innovative in teaching and that their cognitive taxonomy has to be emphasized.

Jones, Lotz, & Holden [141] Empirical
Application of Virtual Design Studios (VDS) during a complete higher education course (3 years) and with all its students, integrated in distance learning, to assess the behavior of these students. Concluding that VDS can support learning and social interaction, leading to positive experiences and results for students, although the correlation between VDS and students' success is higher in the initial stages.

Kuznetcova, Lin, & Glassman [97] Empirical
Questioning the importance of lecturers' presence in online teaching. This presence has been considered crucial to motivate students, although the use of virtual environments, with multiple users simultaneously, may alter this argument. The results showed that the presence of teachers encourages students' independence and interactivity.
Laurie, Kim, José, & Rob [142] SLR Systematization of the literature on the predictors of completing online higher education. Identifying that study strategies, academic self-efficacy, objectives, intentions, institutional or university adjustments, employment, the support network and the student-teacher interaction are predictors of the completion rate of that teaching. Coaching, corrective teaching and peer orientation are promising constructs with a view to solving this problem of course completion. The differences in teaching students with hearing difficulties. They argued that it is important to find innovative teaching models directed to these students, and so implemented a data and text mining application which produced a 90% improvement in their performance.

Yun & Park [98] Empirical
Studying students' motivation in higher education, both face-to-face and online. Concluding that improved interest and environmental control are significantly associated with behavioral involvement and that this improvement, orientation by objectives and the behavioral effort are also significantly associated with emotional and cognitive involvement, moderated by students' academic level.

Corsby & Bryant [144] Empirical
Studying the effects of distance learning in Ph.D. programmes. The results showed the failings of interaction when using technology in distance learning, such as the quality of the technology, familiarity in the classroom, the tutor's help and the user's isolation.
Amin, Piaralal, bin Daud, & Mohamed [145] Transversal investigation of the relations between the dimensions of justice, university image and users' satisfaction with services. The results revealed a significant relation between the dimensions of justice and dissatisfaction with service recovery, in terms of process and interpersonal justice. Satisfaction with service recovery had a significant effect on all the behavioral results of the users studied. The university image had no moderating effect on the relation between the dimensions of justice and satisfaction with service recovery.