Next Article in Journal
A Meta-Analytic Framework for Developing Protocols to Attend Child and Adolescent Victims of Sexual Violence
Previous Article in Journal
Exploring Blue Spaces’ Effects on Childhood Leukaemia Incidence: A Population-Based Case–Control Study in Spain
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Machine Learning and Lean Six Sigma to Assess How COVID-19 Has Changed the Patient Management of the Complex Operative Unit of Neurology and Stroke Unit: A Single Center Study

1
Department of Public Health, University of Naples “Federico II”, 80131 Naples, Italy
2
Interdepartmental Center for Research in Healthcare Management and Innovation in Healthcare (CIRMIS), University of Naples “Federico II”, 80131 Naples, Italy
3
“San Giovanni di Dio e Ruggi d’Aragona” University Hospital, 84121 Salerno, Italy
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(9), 5215; https://doi.org/10.3390/ijerph19095215
Submission received: 13 March 2022 / Revised: 19 April 2022 / Accepted: 23 April 2022 / Published: 26 April 2022

Abstract

:
Background: In health, it is important to promote the effectiveness, efficiency and adequacy of the services provided; these concepts become even more important in the era of the COVID-19 pandemic, where efforts to manage the disease have absorbed all hospital resources. The COVID-19 emergency led to a profound restructuring—in a very short time—of the Italian hospital system. Some factors that impose higher costs on hospitals are inappropriate hospitalization and length of stay (LOS). The length of stay (LOS) is a very useful parameter for the management of services within the hospital and is an index evaluated for the management of costs. Methods: This study analyzed how COVID-19 changed the activity of the Complex Operative Unit (COU) of the Neurology and Stroke Unit of the San Giovanni di Dio e Ruggi d’Aragona University Hospital of Salerno (Italy). The methodology used in this study was Lean Six Sigma. Problem solving in Lean Six Sigma is the DMAIC roadmap, characterized by five operational phases. To add even more value to the processing, a single clinical case, represented by stroke patients, was investigated to verify the specific impact of the pandemic. Results: The results obtained show a reduction in LOS for stroke patients and an increase in the value of the diagnosis related group relative weight. Conclusions: This work has shown how, thanks to the implementation of protocols for the management of the COU of the Neurology and Stroke Unit, the work of doctors has improved, and this is evident from the values of the parameters taken into consideration.

1. Introduction

The pandemic caused by coronavirus disease 2019 (COVID-19) has radically changed the medical landscape in every aspect [1]. The infection with SARS-CoV-2 mainly affects the respiratory system and lungs, but the virus has also been shown to affect other compartments of the body such as the eyes, heart, skin, kidneys and central nervous system (CNS) [2]. Several studies have shown how patients with COVID-19 showed the presence of neurological manifestations [3,4,5]. During this period, neurologists were involved on the front line and found themselves watching over the neurological complications of COVID-19. In fact, patients with neurological disorders, particularly those on immunomodulatory therapy, will require careful monitoring [6]. Although the goal is to put in place protective measures for patients hospitalized due to COVID-19 infection, other difficulties may also arise, such as the availability of side rooms and the logistics of the social distancing of patients, which has been shown to minimize spread [7].
Therefore, all the measures adopted by the government, such as the lock-down, social distancing, the blocking of deferred elective procedures and the management of the pandemic, have inevitably changed the normal activity of the hospital departments, including the neurology department.
The optimization of care processes with a view toward global improvement and the containment of expenditure become elements of fundamental importance in the whole context analyzed. By means of performance-oriented techniques and approaches, borrowed from the manufacturing industry [8,9,10,11] and applied to the healthcare sector [12,13,14,15,16], such as Lean Six Sigma (LSS) [17,18,19,20,21,22], technology assessment [23,24,25,26,27] and big data analysis through machine learning and deep learning algorithms [28,29,30], promising results have been achieved in terms of the improvement in the quality and efficiency of healthcare services, and new methodologies and technologies have been proposed to improve diagnostic [31,32,33,34] or therapeutic pathways and procedures [35,36,37,38,39]. Among the novel care paradigms, telemedicine and telemonitoring, with the provision of remote services [40], have contributed to obtaining benefits for the management of patients, especially those with movement disorders, who are most affected by the effects of the lock-down [41].
The critical situation due to the COVID-19 pandemic has contributed to obtaining benefits regarding inappropriate hospitalizations. Factors that are associated with inappropriate hospitalizations have been shown to be the patient’s age, functional and health status and specialty of care [42,43].
In this study, we intend to evaluate how the influence of the COVID-19 pandemic has influenced the activity of the Complex Operative Unit (COU) of the Neurology and Stroke Unit of the San Giovanni di Dio and Ruggi d’Aragona University Hospital. In addition, we also focus on a specific category of patients, i.e., stroke patients, in order to evaluate the impact of the pandemic on a clinical case. In fact, stroke is the most common reason for hospitalization in the processed dataset, with a percentage that exceeds 30% of the total number of patients treated. Although several analyses have been made in recent years to prevent and manage infections and disease [44,45,46,47], and, within the last two years, to analyze, understand and predict the dynamics and evolution of the COVID-19 pandemic [48,49,50], the majority of this research has focused on how the virus spreads and what factors most impact this spread. In the proposed analysis, we are focusing on the patients in order to evaluate and improve the understanding of the COVID-19 pandemic on a cohort of 1538 subjects. In particular, this study is an extension of a previous work in which the impact of COVID-19 was analyzed on a limited number of cases (hospitalized patients) using statistical analysis and regression models, 845 patients of which were admitted in 2019 and 693 in 2020 [51]. A Six Sigma (SS) methodology was applied in the study. In previous years, many researchers have applied an SS methodology to analyze clinical pathways in different fields of medicine [52,53,54]. Apart from medical procedures, LSS also facilitates administrative management, including medical recordkeeping, finance management, patient hospitalization and discharge forms and medical equipment coding [52]. In this work, we will analyze changes in terms of length of hospital stay (LOS), mode of discharge and diagnosis related group (DRG) relative weight.

2. Materials and Methods

In this analysis, we propose a machine learning-based methodology, whose aim is to investigate the effect of the COVID-19 pandemic on a large cohort of patients. In particular, Figure 1 summarizes the overall flow of our analysis.
We first collected different data about a cohort of 1583 patients from 2019–2021. In particular, this study was conducted at the COU of the Neurology and Stroke Unit of the San Giovanni di Dio e Ruggi d’Aragona University Hospital in Salerno (Italy). All patients admitted in the years 2018–2019 (before COVID-19) and 2020–2021 (during COVID-19) were considered in the study. The dataset was extracted from the hospital’s information system, the QuaniSDO. The extracted information was:
  • Gender,
  • Age,
  • Department and COU,
  • Main and secondary diagnoses,
  • Diagnosis related group (DRG),
  • Length of hospital stay (LOS), i.e. date of admission—date of discharge,
  • Diagnosis related group (DRG) relative weight,
  • Number of days of hospital (DH) admission, i.e. the number of visits to the hospital for appointments and medical checks,
  • Mode of discharge.
Using the DRG, it was possible to identify patient discharge pathologies. From this information, a subgroup was extracted from the dataset, i.e., stroke patients, in order to assess the impact of COVID-19 on this specific class of patient. By analyzing the main and secondary diagnoses, it was possible to identify the main comorbidities (hypertension, atrial fibrillation and atherosclerosis) of stroke patients, which were then used as input variables to the ML algorithms. Finally, different machine learning models were used for classifying patients between the two identified classes.

2.1. Data Analysis

Microsoft Excel (version 2016) and IBM SPSS (Statistical Package for Social Science) Statistics (version 27) were used to study the dataset. In particular, a Pareto diagram was created using MS Excel v2016 Software, while statistical analysis was implemented with the support of IBM SPSS Statistics v27 Software. First, the distribution was tested using the Kolmogorov–Smirnov test, with a significance level of 95%. For each variable, the distribution normality was not demonstrated. For this reason, the Mann–Whitney U test (MW), the Kruskal–Wallis test and the chi-squared test, with a 95% confidence interval, were used. For the dataset consisting of stroke patients only, after performing the comparative statistical analysis, 5 ML algorithms—decision trees (DT), random forest (RF), support vector machine (SVM), logistic regression (LR) and gradient boosted trees (GBT)—were implemented to verify the possibility of classifying patients between the two identified classes. To do this, a Python script was created.

Machine Learning Algorithms

The use of machine learning models to support supervised classification tasks has been applied, achieving high efficacy performances in different domains (i.e., finance [55], security [56], music [57], and healthcare [58,59,60,61,62,63]). In particular, these methods mainly rely on two phases: feature selection, that has been discussed in Section 2.1, and classification.
Concerning the second phase of the proposed methodology, we evaluate the efficacy performances of several well-known machine learning algorithms. In particular, DT is a simple classification model based on the construction of decision trees. At the level of each node, a feature of the variables is checked. The result of this comparison determines the choice of a specific branch to get to the next node. The cost of using the tree (i.e., predicting data) is logarithmic in the number of data points used to train the tree, but small variations in the data might result in a generation of completely different trees. GBT and RF use the DT model and strengthen it through the progressive combination of weak predictors for performance improvement. SVM, however, uses a hyperplane in an N-dimensional space (N—the number of features) defined through the use of a loss function in order to maximize the distance between the points of different classes. Lastly, LR is a linear model for classification, where the probabilities describing the possible outcomes of a single trial are modeled using a logistic function.
For all algorithms, the dataset was divided into a training set and a test set, respectively, at 80% and 20%, and an initial oversampling was performed in order to increase the size of the rare samples (Class 2).

2.2. DMAIC Cycle

In accordance with the problem, solving solution provided by the methodology, the project was divided into five phases, each coinciding with one of the DMAIC roadmap steps [53]. The simplified procedures of each phase are [54]:
  • Define by identifying, prioritizing and selecting the correct project;
  • Measure key process characteristic, the scope of parameters and their performances;
  • Analyze by identifying key causes and process determinants;
  • Improve by changing the process and optimizing performance; and
  • Control by sustaining the gain.
In this framework, both soft Lean and Six Sigma tools have been combined. In addition, the use of additional predictive tools for data analysis and measurements, namely regression and machine learning classifiers, strengthen the Six Sigma approach compared to the Lean method.

2.2.1. Define

During the “define” phase, the purpose of the work and the improvements to be implemented to the process are identified. The identified CTQ (critical to quality) measurement was the LOS, the mode of discharge and DRG relative weight.
The LOS—measured in days—is defined as the difference between the date of admission and the date of discharge of the patient.
All the aspects of the project were clarified in a project chart (Table 1).
SIPOC analysis has been performed in this “define” phase; this diagram is generally used to identify all relevant elements of a process improvement project before work begins. SIPOC stands for supplier, input, process, output and customer (Table 2).

2.2.2. Measure

In this phase, measures of the process before the improvement were carried out. First, we collected data from 1 January 2018 to 31 December 2019 concerning all admissions to the Neurological Clinic and Stroke Unit, representing the pre-pandemic data. The second dataset was collected in the year 2020 and 2021, representing the period affected by the pandemic of COVID-19. The information in Table 3 was collected for all patients: gender, age, mode of discharge, DRG relative weight, number of DH admissions and LOS.

2.2.3. Analyze

The objectives of this phase will be to verify if the potential causes, previously identified as those that triggered the problem under consideration, are actually the correct reasons and to have the support of the confirmation derived from the analysis of the data. The tool used in this phase is the histogram. In Figure 2, the line graph shows the LOS trend in the years 2018 and 2019 for all hospitalized patients, while Figure 3 shows the Pareto diagram of the number of hospital admissions for patients with day hospital admissions in the two years 2018–2019.
Figure 4 shows the trend of the DRG relative weight in the years 2018 and 2019. The histogram shows how often the values occur within the dataset.
Lastly, Figure 5 reports the change in LOS in days for all 650 observations relating to stroke patients in the 2 years 2018–2019. The orange line shows the average value of 11.19 days.

2.2.4. Improve

Only after having collected and examined all the objective evidence is it possible to move on to the actual improvement phase. The purpose of this phase is to design the most suitable solution to solve the problem we are considering.
The COVID-19 emergency, with the necessary social distancing measures and the inevitable fear of the population to go to the hospital or contact local emergency services, has led to a significant decrease in the number of hospitalizations for stroke and therefore, in the number of patients treated compared to the numbers from the same period in the previous year.
The COVID-19 emergency has suddenly changed the geography of the stroke units: stroke is a health emergency but, even during the pandemic, high-level treatment was guaranteed.
The Campania region of Italy has reorganized the stroke network based on the number of hospitalizations for stroke by province and the respective population density, establishing three second-level stroke units and four first-level stroke units for the province of Naples and one second-level stroke unit for each of the remaining provinces. An additional first-level stroke unit, based on population density, has also been established [64].
The challenges and limitations faced in the management of patients of the COU of the Neurology and Stroke Unit induce medical specialists to come up with alternative solutions (Table 4).

2.2.5. Control

The control phase is the final stage where monitoring tools are used to monitor the process.
In this phase, the real effects of the protocols adopted during the COVID-19 pandemic in the COU of the Neurology and Stroke Unit are assessed.
To evaluate the effects and show the differences in the parameters in the two years considered for the analysis, the tool used in this phase is also the histogram. In addition, to support the analysis, logistic regression and descriptive statistic methods were also applied. The results are shown in the next section.

3. Results

We organized our results into two main sections. First, we compared the results between before and after the COVID-19 emergency on the basis of data from the Neurology and Stroke Unit of the San Giovanni di Dio e Ruggi d’Aragona University Hospital in Salerno (Italy). Successively, different machine learning models were evaluated for classifying patients between the two identified classes.

3.1. Statistical Analysis

In this section, a comparison of before and after the COVID-19 emergency was implemented. First, the Pareto charts shown in Figure 6 and Figure 7 compare the LOS and Figure 8 the DRG relative weight in the two years before and after COVID-19, respectively.
Comparing Figure 4 and Figure 7, we see how the values of the DRG relative weight increase in the period of the COVID-19 emergency. To facilitate the comparisons for LOS (Figure 9) and number of DH admissions (Figure 10), the following box diagrams have been created.
Figure 9 shows that there were no changes on the total LOS for hospitalized patients, while Figure 10 shows that a decrease in outliers occurred during the pandemic. Next, the logistic regression was implemented. Logistic regressions were used to test the association between the year of hospitalization (as a dependent variable) and the different risk factors under study (as explanatory variables): LOS, number of DH admissions, gender, age, DRG relative weight and mode of discharge. Logistic analysis has been carried out with IBM SPSS (Statistical Package for Social Science) ver. 27.3.1, and the results are reported in Table 5 and Table 6.
The first logistics analysis showed two significant variables—the DRG relative weight and LOS—while the second showed three significant variables—age, DRG relative weight and number of DH admissions. The descriptive statistics were performed using the chi-squared test and Kruskal–Wallis test, as appropriate. The level of significant α is equal to 0.05. The results are reported in Table 7.
Finally, with the statistical analysis, we obtained two other significant variables: DRG relative weight and the mode of discharge. The DRG relative weight has a p-value < 0.000 comparable to the mode of discharge, confirming the logistic regression.
In regard to stroke patients, Figure 11 shows the run chart obtained by analyzing the LOS of the 338 patients hospitalized in the years 2020–2021.
Comparing the results with those reported in Figure 4, it can be seen that the number of patients and the LOS decrease. To verify the veracity of this statement, statistical tests (Table 8) and logistic regression (Table 9) were implemented.
The analysis of the results shows that there is a statistically significant difference in the total LOS. Finally, the ML algorithms were implemented. Figure 12 shows the analysis of the initial correlations.
As can be seen from Figure 12, the COVID-19 variable is only correlated with hypertension and atherosclerosis, with a coefficient of around 0.2.

3.2. Classification Results

In this section, different well-known machine learning models have been evaluated for classifying patients between the two identified classes. In particular, we designed a binary classification task on the basis of the features analyzed in Section 2.1 according to several measures (accuracy, precision, recall and F-measure) that were chosen for better handling the unbalanced problem, as shown in [38]. Each model is optimized on the basis of the training set to unveil the best parameters to deal with the designed task.
The outcomes of our analysis are summarized in Table 10. It is easy to note that SVM achieves the best performances in terms of accuracy (80% overall), precision and F-measure, being able to better handle this unbalanced dataset with respect to the other models. In fact, it is easy to see in Table 10 that SVM achieves a 10% to 28% F-measure score for the minority class with respect to the other models.
Table 11 shows the confusion matrix for this SVM model, where it is easy to note how the number of false classification samples is about the same for both classes. Furthermore, Figure 13 shows the importance of the permutation feature for the SVM model in order to establish which are the main features affecting the efficacy results.
By looking at the SVM coefficients, it is possible to identify the main features used in classification. In this case, the higher coefficient is associated with the LOS, in accordance with the results of the statistical analysis.
Finally, in Table 12, we show the hyperparameters identified for the SVM model during the training phase in order to improve the reproducibility of the analysis.

4. Discussion

In this study, the data relating to patients who had access to the COU of the Neurology and Stroke Unit of the San Giovanni di Dio e Ruggi d’Aragona University Hospital in the periods between 2018–2019 (pre-COVID-19) and 2020–2021 (during the COVID-19 emergency) were considered. The goal was to evaluate the impact of the COVID-19 pandemic on the ward’s health activities and to consider how the pandemic has affected the hospitalization of patients. To this end, we performed an analysis by comparing the 2018–2019 (pre-COVID-19) and 2020–2021 (during the COVID-19 pandemic) data; this was the data used to assess the impact of the pandemic. The following variables were analyzed for all patients: gender, age, LOS (length of stay), number of DH admissions, relative DRG weight and modality of discharge. Through the use of LSS methodology, with the implementation of the DMAIC cycle, it was possible to outline and compare the parameters characterizing the specific COU.
In particular, through the well-established DMAIC cycle, a rigorous definition of the problem to be addressed has been carried out during the define phase, where the process standards, the timing and, more importantly, the indicator to be measured as critical to quality (in this case, the LOS) have been clarified and agreed upon among all the healthcare staff involved in the reorganization of the COU. Afterwards, the measure and analyze phases helped in describing the so called “as is” process by collecting and analyzing data on the predefined indicators using both a Pareto chart and statistical analysis. In this phase, the statistical analysis supported the identification of the major characteristics of the dataset examined over the entire period under study, while the Pareto chart, followed by the run chart, helped in deepening the understanding and dynamics of the CTQ, i.e., the hospital stay, by outlining its evolution over time. The knowledge of the “as is” process and, more specifically, of the LOS acquired during the measurement phase of the DMAIC cycle allowed the project team to formalize the problem and hypothesize possible solutions for a better management of stroke patients during the COVID-19 pandemic. For this reason, national and regional guidelines and regulations were consulted, and decisions about strategies to improve patient management were proposed in compliance with the national and regional standards. In particular, a reorganization of the stroke network in the Campania region, based on the number of hospitalizations, has been taken into account as the major regional reference. Among the proposed strategies, improvement in the education and information of the healthcare staff about the COVID pandemic and related regulations has been suggested. Moreover, telestroke networks and preferred diagnostic-therapeutic assistance pathways have been set up in order to facilitate the management of stroke patients. The outputs of the final control phase of the DMAIC cycle, which have been extensively presented in the Results section of this work, reveal how the implementation of the proposed improvement measures have impacted the considered CTW and the related indicators examined in this case study. The main results highlight that the LOS plays a major role in the management of stroke patients (as demonstrated in the different regression and machine learning models implemented) and that a slight (although not very significant) decrease in the LOS has been achieved after the implementation of the improvement actions. Despite that, the results demonstrate a reduction in the number of DH admission. This is in accordance with other literature studies indicating that a reduction in hospital admissions for stroke patients is noted during the COID-19 pandemic [65,66]. In particular, the reduction effect is not as noticeable for the mean value as for the reduction in the outliers. Furthermore, the results demonstrated an increase in the value of the DRG relative weight; this indicates a higher complexity of the medical treatments carried out in 2020 and therefore, more appropriate hospital access. This is also in agreement with other studies [67] confirming that from both and economic and clinical perspective, the COVID-19 outbreak has paved the way for the development of novel strategies for a better management of stroke patients. Compared with our previous analysis, where only hospitalizations for the years 2019–2020 were studied, the growth of the relative weight DRG is confirmed. As for the stroke patients, both the statistical analysis and the logistic regression showed a significant reduction in LOS, and therefore, a greater turnover in the use of beds. The implementation of ML algorithms, with an accuracy of 80%, helped to more fully explain the substantial differences that exist between the two different groups of stroke patients, such as by allowing an automatic classification of cases with high performance. In summary, the main novelties of this works compared to the state of the art are:
  • Although several analyses have been made in the last two years to analyze COVID-19 pandemic, the majority of these have focused on how the virus spreads and what factors most impact this spread. This analysis focuses on the patients in order to evaluate and improve the understanding of the impact of the COVID-19 pandemic on a cohort of 1538 subjects,
  • It analyzes changes due to COVID-19 in terms of LOS (length of stay), mode of discharge and DRG (diagnosis related group) relative weight.
  • It combines the use of both Lean Sigma Approach and predictive machine learning tools in order to deepened and strengthen the analysis of the proposed case study.
The COVID-19 emergency led to a profound restructuring—in a very short time—of the Italian hospital system. In times of pandemics, a national health system must guarantee the best possible services to patients with non-communicable diseases. In particular, these systems must maintain their ability to operate effectively, especially for those patients with acute conditions such as stroke and myocardial infarction, in which the applicable treatments are always time-dependent. The limit of this study is that only the whole activity of the said COU was considered, without focusing on the single case study.

5. Conclusions

In this study, the impact of COVID-19 on the activities of the COU of the Neurology and Stroke Unit of the San Giovanni di Dio e Ruggi d’Aragona University Hospital was analyzed. The novel objective of this work is to analyze, from a Lean Six Sigma perspective, the containment actions implemented by the hospital, in order to rigorously evaluate their impact on organizational, clinical and demographic variables of the neurological patients. In addition, a specific focus on stroke patients allowed us study a specific pathology in depth.
The results show an increase in the complexity of cases treated by the department and a reduction in LOS for patients who are admitted for stroke.
Future work will focus on a detailed analysis of the individual pathologies constituting the case mix of the department and a comparison with what has occurred in other departments of the hospital, as well as what has occurred in the same type of COU in other hospitals similar in territory and dimensions.

Author Contributions

Conceptualization, M.T. and A.B.; methodology, G.I.; software, G.I.; validation, G.I., M.T. and A.B.; formal analysis, G.I.; investigation, G.I.; resources, G.I.; data curation, G.I.; writing—original draft preparation, G.I.; writing—review and editing, A.B. and M.T.; visualization, G.I.; supervision, A.B. and M.T.; project administration, A.B. and M.T. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The datasets generated and/or analyzed during the current study are not publicly available for privacy reasons, but are available from the corresponding author on rea-sonable request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Wilson, M.P.; Jack, A.S. Coronavirus disease 2019 (COVID-19) in neurology and neurosurgery: A scoping review of the early literature. Clin. Neurol. Neurosurg. 2020, 193, 105866. [Google Scholar] [CrossRef] [PubMed]
  2. Mao, L.; Jin, H.; Wang, M.; Hu, Y.; Chen, S.; He, Q.; Chang, J.; Hong, C.; Zhou, Y.; Wang, D.; et al. Neurologic manifestations of hospitalized patients with coronavirus disease 2019 in Wuhan, China. JAMA Neurol. 2020, 77, 683–690. [Google Scholar] [CrossRef] [Green Version]
  3. Asadi-Pooya, A.A.; Simani, L. Central nervous system manifestations of COVID-19: A systematic review. J. Neurol. Sci. 2020, 413, 116832. [Google Scholar] [CrossRef] [PubMed]
  4. Moriguchi, T.; Harii, N.; Goto, J.; Harada, D.; Sugawara, H.; Takamino, J.; Ueno, M.; Sakata, H.; Kondo, K.; Myose, N.; et al. A first case of meningitis/encephalitis associated with SARS-coronavirus-2. Int. J. Infect. Dis. 2020, 3, 55–58. [Google Scholar] [CrossRef] [PubMed]
  5. Duong, L.; Xu, P.; Liu, A. Meningoencephalitis without respiratory failure in a young female patient with COVID-19 infection in Downtown Los Angeles, early April 2020. Brain Behav. Immun. 2020, 87, 33. [Google Scholar] [CrossRef] [PubMed]
  6. Manji, H.; Carr, A.S.; Brownlee, W.J.; Lunn, M.P. Neurology in the time of COVID-19. J. Neurol. Neurosurg. Psychiatry 2020, 91, 568–570. [Google Scholar] [CrossRef]
  7. Wee, L.E.; Conceicao, E.P.; Sim, X.Y.J.; Aung, M.K.; Wong, H.M.; Wijaya, L.; Tan, B.H.; Ling, M.L.; Venkatachalam, I. Minimising intra-hospital transmission of COVID-19: The role of social distancing. J. Hosp. Infect. 2020, 105, 113–115. [Google Scholar] [CrossRef] [PubMed]
  8. Komashie, A.; Mousavi, A.; Gore, J. Quality management in healthcare and industry: A comparative review and emerging themes. J. Manag. Hist. 2007. [Google Scholar] [CrossRef]
  9. Dias, A.C.; Reis, A.C.; Oliveira, R.P.; Maruyama, Ú.; Martinez, P. Lean manufacturing in healthcare: A systematic review of literature. Rev. Produção E Desenvolv. 2018, 4, 111–122. [Google Scholar] [CrossRef]
  10. Jarrett, P.G. Logistics in the health care industry. Int. J. Phys. Distrib. Logist. Manag. 1998. [Google Scholar] [CrossRef]
  11. Aceto, G.; Persico, V.; Pescapé, A. Industry 4.0 and health: Internet of things, big data, and cloud computing for healthcare 4.0. J. Ind. Inf. Integr. 2020, 18, 100129. [Google Scholar] [CrossRef]
  12. Kane, M.; Chui, K.; Rimicci, J.; Callagy, P.; Hereford, J.; Shen, S.; Norris, R.; Pickham, D. Lean manufacturing improves emergency department throughput and patient satisfaction. JONA J. Nurs. Adm. 2015, 45, 429–434. [Google Scholar] [CrossRef] [PubMed]
  13. Kim, D. An integrated supply chain management system: A case study in healthcare sector. In Proceedings of the International Conference on Electronic Commerce and Web Technologies, Copenhagen, Denmark, 23–26 August 2005; Springer: Berlin/Heidelberg, Germany, 2005; pp. 218–227. [Google Scholar]
  14. Cesarelli, G.; Scala, A.; Vecchione, D.; Ponsiglione, A.M.; Guizzi, G. An Innovative Business Model for a Multi-echelon Supply Chain Inventory Management Pattern. In Journal of Physics: Conference Series; IOP Publishing: Bristol, UK, 2021; Volume 1828, p. 012082. [Google Scholar]
  15. Improta, G.; Scala, A.; Trunfio, T.A.; Guizzi, G. Application of Supply Chain Management at Drugs Flow in an Italian Hospital District. In Journal of Physics: Conference Series; IOP Publishing: Bristol, UK, 2021; Volume 1828, No. 1. [Google Scholar]
  16. Ponsiglione, A.M.; Romano, M.; Amato, F. A finite-state machine approach to study patients dropout from medical examinations. In Proceedings of the 2021 IEEE 6th International Forum on Research and Technology for Society and Industry (RTSI), Online, 6–9 September 2021; IEEE: Piscataway, NJ, USA, 2021; pp. 289–294. [Google Scholar]
  17. Trunfio, T.A.; Scala, A.; Borrelli, A.; Sparano, M.; Triassi, M.; Improta, G. Application of the Lean Six Sigma approach to the study of the LOS of patients who undergo laparoscopic cholecystectomy at the San Giovanni di Dio and Ruggi d’Aragona University Hospital. In Proceedings of the 2021 5th International Conference on Medical and Health Informatics, Kyoto, Japan, 14–16 May 2021. [Google Scholar]
  18. Ponsiglione, A.M.; Ricciardi, C.; Scala, A.; Fiorillo, A.; Sorrentino, A.; Triassi, M.; Improta, G. Application of DMAIC cycle and modeling as tools for health technology assessment in a university hospital. J. Healthc. Eng. 2021, 2021, 1–11. [Google Scholar] [CrossRef]
  19. Scala, A.; Ponsiglione, A.M.; Loperto, I.; Della Vecchia, A.; Borrelli, A.; Russo, G.; Improta, G. Lean six sigma approach for reducing length of hospital stay for patients with femur fracture in a university hospital. Int. J. Environ. Res. Public Health 2021, 18, 2843. [Google Scholar] [CrossRef] [PubMed]
  20. Ferraro, A.; Centobelli, P.; Cerchione, R.; Cicco, M.V.D.; Montella, E.; Raiola, E.; Triassi, M.; Improta, G. Implementation of lean practices to reduce healthcare associated infections. Int. J. Healthc. Technol. Manag. 2020, 18, 51–72. [Google Scholar] [CrossRef]
  21. Cesarelli, G.; Montella, E.; Scala, A.; Raiola, E.; Triassi, M.; Improta, G. DMAIC approach for the reduction of healthcare-associated infections in the neonatal intensive care unit of the university hospital of Naples ‘federico II’. In Proceedings of the European Medical and Biological Engineering Conference, Portorož, Slovenia, 29 November–3 December 2020; Springer: Cham, Switzerland, 2020. [Google Scholar]
  22. Converso, G.; Improta, G.; Mignano, M.; Santillo, L.C. A simulation approach for agile production logic implementation in a hospital emergency unit. In Proceedings of the International Conference on Intelligent Software Methodologies, Tools, and Techniques, Naples, Italy, 15–17 September 2015; Springer: Cham, Switzerland, 2015. [Google Scholar]
  23. Improta, G.; Triassi, M.; Guizzi, G.; Santillo, L.C.; Revetria, R.; Catania, A.; Cassettari, L. An innovative contribution to health technology assessment. In Modern Advances in Intelligent Systems and Tools; Springer: Berlin/Heidelberg, Germany, 2012; pp. 127–131. [Google Scholar]
  24. Improta, G.; Converso, G.; Murino, T.; Gallo, M.; Perrone, A.; Romano, M. Analytic Hierarchy Process (AHP) in dynamic configuration as a tool for Health Technology Assessment (HTA): The case of biosensing optoelectronics in Oncology. Int. J. Inf. Technol. Decis. Mak. (IJITDM) 2019, 18, 1533–1550. [Google Scholar] [CrossRef] [Green Version]
  25. Improta, G.; Simone, T.; Bracale, M. HTA (Health Technology Assessment): A means to reach governance goals and to guide health politics on the topic of clinical Risk management. In Proceedings of the 11th World Congress on Medical Physics and Biomedical Engineering (IUPESM 2009), Munich, Germany, 7–12 September 2009. [Google Scholar]
  26. Oliver, A.; Mossialos, E.; Robinson, R. Health technology assessment and its influence on health-care priority setting. Int. J. Technol. Assess. Health Care 2004, 20, 1–10. [Google Scholar] [CrossRef]
  27. Revetria, R.; Catania, A.; Cassettari, L.; Guizzi, G.; Romano, E.; Murino, T.; Improta, G.; Fujita, H. Improving healthcare using cognitive computing based software: An application in emergency situation. In Advanced Research in Applied Artificial Intelligence; Springer: Berlin/Heidelberg, Germany, 2012; Volume 7345, pp. 477–490. [Google Scholar]
  28. Zhou, X.; Liang, W.; Kevin, I.; Wang, K.; Wang, H.; Yang, L.T.; Jin, Q. Deep-learning-enhanced human activity recognition for Internet of healthcare things. IEEE Internet Things J. 2020, 7, 6429–6438. [Google Scholar] [CrossRef]
  29. Mir, A.; Dhage, S.N. Diabetes disease prediction using machine learning on big data of healthcare. In Proceedings of the 2018 Fourth International Conference on Computing Communication Control and Automation (ICCUBEA), Pune, India, 16–18 August 2018; IEEE: Piscataway, NJ, USA, 2018; pp. 1–6. [Google Scholar]
  30. Waring, J.; Lindvall, C.; Umeton, R. Automated machine learning: Review of the state-of-the-art and opportunities for healthcare. Artif. Intell. Med. 2020, 104, 101822. [Google Scholar] [CrossRef]
  31. Russo, T.; Peluso, V.; Gloria, A.; Oliviero, O.; Rinaldi, L.; Improta, G.; De Santis, R.; D’Antò, V. Combination design of time-dependent magnetic field and magnetic nanocomposites to guide cell behavior. Nanomaterials 2020, 10, 577. [Google Scholar] [CrossRef] [Green Version]
  32. Cesarelli, M.; Romano, M.; Bifulco, P.; Improta, G.; D’Addio, G. Prognostic decision support using symbolic dynamics in CTG monitoring. EFMI-STC 2013, 186, 140–144. [Google Scholar]
  33. Ponsiglione, A.M.; Cosentino, C.; Cesarelli, G.; Amato, F.; Romano, M. A comprehensive review of techniques for processing and analyzing fetal heart rate signals. Sensors 2021, 21, 6136. [Google Scholar] [CrossRef] [PubMed]
  34. Giovanni, I.; Pasquale, N.; Carmela, S.L.; Triassi, M. Health worker monitoring: Kalman-based software design for fault isolation in human breathing. In Proceedings of the European Modeling and Simulation Symposium (EMSS), Bordeaux, France, 22–24 September 2014. [Google Scholar]
  35. Scala, A.; Loperto, I.; Carrano, R.; Federico, S.; Triassi, M.; Improta, G. Assessment of proteinuria level in nephrology patients using a machine learning approach. In Proceedings of the 2021 5th International Conference on Medical and Health Informatics, Kyoto, Japan, 14–16 May 2021. [Google Scholar]
  36. Santini, S.; Pescape, A.; Valente, A.S.; Abate, V.; Improta, G.; Triassi, M.; Ricchi, P.; Filosa, A. Using fuzzy logic for improving clinical daily-care of β-thalassemia patients. In Proceedings of the 2017 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), Naples, Italy, 9–12 July 2017; IEEE: Piscataway, NJ, USA, 2017. [Google Scholar]
  37. Cortesi, P.A.; Castaman, G.; Trifirò, G.; Creazzola, S.S.; Improta, G.; Mazzaglia, G.; Molinari, A.C.; Mantovani, L.G. Cost-effectiveness and budget impact of emicizumab prophylaxis in haemophilia A patients with inhibitors. Thromb. Haemost. 2020, 120, 216–228. [Google Scholar] [CrossRef] [PubMed]
  38. Fucile, P.; Papallo, I.; Improta, G.; De Santis, R.; Gloria, A.; Onofrio, I.; D’Anto, V.; Maietta, S.; Russo, T. Reverse Engineering and Additive Manufacturing towards the design of 3D advanced scaffolds for hard tissue regeneration. In Proceedings of the 2019 II Workshop on Metrology for Industry 4.0 and IoT (MetroInd4. 0&IoT), Naples, Italy, 4–6 June 2019; IEEE: Piscataway, NJ, USA, 2019. [Google Scholar]
  39. Maniscalco, G.; Cerillo, I.; Servillo, G.; Napolitano, M.; Guarcello, G.; Abate, V.; Improta, G.; Florio, C. Early neutropenia with thrombocytopenia following alemtuzumab treatment for multiple sclerosis: Case report and review of literature. Clin. Neurol. Neurosurg. 2018, 175, 134–136. [Google Scholar] [CrossRef]
  40. Ross, L.; Bena, J.; Bermel, R.; McCarter, L.; Ahmed, Z.; Goforth, H.; Cherian, N.; Kriegler, J.; Estemalik, E.; Stanton, M.; et al. Implementation and patient experience with outpatient subspecialty teleneurology visits at a single academic institution over four years. J. Telemed. e-Health, 2019; in press. [Google Scholar]
  41. Moro, E.; Fernandez, H.H. Adaptive neurology in COVID-19 times. Parkinsonism Relat. Disord. 2020, 75, 124–125. [Google Scholar] [CrossRef]
  42. Houghton, A.; Bowling, A.; Jones, I.; Clarke, K. Appropriateness of admission and the last 24 h of hospital care in medical wards in an east London teaching group hospital. Int. J. Qual. Health Care 1996, 8, 543–553. [Google Scholar] [CrossRef] [Green Version]
  43. Coast, J.; Peters, T.J.; Ingles, A. Factors associated with inappropriate emergency hospital admission in the UK. Int. J. Qual. Healthc. 1996, 8, 31–39. [Google Scholar] [CrossRef] [Green Version]
  44. Taylor, R.A.; Moore, C.L.; Cheung, K.H.; Brandt, C. Predicting urinary tract infections in the emergency department with machine learning. PLoS ONE 2018, 13, e0194085. [Google Scholar] [CrossRef]
  45. da Silva, D.A.; Ten Caten, C.S.; Dos Santos, R.P.; Fogliatto, F.S.; Hsuan, J. Predicting the occurrence of surgical site infections using text mining and machine learning. PLoS ONE 2019, 14, e0226272. [Google Scholar] [CrossRef] [Green Version]
  46. Montella, E.; Alfano, R.; Sacco, A.; Bernardo, C.; Ribera, I.; Triassi, M.; Maria Ponsiglione, A. Healthcare associated infections in the neonatal intensive care unit of the “Federico II” university hospital: Statistical analysis and study of risk factors. In Proceedings of the 2021 International Symposium on Biomedical Engineering and Computational Biology, Nanchang, China, 13–15 August 2021; pp. 1–4. [Google Scholar]
  47. Wang, X.; Che, Q.; Ji, X.; Meng, X.; Zhang, L.; Jia, R.; Gao, Y. Correlation between lung infection severity and clinical laboratory indicators in patients with COVID-19: A cross-sectional study based on machine learning. BMC Infect. Dis. 2021, 21, 192. [Google Scholar] [CrossRef]
  48. Rahman, M.; Paul, K.C.; Hossain, A.; Ali, G.G.M.N.; Rahman, S.; Thill, J.-C. Machine learning on the COVID-19 pandemic, human mobility and air quality: A review. IEEE Access 2021, 9, 72420–72450. [Google Scholar] [CrossRef] [PubMed]
  49. Aviles-Rivero, A.I.; Sellars, P.; Schönlieb, C.B.; Papadakis, N. GraphXCOVID: Explainable deep graph diffusion pseudo-labelling for identifying COVID-19 on chest X-rays. Pattern Recognit. 2022, 122, 108274. [Google Scholar] [CrossRef]
  50. La Gatta, V.; Moscato, V.; Postiglione, M.; Sperli, G. An epidemiological neural network exploiting dynamic graph structured data applied to the covid-19 outbreak. IEEE Trans. Big Data 2020, 7, 45–55. [Google Scholar] [CrossRef]
  51. Loperto, I.; Scala, A.; Alfano, R.; Trunfio, T.A.; Giglio, C.; Rossi, G.; Borrelli, A.; Triassi, M.; Improta, G. Appropriate admission in COVID-19 era: The case study of the COU Neurology and Stroke Unit. In Proceedings of the 2021 International Symposium on Biomedical Engineering and Computational Biology, Nanchang, China, 13–15 August 2021. [Google Scholar]
  52. Taner, M.T.; Sezen, B.; Antony, J. An overview of Six Sigma applications in healthcare industry. Int. J. Health Care Qual. Assur. 2007, 20, 329–340. [Google Scholar] [CrossRef]
  53. De Mast, J.; Does, R.J.M.M.; de Koning, H. Lean Six Sigma for Service and Healthcare; Beaumont Quality Publications: Alphen aan den Rijn, The Netherlands, 2006. [Google Scholar]
  54. Nicolay, C.R.; Purkayastha, S.; Greenhalgh, A.; Benn, J.; Chaturvedi, S.; Phillips, N.; Darzi, A. Systematic review of the application of quality improvement methodologies from the manufacturing industry to surgical healthcare. Br. J. Surg. 2012, 99, 324–335. [Google Scholar] [CrossRef]
  55. Moscato, V.; Picariello, A.; Sperlí, G. A benchmark of machine learning approaches for credit score prediction. Expert Syst. Appl. 2021, 165, 113986. [Google Scholar] [CrossRef]
  56. Maseer, Z.K.; Yusof, R.; Bahaman, N.; Mostafa, S.A.; Foozy, C.F.M. Benchmarking of machine learning for anomaly based intrusion detection systems in the CICIDS2017 dataset. IEEE Access 2021, 9, 22351–22370. [Google Scholar] [CrossRef]
  57. La Gatta, V.; Moscato, V.; Pennone, M.; Postiglione, M.; Sperlí, G. Music Recommendation via Hypergraph Embedding. IEEE Trans. Neural Netw. Learn. Syst. 2022, 1–13. [Google Scholar] [CrossRef]
  58. Qayyum, A.; Qadir, J.; Bilal, M.; Al-Fuqaha, A. Secure and robust machine learning for healthcare: A survey. IEEE Rev. Biomed. Eng. 2020, 14, 156–180. [Google Scholar] [CrossRef]
  59. Colella, Y.; De Lauri, C.; Maria Ponsiglione, A.; Giglio, C.; Lombardi, A.; Borrelli, A.; Romano, M. A comparison of different Machine Learning algorithms for predicting the length of hospital stay for pediatric patients. In Proceedings of the 2021 International Symposium on Biomedical Engineering and Computational Biology, Nanchang, China, 13–15 August 2021; pp. 1–4. [Google Scholar]
  60. Picone, I.; Latessa, I.; Fiorillo, A.; Scala, A.; Angela Trunfio, T.; Triassi, M. Predicting length of stay using regression and Machine Learning models in Intensive Care Unit: A pilot study. In Proceedings of the 2021 11th International Conference on Biomedical Engineering and Technology, Tokyo, Japan, 17–20 March 2021; pp. 52–58. [Google Scholar]
  61. De Felice, F.; Polimeni, A. Coronavirus disease (COVID-19): A machine learning bibliometric analysis. In Vivo 2020, 34 (Suppl. 3), 1613–1617. [Google Scholar] [CrossRef]
  62. Profeta, M.; Maria Ponsiglione, A.; Ponsiglione, C.; Ferrucci, G.; Giglio, C.; Borrell, A. Comparison of machine learning algorithms to predict length of hospital stay in patients undergoing heart bypass surgery. In Proceedings of the 2021 International Symposium on Biomedical Engineering and Computational Biology, Nanchang, China, 13–15 August 2021; pp. 1–5. [Google Scholar]
  63. Kwekha-Rashid, A.S.; Abduljabbar, H.N.; Alhayani, B. Coronavirus disease (COVID-19) cases analysis using machine-learning applications. Appl. Nanosci. 2021, 1–13. [Google Scholar] [CrossRef] [PubMed]
  64. Zedde, M.; Pezzella, F.R.; Paciaroni, M.; Corea, F.; Reale, N.; Toni, D.; Caso, V. Stroke care in Italy: An overview of strategies to manage acute stroke in COVID-19 time. Eur. Stroke J. 2020, 5, 222–229. [Google Scholar] [CrossRef] [PubMed]
  65. Wang, J.; Chaudhry, S.A.; Tahsili-Fahadan, P.; Altaweel, L.R.; Bashir, S.; Bahiru, Z.; Qureshi, A.I. The impact of COVID-19 on acute ischemic stroke admissions: Analysis from a community-based tertiary care center. J. Stroke Cerebrovasc. Dis. 2020, 29, 105344. [Google Scholar] [CrossRef] [PubMed]
  66. Butt, A.A.; Kartha, A.B.; Masoodi, N.A.; Azad, A.M.; Asaad, N.A.; Alhomsi, M.U.; Abou-Samra, A.B. Hospital admission rates, length of stay, and in-hospital mortality for common acute care conditions in COVID-19 vs. pre-COVID-19 era. Public Health 2020, 189, 6–11. [Google Scholar] [CrossRef]
  67. Studer, B.; Roukens, R.; Happe, S.; Schmidt, S.B.; Knecht, S. COVID-19 Reveals Opportunities for Better Care of Stroke Patients: Direct Transfer to Postacute Rehabilitation, Reduction in Length of Stay, and Treatment Outcomes. Dtsch. Ärzteblatt Int. 2021, 118, 346. [Google Scholar]
Figure 1. Overall flow of the proposed analysis from the patient’s point of view based on machine learning models.
Figure 1. Overall flow of the proposed analysis from the patient’s point of view based on machine learning models.
Ijerph 19 05215 g001
Figure 2. Pareto diagram of LOS (2018, 2019).
Figure 2. Pareto diagram of LOS (2018, 2019).
Ijerph 19 05215 g002
Figure 3. Pareto diagram of number of hospital admissions (2018, 2019).
Figure 3. Pareto diagram of number of hospital admissions (2018, 2019).
Ijerph 19 05215 g003
Figure 4. DRG relative weight (2018, 2019).
Figure 4. DRG relative weight (2018, 2019).
Ijerph 19 05215 g004
Figure 5. The run chart of total LOS for stroke patients before COVID-19. The orange line indicates the average value of 11.19 days.
Figure 5. The run chart of total LOS for stroke patients before COVID-19. The orange line indicates the average value of 11.19 days.
Ijerph 19 05215 g005
Figure 6. Pareto diagram of LOS (2020, 2021).
Figure 6. Pareto diagram of LOS (2020, 2021).
Ijerph 19 05215 g006
Figure 7. Pareto diagram of number of DH admission (2020, 2021).
Figure 7. Pareto diagram of number of DH admission (2020, 2021).
Ijerph 19 05215 g007
Figure 8. DRG relative weight (2020, 2021).
Figure 8. DRG relative weight (2020, 2021).
Ijerph 19 05215 g008
Figure 9. Box plot of LOS (2018–2019 vs. 2020–2021).
Figure 9. Box plot of LOS (2018–2019 vs. 2020–2021).
Ijerph 19 05215 g009
Figure 10. Box plot of number of DH admissions (2018–2019 vs. 2020–2021).
Figure 10. Box plot of number of DH admissions (2018–2019 vs. 2020–2021).
Ijerph 19 05215 g010
Figure 11. A run chart of total LOS for stroke patients during the COVID-19 pandemic. The orange line indicates the average value of 10.27 days.
Figure 11. A run chart of total LOS for stroke patients during the COVID-19 pandemic. The orange line indicates the average value of 10.27 days.
Ijerph 19 05215 g011
Figure 12. Correlation analysis.
Figure 12. Correlation analysis.
Ijerph 19 05215 g012
Figure 13. SVM permutation importance.
Figure 13. SVM permutation importance.
Ijerph 19 05215 g013
Table 1. Project chart.
Table 1. Project chart.
Project Title: Lean Six Sigma to Assess How COVID-19 Has Changed the Complex Operative Unit of the Neurology and Stroke Unit Patients’ Management: A Single Center Study.
Question: The inappropriate prolongation of hospital stays.
CTQ: LOS (Length of stay), mode of discharge and DRG relative weight.
Target: To realize corrective measures in order to reduce the CTQ.
Timeline:
Define—January 2018–February 2018
Measure—March 2018–February 2020
Analyze—February 2020–8 March 2020
Improve—8 March 2020–December 2020
Control—31 December 2021
Table 2. SIPOC for the Neurological Clinic and Stroke Unit.
Table 2. SIPOC for the Neurological Clinic and Stroke Unit.
Supplier:
Neurological Clinic and Stroke Unit of San Giovanni di Dio e Ruggi d’Aragona University Hospital
Input:
Hospital Services
Process:
Care Process
(Administration
Services)
Output:
Diagnostic and
Therapeutic
Information
Customers:
Patients at
San Giovanni di Dio e Ruggi d’Aragona University Hospital
Table 3. Study population features.
Table 3. Study population features.
Features2018
(N = 1239)
2019
(N = 1287)
2020
(N = 1148)
2021
(N = 896)
Gender
M627655612462
F612632536434
Age
Age ≤ 50262252256190
50 < Age ≤ 70478477463344
Age > 70499558429362
Mode of discharge:
Deceased39604748
Ordinary at home109711151002747
Protected in non-hospital facilities1-12
Home hospitalization----
Voluntary56443322
Transferred to another hospital672120
Transferred to another regime in the same institution10121421
Transferred to rehabilitation institute24482832
Protected with Integrated Home Assistance activation6124
DRG relative weight
Mean1.101.201.271.44
Number of hospital admissions *
Mean5.384.283.804.42
Length of stay, LOS **
Mean10.5310.8310.6711.18
* Only for 1610 patients with day hospital admissions. ** Only for 2971 hospitalized patients.
Table 4. New proposal for the COVID-19 emergency.
Table 4. New proposal for the COVID-19 emergency.
New Proposals for the Management of the COU of the Neurology and Stroke Unit during the COVID-19 Emergency
Improve education of health professionals and the public during the pandemic
  • Stroke is an emergency, and treatment is available. The benefit of being treated for life-threatening disease far outweighs the risk of being infected with COVID-19.
  • High-standard treatment is guaranteed during the pandemic.
  • Stroke patients will be managed under a “protected stroke code” to avoid infection.
Set up telestroke networks
  • Implementing the existing telestroke networks and avoiding futile transports.
  • Starting telestroke pathways from the patient’s home, employing territorial emergency doctors and nurses who carry out evaluations, so as to eliminate any contact with the disease and the possibility of contagion.
  • Using telemedicine at an in-hospital level to evaluate patients who are suspected of having an acute neurological pathology in the COVID units.
Reorganize stroke pathways with a “protected stroke code”
  • Evaluating patients with unknown COVID-19 status under a “protected stroke code” with appropriate personal protective equipment.
Facilitating new stroke treatment options
Table 5. Logistic regression—Hospitalized patients.
Table 5. Logistic regression—Hospitalized patients.
Exp(B)95% C.I. for EXP(B)p-Value
LowerUpper
Gender, Male1.0810.9291.2560.314
Age0.9990.9951.0040.773
DRG relative weight1.4371.3231.5620.000
Length of stay (LOS)0.9850.9750.9960.006
Mode of discharge
Deceased0.8790.2642.9230.833
Ordinary at home0.7140.2222.2940.572
Protected in non-hospital facilities4.9130.37164.9940.227
Home hospitalization0.5880.1741.9860.393
Voluntary3.0040.80011.2810.103
Transferred to another hospital9.2901.44059.9310.019
Transferred to another regime in the same institution0.7400.2192.4980.628
Table 6. Logistic regression—Patients with DH admissions.
Table 6. Logistic regression—Patients with DH admissions.
Exp(B)95% C.I. for EXP(B)p-Value
LowerUpper
Gender, Male1.1110.9101.3560.301
Age0.9920.9860.9980.011
DRG relative weight5.3692.67910.7630.000
Number of DH admissions0.9780.9610.9970.020
Table 7. Statistical analysis.
Table 7. Statistical analysis.
Group 1 (2018–2019)Group 2 (2020–2021)p-Value
Mean ± Dev. StdMedianMean ± Dev. StdMedian
Gender----0.101
Age64.03 ± 17.8667.0063.17 ± 17.4766.000.169
Number of DH admissions *4.72 ± 7.803.004.08 ± 3.723.000.640
Length of stay (LOS) **10.68 ± 7.989.0010.89 ± 8.309.000.251
DRG relative weight1.15 ± 0.720.9131.35 ± 1.020.9100.000
Mode of discharge----0.000
* Only patients with day hospital admissions. ** Only hospitalized patients are considered.
Table 8. Statistics analysis—Stroke patients.
Table 8. Statistics analysis—Stroke patients.
Class 1 (2019)
N = 650
Class 2 (2020)
N = 338
p-Value
Age
Mean74.0973.220.133
Gender
Male 0.343
Male339187
Female311151
Hypertension
No5182640.560
Yes13274
Atrial Fibrillation
No4992760.076
Yes15162
Atherosclerosis
No5662790.055
Yes8459
LOS
Mean11.1910.270.037
Table 9. Logistic regression—Stroke patients.
Table 9. Logistic regression—Stroke patients.
OR95% CIp-Value
Gender, Male0.9980.987–1.0090.673
Age1.0850.824–1.4280.563
Hypertension (No)0.9250.665–1.2880.645
Atrial Fibrillation (No)1.2420.870–1.7740.232
Atherosclerosis0.6910.477–1.0000.050
Length of stay (LOS)0.9760.955–0.9990.037
Table 10. Performance metrics of all selected models in the test set.
Table 10. Performance metrics of all selected models in the test set.
Performance MetricsClassDTGBTRFSVMLR
Accuracy Overall0.720.640.720.800.52
Precision10.610.650.810.820.52
20.840.630.670.780.52
Recall 10.790.590.570.760.50
20.680.680.870.840.55
F-measure 10.690.620.670.790.51
20.750.650.760.810.53
Table 11. SVM confusion matrix.
Table 11. SVM confusion matrix.
Class12
19931
221109
Table 12. Hyperparameters for SVM.
Table 12. Hyperparameters for SVM.
ParameterValue
KernelRBF
C1
Gamma1
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Improta, G.; Borrelli, A.; Triassi, M. Machine Learning and Lean Six Sigma to Assess How COVID-19 Has Changed the Patient Management of the Complex Operative Unit of Neurology and Stroke Unit: A Single Center Study. Int. J. Environ. Res. Public Health 2022, 19, 5215. https://doi.org/10.3390/ijerph19095215

AMA Style

Improta G, Borrelli A, Triassi M. Machine Learning and Lean Six Sigma to Assess How COVID-19 Has Changed the Patient Management of the Complex Operative Unit of Neurology and Stroke Unit: A Single Center Study. International Journal of Environmental Research and Public Health. 2022; 19(9):5215. https://doi.org/10.3390/ijerph19095215

Chicago/Turabian Style

Improta, Giovanni, Anna Borrelli, and Maria Triassi. 2022. "Machine Learning and Lean Six Sigma to Assess How COVID-19 Has Changed the Patient Management of the Complex Operative Unit of Neurology and Stroke Unit: A Single Center Study" International Journal of Environmental Research and Public Health 19, no. 9: 5215. https://doi.org/10.3390/ijerph19095215

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop