Next Article in Journal
Personal Care and Household Cleaning Product Use among Pregnant Women and New Mothers during the COVID-19 Pandemic
Next Article in Special Issue
Assessment of Infection Prevention and Control Measures at Points of Entry in Sierra Leone in 2021: A Cross-Sectional Study
Previous Article in Journal
The Moral, Ethical, Personal, and Professional Challenges Faced by Physicians during the COVID-19 Pandemic
Previous Article in Special Issue
Bacterial Isolates and Antibiotic Resistance of Escherichia coli Isolated from Fresh Poultry Excreta Used for Vegetable Farming in Freetown, Sierra Leone
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Achieving Minimum Standards for Infection Prevention and Control in Sierra Leone: Urgent Need for a Quantum Leap in Progress in the COVID-19 Era!

1
World Health Organization Country Office, 21A-B Riverside Drive, Brookfields, Freetown 00232, Sierra Leone
2
Tuberculosis Research and Prevention Center (TBRPC), Yerevan 0014, Armenia
3
National Infection Prevention and Control Coordinating Unit, Ministry of Health and Sanitation, Freetown 00232, Sierra Leone
4
Centre for Operational Research, International Union against Tuberculosis and Lung Disease, 75001 Paris, France
5
Directorate of Health Security and Emergencies, Ministry of Health and Sanitation, Freetown 00232, Sierra Leone
6
College of Medicine and Allied Health Sciences, University of Sierra Leone, Freetown 00232, Sierra Leone
7
Institute of Global Health and Development, Queen Margaret University, Edinburgh EH21 6UU, UK
8
Department of Medicine, University of Sierra Leone Teaching Hospitals Complex, Freetown 00232, Sierra Leone
9
Water, Sanitation, and Hygiene (WASH) Program, Ministry of Health and Sanitation, Freetown 00232, Sierra Leone
10
Médecins Sans Frontières, Operational Centre Brussels, 68, Rue de Gasperich, 1617 Luxembourg, Belgium
11
UNICEF, UNDP, World Bank, WHO Special Programme for Research and Training in Tropical Diseases (TDR), Avenue Appia 20, 1211 Geneva, Switzerland
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(9), 5642; https://doi.org/10.3390/ijerph19095642
Submission received: 15 February 2022 / Revised: 11 April 2022 / Accepted: 20 April 2022 / Published: 6 May 2022

Abstract

:
Introduction: Good Infection prevention and control (IPC) is vital for tackling antimicrobial resistance and limiting health care-associated infections. We compared IPC performance before (2019) and during the COVID-19 (2021) era at the national IPC unit and all regional (4) and district hospitals (8) in Sierra Leone. Methods: Cross-sectional assessments using standardized World Health Organizations IPC checklists. IPC performance scores were graded as inadequate = 0–25%, basic = 25.1–50%, intermediate = 50.1–75%, and advanced = 75.1–100%. Results: Overall performance improved from ‘basic’ to ‘intermediate’ at the national IPC unit (41% in 2019 to 58% in 2021) and at regional hospitals (37% in 2019 to 54% in 2021) but remained ‘basic’ at district hospitals (37% in 2019 to 50% in 2021). Priority gaps at the national IPC unit included lack of: a dedicated IPC budget, monitoring the effectiveness of IPC trainings and health care-associated infection surveillance. Gaps at hospitals included no assessment of hospital staffing needs, inadequate infrastructure for IPC and lack of a well-defined monitoring plan with clear goals, targets and activities. Conclusion: Although there is encouraging progress in IPC performance, it is slower than desired in light of the COVID-19 pandemic. There is urgent need to mobilize political will, leadership and resources and make a quantum leap forward.

1. Introduction

Infection prevention and control (IPC) at health facilities is a scientific approach and practical solution to prevent infection and harm to patients and health workers [1]. IPC is a central pillar of health system resilience and contributes to the quality of universal health coverage, since it is relevant to health workers, patients and visitors at every health-care encounter [2]. Importantly, it is fundamental to reducing health care-associated infections (HAIs) [3].
In general, many commonly used IPC measures are resource-intensive, including the use of single-occupancy hospital isolation rooms and single-use personal protective equipment (PPE) [4]. In resource-constrained settings (LMICs), limited availability of these resources and limited staffing may pose challenges. Lack of adequate training, limited microbiological services, and other competing health priorities (e.g., COVID-19) may compromise the implementation of effective IPC programme [5]. In LMICs, poor sanitation, lack of health literacy and resource shortages are just few of the many obstacles that confront when tasked with infectious disease outbreaks.
A systematic review assessing HAIs in Low- and Middle-Income Countries (LMICS) reported a pooled prevalence of 15.5 per 100 patients which is about three-fold higher than in high-income countries [5]. Such infections result in prolonged hospital stays, high costs to patients, and avoidable deaths of patients and health workers [6]. The high prevalence of HAIs in LMICS is a ‘proxy’ of inadequate IPC that needs to be strengthened. A systematic review reported that about 35% to 55% of HAIs can be averted through multifaceted interventions aimed at controlling and preventing infections [7]. IPC is also one of the strategic priorities of the global and national action plans for tackling antimicrobial resistance (AMR) [8]. The logic being that ‘every infection prevented is an antibiotic treatment avoided’ [9].
In countries such as Sierra Leone, achieving minimum IPC standards is paramount to prevent the transmission of infectious diseases that pose global threats, such as pandemic influenza, Ebola virus disease (EVD), other viral haemorrhagic fevers and of recent concern, COVID-19. The country was badly hit by the 2014–2015 EVD outbreak in West Africa, with over 14,000 reported cases and 3955 EVD deaths including those of 221 health workers [10,11]. The rapid transmission of EVD in the country, especially among healthcare workers, was attributed to poor IPC infrastructure and inadequate IPC practices prior to the outbreak.
Recognizing the importance of IPC, the World Health Organization (WHO) developed minimum IPC standards that should be in place in all health facilities [3]. This includes checklists to assess IPC performance at the national IPC unit (Instructions for the National Infection Prevention and Control Assessment, IPCAT) [12] and at health facility levels (Infection Prevention and Control at Facility Level, IPCAF) [13]. These checklists are closed-formatted questionnaires with an associated scoring system that allows grading of IPC into levels, namely: inadequate, basic, intermediate or advanced. They are useful for baseline assessments of IPC status, which can be followed over time by repeated assessments to document progress and facilitate improvements. Most of the published studies in the Africa region have used country specific checklists for IPC performance assessments and were conducted in pre-COVID era [14,15,16].
In Sierra Leone, there has been one study on IPC performance assessment from Kenema district, which used the Ministry of Health of Sierra Leone (MOHS) assessment checklist. The study showed that IPC compliance at the district hospital increased from 69% in 2016 to 73% in 2018 (expected minimal threshold = 70%; desired threshold ≥ 85%) [17]. There has, however, been no published study from Sierra Leone or the African region that has assessed IPC implementation at the national IPC unit and in public health facilities, using the WHO assessment checklists (IPACT and IPACF).
A country-wide IPC performance assessment of the national IPC unit and secondary/tertiary health facilities using WHO checklists was conducted in 2021 in the COVID-19 era. Since a similar IPC assessment was conducted in 2019, this provides an opportunity to assess how far we have come from the pre-COVID-19 era. Such information could help the IPC programme managers to identify the areas of concern (gaps) and catalyse action for improvement.
During the COVID-19 pandemic, there was additional emphasis on improving IPC practices [4]. However, there were no published studies globally on how IPC performance changed in the health facilities with the advent of the COVID-19 pandemic. Thus, we aimed to assess the change in the IPC scores (performance) using WHO checklists, in 2019 (pre-COVID-19 era) and 2021 (COVID-19 era) at the national IPC unit and public health facilities. We also identified the gaps in specific components of IPC implementation.

2. Materials and Methods

2.1. Study Design

This was a before (pre-COVID-2019) and after (COVID-19 era-2021) comparison of the data from the cross-sectional IPC assessments conducted routinely by the IPC programme of Sierra Leone.

2.2. Study Setting

2.2.1. General Setting

Sierra Leone is a tropical country on the Atlantic coast of West Africa lying between Guinea and Liberia. It is divided into 16 districts with five regions, and has an estimated population of about 8 million people [18]. Public healthcare facilities are tiered into tertiary hospitals (6), regional hospitals (4), district hospitals (8), other secondary hospitals (11) and Peripheral Health Units (PHUs). The PHUs include Community Health Centres, Community Health Posts, and Maternal and Child Health Posts. The PHUs are delivery points for primary health care while hospitals deliver secondary and/or tertiary health care [19].
Sierra Leone struggled through a decade of civil war (1991 to 2002) that devastated its health infrastructure. The country has faced a series of infectious disease outbreaks of pandemic influenza, EVD, other viral haemorrhagic fevers and of recent, COVID-19. Recently, Lassa fever, a highly fatal, viral-haemorrhagic disease, is another public health threat in Sierra Leone that also requires high compliance to IPC standards. The advent of the COVID-19 pandemic and growing threats of AMR in resource-limited settings such as Sierra Leone further emphasize the importance of IPC and its monitoring.
Since Sierra Leone recorded it first case of COVID-19 in March 2020, a national COVID-19 emergency response structure (NACOVERC) and district COVID-19 emergency response centres (DECOVERC) were established with clear terms of reference to provide oversight and strategize the overall COVID-19 response activities. Members of these structures included state security and Ministry of Health personnel across all level of health sector, with IPC being one of the technical pillars within the structures.

2.2.2. Specific Setting

The 2014–2015 EVD outbreak drew attention to the gaps in IPC, leading to the establishment in 2015 of a national IPC unit housed at the MOHS and supported by WHO and other public health partners. This unit is mandated to provide leadership as well as to coordinate, train and supervise the implementation and strengthening of all IPC standards countrywide. It has one national IPC coordinator and seven supporting IPC officers. This team performs routine field supervisory visits to all public health facilities and is also responsible for filling up the IPC checklists on an annual basis.
At regional hospital level, all IPC activities are coordinated by designated IPC personnel. At district level, IPC district committees and IPC supervisors are responsible for implementation of the National IPC Policy and Guidelines. Each healthcare facility has an IPC focal person. These individuals are charged with coordinating IPC activities at various levels.
The WHO country office provides technical support through an IPC support team and resource support to the national IPC unit and to health care facilities (for example the local production of alcohol-based hand-rub solutions). The IPC team from WHO works in close collaboration with the national IPC unit of Sierra Leone.
At various levels, the IPC programs have its responsible personnel/body who is accountable for action points and addressing the existing gaps in IPC. The figure below shows the structural arrangement of IPC program in Sierra Leone (Figure 1).

The WHO Checklists for IPC Assessments

The country uses WHO checklists for assessment of IPC standards at the national IPC unit (IPCAT) [12], and at health facilities (IPCAF) [13]. These checklists are standardized, closed-formatted questionnaires with an associated scoring system. They are developed based on the WHO guideline on “Core Components of Infection Prevention and Control at the National and Acute Health Care Facility Levels” [3].
The eight core components included in the IPCAF (for health facilities) checklist are: (1) IPC programme, (2) IPC guidelines, (3) IPC education and training, (4) HAI surveillance, (5) multimodal strategies for implementation of IPC interventions, (6) monitoring/audit of IPC practices and feedback, (7) workload, staffing and bed occupancy and (8) built environment, materials and equipment for IPC. The IPCAF checklist has a total score of 800 with eight core components and 81 indicators [13].
The IPCAT checklist (for the national IPC programme unit) includes the first six of the above-mentioned components. The IPCAT checklist has a total of 112 indicators framed into yes/no response options [12]. A percentage score is calculated based on the total number of ‘yes’ responses. For the IPCAT, a single element is either fully implemented (yes) or not (no). The IPCAF checklist is in a paper-based format and the IPCAT is available in excel format with automated formulas for calculating scores and percentages. The scale and scoring of IPCAF and IPCAT is shown in Supplementary Files S1 and S2.

2.3. Study Inclusion and Period

The study included data from assessment of the national IPC unit and four regional and eight district hospitals of Sierra Leone. These regional and district hospitals were located in four provincial regions of Sierra Leone, namely the Northern, Southern, Eastern, and North-Western regions. The IPC performance assessment of 2019 was conducted in the months of May and July, while the 2021 assessment was conducted in June and July.

2.4. Data Collection, Variables and Sources

2.4.1. Data Collection and Entry

Data for the 2019 annual IPC assessment were already available in the paper-based checklists (hard-copies). Data for the 2021 annual assessment were collected by the IPC team using the same paper-based checklists and in the same routine manner as in 2019. The data from each paper-based checklist were entered into a customized excel database developed by the WHO for calculating scores of IPCAT and IPCAF per assessed facility. The calculated scores from assessment of the national IPC unit, four regional hospitals and eight district hospitals were merged into one excel database for further analysis.

2.4.2. Data Variables

To assess the change in minimum IPC scores at the level of the national IPC unit between 2019 (pre-COVID-19) and 2021 (COVID-19 era), the year, the list of indicators and scores in the six core components of the IPCAT tool were included. Similarly, to compare the change in minimum IPC scores at four regional and eight district hospitals, the year, the name of the assessed facility and list of indicators and scores in the eight core components of the IPCAF tool were included.

2.5. Statistical Analysis

Every component of the IPCAT and IPCAF tool contributes a score of 100 with a maximum total score of 600 for IPCAT (six core components) and 800 for IPCAF (eight ore components). Based on the score obtained for each component and subcomponent, a percentage score was calculated (score obtained divided by maximum component score multiplied by 100). IPC performances in each core component and subcomponent were graded based on the obtained percentage: (i) inadequate (0–25%), (ii) basic (25.1–50%), (iii) intermediate (50.1–75%), and (iv) advanced (75.1–100%). The median scores for regional and district hospitals were calculated for summarizing the IPC scores of the four regional and eight district hospitals. The percentage change in the IPC scores between 2019 and 2021 were calculated for each core component by subtracting the percentage score of 2019 from the percentage score of 2021. Radar charts were used to depict the percentage scores in the core components at the national IPC unit, regional hospitals and district hospitals during the 2019 and 2021 assessments. IPCAT and IPCAF sub-components with inadequate scores (≤25%) were considered as gaps and were listed.

3. Results

3.1. Assessment of National IPC Unit Using IPCAT

3.1.1. Change in IPC Scores from 2019 to 2021

The overall grade improved from ‘basic’ (41%) to ‘intermediate’ (58%) with ‘IPC guidelines’ reaching the ‘advanced’ level. The highest improvement was seen in ‘IPC education and training’ (44% change) while the lowest was in ‘HAI surveillance’ (8% change) and ‘monitoring/audits of IPC practices and feedback’ (5% change). The ‘multi-modal strategies’ remained at the ‘basic’ level during both assessments (Table 1 and Figure 2).

3.1.2. Gaps in the IPCAT Sub-Components at National IPC Unit

The percentage scores of the IPCAT sub-components in 2019 and 2021 are presented in Table 2. In 2021, the five sub-components that reached 100% were under ‘IPC Guideline’, ‘IPC education and training’ and ‘multimodal strategies’. In 2021, the sub-components with inadequate scores (≤25%, gaps) are highlighted in red colour and include ‘monitoring of training and education’, sub-components under the ‘HAI surveillance’ and ‘multimodal strategies’. Not having a dedicated budget was one of the gaps noted under the IPC programme (IPCAT2–1.1.7).

3.2. Assessment of Regional and District Hospital Using IPCAF

3.2.1. Change in IPC Scores in Regional Hospitals from 2019 to 2021

In the regional hospitals (N = 4), the overall grade improved from ‘basic’ (37%) to ‘intermediate’ level (54%). The ‘IPC education and training’ reached ‘advanced’ level by 2021. The highest increase in scores was seen in the ‘HAI surveillance’ component (40% change), but this still remained at the ‘basic’ level. The least increase in percentage scores was seen in the ‘workload, staffing and bed occupancy’ (5% change), and was at a ‘basic’ level. (Table 3 and Figure 3) The cumulative scores and component scores increased in all the four regional hospitals between 2019 and 2021 (Supplementary Table S1).

3.2.2. Change in IPC Scores in District Hospitals from 2019 to 2021

In the district hospitals (N = 8), the overall IPC grade remained at ‘basic’ level. The highest increases in the percentage scores were seen in the ‘HAI surveillance’ component (45% change) and ‘IPC education and training’ (20% change). Less than 5% increase in the percentage scores were seen in the ‘workload, staffing and bed occupancy’ (3% change) and ‘built environment, materials and equipment for IPC at the facility level’ (4% change) components. (Table 3 and Figure 4) The cumulative scores and component scores increased in all the eight district hospitals between 2019 and 2021 (Supplementary Table S2).

3.2.3. Gaps in the IPCAF Sub-Components at Regional and District Hospitals

The median percentage scores and gaps in the sub-components identified in 2021 at regional and district hospitals are shown in Table 4. Five sub-components in the regional hospitals and three sub-components in the district hospitals achieved 100% scores. Six sub-components had inadequate scores (≤25%) in the regional hospitals and eight had inadequate scores (≤25%) in the district hospitals. The sub-components with zero scores in both regional and district hospitals included: ‘a multidisciplinary team for implementing IPC multimodal strategies’; ‘a well-defined monitoring plan with clear goals, targets and activities’; and ‘senior facility leadership commitment and support for the IPC programme: by allocated budget specifically for the IPC activities’. Additionally, ‘assessment of hospital staffing needs’ had a zero score in the district hospitals. ‘Expertise in IPC/infectious disease to develop or adapt guidelines’ and “HAI surveillance performed” were also gaps in the district hospitals.

4. Discussion

This first country-wide assessment of IPC performance in the COVID era showed that IPC grades improved to ‘intermediate’ (51–75%) level at the national programme unit and at regional hospitals, but remained ‘basic’ (25–50%) at district hospitals. Although this reflects progress, the findings serve as an urgent call for a quantum jump in improving IPC performance, with a particular focus on district hospitals. The priority gaps at the national IPC unit were HAI surveillance, while at hospitals it was on assessment of hospital staffing needs and built environment (infrastructure), materials and equipment for IPC implementation.
The findings are important as they add contextual justification for the recent (2022) call by the WHO Director-General to prioritize IPC as a cornerstone of health system strengthening and universal health coverage [20]. Furthermore, optimal IPC implementation and monitoring is relevant to meeting the Sustainable Development Goals (targets 3.1 to 3.3 and 3.8, and those of Goal 6), especially that focused on reducing AMR (3.d.2) [21].
The recent revelation of five million annual global AMR deaths also re-emphasizes the importance of IPC [22]. The notion that ‘every infection prevented is an antibiotic treatment avoided, and possibly a death averted’ is now more relevant, particularly to Western sub-Saharan African countries such as Sierra Leone, which have a higher risk of AMR deaths.
The study had several strengths. First, it was country-wide involving simultaneous assessment of both the national IPC unit and the regional and district hospitals, and the findings are therefore likely to reflect operational realities and are generalizable. Second, the subject matter is an identified national operational research priority, which favours the potential for research uptake. Third, we used standardized WHO checklists and all assessments were carried out by the same external set of well-trained staff, thus limiting observer bias. Finally, we also adhered to the STROBE (Strengthening the Reporting of Observational Studies in Epidemiology) guidelines for the conduct and reporting of observational studies [23].
One of the study limitations was that we did not include private hospitals, which can be carried out in future research. Another limitation is that we did not include in-depth qualitative explorations to better understand the reasons for identified gaps. In future, mixed-methods research would be merited.
There are several policy and practice implications from the study findings. First, it is encouraging that Sierra Leone has a functional national IPC programme, which 55% of low-income countries were yet to achieve by 2018 [24]. The country also achieved a similar status at health facilities, which is in contrast with the observations reported from Ghana [25] and Uganda [16]. However, the overall progress in IPC implementation between 2019 and 2021 has been slower than desired. This may be explained by the fact that although the IPC programme in Sierra Leone is functioning within a clearly defined scope of responsibilities (policy, action plan, and framework for implementation) and dedicated professionals [11,26], it does not have a dedicated budget. Advocacy is needed to ensure dedicated resources for IPC at national and facility levels.
Second, an IPC guideline is now available in the COVID-19 era, with emphasis on the WHO core components, AMR and outbreak management. This document provides a framework for further improvement of the IPC programme and also galvanizes the development of health facility specific guidelines. The latter is an identified gap area due to lack of facility-level expertise (expertise currently at 13% in district hospitals and 50% in regional hospitals). The way forward would be to prioritize expert mentorship and dedicated time to facility-level IPC staff so that they understand and can implement the content of this guiding document. There is also a need to utilize the existing monitoring framework with clear goals, targets and activities in both regional and district hospitals (an identified gap).
Third, the national IPC programme unit conceived a national curriculum for IPC training and education (2020) and supported the training of at least one lead trainer per facility. These efforts reflected positively in the performance of “IPC education and training”, with regional hospitals reaching ‘advanced’ (83%) level and district hospitals moving to the doorstep of ‘advanced’ (75%) grades. This progress was catalysed by the trainings conducted during the initial phase of the COVID-19 pandemic and might explain why healthcare workers were found to be adherent to COVID-19 safe practices (regularly washing or sanitizing their hands and use of facemasks at point of care) [27]. However, a gap area on ‘monitoring the abilities of those trained to implement their acquired knowledge’ can be bridged through routine national level surveys on IPC practices and knowledge among healthcare workers.
Fourth, as in other low-income countries [24], the HAI surveillance remained at a ‘Basic’ grade in Sierra Leone. The national IPC programme was sucked into a ‘chicken and egg’ situation by formulating HAI surveillance objectives in the face of poor or non-existent access to microbiological laboratories—access to laboratories is an important requirement for surveillance. This was despite substantial improvements made in all the regional (40% increase) and district hospitals (45% increase) in surgical site infection (SSI) surveillance based on clinical assessments. This ongoing activity sets the pace for further improvement in HAI surveillance when access to microbiological laboratories becomes a reality through the Fleming fund grant to Sierra Leone [28].
Fifth, health care staff availability assessments according to the national norms on patient/staff ratios are important to optimize IPC implementation. Sierra Leone has a huge deficit in the health workforce (73%), worsened by the deaths of healthcare workers during the 2014–2015 EVD outbreak [29]. A previous study on IPC compliance also highlighted the deficiency of the healthcare workforce, including sanitary workers, and this needs to be addressed [17]. There is also a need to bridge the rhetoric of addressing the human resource gap by acquiring ‘hands-on deck’ to do the job.
Finally, the built environment (infrastructure) should have reached the ‘advanced’ level, but this has been a thorn in the flesh since the pre-COVID era [17]. Undeniably, IPC implementation is dependent on the availability of safe and sufficient water, adequate numbers of functional toilet facilities, facilities for sterilization, and waste disposal systems (e.g., functional incinerators). This also remains a challenge in other countries such as Kenya and Malawi [30,31]. Further, the availability of consumables such as soap, alcohol-based hand rub and Personal Protective Equipment (PPE) kits have remained scarce in Sierra Leone [27] as reported from several other settings [32,33].
The progress made in IPC program at national level also had a corresponding effect on hospital IPC programs. This will then give a good recommendation for countries with similar health system to strengthen the national IPC program objectives and descend at subnational level.

5. Conclusions

Although there has been encouraging improvements in IPC implementation country-wide, the progress between 2019 and 2021 has been slower than desired, with the current overall status ranging from ‘basic’ to ‘intermediate’. In light of the current COVID-19 pandemic and endemic infectious disease outbreaks in Sierra Leone, a more rapid pace of progress is needed in IPC implementation. This will depend on successful mobilization of political will, leadership, resources and accountability. It is high-time to take that leap forward.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/ijerph19095642/s1, Table S1: Percentage scores of the core components of IPCAF in four regional hospitals of Sierra Leone during 2019 (pre-COVID-19) and 2021 (COVID-19 era) assessment; Table S2: Percentage scores of the core components of IPCAF in eight district hospitals of Sierra Leone during 2019 (pre-COVID-19) and 2021 (COVID-19 era). Supplementary File S1: The details of IPCAF tool with associated scale and scorings, Supplementary File S2: the details of IPCT tool with associated scale and scorings.

Author Contributions

Conceptualization, B.D.F., A.M., I.F.K. and R.Z.; methodology, B.D.F., A.A., R.Z. and P.T.; validation, B.D.F., P.T., V.H., A.A., I.F.K., A.M. and R.Z.; formal analysis, B.D.F., P.T., A.A., V.H. and R.Z.; investigation, B.D.F., C.K., I.F.K. and A.M.; resources, B.D.F., R.Z., P.T., V.H., A.A., A.M., J.S.S., A.J.B. and I.F.K.; data curation, B.D.F., A.M., I.F.K., C.K., P.T. and A.J.B.; writing—original draft preparation, B.D.F., R.Z., A.A., V.H. and P.T.; writing—review and editing, B.D.F., A.M., I.F.K., C.K., C.K.N., A.J.B., J.S.S., J.S.K., S.L. and D.K.; visualization, B.D.F., P.T., R.Z., A.A., V.H., C.K.N., J.S.K., A.J.B., D.K. and S.L.; supervision, B.D.F., R.Z., P.T., V.H. and A.A.; project administration, B.D.F. and R.Z.; funding acquisition, R.Z. All authors have read and agreed to the published version of the manuscript.

Funding

The UK Department of Health and Social Care has contributed designated funding for this SORT IT-AMR initiative, which is branded as the NIHR-TDR partnership. TDR is able to conduct its work thanks to the commitment and support from a variety of funders. A full list of TDR donors is available at: https://tdr.who.int/about-us/our-donors (accessed on 28 January 2022).

Institutional Review Board Statement

Permission to use the IPC national data was obtained from the Chief Medical Officer of the MOHS, Sierra Leone. The study proposal was reviewed and approved by the Sierra Leone Ethics and Scientific Review Committee (SLREC—5 July 2021) and the Union Ethics Advisory Group of the International Union against Tuberculosis and Lung Disease, Paris, France (EAG-05/21). As we used secondary anonymized data, the issue of informed consent did not apply.

Informed Consent Statement

Not applicable.

Data Availability Statement

The metadata record of the data used in this paper is available at DOI https://doi.org/10.6084/m9.figshare.19134608 (accessed on 28 January 2022). Requests to access these data should be sent to the corresponding author.

Acknowledgments

This research was conducted through the Structured Operational Research and Training Initiative (SORT IT), a global partnership coordinated by TDR, the Special Programme for Research and Training in Tropical Diseases at the World Health Organization. The specific SORT IT program that led to these publication included a partnership of TDR with the WHO Country office of Sierra Leone and was implemented along with The Tuberculosis Research and Prevention Center Non-Governmental Organization, Armenia; The International Union Against Tuberculosis and Lung Diseases, Paris and South East Asia offices; Medicins Sans Frontières—Luxembourg, Luxembourg; ICMR–National Institute of Epidemiology, Chennai, India; Sustainable Health Systems, Freetown, Sierra Leone; Ministry of Health and Sanitation, Freetown, Sierra Leone; Ministry of Livestock, Freetown, Sierra Leone; University of Guinea, Guinea; The Centre for Rural Training and Research, Meferinyah, Guinea; The Madhira institute, Nairobi, Kenya; Institute of Tropical Medicine, Antwerp, Belgium; University of Chester, United Kingdom; University of Liverpool, United Kingdom and; the University of Washington, USA.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

References

  1. Pittet, D.; Donaldson, L. Clean Care Is Safer Care: The First GlobalChallenge of the WHO World Alliance for Patient Safety. Infect. Control Hosp. Epidemiol. 2005, 26, 891–894. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Allegranzi, B.; Donaldson, L.J.; Kilpatrick, C.; Syed, S.; Twyman, A.; Kelley, E.; Pittet, D. Infection Prevention: Laying an Essential Foundation for Quality Universal Health Coverage. Lancet Glob. Health 2019, 7, e698–e700. [Google Scholar] [CrossRef] [Green Version]
  3. World Health Organization. Minimum Requirements for Infection Prevention and Control Programmes; World Health Organization: Geneva, Switzerland, 2019. [Google Scholar]
  4. Cobb, N.; Papali, A.; Pisani, L.; Schultz, M.J.; Ferreira, J.C. Pragmatic Recommendations for Infection Prevention and Control Practices for Healthcare Facilities in Low- and Middle-Income Countries during the COVID-19 Pandemic. Am. J. Trop. Med. Hyg. 2021, 104 (Suppl. 3), 25–33. [Google Scholar] [CrossRef] [PubMed]
  5. Allegranzi, B.; Nejad, S.B.; Combescure, C.; Graafmans, W.; Attar, H.; Donaldson, L.; Pittet, D. Burden of Endemic Health-Care-Associated Infection in Developing Countries: Systematic Review and Meta-Analysis. Lancet 2011, 377, 228–241. [Google Scholar] [CrossRef]
  6. World Health Organization. Patient Safety: Health Care-Associated Infections. Available online: https://www.who.int/gpsc/country_work/gpsc_ccisc_fact_sheet_en.pdf (accessed on 28 January 2022).
  7. Schreiber, P.W.; Sax, H.; Wolfensberger, A.; Clack, L.; Kuster, S.P. The Preventable Proportion of Healthcare-Associated Infections 2005-2016: Systematic Review and Meta-Analysis. Infect. Control Hosp. Epidemiol. 2018, 39, 1277–1295. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. World Health Organization. Global Action Plan on Antimicrobial Resistance; World Health Organization: Geneva, Switzerland, 2015. [Google Scholar]
  9. World Health Organization Regional Office for Europe. Every Infection Prevented Is an Antibiotic Treatment Avoided. Available online: https://www.euro.who.int/en/health-topics/disease-prevention/antimicrobial-resistance/news/news/2017/11/every-infection-prevented-is-an-antibiotic-treatment-avoided (accessed on 1 February 2022).
  10. Ministry of Health and Sanitation; Government of Sierra Leone. Ebola Viral Disease Situation Report. Available online: https://reliefweb.int/sites/reliefweb.int/files/resources/Ebola-Situation-Report_Vol-260.pdf (accessed on 28 January 2022).
  11. Ministry of Health and Sanitation. National Infection Prevention and Control Guidelines; Ministry of Health and Sanitation: Freetown, Sierra Leone, 2015. [Google Scholar]
  12. World Health Organization. Instructions for the National Infection Prevention and Control Assessment Tool 2 (IPCAT2); World Health Organization: Geneva, Switzerland, 2017. [Google Scholar]
  13. World Health Organization. Infection Prevention and Control Assessment Framework at the Facility Level; World Health Organization: Geneva, Switzerland, 2018. [Google Scholar]
  14. Powell-Jackson, T.; King, J.J.C.; Makungu, C.; Spieker, N.; Woodd, S.; Risha, P.; Goodman, C. Infection Prevention and Control Compliance in Tanzanian Outpatient Facilities: A Cross-Sectional Study with Implications for the Control of COVID-19. Lancet Glob. Health 2020, 8, e780–e789. [Google Scholar] [CrossRef]
  15. Tremblay, N.; Musa, E.; Cooper, C.; Van den Bergh, R.; Owiti, P.; Baller, A.; Siafa, T.; Woldeyohannes, D.; Shringarpure, K.; Gasasira, A. Infection Prevention and Control in Health Facilities in Post-Ebola Liberia: Don’t Forget the Private Sector! Public Health Action 2017, 7 (Suppl. 1), S94. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Opollo, M.S.; Otim, T.C.; Kizito, W.; Thekkur, P.; Kumar, A.M.V.; Kitutu, F.E.; Kisame, R.; Zolfo, M. Infection Prevention and Control at Lira University Hospital, Uganda: More Needs to Be Done. Trop. Med. Infect. Dis. 2021, 6, 69. [Google Scholar] [CrossRef] [PubMed]
  17. Squire, J.S.; Conteh, I.; Abrahamya, A.; Maruta, A.; Grigoryan, R.; Tweya, H.; Timire, C.; Hann, K.; Zachariah, R.; Vandi, M.A. Gaps in Infection Prevention and Control in Public Health Facilities of Sierra Leone after the 2014–2015 Ebola Outbreak. Trop. Med. Infect. Dis. 2021, 6, 89. [Google Scholar] [CrossRef] [PubMed]
  18. Institute for Health Metrics and Evaluation. Sierra Leone Population and Housing Census 2015|GHDx. Available online: http://ghdx.healthdata.org/record/sierra-leone-population-and-housing-census-2015 (accessed on 28 January 2022).
  19. Ministry of Health and Sanitation. Serra Leone Basic Package of Essential Health Services; Ministry of Health and Sanitation: Freetown, Sierra Leone, 2015. [Google Scholar]
  20. World Health Organization. Infection Prevention and Control: Report by the Director-General; World Health Organization: Geneva, Switzerland, 2022. [Google Scholar]
  21. United Nations. Sustainable Development Goals. Available online: https://sdgs.un.org/goals (accessed on 28 January 2022).
  22. Antimicrobial Resistance Collaborators. Global Burden of Bacterial Antimicrobial Resistance in 2019: A Systematic Analysis. Lancet 2022, 399, 629–655. [Google Scholar] [CrossRef]
  23. Von Elm, E.; Altman, D.G.; Egger, M.; Pocock, S.J.; Gøtzsche, P.C.; Vandenbroucke, J.P. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for Reporting Observational Studies. Lancet 2007, 370, 1453–1457. [Google Scholar] [CrossRef]
  24. Tartari, E.; Tomczyk, S.; Pires, D.; Zayed, B.; Coutinho Rehse, A.P.; Kariyo, P.; Stempliuk, V.; Zingg, W.; Pittet, D.; Allegranzi, B. Implementation of the Infection Prevention and Control Core Components at the National Level: A Global Situational Analysis. J. Hosp. Infect. 2021, 108, 103. [Google Scholar] [CrossRef] [PubMed]
  25. Oppong, T.B.; Amponsem-Boateng, C.; Kyere, E.K.D.; Wang, Y.; Gheisari, Z.; Oppong, E.E.; Opolot, G.; Duan, G.; Yang, H. Infection Prevention and Control Preparedness Level and Associated Determinants in 56 Acute Healthcare Facilities in Ghana. Infect. Drug Resist. 2020, 13, 4263–4271. [Google Scholar] [CrossRef] [PubMed]
  26. Kanu, H.; Wilson, K.; Sesay-Kamara, N.; Bennett, S.; Mehtar, S.; Storr, J.; Allegranzi, B.; Benya, H.; Park, B.; Kolwaite, A. Creation of a National Infection Prevention and Control Programme in Sierra Leone, 2015. BMJ Glob. Health 2019, 4, e001504. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Kanu, S.; James, P.B.; Bah, A.J.; Kabba, J.A.; Kamara, M.S.; Elleanor, C.E.; Kanu, W.J.S. Healthcare Workers’ Knowledge, Attitude, Practice and Perceived Health Facility Preparedness Regarding COVID-19 in Sierra Leone. J. Multidiscip. Healthc. 2021, 14, 67–80. [Google Scholar] [CrossRef] [PubMed]
  28. The Fleming Fund. Sierra Leone|AMR Action Plan. Available online: https://www.flemingfund.org/countries/sierra-leone/ (accessed on 31 January 2022).
  29. Squire, J.S.; Hann, K.; Denisiuk, O.; Zachariah, R.; Davtyan, H. Staffing in Public Health Facilities after the Ebola Outbreak in Rural Sierra Leone: How Much Has Changed? F1000Research 2020, 8, 793. [Google Scholar] [CrossRef] [PubMed]
  30. Maina, M.; Tosas-Auguet, O.; English, M.; Schultsz, C.; McKnight, J. Infection Prevention and Control during the COVID-19 Pandemic: Challenges and Opportunities for Kenyan Public Hospitals. Wellcome Open Res. 2020, 5, 211. [Google Scholar] [CrossRef] [PubMed]
  31. Sonenthal, P.D.; Masiye, J.; Kasomekera, N.; Marsh, R.H.; Wroe, E.B.; Scott, K.W.; Li, R.; Murray, M.B.; Bukhman, A.; Connolly, E.; et al. COVID-19 Preparedness in Malawi: A National Facility-Based Critical Care Assessment. Lancet Glob. Health 2020, 8, e890–e892. [Google Scholar] [CrossRef]
  32. Ilesanmi, O.S.; Afolabi, A.A.; Akande, A.; Raji, T.; Mohammed, A. Infection Prevention and Control during COVID-19 Pandemic: Realities from Health Care Workers in a North Central State in Nigeria. Epidemiol. Infect. 2021, 149, e15. [Google Scholar] [CrossRef] [PubMed]
  33. Abbas, S.; Sultan, F. Infection Control Practices and Challenges in Pakistan during the COVID-19 Pandemic: A Multicentre Cross-Sectional Study. J. Infect. Prev. 2021, 22, 205–211. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Organizational structure of IPC program in Sierra Leone.
Figure 1. Organizational structure of IPC program in Sierra Leone.
Ijerph 19 05642 g001
Figure 2. Radar chart showing IPC compliance scores at National IPC unit assessment in 2019 (pre-COVID-19) and 2021 (COVID-19 era) in Sierra Leone. Note: The radar chart shows the IPC component score emanating from the centre (0%) expanding outwards to a maximum of 100%. The 2021 scores (green line) lie outside the 2019 scores (red line), indicating overall improvement in all the components of IPC. Abbreviation: IPC = Infection, Prevention and Control; HAI = Healthcare Associated Infection.
Figure 2. Radar chart showing IPC compliance scores at National IPC unit assessment in 2019 (pre-COVID-19) and 2021 (COVID-19 era) in Sierra Leone. Note: The radar chart shows the IPC component score emanating from the centre (0%) expanding outwards to a maximum of 100%. The 2021 scores (green line) lie outside the 2019 scores (red line), indicating overall improvement in all the components of IPC. Abbreviation: IPC = Infection, Prevention and Control; HAI = Healthcare Associated Infection.
Ijerph 19 05642 g002
Figure 3. Median IPC compliance percentage scores across eight core components in the four regional hospitals during 2019 (pre-COVID-19) and 2021 (COVID-19 era), Sierra Leone. Note: The radar chart shows the IPC component score emanating from the centre (0%) expanding outwards to a maximum of 100%. The 2021 scores (green line) lie outside the 2019 scores (red line), indicating overall improvement in all the components of IPC. Abbreviation: IPC = Infection, Prevention and Control; HAI = Healthcare Associated Infection.
Figure 3. Median IPC compliance percentage scores across eight core components in the four regional hospitals during 2019 (pre-COVID-19) and 2021 (COVID-19 era), Sierra Leone. Note: The radar chart shows the IPC component score emanating from the centre (0%) expanding outwards to a maximum of 100%. The 2021 scores (green line) lie outside the 2019 scores (red line), indicating overall improvement in all the components of IPC. Abbreviation: IPC = Infection, Prevention and Control; HAI = Healthcare Associated Infection.
Ijerph 19 05642 g003
Figure 4. Median IPC compliance percentage scores across eight core components in the eight district hospitals during 2019 (pre-COVID-19) and 2021 (COVID-19 era), Sierra Leone. Note: The radar chart shows the IPC component score emanating from the centre (0%) expanding outwards to a maximum of 100%. The 2021 scores (green line) lie outside the 2019 scores (red line), indicating overall improvement in all the components of IPC. Abbreviation: IPC = Infection, Prevention and Control; HAI = Healthcare Associated Infection.
Figure 4. Median IPC compliance percentage scores across eight core components in the eight district hospitals during 2019 (pre-COVID-19) and 2021 (COVID-19 era), Sierra Leone. Note: The radar chart shows the IPC component score emanating from the centre (0%) expanding outwards to a maximum of 100%. The 2021 scores (green line) lie outside the 2019 scores (red line), indicating overall improvement in all the components of IPC. Abbreviation: IPC = Infection, Prevention and Control; HAI = Healthcare Associated Infection.
Ijerph 19 05642 g004
Table 1. Percentage change in minimum IPC score at the national IPC unit between 2019 (pre-COVID-19) and 2021 (COVID-19 era) in Sierra Leone.
Table 1. Percentage change in minimum IPC score at the national IPC unit between 2019 (pre-COVID-19) and 2021 (COVID-19 era) in Sierra Leone.
IPC Core Components a20192021% Change d
Grade bScore(%) cGrade bScore(%) c
i. IPC programmeBasic44(44)Intermediate61(61)17
ii. IPC guidelinesIntermediate67(67)Advanced83(83)16
iii. IPC education and trainingInadequate23(23)Intermediate67(67)44
iv. HAI surveillanceInadequate19(19)Basic27(27)8
v. Multimodal strategiesBasic28(28)Basic40(40)12
vi. Monitoring/audits of IPC practices and feedbackIntermediate64(64)Intermediate69(69)5
Cumulative score (%)Basic245(41)Intermediate347(58)17
Abbreviation: IPC = Infection, Prevention and Control; HAI = Healthcare Associated Infection. a Maximum score for each component is 100 and for the cumulative it is 600. b Grade: IPC performance in each component is graded based on the obtained percentage: (i) inadequate (0–25%), (ii) basic (25.1–50%), (iii) intermediate (50.1–75%), and (iv) advanced (75.1–100%). c Percentages are calculated relative to the maximum score for the component. d Percentage in 2021–Percentage in 2019.
Table 2. The percentage scores of the sub-components of IPCAT at the national IPC unit of Sierra Leone during 2019 (pre-COVID-19) and 2021 (COVID-19 era) assessment.
Table 2. The percentage scores of the sub-components of IPCAT at the national IPC unit of Sierra Leone during 2019 (pre-COVID-19) and 2021 (COVID-19 era) assessment.
IPC Core ComponentsSub-Components20192021
i. IPC ProgrammeOrganization and leadership of the programme63%63%
Defined scope of responsibilities43%71%
Linkages with other programmes and professional organizations25%50%
ii. IPC GuidelineDevelopment, dissemination, and implementation of national technical guidelines67%100%
Education and training of relevant healthcare workers on IPC guidelines33%67%
Monitoring of guideline adherence100%100%
iii. IPC education and trainingSupporting and facilitating IPC education and training at the facility level60%100%
National curricula and IPC training and education0%100%
Monitoring of training and education0%0%
Implementation of training and education33%67%
iv. HAI surveillanceCoordination of surveillance at the national level29%43%
National objectives of surveillance20%20%
Prioritized HAIs for surveillance0%17%
Methods of surveillance67%67%
v. Multimodal strategiesNational and sub-national coordination in support of local implementation of IPC improvement interventions50%100%
National and sub-national facilitation in support of local implementation of IPC improvement interventions60%60%
Programme and accreditation linkages0%0%
vi. Monitoring/audits of IPC practices and feedbackMonitoring/audit and feedback framework for IPC50%50%
Monitoring/audit indicators75%75%
Monitoring/audit and feedback process and reporting67%83%
Abbreviation: IPC = Infection, Prevention and Control; HAI = Healthcare Associated Infection. Ijerph 19 05642 i001 Inadequate; Ijerph 19 05642 i002 Basic; Ijerph 19 05642 i003 Intermediate; Ijerph 19 05642 i004 Adequate.
Table 3. Percentage change in median IPC scores at regional (N = 4) and district hospitals (N = 8) between 2019 (pre-COVID-19) and 2021 (COVID-19 era) in Sierra Leone.
Table 3. Percentage change in median IPC scores at regional (N = 4) and district hospitals (N = 8) between 2019 (pre-COVID-19) and 2021 (COVID-19 era) in Sierra Leone.
IPC Core Components aRH (N = 4)DH (N = 8)
20192021% Change d20192021% Change d
Score(%) bScore(%) bScore(%) bScore(%) b
i. IPC programme41(41)49(49)835(35)40(40)5
ii. IPC guidelines65(65)71(71)665(65)68(68)3
iii. IPC education and training58(58)83(83)2555(55)75(75)20
iv. HAI surveillance3(3)43(43)400(0)45(45)45
v. Multimodal strategies38(38)45(45)838(38)45(45)8
vi. Monitoring/audits of IPC practices and feedback25(25)56(56)3135(35)53(53)18
vii. Workload, staffing and bed occupancy25(25)30(30)525(25)28(28)3
viii. Built environment, materials and equipment for IPC at the facility level44(44)57(57)1347(47)51(51)4
Cumulative score (%)299(37)434(54)17300(37)405(50)13
Grading cBasicIntermediate BasicBasic
Abbreviation: IPC = Infection, Prevention and Control; RH = regional hospital; DH = district hospital; HAI = Healthcare Associated Infection. a Maximum score for each component is 100 and for the cumulative it is 800. b Percentages are calculated relative to the maximum score for the component. c Grade: IPC performance in each component will be graded based on the obtained percentage: (i) inadequate (0–25%), (ii) basic (25.1–50%), (iii) intermediate (50.1–75%), and (iv) advanced (75.1–100%). d Percentage in 2021–Percentage in 2019.
Table 4. The percentage scores of the sub-components of IPCAF at the regional and district hospitals of Sierra Leone in 2021.
Table 4. The percentage scores of the sub-components of IPCAF at the regional and district hospitals of Sierra Leone in 2021.
IPC Core ComponentsSub-ComponentsMedian Percentage Score *
RH (N = 4)DH (N = 8)
i. IPC ProgrammeIPC programme at facility50%50%
Functional IPC committee100%50%
Senior facility leadership commitment and support for the IPC programme: by allocated budget specifically for the IPC activities0%0%
ii. IPC GuidelineExpertise in IPC to develop or adapt guidelines50%13%
Availability of IPC guidelines57%56%
Consistent with national/international guidelines100%100%
iii. IPC education and trainingAvailability of personnel with the IPC expertise to lead IPC training100%100%
Frequency of IPC training83%50%
IPC training integrated in the clinical practice and training of other specialties13%13%
iv. HAI surveillanceSurveillance as a defined component of IPC programme100%75%
HAI surveillance performed14%11%
Methods of surveillance45%20%
v. Multimodal strategiesUse of Multimodal strategies to implement IPC interventions100%100%
Multimodal strategies elements implemented in an integrated way40%40%
A multidisciplinary team for implementing IPC multimodal strategies0%0%
vi. Monitoring/audits of IPC practices and feedbackA well-defined monitoring plan with clear goals, targets and activities0%0%
Monitoring of IPC processes and indicators50%32%
Feedback of auditing reports on the state of the IPC activities/performance60%63%
vii. Workload, staffing and bed occupancyAssessment of hospital staffing needs25%0%
Hospital bed occupancy64%44%
viii. Built environment, materials and equipment for IPC at the facility levelWater availability and access58%40%
Functioning Hand hygiene and sanitation facilities50%65%
Patient placement and personal protective equipment (PPE) in health care settings58%50%
Medical waste management, and sewage54%49%
Decontamination and sterilization42%50%
Abbreviation: IPC = Infection, Prevention and Control; HAI = Healthcare Associated Infection, RH = Regional Hospital, DH = District Hospital. * The % score for each component in the facility was calculated using IPCAF scores. The median of this score among regional hospitals and district hospitals is presented. Ijerph 19 05642 i001 Inadequate; Ijerph 19 05642 i002 Basic; Ijerph 19 05642 i003 Intermediate; Ijerph 19 05642 i004 Adequate.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Fofanah, B.D.; Abrahamyan, A.; Maruta, A.; Kallon, C.; Thekkur, P.; Kamara, I.F.; Njuguna, C.K.; Squire, J.S.; Kanu, J.S.; Bah, A.J.; et al. Achieving Minimum Standards for Infection Prevention and Control in Sierra Leone: Urgent Need for a Quantum Leap in Progress in the COVID-19 Era! Int. J. Environ. Res. Public Health 2022, 19, 5642. https://doi.org/10.3390/ijerph19095642

AMA Style

Fofanah BD, Abrahamyan A, Maruta A, Kallon C, Thekkur P, Kamara IF, Njuguna CK, Squire JS, Kanu JS, Bah AJ, et al. Achieving Minimum Standards for Infection Prevention and Control in Sierra Leone: Urgent Need for a Quantum Leap in Progress in the COVID-19 Era! International Journal of Environmental Research and Public Health. 2022; 19(9):5642. https://doi.org/10.3390/ijerph19095642

Chicago/Turabian Style

Fofanah, Bobson Derrick, Arpine Abrahamyan, Anna Maruta, Christiana Kallon, Pruthu Thekkur, Ibrahim Franklyn Kamara, Charles Kuria Njuguna, James Sylvester Squire, Joseph Sam Kanu, Abdulai Jawo Bah, and et al. 2022. "Achieving Minimum Standards for Infection Prevention and Control in Sierra Leone: Urgent Need for a Quantum Leap in Progress in the COVID-19 Era!" International Journal of Environmental Research and Public Health 19, no. 9: 5642. https://doi.org/10.3390/ijerph19095642

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop