Skip to main content
Advertisement
  • Loading metrics

Estimates of the number and distribution of zero-dose and under-immunised children across remote-rural, urban, and conflict-affected settings in low and middle-income countries

  • Adelle Wigley ,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Visualization, Writing – original draft, Writing – review & editing

    a.s.wigley@soton.ac.uk

    Affiliation WorldPop, Geography and Environmental Science, University of Southampton, Highfield Campus, Southampton, United Kingdom

  • Josh Lorin,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Validation, Writing – review & editing

    Affiliation Gavi, The Vaccine Alliance, Geneva, Switzerland

  • Dan Hogan,

    Roles Conceptualization, Methodology, Validation, Writing – review & editing

    Affiliation Gavi, The Vaccine Alliance, Geneva, Switzerland

  • C. Edson Utazi,

    Roles Conceptualization, Funding acquisition, Methodology, Writing – review & editing

    Affiliation WorldPop, Geography and Environmental Science, University of Southampton, Highfield Campus, Southampton, United Kingdom

  • Brittany Hagedorn,

    Roles Conceptualization, Writing – review & editing

    Affiliation Institute for Disease Modelling, Bill & Melinda Gates Foundation, Seattle, Washington, WA, United States of America

  • Emily Dansereau,

    Roles Conceptualization, Writing – review & editing

    Affiliation Institute for Disease Modelling, Bill & Melinda Gates Foundation, Seattle, Washington, WA, United States of America

  • Andrew J. Tatem,

    Roles Conceptualization, Funding acquisition, Methodology, Supervision, Writing – review & editing

    Affiliation WorldPop, Geography and Environmental Science, University of Southampton, Highfield Campus, Southampton, United Kingdom

  • Natalia Tejedor-Garavito

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Methodology, Project administration, Visualization, Writing – review & editing

    Affiliation WorldPop, Geography and Environmental Science, University of Southampton, Highfield Campus, Southampton, United Kingdom

Abstract

While there has been great success in increasing the coverage of new childhood vaccines globally, expanding routine immunization to reliably reach all children and communities has proven more challenging in many low- and middle-income countries. Achieving this requires vaccination strategies and interventions that identify and target those unvaccinated, guided by the most current and detailed data regarding their size and spatial distribution. Through the integration and harmonisation of a range of geospatial data sets, including population, vaccination coverage, travel-time, settlement type, and conflict locations. We estimated the numbers of children un- or under-vaccinated for measles and diphtheria-tetanus-pertussis, within remote-rural, urban, and conflict-affected locations. We explored how these numbers vary both nationally and sub-nationally, and assessed what proportions of children these categories captured, for 99 lower- and middle-income countries, for which data was available. We found that substantial heterogeneities exist both between and within countries. Of the total 14,030,486 children unvaccinated for DTP1, over 11% (1,656,757) of un- or under-vaccinated children were in remote-rural areas, more than 28% (2,849,671 and 1,129,915) in urban and peri-urban areas, and up to 60% in other settings, with nearly 40% found to be within 1-hour of the nearest town or city (though outside of urban/peri-urban areas). Of the total number of those unvaccinated, we estimated between 6% and 15% (826,976 to 2,068,785) to be in conflict-affected locations, based on either broad or narrow definitions of conflict. Our estimates provide insights into the inequalities in vaccination coverage, with the distributions of those unvaccinated varying significantly by country, region, and district. We demonstrate the need for further inquiry and characterisation of those unvaccinated, the thresholds used to define these, and for more country-specific and targeted approaches to defining such populations in the strategies and interventions used to reach them.

Introduction

While there has been great success in increasing the coverage of new childhood vaccines globally, expanding routine immunization services to reliably reach all children and communities has proven more challenging [14]. Certain populations remain un- or under-vaccinated in many LMICs [2, 5, 6] and infectious diseases still account for a large proportion of deaths among children [2, 7, 8]. Lack of accessibility to health care, poverty and overcrowding, as well as civil and political unrest, are all considered major contributors to the transmission of vaccine preventable diseases, and present significant challenges in reaching global coverage targets [9]. In 2019, 13.6 million children failed to receive even a first dose of the diphtheria-tetanus-pertussis vaccine (DTP1), rising significantly to 17.1 million in 2020, due to disruptions to health services amidst the ongoing coronavirus pandemic [10]. Moreover, the percentage of children receiving three doses of the diphtheria-tetanus-pertussis vaccine (DTP3) declined by 5 percent from 2019 to 2021, reflecting a sustained decline in DTP3 coverage [11].

Considering the substantial burden of vaccine-preventable diseases and the frequent occurrence of outbreaks among disadvantaged populations [2, 12] there have been continuous efforts in the health policy environment to design vaccination strategies and interventions that prioritize and target these population groups [3, 13, 14]. In 2017, senior leaders in the immunization sector formed the Equity Reference Group for Immunization (ERG), identifying remote-rural, conflict-affected and the urban poor as likely groups to be un- or under-vaccinated; also recognizing gender-related barriers as a cross-cutting issue [15, 16]. Gavi, the Vaccine Alliance, has adopted a new five-year strategy (“Gavi 5.0”) for 2021–2025, with a vision of "Leaving no one behind with immunization" by increasing equitable and sustainable use of vaccines [17]. Further, the World Health Organization’s Immunization Agenda 2030 sets a global vision and strategy for vaccines and immunization, committing to an ambitious target of reducing the number of zero-dose children by 50% by 2030 [18].

Despite these developments, estimates of how many children living in remote-rural, urban slum or conflict-affected settings, their vaccination rates and relative distributions within countries remain scarce, limiting robust resource allocation and strategy design [19]. Previous studies have revealed significant geographic inequalities in routine vaccination coverage across many LMICs, through analysis at the district level, helping to identify areas of low coverage and vaccine delivery system vulnerabilities [5, 8, 2022]. However, to date, there has been no global scale analysis at these finer spatial resolutions focusing on the numbers of unvaccinated children in these key geographically marginalised populations [6, 9, 18]. Achieving equitable coverage, which has been identified as a core priority moving forward [17, 18, 23] needs to be guided by the most current and detailed evidence regarding the size, distribution, and characteristics of these key at risk groups [20, 21, 2426], if current global immunization targets are to be met [17, 18].

Here, we present outputs from the integration of a range of geospatial datasets to estimate the number and distribution of zero-dose and under immunised children, across remote-rural, conflict-affected, and urban settings. We estimate the relative proportions and numbers of these key populations, to assess variabilities both between and within countries, to help guide global, national, and regional strategies and interventions, and to highlight those areas where children may remain unvaccinated. Given available data and to reflect key immunization program performance indicators, our study focuses on receipt of DTP1, DTP3, and the first dose of the measles containing vaccine (MCV1) among children under the age of one in 2019.

Data and methods

We assembled geospatial datasets on the distributions of children under the age of one (U1) [27], vaccination coverage estimates of DTP1, DTP3 and MCV1 (VC) [5], estimated travel-time to the nearest major settlement [28], the location and timing of conflict-related fatalities [29], the distribution and extent of urban, peri-urban, and rural areas [30], and administrative boundaries at the second subnational level (ADM2) [31]. Note we use the term ‘unvaccinated’ throughout to refer to non-receipt of DTP1, DTP3 or MCV1.

Using vaccination coverage and population estimates, we first calculated both the total numbers of U1 and the numbers of unvaccinated U1. Then, using the travel-time, conflict, settlement type, and administrative boundary data, we estimated the numbers of unvaccinated U1 living in (i) remote-rural (and rural non-remote), (ii) conflict-affected (broad and narrow definitions, see below) and (iii) urban and peri-urban locations. The resulting datasets were summarised for 99 LMICs that had subnational boundaries at ADM2 for which data was available. The following outlines each of the steps in more detail.

Ethics approval for this article was obtained from the Ethics Committee at the Faculty of Environmental and Life Sciences, University of Southampton, United Kingdom (Ethics number: 50248). Consent to participate is not applicable.

Mapping U1.

Estimates of the number of U1 at the 1x1 km grid square scale, were obtained from the WorldPop database for 2019 [27]. These were then summarised at ADM2 using the database of Global Administrative Areas (GADM) [31]. Detailed publications on the methods used to produce these estimates are available elsewhere [3234]. Though in brief, machine learning methods in combination with a range of geospatial covariates, are used to disaggregate population counts from areal units to 1x1 km grid squares, and models based on census, survey and microdata used to further disaggregate these by age and sex.

Mapping unvaccinated U1 for DTP1, DTP3 and MCV1.

To estimate the numbers of unvaccinated U1, vaccination coverage (VC) rates for DTP1, DTP3, and MCV1, were obtained from the Institute for Health Metrics and Evaluation (IHME) for 2019, at 5x5km resolution. Methods detailing the production of these datasets are described in Sbarra A. et al. [5]. The vaccination coverage datasets were re-sampled to 1x1km resolution, to align to the WorldPop estimates of U1 [27], and the numbers of unvaccinated U1 per 1x1 km grid square subsequently calculated as: (1-VC) X U1, before summarising by ADM2 using the GADM administrative boundaries.

Mapping unvaccinated U1 in urban and peri-urban areas.

To estimate the numbers of unvaccinated U1 in urban and peri-urban areas, we used the Global Human Settlement Layer (GHS-SMOD), which delineates and classifies settlement typologies, using both population size and built-up area densities [30]. To define urban areas, we used the urban centre grid cell category, and to define peri-urban we used the dense urban, semi-dense urban, and sub-urban grid cell categories, assigning each a grid square value of 1, with these categories making up the ‘urban domain’ as specified in the GHS-SMOD. The data were harmonized and resampled to the same resolution as the WorldPop data, before multiplying with the population and vaccination coverage data, to estimate the numbers of unvaccinated U1 in urban and peri-urban areas at the grid square level. The data were then summarised at ADM2, using the GADM administrative boundaries.

Whilst identified as a key population group likely to be un- or under-vaccinated, the availability and reliability of a global data set on urban slum locations makes it challenging to estimate the proportion of children not receiving vaccinations in urban slums. This is further complicated by the spatial resolution of the IHME immunisation coverage estimates, produced at the 5x5 km2 scale, which is larger than many areas of urban slums, thus having the potential to overestimate the numbers of unvaccinated children living in these areas. For these reasons we have not included estimates of the numbers of unvaccinated U1 living in urban slums in this analysis.

Mapping unvaccinated U1 in remote-rural areas.

To estimate the numbers of unvaccinated U1 in remote-rural areas, travel-time estimates to the nearest town/city of 50,000 people or more [28] were used to define remote areas, and the GHS-SMOD used to define rural areas [30]. We classified as remote those areas where the travel-time was 180 minutes or more to the nearest town/city [28, 35, 36] and as rural, those areas in the GHS-SMOD with a rural grid square classification, using only grid cells that were classified as both rural and remote, then assigning these a grid square value of 1. The data were harmonized and resampled to match the WorldPop data, before multiplying with the population and vaccination coverage data, to estimate the numbers of unvaccinated U1 in remote-rural areas at the grid square level. The data were then summarised at ADM2, using the GADM administrative boundaries.

Mapping unvaccinated U1 in rural (non-remote) areas.

The remainder of U1 (those not classified as urban, peri-urban, or remote-rural areas) were considered rural (non-remote). As in Weiss et al. (2020) [45], we use travel-time categories to summarise the numbers of unvaccinated U1 in rural (non-remote) areas, defined as rural areas within 180 minutes of the nearest town or city, classifying the travel-times into 0 to 60, 60 to 120, and 120 to 180 minute categories, and assigning each a grid square value of one. The data were harmonized and resampled to match the WorldPop data, before multiplying with the population data and vaccination coverage data, to estimate the numbers of unvaccinated U1 in rural (non-remote) areas at the grid square level. The data were then summarised at ADM2, using the GADM administrative boundaries.

Mapping unvaccinated U1 in conflict-affected areas.

To estimate the numbers of unvaccinated U1 in conflict-affected areas, geo-located conflict locations were obtained from the Armed Conflict Location & Event Data Project (ACLED) [29], for conflicts resulting in violent deaths (battles, explosions/remote violence, and violence against citizens), two years prior to 2019. From these we selected conflicts resulting in at least one fatality and used these to select ADM2 units experiencing at least one conflict, to define conflict-affected areas. The data were then summarised using only the conflict affected ADM2 units. After evaluation and comparisons to the perceived conflict situation, likely impacts on service delivery, and with reference to current literature on defining exposure to conflict, this definition was refined further. Using thresholds of at least 30 and 300 fatalities per million people to classify districts as being conflicted-affected according to both broad and narrow definitions of conflict, respectively.

Results

We found substantial heterogeneities in the spatial distribution and setting (or context) of unvaccinated U1, both among and within countries, with a large proportion of them found to be concentrated within a small number of countries. Whilst many of those unvaccinated were found to be in remote-rural (11.8%), conflict-affected (5.9% to 14.7%), and urban locations (20.3%), a large proportion were found in settings other than these (59.7%), with nearly 40% found to be in rural (non-remote) locations within 1-hour of the nearest town or city (not including urban and peri-urban areas) (DTP1).

Geographical distributions of unvaccinated U1

We first examined the geographical distributions of unvaccinated U1. Fig 1 shows the estimated proportion of U1 who did not receive the first dose of the DTP vaccine in 2019 at ADM2 and highlights the substantial differences in vaccination coverage both among and within countries. S1 and S2 Figs, show the same for DTP3 and MCV1 and display broadly similar spatial patterns. The largest numbers of unvaccinated U1 for all three doses were in India and Nigeria, whereas the largest proportions were in Somalia, Papua New Guinea, Guinea, Chad, and Angola (S3 Fig).

thumbnail
Fig 1.

Proportion of children under 1 year of age estimated to have not received the first dose of the DTP vaccine in 2019 at GADM administrative level 2 [31, 37] for Latin America (A), Africa (B), and Asia (C).

https://doi.org/10.1371/journal.pgph.0001126.g001

Breakdown of unvaccinated U1 by setting

Next, we examined the numbers and proportions of unvaccinated U1 residing in remote-rural, conflict-affected (broad and narrow), urban and peri-urban, and rural (non-remote) locations at the global, national, and subnational levels to further characterise those unvaccinated.

Table 1 shows the distribution of unvaccinated U1 broken down by geographical setting, vaccine dose, and conflict for all countries in the analysis. We found that more than 19% lived in urban areas, with a smaller proportion in peri-urban areas, whilst more than 11% lived in remote-rural areas more than 3 hours travel-time from the nearest town or city. Around 60% of those unvaccinated lived in other rural areas, not classed as remote, urban, or peri-urban (rural non-remote). Table 1 also shows the percentage of unvaccinated U1 considered to be conflict-affected, which was estimated to be between 6% and 18%, depending on the definition of conflict used (narrow and broad).

thumbnail
Table 1. Global distribution of unvaccinated children under 1 year of age (percentage and number) in 2019 broken down by geographical setting, vaccine dose, and conflict for all countries in the analysis (Note: Conflict can overlap with other settings in the table).

https://doi.org/10.1371/journal.pgph.0001126.t001

Unvaccinated U1 in remote-rural locations

Fig 2 shows where the unvaccinated U1 in remote-rural areas were concentrated, by mapping the proportions of U1 unvaccinated for DTP1 (of the total unvaccinated) at ADM2. The map highlights countries where significant proportions of U1 were estimated to be unvaccinated, including the Central African Republic, Republic of Congo, and Mauritania, as identified above. However, it additionally reveals regions not previously identified at the national level, for example large areas of northern Chad, central DRC, and South-eastern Angola/Eastern Botswana. The distributions of unvaccinated U1 in remote-rural areas were similar for all three vaccine indicators, though generally appeared slightly lower for MCV1 (S4 and S5 Figs).

thumbnail
Fig 2.

Proportion of children under 1 year of age in remote-rural areas estimated to have not received the first dose of the DTP vaccine in 2019 at GADM administrative level 2 [31, 37] for Latin America (A), Africa (B), and Asia (C).

https://doi.org/10.1371/journal.pgph.0001126.g002

S6S8 Figs, show the top 20 ranked countries, by the estimated proportion (of the total unvaccinated) and corresponding total number of U1 not receiving DTP1/DTP3/MCV1 in remote-rural areas. In terms of proportion, Madagascar, Mauritania, Central African Republic, Papua New Guinea, and Republic of Congo were in the top 5 ranked countries for both DTP1 and DTP3, where around 60% to 70% of unvaccinated U1 were estimated to be in remote-rural locations. These figures are similar for MCV1, where around 60 to 66% of U1 unvaccinated for MCV1 were found to be in remote-rural locations, though Eritrea additionally ranks in the top five countries, rather than the Republic of Congo. However, when considering absolute numbers DR Congo was estimated to have the greatest number of unvaccinated U1 in remote-rural locations for all vaccine doses (on the order of 202,025 children, for DTP1), though Chad and Madagascar remain high in the rankings.

Unvaccinated U1 in urban and peri-urban locations

Of the total number of U1 around 20% were found to be in urban areas. S9S11 Figs, show where the unvaccinated U1 in urban locations were concentrated, by mapping the proportions of unvaccinated U1 (of the total unvaccinated) at ADM2. The map highlights key regions such as north-west Mexico, and central Brazil, which show large heterogeneity in the distributions of those unvaccinated. However, in countries with larger urban populations, such as India and China, higher proportions of unvaccinated U1 were observed in urban areas across a greater number of administrative units compared to countries with lower urban populations. These distributions are similar for all three vaccine doses.

S12S14 Figs, show the top 20 countries by estimated proportions and numbers of U1 not receiving DTP1/DTP3/MCV1 in urban areas. In terms of the proportions of unvaccinated U1, Egypt and Mexico had the largest, with nearly 60% of U1 not receiving DTP1 in urban areas, and when considering absolute numbers Mexico also had the largest numbers of unvaccinated U1 in urban areas, with Brazil also ranking high.

S15S17 Figs, map the percentage distribution of U1 not receiving DTP1/DTP3/MCV1 (of the total unvaccinated) within peri-urban areas at ADM2. The maps highlight key regions where the unvaccinated U1 were located, though with a different pattern in the distribution of those unvaccinated compared to the distributions of unvaccinated U1 in urban areas, with larger proportions observed across many areas throughout Brazil, South Africa, and China in particular. These distributions are similar for all three doses examined.

Unvaccinated U1 in rural (non-remote) locations

With a large proportion of unvaccinated U1 estimated to be in rural areas not classed as remote, urban or peri-urban (rural non-remote), this category was broken down further by travel-time to the nearest town or city, into 0 to 60, 60 to 120, and 120 to 180 minute zones, to see how the numbers of unvaccinated U1 were distributed within these areas.

S18 to S23 Figs, map the percentage breakdown of U1 not receiving DTP1/DTP3/MCV1 within rural (non-remote) areas at the second administrative level, within 0 to 60 minutes, 60 to 120, and 120 to 180 mins of the nearest town or city, in Pakistan, India, Nigeria, and Ethiopia. Although some spatial variation can be observed between countries, a large proportion of unvaccinated U1 within rural (non-remote) areas were found to be located within 0 to 60 minutes of the nearest town or city. Most notably within India and Nigeria, where many districts are found to have the majority of those unvaccinated living in rural (non-remote) areas, within 1 hour of the nearest town or city.

Unvaccinated U1 in conflict-affected locations

Fig 3 shows where the unvaccinated U1 (DTP1) in conflict-affected locations were concentrated according to the broad definition of conflict (at least 30 fatalities per million people) at ADM2 (S24 and S25 Figs). The map highlights conflict-affected regions where large proportions of U1 were unvaccinated, including much of Somalia (52%), Chad (46%), northeast Nigeria (34%), large parts of Central African Republic (26%), and Afghanistan (17%).

thumbnail
Fig 3.

Proportion of children under 1 years of age in conflict-affected areas (broad definition) estimated to have not received the first dose of the DTP vaccine in 2019 at GADM administrative level 2 [31, 37] for Africa and Asia, with close ups shown for northern sub-Saharan Africa (A), and the Middle East/West Asia region (B).

https://doi.org/10.1371/journal.pgph.0001126.g003

S26S28 Figs, show the top 20 countries, by estimated proportion and numbers of U1 not receiving DTP1/DTP3/MCV1 in conflict-affected areas according to the broad definition. In terms of the proportions of U1 unvaccinated, Syria, South Sudan and Afghanistan had the highest prevalence of unvaccinated U1, with over 80% of U1 not receiving DTP1 found to be in conflict-affected areas. However, when considering absolute numbers, Nigeria had the largest numbers of unvaccinated U1 in conflict -affected areas, though Somalia, South Sudan, and DRC also ranked high. Note that conflict-affected unvaccinated U1 are disbursed across all other geographic settings (urban, peri-urban, remote-rural, and rural non-remote) and included all those unvaccinated within a conflict affected ADM2 unit.

Unvaccinated U1 across all settings

Fig 4 shows the proportion of U1 not receiving DTP1, broken down by country and urban/rural setting. It highlights the variations that exist between countries, with some countries (e.g. Egypt, South Africa) found to have the largest proportion of U1 not receiving DTP1 in urban areas, and other countries (e.g. Mauritania, Madagascar) found to have substantial numbers in remote-rural areas. Similar proportions for urban/rural settings were observed for the different vaccines (S29 and S30 Figs).

thumbnail
Fig 4. Plot showing the estimated breakdown of children under 1 year of age not receiving DTP1 in 2019 by urban/peri-urban/rural (non-remote)/rural (remote) characteristics, for all countries in the study area in Latin America (AM), Africa (AF), and Asia (AS), and also regional averages.

https://doi.org/10.1371/journal.pgph.0001126.g004

Fig 5 maps the setting where the greatest number of unvaccinated U1 (DTP1) were found, at ADM2, for urban, peri-urban, rural (non-remote), rural (remote), and conflict areas. Again, large heterogeneities were observed both among and within countries, with different characteristics of those unvaccinated observed at both national and sub-national levels. For example, in India, the majority of unvaccinated U1 were found to be in rural (non-remote) areas. However, within Africa, most of those unvaccinated were found to be in conflict-affected, rural (remote) locations, and rural (non-remote) locations. In Latin America, we observed significant proportions of unvaccinated U1 in rural (non-remote) and rural (remote) areas, however in Brazil, higher numbers were estimated to be found in urban and peri-urban areas (S31 and S32 Figs).

thumbnail
Fig 5.

Map highlighting the geographical setting with the estimated greatest number of children under 1 years of age in 2019 not receiving DTP1 at GADM administrative level 2 [31, 37] for Latin America (A), Africa (B), and Asia (C).

https://doi.org/10.1371/journal.pgph.0001126.g005

Discussion

If global targets to reduce the number of zero-dose children are to be met [18], then immunisation programmes need to identify and reach those children [6, 17, 18, 23, 24, 38, 39]. This requires the use of data driven actionable evidence, regarding the location and characteristics of those unvaccinated, and the design of tailored vaccination strategies appropriate for a given context [9, 18, 20, 21, 24, 25]. This study integrates a range of geospatial datasets [5, 27, 29, 30] to estimate the numbers of unvaccinated children living within key at-risk settings, including urban, remote-rural, and conflict affected locations, at the sub-national level. It is complementary to country-specific work, which identifies community and other household and individual level factors that characterise zero-dose populations and quantifies their relationship to vaccination coverage [26].

We find that coverage varies widely among and within countries, with substantial heterogeneities existing in the context and spatial distributions of those unvaccinated. Considering the settings identified by the ERG, we estimate that over 11% of zero-dose children are living in remote-rural areas, more than 26% in urban and peri-urban areas, and between 6 and 18% in conflict-affected locations. Altogether, this means that nearly 40% of zero-dose children are living in remote-rural and urban settings, and nearly 20% in conflict settings. Yet, whilst many of those unvaccinated are found to be living in these key at-risk settings, a significant proportion are located within areas other than these, in areas with lower population and/or built-up density than an urban or peri-urban setting. These findings highlight the variability of immunization coverage, both geographically and in terms of the characteristics of those populations, demonstrating the need for both country and regional specific strategies for immunization, that consider country size, available resources, and the context in which people live [17, 18], as well as further identification and characterisation of those most at risk of missing out on immunisation [17, 18].

There is a need for broader ranging yet tailored interventions, particularly while there are ongoing immunisation system vulnerabilities due to the COVID-19 pandemic [24]. One of the key principles guiding Universal Health Coverage is community designed and driven implementation of services, and there has been previous success in strategies that prioritise community engagement to identify and reach vulnerable populations [9, 40], as well improved public-private partnerships and microplanning to help identify and reach vulnerable populations [9, 40]. Additionally, the ERG recommends a range of targeted data-driven interventions that can help to address vulnerable populations in difficult to identify, hard to reach, and dangerous and fragile settings [40]. Which emphasise the need for timely and actionable data on vulnerable populations, through the use and implementation of electronic immunisation registries, dashboards, and visualisations, that allow current data to be collected and aggregated to the appropriate level for informative decision making [4143].

Whilst we aim to provide the most detailed and up to date analysis of un- and under- vaccinated children characterised as most at risk, the analysis is limited by the choice and definition of those settings, data quality limitations, and both the availability of and ability to link together data from a variety of disparate sources. Regarding the choice of the settings, we chose to focus on key at risk populations, as identified by the ERG [40] to begin to characterise those most at risk from un- and under-vaccination. However, as highlighted by the results, nearly 60% are found to be living outside of these settings. There is, therefore, scope to expand on and further characterise the key geographical settings in which the most disadvantaged populations are located, as well as the consideration of non-geographic dimensions, such as gender related barriers. Further work could look to examine the numbers of zero-dose children living outside of urban, remote-rural, and conflict-affected settings, to explore other potentially relevant variables that may help to explain barriers to immunisation [18, 44]. For example, when measuring remoteness, using travel-time to the nearest health facility [45], as opposed to the nearest town or city, which may be a more relevant measure in assessing the effect of geographical accessibility on vaccination coverage [46, 47].

Additionally, defining what is urban or rural can be challenging, with governments typically establishing their own definitions, making it difficult to meaningfully compare indicators across national borders [48]. For this study, we use the most current and recent globally available standard definitions of urban and rural [30]. However, the datasets feeding into these decisions are typically continuous in nature and so the choice of threshold or data to use naturally affects the estimates produced [49], and such simple classifications may unduly lead to the concealment of smaller areas of geographical inequality [50]. There is additionally the challenge of defining informal urban settlements, without access to globally available comparable data. An attempt was made to use accessibility to utility services [51] as a proxy for informal settlements, though comparison to alternative slum data proved validation difficult.

Furthermore, there is scope for exploring the sensitivity of these definitions, such as evaluating the adjustment of threshold values and the comparison of alternative data sets, to examine how much of an effect each has on the estimated numbers of unvaccinated children found to be living within these settings [52]. More recently, there have been collaborative efforts to address these issues, such as the development of a new global definition of urban and rural areas, using the ‘Degree of Urbanisation,’ to facilitate international comparisons. This method considers the urban-rural continuum, using three classes of ‘cities,’ ‘towns & semi-dense areas,’ and ‘rural areas,’ instead of two, as well as population size and density, and considers the functional urban area around each city [53]. Such data may provide more insight into the numbers of zero-dose children found to be living outside urban areas, though within 1 hour to the nearest town or city.

The analysis links together data from a variety of disparate sources, each with their own limitations of use that need to be considered. Whilst we aim to assemble to most recent and spatially detailed data available, certain compromises need to be made to facilitate comparability between the data sets and global coverage. For example, whilst more recent and higher resolution population estimates are available elsewhere [27], the vaccination coverage estimates are available at 5km, and it was deemed sufficient to conduct the analysis using the 1km population estimates within the same period of the vaccination coverage estimates. Additionally, whilst the accuracy and quality of the vaccination coverage estimates have been assessed elsewhere [5], uncertainties remain as to whether survey samples have been conducted in areas of conflict, for instance. Additionally, while we consider remoteness as travel-time to the nearest town/or city [28], one could also consider travel-time to the nearest health facility or hospital, or distance to major roads, which may be of interest in further analysis. Another key factor influencing the estimated outputs is the choice of administrative boundaries used to summarise the numbers of unvaccinated children, as naturally, the use of different or updated boundaries inherently affects how these numbers are aggregated, as demonstrated by the Modifiable Areal Unit Problem (MAUP), which describes how spatial summary measures are inherently influenced by the boundaries that they are reported at [54]. Finally, whilst we attempt to capture conflict using both broad and narrow definitions, the data available [29] largely relies on media coverage, and whilst we aim to consider two years prior to the vaccination coverage estimates, areas of conflict or insecurity can change significantly over time.

Despite the inherent uncertainties observed in the data quality, definitions and thresholds applied, we present here the first available sub-national estimates, across 99 low- and middle-income countries, on the distributions and numbers of children not receiving vaccine doses in key at-risk settings. These baseline estimates provide significant insights into the inequalities in vaccination coverage, that can assist policy makers in the development of effective immunisation strategies that identify and reach all zero-dose children and missed communities [17]. We demonstrate additionally the need for further inquiry and characterisation of those un- and under immunised, the thresholds used to define these, and for more country-specific and targeted approaches to immunisation.

Supporting information

S1 Fig.

Proportion of children under 1 year of age estimated to have not received the third dose of the DTP vaccine in 2019 at administrative level 2 [31, 37] for Latin America (A), Africa (B), and Asia (C).

https://doi.org/10.1371/journal.pgph.0001126.s001

(TIF)

S2 Fig.

Proportion of children under 1 year of age estimated to have not received the first dose of the MCV vaccine in 2019 at administrative level 2 [31, 37] for Latin America (A), Africa (B), and Asia (C).

https://doi.org/10.1371/journal.pgph.0001126.s002

(TIF)

S3 Fig.

Graphs showing the top ten countries for children under 1 year of age not receiving DTP1/DTP3/MCV1 in 2019 measured by (left hand side) total number and (right hand side) proportion of the total children under 1 year of age; broken down by (a) first dose of DTP vaccine, (b) third dose of DTP vaccine; (c) first dose of MCV.

https://doi.org/10.1371/journal.pgph.0001126.s003

(TIF)

S4 Fig.

Proportion of children under 1 year of age in remote-rural areas estimated to have not received the third dose of the DTP vaccine in 2019 at administrative level 2 [31, 37] for Latin America (A), Africa (B), and Asia (C).

https://doi.org/10.1371/journal.pgph.0001126.s004

(TIF)

S5 Fig.

Proportion of children under 1 year of age in remote-rural areas estimated to have not received the first dose of the MCV vaccine in 2019 at administrative level 2 [31, 37] for Latin America (A), Africa (B), and Asia (C).

https://doi.org/10.1371/journal.pgph.0001126.s005

(TIF)

S6 Fig. Proportion and total number of children under 1 year of age in remote-rural areas estimated to have not received the first dose of the DTP vaccine in 2019 for the top 20 highest ranking countries.

https://doi.org/10.1371/journal.pgph.0001126.s006

(TIF)

S7 Fig. Proportion and total number of children under 1 year of age in remote-rural areas estimated to have not received the third dose of the DTP vaccine in 2019 for the top 20 highest ranking countries.

https://doi.org/10.1371/journal.pgph.0001126.s007

(TIF)

S8 Fig. Proportion and total number of children under 1 year of age in remote-rural areas estimated to have not received the first dose of the MCV vaccine in 2019 for the top 20 highest ranking countries.

https://doi.org/10.1371/journal.pgph.0001126.s008

(TIF)

S9 Fig.

Proportion of children under 1 year of age in urban areas estimated to have not received the first dose of the DTP vaccine in 2019 at administrative level 2 [31, 37] for Latin America (A), Africa (B), and Asia (C).

https://doi.org/10.1371/journal.pgph.0001126.s009

(TIF)

S10 Fig.

Proportion of children under 1 year of age in urban areas estimated to have not received the third dose of the DTP vaccine in 2019 at administrative level 2 [31, 37] for Latin America (A), Africa (B), and Asia (C).

https://doi.org/10.1371/journal.pgph.0001126.s010

(TIF)

S11 Fig.

Proportion of children under 1 year of age in remote-rural areas estimated to have not received the first dose of the MCV vaccine in 2019 at administrative level 2 [31, 37] for Latin America (A), Africa (B), and Asia (C).

https://doi.org/10.1371/journal.pgph.0001126.s011

(TIF)

S12 Fig. Proportion and total number of children under 1 year of age in urban areas estimated to have not received the first dose of the DTP vaccine in 2019 for the top 20 highest ranking countries.

https://doi.org/10.1371/journal.pgph.0001126.s012

(TIF)

S13 Fig. Proportion and total number of children under 1 year of age in urban areas estimated to have not received the third dose of the DTP vaccine in 2019 for the top 20 highest ranking countries.

https://doi.org/10.1371/journal.pgph.0001126.s013

(TIF)

S14 Fig. Proportion and total number of children under 1 year of age in urban areas estimated to have not received the first dose of the MCV vaccine in 2019 for the top 20 highest ranking countries.

https://doi.org/10.1371/journal.pgph.0001126.s014

(TIF)

S15 Fig.

Proportion of children under 1 year of age in peri-urban areas estimated to have not received the first dose of the DTP vaccine in 2019 at administrative level 2 [31, 37] for Latin America (A), Africa (B), and Asia (C).

https://doi.org/10.1371/journal.pgph.0001126.s015

(TIF)

S16 Fig.

Proportion of children under 1 year of age in peri-urban areas estimated to have not received the third dose of the DTP vaccine in 2019 at administrative level 2 [31, 37] for Latin America (A), Africa (B), and Asia (C).

https://doi.org/10.1371/journal.pgph.0001126.s016

(TIF)

S17 Fig.

Proportion of children under 1 year of age in peri-urban areas estimated to have not received the first dose of the MCV vaccine in 2019 at administrative level 2 [31, 37] for Latin America (A), Africa (B), and Asia (C).

https://doi.org/10.1371/journal.pgph.0001126.s017

(TIF)

S18 Fig.

Proportion of children under 1 year of age unvaccinated for DTP1 in rural non-remote areas (Pakistan and India [31, 37]), within 0 to 60 (A), 60 to 120 (B), and 120 to 180 (C) minutes of the nearest town or city of 500,000 people or more.

https://doi.org/10.1371/journal.pgph.0001126.s018

(TIF)

S19 Fig.

Proportion of children under 1 year of age unvaccinated for DTP1 in rural non-remote areas (Nigeria and Ethiopia [31, 37]), within 0 to 60 (A), 60 to 120 (B), and 120 to 180 (C) minutes of the nearest town or city of 500,000 people or more.

https://doi.org/10.1371/journal.pgph.0001126.s019

(TIF)

S20 Fig.

Proportion of children under 1 year of age unvaccinated for DTP3 in rural non-remote areas (Pakistan and India [31, 37]), within 0 to 60 (A), 60 to 120 (B), and 120 to 180 (C) minutes of the nearest town or city of 500,000 people or more.

https://doi.org/10.1371/journal.pgph.0001126.s020

(TIF)

S21 Fig.

Proportion of children under 1 year of age unvaccinated for DTP3 in rural non-remote areas (Nigeria and Ethiopia [31, 37]), within 0 to 60 (A), 60 to 120 (B), and 120 to 180 (C) minutes of the nearest town or city of 500,000 people or more.

https://doi.org/10.1371/journal.pgph.0001126.s021

(TIF)

S22 Fig.

Proportion of children under 1 year of age unvaccinated for MCV1 in rural non-remote areas (Pakistan and India [31, 37]), within 0 to 60 (A), 60 to 120 (B), and 120 to 180 (C) minutes of the nearest town or city of 500,000 people or more.

https://doi.org/10.1371/journal.pgph.0001126.s022

(TIF)

S23 Fig.

Proportion of children under 1 year of age unvaccinated for MCV1 in rural non-remote areas (Nigeria and Ethiopia [31, 37]), within 0 to 60 (A), 60 to 120 (B), and 120 to 180 (C) minutes of the nearest town or city of 500,000 people or more.

https://doi.org/10.1371/journal.pgph.0001126.s023

(TIF)

S24 Fig.

Proportion of children under 1 year of age in conflict-affected areas (broad definition) estimated to have not received the third dose of the DTP vaccine in 2019 at administrative level 2 for Africa and Asia [31, 37], with close ups shown for northern sub-Saharan Africa (A), and the Middle East/West Asia region (B).

https://doi.org/10.1371/journal.pgph.0001126.s024

(TIF)

S25 Fig.

Proportion of children under 1 year of age in conflict-affected areas (broad definition) estimated to have not received the first dose of the MCV vaccine in 2019 at administrative level 2 for Africa and Asia [31, 37], with close ups shown for northern sub-Saharan Africa (A), and the Middle East/West Asia region (B).

https://doi.org/10.1371/journal.pgph.0001126.s025

(TIF)

S26 Fig. Proportion and total number of children under 1 year of age in conflict-affected areas (broad definition) estimated to have not received the first dose of the DTP vaccine in 2019 for the top 20 highest ranking countries.

https://doi.org/10.1371/journal.pgph.0001126.s026

(TIF)

S27 Fig. Proportion and total number of children under 1 year of age in conflict-affected areas (broad definition) estimated to have not received the third dose of the DTP vaccine in 2019 for the top 20 highest ranking countries.

https://doi.org/10.1371/journal.pgph.0001126.s027

(TIF)

S28 Fig. Proportion and total number of children under 1 year of age in conflict-affected areas (broad definition) estimated to have not received the first dose of the MCV vaccine in 2019 for the top 20 highest ranking countries.

https://doi.org/10.1371/journal.pgph.0001126.s028

(TIF)

S29 Fig. Plot showing the estimated breakdown of children under 1 year of age not receiving DTP3 in 2019 by urban/peri-urban/rural (non-remote)/rural (remote) characteristics, for all countries in the study area in Latin America (AM), Africa (AF), and Asia (AS), and also regional averages.

https://doi.org/10.1371/journal.pgph.0001126.s029

(TIF)

S30 Fig. Plot showing the estimated breakdown of children under 1 year of age not receiving MCV1 in 2019 by urban/peri-urban/rural (non-remote)/rural (remote) characteristics, for all countries in the study area in Latin America (AM), Africa (AF), and Asia (AS), and also regional averages.

https://doi.org/10.1371/journal.pgph.0001126.s030

(TIF)

S31 Fig.

Map highlighting the geographical setting with the estimated greatest number of children under 1 years of age in 2019 not receiving DTP3 at administrative level 2 [31, 37] for Latin America (A), Africa (B), and Asia (C).

https://doi.org/10.1371/journal.pgph.0001126.s031

(TIF)

S32 Fig.

Map highlighting the geographical setting with the estimated greatest number of children under 1 years of age in 2019 not receiving MCV1 at administrative level 2 [31, 37] for Latin America (A), Africa (B), and Asia (C).

https://doi.org/10.1371/journal.pgph.0001126.s032

(TIF)

Acknowledgments

We would like to acknowledge the support, data provision and insights provided by John Mosser at the Institute for Health Metrics and Evaluation (IHME), University of Washington, and Francesco Checchi at the London School of Hygiene & Tropical Medicine (LSHTM).

References

  1. 1. Machingaidze S, Wiysonge CS, Hussey GD. Strengthening the Expanded Programme on Immunization in Africa: Looking beyond 2015. PLoS Med. 2013;10: e1001405. pmid:23526886
  2. 2. Peck M, Gacic-Dobo M, Diallo MS, Nedelec Y, Sodha SS, Wallace AS. Global Routine Vaccination Coverage, 2018. MMWR Morb Mortal Wkly Rep. 2019;68: 937–942. pmid:31647786
  3. 3. World Health Organization. Global vaccine action plan 2011–2020. 2013. Available: https://www.who.int/publications/i/item/global-vaccine-action-plan-2011-2020
  4. 4. Rainey JJ, Watkins M, Ryman TK, Sandhu P, Bo A, Banerjee K. Reasons related to non-vaccination and under-vaccination of children in low and middle income countries: findings from a systematic review of the published literature, 1999–2009. Vaccine. 2011;29: 8215–8221. pmid:21893149
  5. 5. Sbarra AN, Rolfe S, Nguyen JQ, Earl L, Galles NC, Marks A, et al. Mapping routine measles vaccination in low- and middle-income countries. Nature. 2021;589: 415–419. pmid:33328634
  6. 6. Harrison K, Rahimi N, Carolina Danovaro-Holliday M. Factors limiting data quality in the expanded programme on immunization in low and middle-income countries: A scoping review. Vaccine. 2020;38: 4652–4663. pmid:32446834
  7. 7. Andre FE, Booy R, Bock HL, Clemens J, Datta SK, John TJ, et al. Vaccination greatly reduces disease, disability, death and inequity worldwide. Bull World Health Organ. 2008;86: 140–146. pmid:18297169
  8. 8. Mosser JF, Gagne-Maynard W, Rao PC, Osgood-Zimmerman A, Fullman N, Graetz N, et al. Mapping diphtheria-pertussis-tetanus vaccine coverage in Africa, 2000–2016: a spatial and temporal modelling study. The Lancet. 2019;393: 1843–1855. pmid:30961907
  9. 9. Chopra M, Bhutta Z, Blanc DC, Checchi F, Gupta A, Lemango ET, et al. Addressing the persistent inequities in immunization coverage. Bull World Health Organ. 2020;98: 146–148. pmid:32015586
  10. 10. Abbas K, Procter SR, van Zandvoort K, Clark A, Funk S, Mengistu T, et al. Routine childhood immunisation during the COVID-19 pandemic in Africa: a benefit–risk analysis of health benefits versus excess risk of SARS-CoV-2 infection. Lancet Glob Health. 2020;8: e1264–e1272. pmid:32687792
  11. 11. World Health Organization. COVID-19 pandemic fuels largest continued backslide in vaccinations in three decades. 2022 [cited 23 Aug 2022]. Available: https://www.who.int/news/item/15-07-2022-covid-19-pandemic-fuels-largest-continued-backslide-in-vaccinations-in-three-decades
  12. 12. Ozawa S, Yemeke TT, Evans DR, Pallas SE, Wallace AS, Lee BY. Defining hard-to-reach populations for vaccination. Vaccine. Elsevier Ltd; 2019. pp. 5525–5534. pmid:31400910
  13. 13. Wittet S. Introducing GAVI and the Global Fund for Children’s Vaccines. Vaccine. Elsevier; 2000. pp. 385–386. pmid:11027798
  14. 14. World Health Organization, Unicef. Global Immunization Vision and Strategy. World Health Organization; 2013 [cited 26 May 2021]. Available: https://www.who.int/immunization/givs/en/
  15. 15. Equity Reference Group for Immunization. WHO WE ARE. 2021. Available: https://sites.google.com/view/erg4immunisation
  16. 16. Equity Reference Group for Immunization. A focus on “zero dose” children: Key issues for consideration. 2020. Available: https://sites.google.com/view/erg4immunisation/products?authuser=0
  17. 17. Gavi The Vaccine Alliance. Gavi Strategy 5.0. 2021 [cited 7 Jan 2022]. Available: https://www.gavi.org/our-alliance/strategy/phase-5-2021-2025
  18. 18. World Health Organization. IMMUNIZATION AGENDA 2030. 2020. Available: https://www.who.int/publications/m/item/immunization-agenda-2030-a-global-strategy-to-leave-no-one-behind
  19. 19. World Health Organization. Limitations related to globally reported immunization subnational data. 2020;2019: 2019–2020.
  20. 20. Utazi CE, Thorley J, Alegana VA, Ferrari MJ, Takahashi S, Metcalf CJE, et al. High resolution age-structured mapping of childhood vaccination coverage in low and middle income countries. Vaccine. 2018;36: 1583–1591. pmid:29454519
  21. 21. Utazi CE, Wagai J, Pannell O, Cutts FT, Rhoda DA, Ferrari MJ, et al. Geospatial variation in measles vaccine coverage through routine and campaign strategies in Nigeria: Analysis of recent household surveys. Vaccine. 2020;38: 3062–3071. pmid:32122718
  22. 22. Utazi CE, Thorley J, Alegana VA, Ferrari MJ, Nilsen K, Takahashi S, et al. A spatial regression model for the disaggregation of areal unit based data to high-resolution grids with application to vaccination coverage mapping. Stat Methods Med Res. 2019;28: 3226–3241. pmid:30229698
  23. 23. Galles NC, Liu PY, Updike RL, Fullman N, Nguyen J, Rolfe S, et al. Measuring routine childhood vaccination coverage in 204 countries and territories, 1980–2019: a systematic analysis for the Global Burden of Disease Study 2020, Release 1. The Lancet. 2021;398: 503–521. pmid:34273291
  24. 24. Cutts FT, Ferrari MJ, Krause LK, Tatem AJ, Mosser JF. Vaccination strategies for measles control and elimination: time to strengthen local initiatives. BMC Med. 2021;19: 1–8. pmid:33397366
  25. 25. Utazi CE, Thorley J, Alegana VA, Ferrari MJ, Takahashi S, Metcalf CJE, et al. Mapping vaccination coverage to explore the effects of delivery mechanisms and inform vaccination strategies. Nat Commun. 2019;10: 1–10. pmid:30967543
  26. 26. Utazi CE, Pannell Id O, Aheto Id MK, Wigley A, Tejedor-Garavito Id N, Id JW, et al. Assessing the characteristics of un- and under-vaccinated children in low- and middle-income countries: A multi-level cross-sectional study. PLOS Global Public Health. 2022;2: 1–13.
  27. 27. WorldPop. Open Spatial Demographic Data and Research. 2021. Available: https://www.worldpop.org/
  28. 28. Weiss DJ, Nelson A, Gibson HS, Temperley W, Peedell S, Lieber A, et al. A global map of travel time to cities to assess inequalities in accessibility in 2015. Nature. 2018;553: 333–336. pmid:29320477
  29. 29. Acled. The Armed Conflict Location and Event Data Project. 2021. Available: https://acleddata.com/#/dashboard
  30. 30. European Commission. Global Human Settlement—GHSL. 2021. Available: https://ghsl.jrc.ec.europa.eu/
  31. 31. GADM. GADM Data. 2018. Available: https://gadm.org/data.html
  32. 32. Pezzulo C, Hornby GM, Sorichetta A, Gaughan AE, Linard C, Bird TJ, et al. Sub-national mapping of population pyramids and dependency ratios in Africa and Asia. Scientific Data 2017 4:1. 2017;4: 1–15. pmid:28722706
  33. 33. Tatem AJ, Garcia AJ, Snow RW, Noor AM, Gaughan AE, Gilbert M, et al. Millennium development health metrics: Where do Africa’s children and women of childbearing age live? Popul Health Metr. 2013;11: 1–11.
  34. 34. Alegana VA, Atkinson PM, Pezzulo C, Sorichetta A, Weiss D, Bird T, et al. Fine resolution mapping of population age-structures for health and development applications. J R Soc Interface. 2015;12. pmid:25788540
  35. 35. Myers BA, Fisher RP, Nelson N, Belton S. Defining Remoteness from Health Care: Integrated Research on Accessing Emergency Maternal Care in Indonesia. AIMS Public Health. 2015;2: 257–273. pmid:29546110
  36. 36. Meara JG, Leather AJM, Hagander L, Alkire BC, Alonso N, Ameh EA, et al. Global Surgery 2030: Evidence and solutions for achieving health, welfare, and economic development. The Lancet. 2015;386: 569–624.
  37. 37. GADM. GADM Licence. 2021 [cited 8 Jul 2022]. Available: https://gadm.org/license.html
  38. 38. United Nations. Goal 3 | Department of Economic and Social Affairs. 2021 [cited 24 Nov 2021]. Available: https://sdgs.un.org/goals/goal3
  39. 39. World Health Organization. Global Vaccine Action Plan. Vaccine. 2020. pmid:23734366
  40. 40. Equity Reference Group for Immunization. ERG Advocacy Brief. 2019 [cited 5 Feb 2022]. Available: sites.google.com/view/erg4immunisation
  41. 41. Equity Reference Group for Immunisation. Tackling inequities in immunization outcomes: urban contexts. 2019.
  42. 42. Equity Reference Group for Immunisation. Tackling inequities in immunization outcomes: conflict contexts. 2019. Available: https://sites.google.com/view/erg4immunisation/products?authuser=0
  43. 43. Equity Reference Group for Immunisation. Tackling inequities in immunization outcomes: remote rural contexts. 2019. Available: https://sites.google.com/view/erg4immunisation/products?authuser=0
  44. 44. Bangura JB, Xiao S, Qiu D, Ouyang F, Chen L. Barriers to childhood immunization in sub-Saharan Africa: A systematic review. BMC Public Health. 2020;20: 1–15.
  45. 45. Weiss DJ, Nelson A, Vargas-Ruiz CA, Gligorić K, Bavadekar S, Gabrilovich E, et al. Global maps of travel time to healthcare facilities. Nature Medicine 2020 26:12. 2020;26: 1835–1838. pmid:32989313
  46. 46. Joseph NK, Macharia PM, Ouma PO, Mumo J, Jalang’o R, Wagacha PW, et al. Spatial access inequities and childhood immunisation uptake in Kenya. BMC Public Health. 2020;20: 1–12.
  47. 47. Okwaraji YB, Mulholland K, Schellenberg J, Andarge G, Admassu M, Edmond KM. The association between travel time to health facilities and childhood vaccine coverage in rural Ethiopia. A community based cross sectional study. BMC Public Health. 2012;12: 1–9.
  48. 48. World Bank. How do we define cities, towns, and rural areas? 2020 [cited 17 Dec 2021]. Available: https://blogs.worldbank.org/sustainablecities/how-do-we-define-cities-towns-and-rural-areas
  49. 49. Wong DW. Modifiable Areal Unit Problem. International Encyclopaedia of Human Geography. Elsevier; 2009. pp. 169–174. https://doi.org/10.1016/B978-008044910-4.00475–2
  50. 50. Arsenault C, Harper S, Nandi A, Mendoza Rodríguez JM, Hansen PM, Johri M. An equity dashboard to monitor vaccination coverage. Bull World Health Organ. 2017;95: 128–134. pmid:28250513
  51. 51. Brelsford C, Martin T, Hand J, Bettencourt LMA. Toward cities without slums: Topology and the spatial evolution of neighborhoods. Sci Adv. 2018;4: 1–8. pmid:30167459
  52. 52. Gething P, Tatem A, Bird T, Burgert-Brucker CR. Creating Spatial Interpolation Surfaces with DHS Data. 2015. Available: https://www.dhsprogram.com/publications/publication-SAR11-Spatial-Analysis-Reports.cfm?cssearch=17047_1
  53. 53. The European Union, The Food and Agriculture Organization of the United Nations, The International Labour Office, The Organization for Economic Co-operation and Development, United Nations Human Settlements Programme, World Bank. Items for discussion and decision: demographic statistics. 2020. Available: https://ec.europa.eu/eurostat/cros/content/recommendation-method-delineate-cities-urban-and-rural-areas-international-statistical-comparisons_en
  54. 54. Fotheringham AS, Wong DWS. The Modifiable Areal Unit Problem in Multivariate Statistical Analysis: 1991;23: 1025–1044.