The INSPIRING Jigawa Trial is a cluster randomised controlled trial (cRCT), evaluating a three-part whole system strengthening intervention package, in Kiyawa Local Government Area (LGA), Jigawa State, Nigeria. This will be complemented with an embedded ethnographic process evaluation and economic evaluation to determine cost-effectiveness. The trial will run from January 2021 to September 2022, following a formative phase and COVID-19 adaptation from December 2019 to December 2020 (Figure 1).
Setting
The trial will be conducted in Kiyawa LGA, Jigawa state. The population is approximately 230,000 people, with 25% estimated to be children under-five years. The area is predominantly Islamic with two main ethnic groups - Hausa and Fulani, living in mostly rural communities.[12] Large extended family groups live in compounds, which often comprise several households with an element of shared resources. At study inception, Kiyawa LGA had 33 government health facilities, made up of primary health centres (PHCs), basic health centres and health posts, and a further two private primary care facilities, and private pharmacy shops. Children who meet WHO criteria for referral should be sent to PHCs or hospital care at Dutse General or Rasheed Shekoni Teaching hospital, both located in the state capital, Dutse, in the neighbouring LGA (Figure 2). Maternal and child health services are provided free at selected facilities, but out of pocket costs still pose a financial barrier to access.[4] Kiyawa LGA was selected through discussion between Save the Children Nigeria, the State Ministry of Health (SMOH) and the Jigawa State Government, using pre-defined criteria (e.g. mortality burden, road access).
Design
This is a pragmatic community-based cRCT, following a formative phase of intervention development, concept testing and community engagement. Clusters are defined as the geographical catchment area of government primary care facilities. All villages in Kiyawa LGA will be included in the study; however, Kiyawa PHC cluster will be excluded from the impact evaluation as this facility is in a peri-urban area and provides a level of inpatient care - unlike the other primary facilities. Impact against the primary outcome will be evaluated using an open prospective cohort, recording vital events (pregnancies, births and under-five child deaths) amongst a random sample of women on a rolling 4-monthly basis. Secondary outcomes will be recorded during cross-sectional surveys conducted at baseline (January-March 2021) and end line (July-September 2022) - Figure 1. The same random sample of compounds, and all eligible women and children residing in these compounds, will be included in both surveys and prospective cohort.
Population
The target population for the impact evaluation is women of childbearing age, defined as 16-49 years inclusive, and children aged 0-59 months inclusive, who reside permanently in Kiyawa LGA. The intervention is open to all community members, with no age or gender restrictions.
Intervention
The intervention is a locally adapted ‘whole systems strengthening’ package of three evidence-based activities: PLA men’s and women’s groups[8]; Partnership Defined Quality Scorecard (PDQS)[13-15]; training, mentorship and provision of basic essential equipment and commodities for child health (Table 1). The details of the community groups and PDQS have been refined through a co-design process, using a modified version of community conversation methodology. In its original form, the approach has been used across a range of settings in Africa to shift and influence behaviour change in relation to health, including HIV/AIDS [16] and female genital mutilation [17]. Though typically applied as an intervention itself, our reformulation was designed to deepen engagement with communities at scale as part of the concept testing process. Conversations were organised in a similar manner to the PLA groups that will form one component of the intervention, providing an additional layer for exploring the acceptability of this approach prior to implementation. Groups of stakeholders, including men, women and healthcare workers, were brought together through a series of iterative and interactive discussions to explore: perceptions of key concepts underpinning the interventions (e.g. challenges related to child health); community relationships with health care workers; and how key intervention components would work best in their communities, including location and timing for delivery of groups and incentives. Full details of this methodology and results will be published separately.
PLA groups with integrated PDQS
Groups of approximately 20-30 men and women in each community will be convened. Group meetings will be held separately for men and women to allow gender norms to be respected, and tailor meetings to different locations and times. Groups are open to all community members, and sharing of group messages will be encouraged; men and women with young children and those currently pregnant, will be particularly encouraged to join.
The groups will work through a four-phase PLA cycle, following an initial introductory session. The phases include: the analysis of the situation and prioritisation of child health issues in their communities (phase 1); planning actions to tackle these issues (phase 2); implementing the selected strategies (phase 3); collective self-evaluation (phase 4) - Figure 3. The PDQS process focussed specifically on healthcare service quality issues, with group members and healthcare workers joining together to mutually agree on quality indicators and joint actions. PDQS will be incorporated into all 4-phases of the PLA cycle, where healthcare workers will attend men’s and women’s groups. Each phase can involve multiple physical meetings, decided on by group members (see Ethics section for details on COVID-19 mitigations). The completion of one PLA cycle is anticipated to take 4-5 months, and groups will repeat the cycle multiple times over the 18-month intervention period.
We plan 340 groups to ensure the recommended coverage of one group per 500 population[6]. Groups will be led by 170 trained community health volunteers (CHV), provided with a stipend. CHVs will facilitate an average of two groups, with 12 to 28 groups per cluster, depending on the population. CHVs will be recruited from the local communities, meeting the following criteria: previous experience in community mobilization; basic knowledge of child health; fluent in Hausa; minimum basic primary education; resident in Kiyawa LGA. Where possible, facilitators will be recruited from those working as Volunteer Community Mobilizers (VCM), Team Supervisors or other community health workers. They will receive a 5-day training, covering: the PLA approach; their roles and responsibilities; participatory skills development using observation and feedback; use of the flipbook job aid; and collaboration with key community stakeholders. Following training, a questionnaire assessment will be administered, and only those showing adequate competencies in networking, negotiation and mediation, and basic child health knowledge will be retained. CHVs will be supervised by Save the Children study staff based in Dutse, in collaboration with the SMOH, Kiyawa LGA staff and health facility staff.
Health system strengthening
The staff at health posts, basic health centres and PHCs within the intervention clusters will receive a package of trainings to support child health, including: iCCM for community health workers; IMCI for facility staff; nutrition management and vaccination supply chain management (Table 1). Training will be delivered at the start of the intervention period, and then followed up with mentorship and supervision. Training and supervision will be delivered by Save the Children Nigeria in collaboration with the SMOH. A post-training ‘start-up kit’ will be provided, including basic essential equipment (e.g. respiratory rate timers, thermometers, MUAC tape) and guideline booklets and charts.
Control
All clusters, including control, will have access to a child health radio programme throughout the project period (Figure 1). The radio programme consists of weekly drama’s, covering prevention, recognition and care-seeking for common childhood diseases, including pneumonia. There will be a monthly call-in session, where members of the public can ask questions and share experiences. The radio station is accessible across the whole study area.
The two referral hospitals located in Dutse LGA (Figure 2), and three PHCs in Kiyawa LGA will be supported with oxygen and pulse oximetry, to ensure minimum standard of care is available for children meeting WHO IMCI referral criteria in intervention and control clusters.
Outcome
The primary outcome is under-five mortality. This is defined as the number of children aged 7 days to 59 months reported to have died over a 12-month period who resided in sampled compounds (numerator), divided by the total number of children aged 7 days to 59 months who reside in sampled compounds (denominator). Deaths in the first week of life are excluded due to the challenges of accurate reporting of stillbirths and early neonatal deaths,[18] and we do not expect the intervention to impact perinatal causes. Secondary outcomes are detailed in Table 2, and are based on the INSPIRING Programme Theory of Change.
Randomisation
The 33 clusters will be randomised using a 1:1 ratio between intervention and control. Randomisation will be done publicly, with representatives from the LGA and all the wards, following community consent for the study and randomisation process. The names of the health facility clusters will be written on pieces of paper, folded and then pulled out of a container in front of community witnesses. The first 17 will be assigned to intervention, and the final 16 will be assigned to control. Due to the nature of the intervention, communities will not be blinded to their status; however, we will not inform data collectors of the intervention status of villages or that they work across intervention and control clusters, and investigators will be blinded during primary analysis.
Sampling
During the formative phase, we conducted a community mapping exercise to create a sampling frame, enumerating all villages and the total number of compounds. We will sample proportionately to cluster size, with a minimum of 50 compounds per cluster. Simple random sampling will be used to generate a list of compound numbers within each cluster. During the baseline survey, data collectors will use an Expanded Programme of Immunization approach[19] to number all the compounds in a village, following these steps: 1. locating the centre of the village with support from a community gate keeper; 2. spinning a pen and walking in the direction it points; 3. numbering the first compound encountered as 1; 4. walking in a clockwise direction until all compounds are numbered. They will then recruit the compounds according to the generated random sample. The same compounds will be included in all subsequent surveys and GPS coordinates will be taken to facilitate follow-ups. All eligible women, and children under-five years of age who are under their direct care, residing within sampled compounds will be recruited.
Sample size
The under-five mortality rate in Jigawa was reported as 192/1000 livebirths in 2017 [20], and deaths in the first week of life may reasonably account for 15% of the total under-five deaths. More recently, a participatory radio programme on child health and COVID-19 was delivered across the LGA (June – December 2020) and vaccine coverage has increased (unpublished data), which we assume to have reduced mortality. We therefore used a conservative baseline mortality of 100 deaths amongst children aged 7 days to 59 months per 1000 livebirths. With the following parameters, we will have a minimum detectable effect size of 30% [6]: a) 4,480 compounds; b) 80% power; c) 5% significance; d) intra-cluster correlation of 0.007[21]; e) coefficient of variance of cluster size of 0.74. This assumes three children under-five per compound and allows for 10% loss to follow-up, resulting in a total sample of 12,096 children. We will review these assumptions following the baseline survey.
Data Collection
Data collection will be done by 20 female clinical data collectors recruited from Jigawa, with two field supervisors. They will work in teams of 3-4, accompanied by a lay data collector to support community mapping. A sub-set of data collectors will be retained between surveys to conduct prospective vital events reporting. Data will be collected using a custom built CommCare application on Android tablets. The forms will have in-built skip patterns and cleaning rules to minimise data entry errors. Data will be uploaded daily to a central secure server, and participant ID and data cleaning checks will be conducted continually during the data collection period. Data collectors will be trained using a hybrid approach, with a mix of practical sessions, at-home assignments and online webinars over a 2-week period. This will be followed by a field pilot in a neighbouring LGA and mock interviews with a group of women in the community who took part in questionnaire co-design discussions.
Baseline and endline surveys
The baseline and endline surveys are planned to take 3-months, with approximately 70 compounds interviewed each day. Three respondent types will be interviewed in each compound: 1. Head of compound; 2. Head of households; 3. Eligible women. The head, or most senior member of the compound present at the time of the survey, interview will include: compound membership, structure and construction; shared compound and individual household assets and income; and community cohesion. Household heads will be asked about household membership and asset ownership. Women will be asked about themselves, and then about each of the children under-five who are in their direct care. Questions include: recent birth history; demographics and social status; knowledge of pneumonia; recent illness episodes and care-seeking; vaccination status; feeding practices; smoke exposure; community cohesion and wellbeing (using the Short Warwick-Edinburgh Mental Wellbeing Scale [22]). Questions on pneumonia knowledge and recent illness will use multi-media (i.e. videos and sounds) to provide examples of key signs and symptoms. In the endline survey, additional questions will be asked about intervention exposure and engagement.
A clinical screening for malnutrition and pneumonia will be conducted on all children aged 0-59 months who are present in the compound at the time of the survey. The assessment will follow the WHO’s 2014 IMCI guidelines,[23] enhanced with pulse oximetry using the Lifebox pulse oximeter (Acare Technology, New Taipei City, Taiwan). If a child is found with pneumonia, the data collector will inform the caregiver and advise them to seek care and facilitate referral in cases of severe illness.
Prospective vital events reporting
Following recruitment, the same compounds will be visited on a four-monthly rolling-basis. All previously registered women will be asked about their current pregnancy status, the outcome of previously reported and completed pregnancies and the vital status of all registered children. Any new children under-five will be registered and included in the cohort. Verbal autopsies (VAs) will be conducted for all deaths in children under-five, including those reported in the prior 12-months from birth histories. This time period was chosen to minimize recall bias, but ensure a culturally appropriate period of time has passed since the death. We will use COVID-19 adapted WHO 2016 VA tool and include locally adapted social autopsy questions which explore care-seeking pathways.[24, 25]
Analysis
The primary analysis will be intention-to-treat, comparing under-five mortality between intervention and control clusters over a 12-month period (July 2021 – June 2022), using logistic regression, adjusted for compound-level clustering and trial cluster. Data from the first 6-months of intervention implementation (January – June 2021) will be considered as a baseline period, before any intervention effect would be expected. Any imbalances in baseline characteristics between arms will be presented to the Trial Steering Committee (TSC), who will advise on whether the primary analysis should be adjusted for these. We will conduct a complete case analysis, where only children with confirmed survival outcomes will be included; a sensitivity analyses using multiple imputation will be done, if outcome data is found to be missing at random.
Secondary analyses will explore: differences in pneumonia prevalence, coverage of prevent and protect indicators, knowledge and care-seeking between intervention and control clusters (Table 2); changes in pneumonia prevalence, knowledge, and care-seeking between baseline and endline surveys.
Process Evaluation
We will also conduct a concurrent mixed-methods process evaluation (Supplementary Appendix 1), in line with UK Medical Research Council guidelines to describe intervention implementation and develop the theory of how the intervention can affect health outcomes in this context.[26] The process evaluation will start before the intervention period, from June 2020, and continue throughout the trial period.
Qualitative
The qualitative aspect will take an ethnographic approach[27], to describe how, why, where, when and for whom (under what conditions) the intervention works. Our approach enables us to develop understandings of outcomes within social context, and build theory grounded in real world settings.[27] It ensures that theory of change and outcomes identified through the intervention can be explored as part of an iterative analysis that remains anchored to the daily realities of implementation, delivery and uptake of the intervention. The ethnography will operate at three levels: household, health services and Intervention. Each level will include a blend of participant observation, longitudinal in-depth interviews, and focus group discussions. At household level, we will follow a sample of 30 randomly selected households, stratified to reflect intervention (n=3) and control (n=3) clusters. Up to five women from each household will be invited to participate. PLA groups associated to these clusters will also be observed through participant observation, to explore live dynamics of groups. Health facilities in each cluster will also be observed monthly across the intervention. Data will be collected by three female Nigerian research assistants. All field notes, interviews and discussions will be transcribed and translated into English for analysis. Monthly analysis meetings between the data collectors and RAB will be done to promote reflexive practice.
Quantitative
The quantitative component involves quarterly extraction of clinical case notes and ward admission logs from all 33 facilities in Kiyawa LGA and the two secondary referral hospitals in Dutse LGA. This will allow us to monitor changes in both clinical practice, diagnosis, cases of suspected pneumonia and inpatient case-fatality rates during the study period. An annual equipment audit will be conducted by a qualified biomedical engineer, to check the availability of functional medical grade oxygen in Jigawa (i.e. minimum standard of care for severe pneumonia cases). CHV group facilitators will keep meeting logs, recording the number of meetings, meeting attenders and their demographics, and key action plans and decisions made by groups. These data will be analysed to describe intervention reach and the different strategies employed by groups.
Economic Evaluation
The economic evaluation will determine the cost-effectiveness of the intervention package relative to current and future spending (opportunity costs and affordability).[28-30] This is crucial considering the current paucity of economic evaluation evidence for interventions to tackle childhood infectious diseases and pneumonia, and will be important to understand in the context of the COVID-19 pandemic. We will conduct a prospective costing of the interventions which will include financial (i.e. capital set-up and recurrent expenditures)[31] and economic costs, including time, and be based on the Ministry of Health provider perspective. We will also consider the household perspective via surveys of financial and opportunity costs of care-seeking to caregivers.
Management and Oversight
Save the Children Nigeria will be responsible for the coordination and implementation of the intervention, working closely with the State Ministry of Health. University College Hospital Ibadan, in collaboration with University College London, Karolinska Institutet, Melbourne University and Johns Hopkins University, will be responsible for the impact, process and economic evaluation. All co-investigators will have access to the final trial dataset. Save the Children UK, GSK and GSK Nigeria will be involved in overall project management. The Project Management Board will meet monthly and include representatives from all partners.
A TSC will be convened for the study, with a plan to meet a minimum of three times (protocol review, mid-point, final analysis), and in between if major ethical or design issues arise. The TSC will be responsible for providing independent and external oversight of the trial conduct, including reviewing: processes, progress, participant safety and protocol amendments. The TSC will comprise of subject specific experts, and will include the following disciplines: statistician, clinician, social scientist, epidemiologist. We are not planning to conduct an interim analysis given the short intervention period, and do not have stop/start rules in place; we will not convene a separate Data Monitoring Committee. The trial is sponsored by University College London, Institute for Global Health (30 Guildford Street, London, WC1N 1EH, UK).
Ethical considerations
We have two key ethical concerns. First is study staff responsibility to act when faced with participants in need. Specifically, if a child is diagnosed with a severe illness according to WHO IMCI criteria during compound visits, they should be referred for inpatient care. In such cases, we will support the family in finding transportation, and inform the caregiver of the diagnosis. Further, we are aware that in our in-depth engagement with 30 compounds over the life of the study as part of the process evaluation, we may identify safeguarding issues, interpersonal violence, health emergencies and challenges in accessing basic livelihood needs. We have a detailed protocol that data collectors will be trained on, to escalate immediately through local partners, so that any extraordinary needs can be addressed quickly.
Secondly, the nature of PLA groups could increase participants’ risks of transmitting COVID-19 if there is on-going community transmission. Implementation will only begin following a local risk assessment, approved by the Project Management Board. The assessment will be based on reported local and national numbers of COVID-19 cases and deaths, and in accordance with local government advice. As an additional precaution, all facilitators and study staff will be provided with face masks, hand sanitizer and training on physical distancing procedures. Community sensitisation about COVID-19 was conducted through a participatory radio programme from June-December 2020, and study staff will continue to promote infection prevention and control messages. Aside from the COVID-19 risks, we do not anticipate any other serious negative impacts to participants taking part, and the intervention package could provide benefit to individuals and wider communities.
Equipoise
Given the different components of the intervention package have previously shown impact on child health outcomes, equipoise needs to be justified. Firstly, combining the three intervention elements into a single complex intervention package is novel. Secondly, implementation of PLA groups in the context of Jigawa, with conservative gender norms and complex compound relationship structures, may pose unique challenges. Finally, the public health messages from the COVID-19 pandemic around physical distancing may have changed how communities meet and interact. We felt all of these factors provide sufficient uncertainty to justify the cRCT design.
Consent
Informed verbal or written consent will be sought from all participants for interviews, focus group discussions and household surveys. Participants will be reimbursed for any transport costs incurred when taking part in the study, and given a small token of appreciation (e.g. soap, face mask) following interviews. Consent for case note reviews from primary and secondary care will be sought from facility managers.
Engagement and Dissemination
Engagement with key stakeholders, including healthcare workers, communities and both State and LGA Ministry of Health officials will be done continually during the project. The overall study aims and focus were developed through round table discussions with project partners, and representatives from the SMOH. Local dissemination events will be held with the Ministry of Health and during community meetings at the end of the project, to share the findings and present the plans for future implementation. However, regular meetings will be held as and when needed to share important findings, discuss interpretation and report on progress.
We will publish the main impact results, process evaluation and economic evaluation results as academic publications in open access journals.