Evaluation of a social franchising and telemedicine programme and the care provided for childhood diarrhoea and pneumonia, Bihar, India

Abstract Objective To evaluate the impact on the quality of the care provided for childhood diarrhoea and pneumonia in Bihar, India, of a large-scale, social franchising and telemedicine programme – the World Health Partners’ Sky Program. Methods We investigated changes associated with the programme in the knowledge and performance of health-care providers by carrying out 810 assessments in a representative sample of providers in areas where the programme was and was not implemented. Providers were assessed using hypothetical patient vignettes and the standardized patient method both before and after programme implementation, in 2011 and 2014, respectively. Differences in providers’ performance between implementation and nonimplementation areas were assessed using multivariate difference-in-difference linear regression models. Findings The programme did not significantly improve health-care providers’ knowledge or performance with regard to childhood diarrhoea or pneumonia in Bihar. There was a persistent large gap between knowledge of appropriate care and the care actually delivered. Conclusion Social franchising has received attention globally as a model for delivering high-quality care in rural areas in the developing world but supporting data are scarce. Our findings emphasize the need for sound empirical evidence before social franchising programmes are scaled up.


Introduction
Diarrhoea and pneumonia are leading causes of childhood morbidity and mortality despite being targeted by global investment in health for decades. In the last 5 years, these diseases were responsible for almost 25% of deaths among children aged 1 to 4 years worldwide. 1 In India, nearly 500 000 children younger than 5 years died from diarrhoea or respiratory infections in 2013. 2 These poor health outcomes were partially due to the low quality of care in both public and private health sectors, including absenteeism, poor knowledge and the know-do gap, i.e. the gap between knowledge of appropriate care and the care actually delivered. [3][4][5][6][7][8][9][10][11][12] Efforts to improve the quality of primary care in developing countries have focused on a variety of strategies, ranging from training and performance incentives to organizational innovations in the private sector and the use of new technologies, such as telemedicine. 13 One prominent approach is social franchising, which is similar to commercial franchising. The aim is to improve a socially desirable outcome, such as health, while generating sufficient revenue to be self-sustaining. In social franchising, a franchisor offers a standardized, branded set of products or services through franchisees who pay a subscription fee to join the franchisor's network. Franchisees, who are typically existing local providers, in turn, receive training and follow service delivery protocols established by the franchisor. They also benefit from marketing, branding, supply chain management and diagnostic services organized by the franchisor. Many franchisors use new information technologies to improve the efficiency and coordination of their network of franchisees. However, despite the rapid growth of social franchising in developing countries, there is little evidence that it affects the quality of care provided on a large scale, [14][15][16] except for a recent programme in Myanmar where the introduction of social franchising was accompanied by a substantial increase in the number of health-care workers. 17,18 In this study, we investigated the effectiveness of the World Health Partners' Sky Program in improving the knowledge and performance of health-care providers in Bihar, India. In addition to its effect on participating health-care providers, it was hoped that the programme would also improve the performance of other local providers through spillover effects and by encouraging competition. Understanding of the programme's effect on the quality of care could help to explain why a programme in rural Bihar costing over 23 million United States dollars (US$) failed to increase the appropriate treatment of childhood diarrhoea or pneumonia. 19 The programme was originally developed as a hub-andspoke model: SkyHealth providers with telemedicine facilities at the hub would link to peripheral rural health providers with smaller, more basic facilities (called SkyCare providers). SkyCare providers typically offered basic primary care and symptom-based treatment and could refer patients to SkyHealth providers. 20 SkyHealth providers had access to telemedicine technology that was able to connect physicians at the World Health Partners' central medical facility in Delhi to Objective To evaluate the impact on the quality of the care provided for childhood diarrhoea and pneumonia in Bihar, India, of a large-scale, social franchising and telemedicine programme -the World Health Partners' Sky Program. Methods We investigated changes associated with the programme in the knowledge and performance of health-care providers by carrying out 810 assessments in a representative sample of providers in areas where the programme was and was not implemented. Providers were assessed using hypothetical patient vignettes and the standardized patient method both before and after programme implementation, in 2011 and 2014, respectively. Differences in providers' performance between implementation and nonimplementation areas were assessed using multivariate difference-in-difference linear regression models. Findings The programme did not significantly improve health-care providers' knowledge or performance with regard to childhood diarrhoea or pneumonia in Bihar. There was a persistent large gap between knowledge of appropriate care and the care actually delivered. Conclusion Social franchising has received attention globally as a model for delivering high-quality care in rural areas in the developing world but supporting data are scarce. Our findings emphasize the need for sound empirical evidence before social franchising programmes are scaled up.
Social franchising and quality of care in Bihar, India Manoj Mohanan et al.  0  20  40  60  80  100 0  20  40  60  80  100   Diagnostic question or  proposed diagnostic test   Areas where the programme  was not implemented   Areas where the programme  was implemented Does the child have a fever or is she/he warm? Is the child's urine normal and has a normal colour?
When did the child last urinate? How do the child's stools look? How often does the child pass stools? How many stools has the child passed? Is there blood or mucous in the child's stools?
Are there worms in the child's stools? Do the child's stools smell foul? Does the child have a stomach ache?
Is the child weak? Is the child vomiting? Is the child drinking a lot of water?
The child's weight should be measured The child's temperature should be measured The child's mucous membranes should be examined The child's skin colour and turgor should be examined The child's abdomen should be palpated Notes: The World Health Partners' Sky Program employed social franchising and telemedicine technology to help improve the knowledge and performance of health-care providers. Implementation areas included 50 study clusters and nonimplementation areas included 30 study clusters. Health-care providers' knowledge was assessed at baseline in 2011 before the programme was implemented and at follow-up in 2014 after implementation using a hypothetical patient vignette of childhood diarrhoea as commonly encountered locally, to which they had to respond. Health-care providers in implementation areas were not all participants in the programme. Notes: The World Health Partners' Sky Program employed social franchising and telemedicine technology to help improve the knowledge and performance of health-care providers. Implementation areas included 50 study clusters and nonimplementation areas included 30 study clusters. Health-care providers' knowledge was assessed at baseline in 2011 before the programme was implemented and at follow-up in 2014 after implementation using a hypothetical patient vignette of childhood pneumonia as commonly encountered locally, to which they had to respond. The knowledge score was the item response score based on questions health-care providers asked interviewers in response to the vignette. Health-care providers in implementation areas were not all participants in the programme.

Research
Social franchising and quality of care in Bihar, India Manoj Mohanan et al.
patients in rural areas via an audiovisual interface. Using this technology, physicians were able to examine patients by auscultation, assess their blood pressure and pulse and obtain electrocardiogram results if needed. In addition, SkyCare providers could offer mobile phone consultations with these physicians or refer patients to SkyHealth providers.
Although planned as a hub-andspoke model in which SkyHealth providers would be responsible for the empanelment of SkyCare providers, the programme was instead implemented as a two-tier model without referral networks in which the two types of provider were recruited directly by World Health Partners. Existing informal health-care providers or pharmacists in rural areas were approached by World Health Partners' field representatives, given information about the programme and offered the opportunity to join the network by paying a franchisee fee. In early 2014, the franchisee fee for a SkyHealth centre was US$ 500 in addition to an investment of approximately US$ 1000 to set up the telemedicine centre. 21 SkyCare providers paid a franchisee fee of US$ 17 plus a small fee of US$ 0.17 for each mobile phone consultation. The training offered reflected the heterogeneity of providers in the network: SkyHealth providers received 6 days of training on the diagnosis and treatment of infectious diseases, whereas training lasted 3 days for SkyCare providers. 21 Both types of provider received some training on protocols for basic service delivery, marketing services, diagnostic services and ensuring a predictable supply of adequate-quality drugs. SkyHealth providers were also trained in operating computers for telemedicine services.

Methods
We assessed the knowledge and performance of health-care providers in 80 study clusters across 11 districts in Bihar at baseline between June and September 2011 and again at follow-up between June and September 2014. These 80 clusters were randomly selected, using Stata version 13.1 (StataCorp. LP, College Station, United States of America) from the 360 study clusters included in the Bihar Evaluation of Social Franchising and Telemedicine project before the Sky Program was implemented. 22 Clusters comprised catchment areas surrounding a central village that met eligibility criteria for the possible establishment of a SkyHealth telemedicine centre -criteria primarily included the availability of a broadband connection, health-care infrastructure and potential investors in the franchisee network. 20 To evaluate the effect of the Sky Program on the quality of care provided to households, we interviewed a sample of 64 households in each study cluster and selected the five most frequently visited providers for our baseline sample (i.e. we implicitly randomly selected providers on the basis of their market share). 19 This process was repeated at follow-up but we also added providers from the Skycare programme network if they were not among the five most frequently visited providers at follow-up. In total, we carried out 810 assessments: 395 at baseline and 415 at follow-up. We collected information on the health-care provider's age, educational attainment, socioeconomic characteristics and health-care practice and background, including medical training and experience, types of illness treated and familiarity with technology. At recruitment, providers consented to taking part in vignette interviews and to being visited unannounced by standardized patients within the following 2 months. Our primary outcomes The difference-in-difference method estimated the difference in the change from baseline in 2011 to follow-up in 2014 in providers' knowledge, as assessed using hypothetical vignette interviews, between implementation areas and nonimplementation areas. c Each row shows the result of a regression model with the outcome variable specified in the first column.
All regressions included the following control variables: (i) age; (ii) education; (iii) medical qualifications; (iv) experience; (v) knowledge score (i.e. the item response score based on questions health-care providers asked interviewers in response to the vignette); (vi) working hours; (vii) patient caseload; (viii) a dummy variable indicating whether the health-care facility organizes camps; (ix) a dummy variable indicating whether the facility is a public health facility; and (x) an index for the clinic's infrastructure. We also included a binary variable indicating whether the cluster in which the health-care facility was located was in a programme implementation area and we included time and district fixed effects. All standard errors were clustered at the cluster level. d Data on some analysis variables were missing for 10 assessments. e Health-care providers' knowledge was assessed using hypothetical patient vignettes of childhood diarrhoea and pneumonia as commonly encountered locally, to which they had to respond.

Vignettes
Two interviewers presented hypothetical patient vignettes to health-care providers. One interviewer recorded the diagnostic questions asked by providers in response to the vignettes and the other one read scripted responses to these questions. [23][24][25] Vignettes were devised to represent cases of childhood diarrhoea and pneumonia commonly encountered locally. The two vignettes used featured a father seeking treatment for his 2-yearold son: in the one for diarrhoea, the child had had loose stools for 2 days; in the one for severe pneumonia, the child had had a fever and cough for 5 days and difficulty breathing (full details of the vignettes are available from the corresponding author). Appropriate treatment for diarrhoea was defined according to 2005 World Health Organization guidelines as the provision of oral rehydration solution, with or without zinc supplements and without the prescription of unnecessary or potentially harmful drugs. 26 The appropriate treatment for severe pneumonia was defined as the provision of antibiotics, without the prescription of potentially harmful drugs, and referral to a hospital for further evaluation. 27

Standardized patients
We assessed health-care providers' performance in practice using a standardized patient method in which enumerators trained as standardized patients visited providers unannounced. 8,9,[28][29][30] We used a proxy, standardized patient, case method, 8 in which a father seeks treatment for his 2-year-old son who has the same clinical symptoms described in the vignettes. The cases and methods used for standardized patients were developed by members of our study team and have now been used in numerous settings. 8,31,32 Knowledge and performance scores were calculated for the vignettes and standardized patients, respectively, according to item response theory and based on whether the correct diagnostic questions had been asked and the appropriate examinations had been proposed. 23,33

Statistical analysis
We used a difference-in-difference method to compare changes in providers' performance between areas in which the programme was implemented and areas in which it was not. [34][35][36][37][38][39][40] Implementation areas were those in which at least one SkyHealth or SkyCare provider was active, as recorded by our field staff at follow-up data collection. Although the study was originally designed as a large-scale, cluster randomized study, 22 substantial deviations from the planned randomization occurred. Hence, we employed a quasiexperimental difference-in-difference analysis. Specifically, we used multiple linear regression to explore the association between changes in providers' knowledge and performance (i.e. outcomes) and an indicator variable denoting the period before or after implementation of the programme interacted with an indicator of whether or not the study cluster was in an implementation area. The difference-in-difference method provided estimates of covariateadjusted differences in the knowledge and performance of providers between implementation and nonimplementation areas at follow-up that took into account any differences that existed before implementation. Our estimates probably captured both the direct effects of the programme on participating providers and the indirect effects on other providers in study areas that resulted from market competition. The analysis also included an indicator for the year and district fixed effects to account for unobserved differences across districts at the two assessments. Since, at baseline, it was not possible to predict which providers would participate in the programme, we did not have baseline data for all providers to conduct a providerlevel, difference-in-difference analysis. As a robustness check, we performed analysis of covariance (ANCOVA) regressions to compare providers in Is the child vomiting? What has the child eaten?
Is the child taking fluids?
Notes: The World Health Partners' Sky Program employed social franchising and telemedicine technology to help improve the knowledge and performance of health-care providers. Implementation areas included 50 study clusters and nonimplementation areas included 30 study clusters. Health-care providers' performance was assessed at baseline in 2011 before the programme was implemented and at follow-up in 2014 after implementation using a standardized patient method in which enumerators trained as standardized patients visited providers unannounced to ask about their 2-year-old son who was described as having childhood diarrhoea as commonly encountered locally. Health-care providers in implementation areas were not all participants in the programme.

Research
Social franchising and quality of care in Bihar, India Manoj Mohanan et al.
implementation and nonimplementation areas using follow-up data with district fixed effects and cluster-level average values for outcomes at baseline. In all regressions, standard errors were clustered at the cluster level to correct for the correlation of the error term across providers within the same cluster. We used Stata version 13.1 for all statistical analyses.
Assuming an intracluster correlation of 0.05, a sample of 400 providers (i.e. 5 providers in each of 80 clusters) would yield over 95% power at the 0.05 level of significance for detecting a standardized effect size of 0.4 on knowledge scores based on the vignettes. Similarly, a sample of 200 providers (i.e. 5 in each of 40 clusters) would yield over 99% power for detecting a standardized effect size of 0.66 on performance scores based on the standardized patients. These relatively large effect sizes reflect the projected impact of the programme at the time of planning.

Results
Overall, 50 of the 80 study clusters were in areas in which the programme was implemented. At baseline and follow-up, providers in implementation and nonimplementation areas were comparable in terms of demographic characteristics, infrastructure, clinical activity and the type of medicine practiced (Table 1; available at: http://www.who.int/bulletin/volumes/95/5/16-179556). However, given the criteria for enrolment in the programme, participating providers were younger than nonparticipating providers, had more experience using computers, had fewer years of clinical experience and reported working fewer hours. Relative to the baseline in 2011, providers in both implementation and nonimplementation areas reported lower patient volumes, longer working hours and higher consultation fees in 2014.
Providers' knowledge of childhood diarrhoea and pneumonia was greater at follow-up in both implementation and nonimplementation areas, as illustrated in Fig. 1, Fig. 2 Fig. 4: a greater proportion of all types of provider asked diagnostic questions about diarrhoea and pneumonia in response to the vignettes at follow-up than at base-line. However, there was no significant difference between the performance of providers who participated in the programme and those who did not. Fig. 3 and Fig. 4 show data on the diagnoses offered and treatments proposed in response to the diarrhoea and pneumonia vignettes, respectively, at baseline and follow-up. Providers in both implementation and nonimplementation areas gave correct diagnoses more often at follow-up. In implementation areas, the performance of participating providers was generally similar to that of nonparticipants, except that participating providers were more likely: (i) to wrongly report that prescriptions did not include antibiotics; (ii) to prescribe the correct treatment for diarrhoea; and (iii) to diagnose pneumonia in response to the vignette (details available from the corresponding author). Table 2 shows the results of the difference-in-difference analysis of changes in providers' knowledge as assessed using the vignettes. The change between baseline and follow-up in the proportion of providers in implemen-tation areas who asked the correct diagnostic questions for pneumonia was significantly less than the change in the corresponding proportion of providers in nonimplementation areas (differencein-difference estimate: -0.027; 95% confidence interval, CI: -0.054 to -0.001). The programme had no significant effect on any other indicator of providers' knowledge of either childhood diarrhoea or pneumonia, including making the correct diagnosis, prescribing the correct treatment and prescribing harmful treatments less often. The robustness checks performed using ANCOVA regression analysis showed that the programme had no significant effect on eight of 10 measures of providers' knowledge (details available from the corresponding author). However, at follow-up, providers in implementation areas were seven percentage points more likely to prescribe the correct treatment in response to the pneumonia vignette than those in nonimplementation areas (intergroup difference: 0.070; 95% CI: 0.015 to 0.129) and seven percentage points less likely to prescribe a harm- Social franchising and quality of care in Bihar, India Manoj Mohanan et al.
ful treatment (intergroup difference: -0.070; 95% CI: -0.127 to -0.011). These estimates were comparable to point estimates in the difference-in-difference analysis though the latter were not statistically significant. Providers spent an average of 1.64 min with the diarrhoea standardized patient at follow-up and prescribed an average of 1.76 drugs; at baseline, the corresponding figures were 1.59 min and 1.85 drugs. Fig. 5 shows that, in general, providers in both implementation and nonimplementation areas asked standardized patients diagnostic questions about diarrhoea less often at follow-up than at baseline, though they asked about the nature of the stools more frequently. For the pneumonia standardized patient, there was no clear pattern in the change between baseline and follow-up in the types of questions asked ( Fig. 6; available at: http://www.who.int/bulletin/volumes/95/5/16-179556). Whereas all providers asked more often at followup about rapid breathing, the type of cough and a runny nose, providers in programme implementation areas asked less often about chest indrawing with flaring nostrils. The last feature is important because chest indrawing and flaring nostrils are key signs of respiratory distress that can help differentiate severe pneumonia, which is treated with antibiotics and urgent referral to hospital, from pneumonia, which is treated with antibiotics alone. Moreover, these questions are critical given that the child was not present and could not be examined. The performance of providers in giving the correct diagnosis and treatment was poorer with standardized patients than with vignettes, which is consistent with the gap between knowledge and practice previously reported for these providers. 32 For the diarrhoea standardized patient, all providers prescribed treatment at follow-up but none was the correct treatment for simple diarrhoea (Fig. 7). Among providers in the programme, in contrast, 16.7% (8/48) prescribed the correct treatment at follow-up in response to the diarrhoea vignette. Similarly, 11.1% (1/9) of programme providers prescribed the correct treatment for pneumonia standardized patients at follow up, whereas 22.9% (11/48) proposed the correct treatment in response to the pneumonia vignette. Fig. 8 (available at: http://www.who.int/bulletin/volumes/95/5/16-179556) shows data on the diagnoses offered and treatments prescribed by health-care providers for the pneumonia standardized patient. Table 3 shows the results of the difference-in-difference analysis of changes in providers' performance as assessed using standardized patients. There was no evidence for either diarrhoea or pneumonia that the programme was associated with a significant improvement on any measure of provider performance. Robustness checks performed using ANCOVA regression analysis confirmed these findings.

Discussion
We did not find evidence that the World Health Partners' Sky Program improved the quality of care for childhood diarrhoea or pneumonia in Bihar. Although health-care providers who participated in the programme were almost seven percentage points more likely to propose appropriate treatments with vignettes, we found no significant difference in the quality of care provided in practice for diarrhoea or pneumonia. This failure could be attributed to the weak design and implementation of the programme. For example, only 3 to 6 days of train-  to follow-up in 2014 in providers' performance, as assessed in interviews with standardized patients, between implementation areas and nonimplementation areas. c Each row shows the result of a regression model with the outcome variable specified in the first column.
All regressions included the following control variables: (i) age; (ii) education; (iii) medical qualifications; (iv) experience; (v) performance score (i.e. the item response score based on questions health-care providers asked the standardized patient); (vi) working hours; (vii) patient caseload; (viii) a dummy variable indicating whether the health-care facility organizes camps; (ix) a dummy variable indicating whether the facility is a public health facility; and (x) an index for the clinic's infrastructure. We also included a binary variable indicating whether the cluster in which the health-care facility was located was in a programme implementation area and we included time and district fixed effects. All standard errors were clustered at the cluster level. d Not all health-care providers were assessed using standardized patients because standardized patients could be introduced without detection only in clinics with a high patient volume. e Health-care providers' performance was assessed using a standardized patient method in which enumerators trained as standardized patients visited providers unannounced to ask about their 2-year-old son who was described as having childhood diarrhoea or pneumonia as commonly encountered locally.

Research
Social franchising and quality of care in Bihar, India Manoj Mohanan et al.
ing was offered to providers who signed up as franchisees, which was probably insufficient and was shorter than other training interventions that have successfully improved provider's knowledge and practice. 13,41 For example, a recent study showed that intensive, sustained training for similar informal providers in India significantly improved their performance. 42 In addition, the programme did not significantly influence patient demand: in 2014, health-care providers in the programme accounted for only 3.5% of all providers in implementation areas and 6% of all private providers. Moreover, fewer than 3% of children with symptoms of diarrhoea or pneumonia were taken to programme providers. 19 Our study has several limitations. First, assessments of providers were carried out in only 80 randomly selected clusters out of the 360 study clusters. Second, our assessments involved standardized cases of childhood diarrhoea and pneumonia, which means that our findings may not be generalizable to other conditions. However, these two conditions have a high priority in India's health system. 43 Another limitation is that, although the standardized patient method is considered the standard for evaluating provider performance, 8,28,32 standardized patients can be introduced without detection only in clinics with a high patient volume (e.g. SkyHealth providers), which excluded most small rural providers who form the majority of SkyCare providers.
Our findings do not necessarily imply that franchising or technology that provides support for clinical decisionmaking and patient management cannot improve the performance of providers in rural settings. Instead, their failure to improve performance points towards problems with implementation -the programme design may not have been sufficient to boost the quantity or quality of the health-care services delivered. Moreover, because the programme network covered only a small fraction of existing rural health-care providers -most of whom were informally trained, had degrees in alternative medicine or had undertaken apprenticeships with formal practitioners, 44,45 it is unlikely that the programme could have influenced health or health care at the population level. Our results also underscore the challenges faced by social franchising in identifying appropriate incentives for providers to adopt technology and improve quality and in understanding patients' responses to quality improvements.
Social franchising has the potential to create sustainable networks of private health-care providers and improve health-care quality and health outcomes. However, the success of this concept depends on identifying models that can be empirically shown to improve health outcomes before they are scaled up with investments from governments and global donors. ■

Research
Social franchising and quality of care in Bihar, India Manoj Mohanan et al.

Evaluación de un programa de telemedicina y franquicia social y la atención proporcionada para la diarrea y la neumonía infantiles, Bihar, India
Objetivo Evaluar el impacto en la calidad de la atención proporcionada para la diarrea y la neumonía infantiles en Bihar, India, de un programa de telemedicina y franquicia social a gran escala, el programa Sky de la ONG World Health Partners. Métodos Se investigaron los cambios relacionados con el programa en el conocimiento y el rendimiento de los proveedores de atención de salud realizando 810 evaluaciones en una muestra representativa de proveedores en zonas en las que el programa se implementó y en zonas en las que no. Los proveedores fueron evaluados a través de viñetas de pacientes hipotéticos y el método del paciente estandarizado antes y después de la implementación del programa, en 2011 y 2014, respectivamente. Se evaluaron las diferencias en cuanto al rendimiento de los proveedores entre las zonas de implementación y las de no implementación utilizando unos modelos de regresión lineal multivariables de diferencias en diferencias. Resultados El programa no mejoró de forma significativa el conocimiento ni el rendimiento de los proveedores de atención de salud en cuanto a la diarrea o la neumonía infantil en Bihar. El resultado fue una gran y constante diferencia entre el conocimiento de la atención adecuada y la que se proporcionaba. Conclusión La franquicia social ha recibido atención a escala mundial como un modelo para proporcionar una atención de alta calidad en zonas rurales del mundo en desarrollo, aunque los datos que lo fundamentan son escasos. Los resultados destacan la necesidad de una prueba empírica adecuada antes de ampliar los programas de franquicia social.  Did the fever and cough start more than 5 days ago?
Does the child have a runny or blocked nose?
Is the child breathing rapidly?
Do the child's nostrils flare? Does the skin over the child's ribs and stomach pull inwards on breathing? Does the child's breathing sound unusual?
Has the child been breathless in the past?
The child's weight should be measured The child's respiration rate should be measured The child's chest and heart should be auscultated The child's pulse rate should be measured The child's temperature should be measured The child's chest should be examined The child should undergo radiography The child's leukocyte count should be measured The child's white blood cell differential count should be measured Social franchising and quality of care in Bihar, India Manoj Mohanan et al. Notes: The World Health Partners' Sky Program employed social franchising and telemedicine technology to help improve the knowledge and performance of health-care providers. Implementation areas included 50 study clusters and nonimplementation areas included 30 study clusters. Health-care providers' knowledge was assessed at baseline in 2011 before the programme was implemented and at follow-up in 2014 after implementation using a hypothetical patient vignette of childhood diarrhoea as commonly encountered locally, to which they had to respond. The knowledge score was the item response score based on questions health-care providers asked interviewers in response to the vignette. Health-care providers in implementation areas were not all participants in the programme.
Social franchising and quality of care in Bihar, India Manoj Mohanan et al. Does the child have a fever?
Is the child breathing rapidly?
Do the child's nostrils flare and does the skin over the ribs and stomach pull inwards on breathing?
What type of cough does the child have?
Does the child have a runny or blocked nose?
Does the child's breathing sound unusual?
Is the child weak?
Is the child breastfeeding and what is their immunization history?
Notes: The World Health Partners' Sky Program employed social franchising and telemedicine technology to help improve the knowledge and performance of health-care providers. Implementation areas included 50 study clusters and nonimplementation areas included 30 study clusters. Health-care providers' performance was assessed at baseline in 2011 before the programme was implemented and at follow-up in 2014 after implementation using a standardized patient method in which enumerators trained as standardized patients visited providers unannounced to ask about their 2-year-old son who was described as having childhood pneumonia as commonly encountered locally. Health-care providers in implementation areas were not all participants in the programme.
Social franchising and quality of care in Bihar, India Manoj Mohanan et al. Gave the correct treatment when treatment was given