http://orcid.org/0000-0002-6188-3607
Figures
Abstract
Introduction
Financial incentives are utilised in healthcare systems in a number of countries to improve quality of care delivered to patients by rewarding practices or practitioners for achieving set targets.
Objectives
To systematically review the evidence investigating the impact of financial incentives for implementation of supported self-management on quality of care including: organisational process outcomes, individual behavioural outcomes, and health outcomes for individuals with asthma or diabetes; both conditions with an extensive evidence base for self-management.
Methods
We followed Cochrane methodology, using a PICOS search strategy to search eight databases in November 2015 (updated May 2017) including a broad range of implementation methodologies. Studies were weighted by robustness of methodology, number of participants and the quality score. We used narrative synthesis due to heterogeneity of studies.
Results
We identified 2,541 articles; 12 met our inclusion criteria. The articles were from the US (n = 7), UK (n = 4) and Canada (n = 1). Measured outcomes were HbA1c tests undertaken and/or the level achieved (n = 10), written action plans for asthma (n = 1) and hospital/emergency department visits (n = 1). Three of the studies were part of a larger incentive scheme including many conditions; one focused on asthma; eight focussed on diabetes. In asthma, the proportion receiving ‘perfect care’ (including providing a written action plan) increased from 4% to 88% in one study, and there were fewer hospitalisations/emergency department visits in another study. Across the diabetes studies, quality-of-care/GP performance scores improved in three, were unchanged in six and deteriorated in one.
Conclusions
Results for the impact of financial incentives for the implementation of self-management were mixed. The evidence in diabetes suggests no consistent impact on diabetic control. There was evidence from a single study of improved process and health outcomes in asthma. Further research is needed to confirm these findings and understand the process by which financial incentives may impact (or not) on care.
Citation: Jackson T, Shields MD, Heaney LG, Kendall M, Pearce CJ, Hui CY, et al. (2017) The impact of financial incentives on the implementation of asthma or diabetes self-management: A systematic review. PLoS ONE 12(11): e0187478. https://doi.org/10.1371/journal.pone.0187478
Editor: Emma Giles, Teesside University, UNITED KINGDOM
Received: March 23, 2017; Accepted: October 20, 2017; Published: November 6, 2017
Copyright: © 2017 Jackson et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: TJ is funded by The University of Edinburgh CMVM PhD Studentship [Asthma UK Centre for Applied Research PHD/14/16]. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors declare that there are no conflicts of interest.
Introduction
The prevalence of long term conditions is increasing and supported self-management is a strategy to enable healthcare services to cope with this increase [1]. Self-management has been defined as ‘the tasks that individuals must undertake to live with one or more chronic conditions. These tasks include having the confidence to deal with medical management, role management and emotional management of their conditions’ [2]. A core responsibility of professionals and healthcare organisations is to provide support to enable people with long-term conditions to manage their own condition [3]. Asthma and diabetes are two long-term conditions with a robust evidence base for supported self-management [4, 5].
Asthma and diabetes in the United Kingdom
In the United Kingdom (UK), 3.6 million people are being treated for clinician-diagnosed asthma, costing £1.1 billion annually in healthcare resources [6]; globally up to 334 million people are affected [7]. Supported self-management, including education and personalised asthma action plans (PAAPs) have consistently been shown to improve asthma control, minimise exacerbations and reduce emergency use of healthcare resources [5, 8–10]. The British Guideline on the Management of Asthma recommends that all individuals with asthma should be provided with self-management education and offered a PAAP [11]. However, ownership of PAAPs remains low with only 24% of people with asthma in the UK reporting that they are in possession of a PAAP [12].
There are 3.5 million people in the UK who have been diagnosed with diabetes and approximately 1.1 million are as yet undiagnosed [13]. Self-management of diabetes, including lifestyle changes, adherence to medication, monitoring blood sugars and adjusting dosages accordingly can greatly improve quality of life. However, only 16% of individuals with diabetes were offered an education course when first diagnosed [14]. In the UK GPs are incentivised through the Quality Outcome Framework (QOF) to provide eight routine checks, as recommended by National Institute for Health and Care Excellence, to individuals with diabetes [15] but just 43.3% of individuals with Type 1 diabetes were receiving all eight of the recommended care processes in 2010–11 and this has further dropped to 36.5% in 2015–16 [16].
Financial incentive schemes
Physician focussed financial incentive schemes are a potential strategy for changing physician behaviour to improve quality of care which has recently been employed in national and local schemes [15, 17]. Financial incentives which place the physician at financial risk have been found to modify resource use (measured by hospitalisation rates and primary care visits) but the evidence investigating the impact of bonus payments shows mixed results in terms of impact [18]. Pay-for-performance can be effective in healthcare but providers should be involved with programme design and schemes need to be tailored to the setting [19] and patient population [20]. Incentives need to be tied to improvements in information systems and quality reporting standards [21]. Policy makers must remain aware of unintended consequences and carefully weigh potential benefits against the risks for their individual setting [22]. For example, general practitioners (GPs) interviewed about QOF highlighted the potential for reduced continuity of care, lack of attention to non-incentivised conditions and potential damage to healthcare professional’s internal motivation [23].
There is therefore uncertainty about the appropriate models employed in financial incentive schemes and inconclusive insufficient evidence of their impact on quality of care [24]. This paper reports the findings of a systematic review describing the features of financial incentive schemes promoting supported self-management, and evaluating the impact of the schemes on quality of care, specifically organisational process outcomes, individual behavioural outcomes, and health outcomes.
Methods
Our protocol is available on PROSPERO, registration number: CRD42016027411 (S1 Appendix), and we followed the procedures described in the Cochrane Handbook for Systematic Reviews of Interventions [25]. The searches were run in November 2015 and updated in May 2017.
Search strategy
Our PICOS search strategy is shown in Table 1. We searched eight databases: Cochrane Central Register of Controlled Trials (CENTRAL); Cochrane Database of Systematic Reviews (CDSR); MEDLINE; PsychInfo; CINAHL; ScienceDirect; Web of Science; Embase. We searched for asthma OR diabetes AND financial incentives AND self-management keywords (S2 Appendix gives a detailed search strategy) and did not restrict the date range. The bibliographies of all eligible studies were examined to identify potential studies for inclusion and we searched registries for studies in progress.
Study selection
One reviewer (TJ) conducted the searches in November 2015 and May 2017, 2,541 articles were identified (Fig 1). Two reviewers (TJ and HP) screened a random selection of 100 papers, compared and discussed decisions in order to reach agreement on the application of the inclusion/exclusion criteria. After this training process, one reviewer (TJ) screened the remaining titles and abstracts for potentially relevant papers. Full text screening was undertaken by two reviewers (TJ and CYH) independently. Uncertainties and disagreements were resolved in discussion with a third reviewer (HP). Reviewers achieved 100% agreement with articles selected for inclusion.
Quality assessment
It was anticipated that most of the studies included would be reporting implementation studies, therefore we did not apply any methodological filters. In order to weight the papers which we expected would include a diverse range of methodologies, we adopted the approach of Pinnock 2015 [4] and papers were classified by robustness of study design, number of participants and the quality score (using Downs’ and Black checklist [26]).
Outcomes
We defined our outcomes of interest in three categories:
- Organisational process outcomes. Specific examples are ownership of a personalised asthma action plan; attendance at patient training self-management courses for asthma or diabetes; attendance at reviews providing supported self-management of asthma or diabetes.
- Individual behavioural outcomes. Examples include self-efficacy, activation, adherence to preventer medication, adherence to insulin regimes.
- Health outcomes. Examples are symptom control, reducing asthma exacerbations, unscheduled care or use of emergency health services, and measuring glycaemic control for people with diabetes (glycated haemoglobin (HbA1c) levels reflect the overall glycaemic exposure over the previous 2–3 months) [27].
Data extraction
Data were extracted from included papers by two reviewers (TJ and CJP) using a previously piloted customised version of the Effective Practice and Organisation of Care (EPOC) Good Practice data extraction form [28]. The extracted data were then compared and disagreements resolved by discussion. We extracted details about the interventions under the following headings: “setting”, “risk of bias assessment”, “participants”,”intervention groups” “methods”, “outcomes” and “results”.
Linked papers of the included studies were checked for descriptions of interventions, nested qualitative studies, and process evaluations in order to supplement the information available and to provide context. All authors were contacted to ask if any follow up work had been conducted on their study and if they had any data available that were not included in the systematic review.
Analysis and synthesis
We anticipated substantial heterogeneity in study design and intervention [29]; meta-analysis was therefore not appropriate and a narrative synthesis was undertaken. Asthma and diabetes papers were analysed separately. We classified components of the interventions (e.g. whether the financial incentive was paid to the individual (self-employed) healthcare professional or to an organisation); whether payment was for achieving process standards (e.g. attendance at a diabetes course) or health outcomes (e.g. reduced unscheduled care). A matrix of interventions was developed with the interventions being shown to be effective or ineffective under the headings of: “organisational process”; “measure of disease control” and “individual behaviour”. We used Adams’ 2013 framework, which has been specifically designed for documenting financial incentive interventions [30]. The framework contains nine domains which we used to identify the features and describe the schemes in detail. These domains are: direction (positive reward or avoidance of penalty), form (cash or healthcare costs), magnitude (total value of incentive available to participant), certainty (certainty of receiving payment if behaviour is successfully changed: certain, certain chance or uncertain chance), target behaviour (process, intermediate or outcome), frequency of reward (all or some instances incentivised), immediacy (time between behaviour and payment), schedule (fixed or variable), and recipient(s) of incentives (clinicians).
We synthesised our results in the form of Harvest Plots, as they are a useful method for illustrating the different effects of interventions because they represent all relevant data in one plot [31]. In a Harvest plot, each bar represents an individual study, the bar colour indicates the study design, the bar height reflects the number of participants in the study and the number reflects the Downs and Black quality score.
Results
From the 2,541 papers found, 12 papers were eligible for the systematic review (Fig 1 is the PRISMA diagram with details of the selection process).
Study characteristics
The 12 papers were published between 2004–2017, seven were conducted in the United States of America [32–38], four in the UK [39–42] and one in Canada [43]. One study reported on an asthma-only scheme [36], three focused on diabetes-only schemes [32, 33, 43] and the remaining eight looked at diabetes within a multiple condition scheme [34, 35, 37–42].
Risk of bias of included studies
There were problems with allocation concealment, selection bias, purposive sampling, random sequence generation and selective outcome reporting in the selected studies. We used Review Manager 5.3 to record and generate the risk of bias summary figure for the included studies (S1 Fig). Beck’s [32] participants had volunteered to take part in the intensive case management programme and the control group were those who had chosen not to, creating a non-randomised, biased sample biased by willingness to participate. Conrad’s [34] participating group were selected by the Health Insurer, Fagan’s [35] participants were selected by the managed care organisation as they had a “leadership which was willing to champion the proposed quality improvement initiative” and Gulliford’s [39] participants were a self-selected group that agreed to participate in an evaluation of diabetes care. Due to the nature of financial incentive schemes, participant blinding is not an option so that allocation concealment was an important source of bias.
Study quality and weight of evidence
The study designs varied (Fig 2) and included: five quasi-experimental [32–35, 37]; three interrupted time series [38, 40, 42]; two longitudinal [39, 43]; one repeated measures [36] and one controlled before and after study [41].
Hierarchy based on: randomisation and status of comparator groups; prospective/retrospective design. These categories overlap and other factors will influence the robustness of the evidence (adapted for this review from Pinnock 2015 [4]).
The quality scores ranged from 10 to 18 (Table 2). In common with other reviews assessing the quality of implementation studies [44], we observed that some questions in the Downs’ and Black checklist [26] were not applicable to studies involving financial incentives. For example, blinding of participants is not relevant in schemes which rely on publicity to promote financial incentives awarded for achieving pre-set targets. Similarly, questions regarding the randomisation process were not applicable to many of the quasi-experimental studies.
The size of the studies, in terms of patients, varied widely from 16 children admitted to hospital with an episode of diabetic ketoacidosis who elected to participate in the scheme [32] to 1,174,294 patients with diabetes whose health insurance company, PacifiCare, trialled a pay-for-performance scheme in their California medical groups and compared results to their medical practices in Oregon and Washington [37]. In these cluster randomised implementation studies, the total number of eligible patients was not always clear. We contacted three authors: two were able to confirm patient numbers [37, 41] and one was not [38]. However, from the number of physicians in this latter study we were able to estimate the number of patients.
The overall weightings [4] which reflect the robustness of the study design (Fig 2), number of participants and quality score are summarised in Table 2.
Features of the financial incentive schemes
Table 2 describes the characteristics of the studies; the key features of the schemes mapped to the financial incentive framework for documenting financial incentive interventions to change health behaviours [30] are listed in the “Intervention” column. The studies are described below using the domains of this framework.
Direction and form.
One scheme used avoidance of penalty [32], ten studies used positive rewards [33–37, 39–43] and one study used a mixture of avoidance of penalty and positive rewards [38] as the reward component of the incentive scheme. One study looked at a reimbursement scheme in which the insurance company refunded practices for preventative self-management education costs [30], the remaining eleven schemes were cash incentives paid to the clinicians or practice for achieving targets [33–43].
Magnitude and certainty.
One study looked at a scheme which paid a financial incentive for each HbA1c test that was completed [33]. One study described a scheme which involved receiving a payment for each performance target met or exceeded [37]. One study described a scheme where physicians were paid a set amount per patient that received two HbA1c tests per year [43]. Eight studies looked at a target achievement scheme where there were pre-set “percentage of patients” targets that physicians had to achieve in order to receive the financial incentive [34–36, 38–42] and ten studies had ‘certain’ incentives if practices successfully achieved targets [33, 35–43]. One scheme had an ‘uncertain’ chance of receiving the financial incentive if they changed their behaviour at the start of the scheme (years 2003–2004) as the payments were only paid to top scoring groups [34]. In the second phase of the scheme (years 2005–2007) this was altered and all groups had a certain chance of receiving a payment if they changed their behaviour. Beck’s 2004 [32] study of children with diabetes in Oklahoma had an uncertain chance of receiving a return on the amount spent on the incentive case management scheme, it depended on whether, and how many times, the participant was rehospitalised.
Target and frequency.
All schemes [30–43] focussed on “process” behaviours, these are clinician actions that are likely to improve health outcomes. All of the studies included in this review were assessing the impact of financial incentives on clinician behaviour. There were four studies that focussed on a single condition, asthma or diabetes [32, 33, 36, 43]. Three of which reported a positive impact on supported self-management behaviour: Beck 2004 [32] (quasi-experimental, 1 hospital, 16 children, D&B = 15); LeBlanc 2017 [43] (longitudinal, 583 physicians, 83,580 adult patients, D&B = 13) and Mandel 2007 [36] (repeated measures, 44 practices, 13,380 children, D&B = 16). The final study, Chien 2012 [33] (quasi-experimental, 118 practices, 5,557 participants, D&B = 13), showed no effect. The rest of the studies looked at multiple condition schemes which included diabetes and reported a mixture of positive results [39, 40], no effect [35, 37, 38, 41, 42] and a negative outcome was reported by Conrad 2013 [34] (quasi-experimental, 19 medical groups, 21, 365 patients, D&B = 10). Two schemes [32, 33] incentivised all instances of the behaviour and the remaining studies had some instances incentivised as they had to reach percentage targets [34–42].
Immediacy and schedule.
The financial incentive framework [30] defines immediacy as how soon the recipient receives the incentive payment after the behaviour. If the time between behaviour and reward is too long, recipients may not link the two and the incentive will fail to be effective. Eight of the included schemes paid incentives on an annual basis [33–35, 38–42]. Two studies reported an explicit link between performance and payment; Rosenthal 2005 [37] described a scheme which paid a quarterly bonus of $0.23 per member per month for each performance target that was met or exceeded by the physician group and Chien 2012 [33] reporting practices receiving $100 for each patient for which missing care processes were completed. It was unclear in the article by LeBlanc (2017) [43] when the physicians received the payment for achieving the target of two HbA1c tests per year.
In the only asthma study included [36], the Cincinnati asthma improvement collaborative comprised of three stages with two different payment phases: all awards were assessed on 31 December 2004 and first-level fee schedule increases implemented from 1 May 2004 through to 31 December 2005; second and third-level fee schedule increases effective from 1 March 2005, through to 31 December 2005.
Beck 2003 [32] developed a 15-month scheme with a less tangible reward of reduced healthcare costs where they calculated financial impact of participation in the programme versus the healthcare costs per participant and non-participant.
Recipients.
Although all studies looked at a financial incentive paid to either the clinician or the practice, the papers differed in the way in which they reported numbers of study participants: nine articles noted number of patients [32–35, 39, 40, 42, 43]; seven referred to the number of practices/medical groups [33–37, 39, 40, 42, 43]; one study discussed a primary care trust (administrative body responsible for primary healthcare services in England) [41] and one discussed number of physicians [38]. Fagan [35] described an intervention for individuals with diabetes aged 65 years plus, two studies focussed on a targeted population of children [32, 36] and Chien 2012 [33] evaluated the impact of a scheme where lower socio-economic populations were targeted.
Impact of the schemes on process, behavioural and health outcomes
Table 2 summarizes the key findings from each of the studies and Fig 3 illustrates our synthesis with supporting information in S1 Table.
Illustrating the impact of financial incentives schemes on organisational process and disease control outcomes. Notes: Each bar represents an individual study. The colour of the bar indicates the study design, the height of the bar reflect the number of participants in the study and the number is the Downs and Black quality score. The decisions that underpin this plot are detailed in S1 Table.
Organisational process.
One study described an asthma improvement collaborative in Cincinnati [36] (repeated measures, 44 practices, 13,380 children, D&B = 16) which consists of a three level reward system. Practices had to reach a set target in each level in order to be eligible to proceed to the next level. Written action plans for patients with asthma were part of the criteria for the third level of the reward system. Authors concluded that the asthma pay-for-performance scheme had a positive impact on the proportion of patients with asthma receiving “perfect care” which increased from 4% before the intervention to 88% after. “Perfect care” was assessed on performance of components including: provision of a written action plan; provision of controller medication (if required); and recording patients’ control based on National Heart, Lung, and Blood Institute guideline recommended classification.
Nine studies reported proportion of patients who received HbA1c tests [33–35, 37–40, 42, 43]. Six reported that the financial incentive scheme had no effect [33, 35, 37, 38, 42], three reported that financial incentives had a positive effect on increasing frequency of HbA1c testing [39, 40, 43] and one study reported negative impact on the number of HbA1C tests performed [34]. Fagan 2010 [35] (Quasi-experimental, 20,943 65+ year old patients, D&B = 16) found that although the intervention group improved, it did not improve as much as the comparison group; the authors concluded that the study did not generate significant evidence to support a pay for performance scheme.
Chien [33] (quasi-experimental, 118 practices, 5,557 participants, D&B = 13) found no statistically significant improvement in patterns of care or clinical outcomes. They identified that younger adults and those with more comorbidities were less likely to receive recommended care and experienced a diabetes-related emergency department visit more often. However, two studies noted that practices in lower socio-economic status areas require additional support to overcome barriers [37, 39].
Disease control.
Six studies reported on test results for HbA1c levels [33, 39–43], with four studies reporting no effect [33, 41, 42] and two reporting a positive effect [39, 40]. One study evaluated an intensive case management scheme offered to 16 children who had been hospitalised after an incident of diabetic ketoacidosis [32]. They reported that participation in the intensive program was associated with fewer hospitalisations resulting in lower costs for participants ($1063 per individual) than non-participants ($2396 per individual).
Discussion
Statement of principal findings
A total of 12 papers (three diabetes; one asthma; eight multiple condition schemes including diabetes but not asthma) reporting on self-management interventions met the inclusion criteria and were included in the review. The impact of financial incentives paid to healthcare professionals for implementing self-management to patients with asthma or diabetes is inconsistent. Although most showed no effect [33, 35, 37, 38, 41, 42, 43] or a positive impact [32, 36, 39, 40, 43] on organisational process or disease control outcomes, one study targeting organisational processes showed a negative effect on the proportion of people with HbA1c testing [34]. We found no articles which analysed the impact of financial incentives on individual behaviour outcomes.
Interpretation of findings in relation to previously published work
The schemes targeted a range of organisational and health outcomes including: programme participation, asthma action plan ownership, HbA1c testing, HbA1C level testing and hospitalisations. However, we did not find any studies matching our inclusion criteria which looked at individual behavioural outcomes, identifying a gap in the research literature. For the organisational process outcomes five of the studies reported positive results [32, 36, 39, 40, 43], five reported no statistically significant effect [33, 35, 37, 38, 42] and one reported that the financial incentive scheme had a negative impact on results [34]. In the studies targeting disease control outcomes; three reported positive effects [32, 39, 40] and four reported no effect [33, 41, 42, 43]. Effective implementation strategies involve a multifaceted approach accommodating patient, professional and organisational aspects [5] but financial incentive schemes do not incorporate all of these aspects. Typically, they focus on the professionals, the organisations, or the patients separately but do not take a whole systems approach which proposes that all of these aspects require inclusion for successful implementation.
The financial incentives schemes were diverse and incorporated features across all the domains of the financial incentives framework (1). It was difficult to draw conclusions on which type of scheme was the most effective in changing healthcare professionals’ behaviour in relation to providing supported self-management to individuals with asthma or diabetes. Four of the studies that reported no statistically significant effect noted that the magnitude of the financial incentive might have contributed to the lack of effect [33–35, 37]. If the health care professional deems the size of the incentive potentially too modest for the effort and money spent on achieving the target, they are unlikely to change their behaviour.
The one negative result is a reminder that providing financial incentives may have unintended consequences and the implementation of financial incentive schemes must be approached with caution. Previous work has identified the potential negative impact of financial incentives schemes and produced a checklist to prevent inappropriate implementation [45]. Glazsiou’s checklist consists of nine questions and is divided into two parts “Part A: Is a financial incentive appropriate?” and “Part B: Implementation”. All six questions in Part A must be answered yes before continuing to considering implementation in Part B. One question in the checklist addresses the potential for unintended consequences and specifically highlights harm to the patient-clinician relationship. They provide evidence from a report showing that some UK clinicians became reluctant to register patients with complex poorly controlled conditions that would make it difficult for them to achieve their QOF targets [46]. Within QOF guidelines, practices are able to exclude patients from their reporting if the intervention was considered inappropriate, or was declined by the patient. Two studies identified overuse of ‘exception reporting’ as a strategy for potentially achieving more favourable results [39, 41]. Gulliford 2007 [39] raised concerns that an increase in ‘excepted’ cases was a potential reason for high QOF achievements. Pape [41] found that with the introduction of QOF+ (a UK scheme with more ambitious targets than the national QOF scheme), ‘exception reporting’ increased significantly in the indicators for HbA1c and concluded that financial incentives schemes had no significant effect.
When applying the financial incentives framework [30] to schemes for clinicians, the ‘Recipient’ domain does not take into consideration the patient population and whether the scheme was targeted at a specific population, for example lower socio-economic status was a population identified by two authors as having barriers which require additional support [37, 39]. Glazsiou’s checklist for implementing a financial incentive scheme identifies the importance of understanding and assessing potential barriers to changing clinician behaviours [45]. Evidence has shown that while financial incentives have the potential to reduce the inequalities in achievement related to area deprivation, differences do still exist [47], these must therefore be considered when designing future financial incentives schemes aimed at clinician behaviour.
The number of conditions in the scheme, a domain not included in the financial incentives framework [30], was not consistently associated with positive or negative findings and further research is required into whether an incentive scheme focussing on a single condition rather than multiple conditions would produce more positive results.
Strengths and limitations
The heterogeneity of methodologies used in studies investigating financial incentives paid to health care professionals for providing self-management education to their patients with asthma or diabetes made it difficult to compare studies. Therefore, we adopted the approach of Pinnock 2015 [4] and classified papers by methodology robustness, number of participants and quality score. A number of questions on the quality checklist employed in this review [26] were not appropriate for the papers included which led to low quality scores. A recently published quality checklist for reporting implementation studies may provide a framework better able to assess the quality of implementation research [29].
All studies were conducted in either the United States of America, Canada or the UK which limits the generalisability of the findings. Research looking at financial incentives aimed at healthcare professionals uses self-reporting data which presumes that all information provided is accurate and truthful.
All the studies were nonrandomised studies which are inherently more biased than randomised control trials [48], though the risk of bias in the included studies was assessed as low or unclear in the majority of the studies. Selection bias, purposive sampling, and selective outcome reporting were also identified in the selected studies.
We were unable to complete funnel plots to measure the extent of publication bias as we conducted a narrative analysis not a meta-analysis due to the heterogeneity of the study designs. However, the results of the included studies were a mixture of positive, no effect and negative on health and process outcomes in self-management of asthma or diabetes which suggests that there was not a high percentage of publication bias [49].
Time and resource constraints meant that the initial screening of title and abstracts was conducted by a single reviewer. However, training and quality assessment were undertaken on 5% of title/abstracts screened to reduce subjectivity and minimise potential inaccuracies. Full text screening and data extraction was completed by two reviewers.
Implications for future research, clinical care and policy
The limited number of studies investigating the impact of financial incentives on the implementation of asthma or diabetes self-management identifies a gap in the literature where further research is required. In particular, we only identified one study investigating the impact of financial incentives on the implementation of asthma self-management [36]. There is a further gap in research assessing the impact of financial incentives paid to healthcare professionals, on behavioural outcomes such as self-efficacy, activation or adherence to medication; no studies were identified in this area.
Further research is needed to confirm findings and understand the process by which financial incentives impact (or not) on care. Determinants of how financial incentives impact on organisation of care and health outcomes are multifactorial and complex. Results from this systematic review show that as well as money, there are other factors influencing healthcare professionals’ behaviour in delivering self-management for asthma and diabetes. Smaller practices may lack the infrastructure that is required to improve quality of care [38] and practices with a patient population of low socioeconomic status face barriers that make financial incentives schemes less effective in these areas [37, 39]. The use of ‘exception reporting’ for individuals who do not meet QOF (or other financial incentives scheme’s) guidelines needs to be monitored to ensure that individuals who require specialised, complex or more critical care are not being overlooked. When producing incentive schemes designers need to consider: the existing infrastructure in the organisation; target populations; the size of the incentive and time; effort and resources required to implement change; as well as unintended consequences.
Conclusion
The evidence provided in this systematic review showed mixed results for whether financial incentives have an impact on behaviour change in healthcare professionals to provide self-management to individuals with asthma or diabetes. Due to the diversity of the schemes, it is difficult to draw conclusions on what aspects of the incentives are most effective. However, size of financial incentives, exception reporting and socio-economic status of patient population were all reported as being influential. The number of conditions in an incentive scheme, i.e. targeted on one condition or multiple condition scheme, was not associated with the success of the scheme. Further research is required in order to understand the complex nature of behaviour changing interventions on healthcare professionals in relation to increasing self-management in individuals with asthma or diabetes.
Supporting information
S2 Appendix. Search strategy for identification of studies for financial incentives in relation to self-management of asthma or diabetes.
https://doi.org/10.1371/journal.pone.0187478.s002
(PDF)
S1 Table. Supporting information for Harvest plots.
https://doi.org/10.1371/journal.pone.0187478.s003
(PDF)
S2 Table. PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist.
https://doi.org/10.1371/journal.pone.0187478.s004
(PDF)
Acknowledgments
The authors acknowledge and thank the assistance and support of Marshall Dozier, Senior Liaison Librarian for the College of Medicine and Veterinary Medicine, The University of Edinburgh and Richard Parker, Senior Statistician at the Health Services Research Unit, The University of Edinburgh.
References
- 1.
Coulter A, Roberts S, Dixon A. Delivering better services for people with long-term conditions. The King's Fund; 2013. Available from: https://www.kingsfund.org.uk/sites/files/kf/field/field_publication_file/delivering-better-services-for-people-with-long-term-conditions.pdf.
- 2.
Corrigan JM, Greiner AC, Adams K, editors. 1st Annual Crossing the Quality Chasm Summit: A focus on communities Washington DC: National Academies Press; 2004
- 3. Pearce G, Parke HL, Pinnock H, Epiphaniou E, Bourne CL, Sheikh A, Taylor SJ. The PRISMS taxonomy of self-management support: derivation of a novel taxonomy and initial testing of its utility. Journal of health services research & policy. 2016 April; 21(2): p. 73–82.
- 4. Pinnock H, Epiphaniou E, Pearce G, Parke H, Greenhalgh T, Sheikh A, et al. Implementing supported self-management for asthma: a systematic review and suggested hierarchy of evidence of implementation studies. BMC Medicine. 2015 June; 13(1): 127. pmid:26032941
- 5. Taylor SJ, Pinnock H, Epiphaniou E, Pearce G, Parke HL, Schwappach A, et al. A rapid synthesis of the evidence on interventions supporting self-management for people with long-term conditions: PRISMS—Practical systematic Review of Self-Management Support for long-term conditions. Health Services and Delivery Research. 2014 December; 2(53).
- 6. Mukherjee M, Stoddart A, Gupta RP, Nwaru BI, Farr A, Heaven M, et al. The epidemiology, healthcare and societal burden and costs of asthma in the UK and its member nations: analyses of standalone and linked national databases. BMC Medicine. 2016 August 29; 14(1): p. 113 pmid:27568881
- 7.
Global Asthma Network. The Global Asthma Report. Global Asthma Network. 2014. Available from: http://www.globalasthmareport.org. Cited October 2016.
- 8. Pinnock H, Parke HL, Panagioti M, Daines L, Pearce G, Epiphaniou E, et al. Systematic meta-review of supported self-management for asthma: a healthcare perspective. BMC Medicine. 2017 March; 15(64). pmid:28302126
- 9. Gibson PG, Powell H. Written action plans for asthma: an evidence-based review of the key components. Thorax. 2004 February; 59(2): p. 94–9. pmid:14760143
- 10. Powell H, Gibson PG. Options for self-management education for adults with asthma. Cochrane Database of Systematic Reviews. 2002 July; 3. pmid:12535511
- 11.
British Thoracic Society, Scottish Intercollegiate Guideline Network. British guideline on the management of asthma: A national clinical guideline. Scottish Intercollegiate Guidelines Network. 2014. Available from: http://sign.ac.uk/pdf/SIGN153.pdf.
- 12.
Asthma UK. Compare your care report. Asthma UK. 2013. Available from: https://www.asthma.org.uk/globalassets/campaigns/compare-your-care-2013.pdf. Cited October 2015.
- 13.
Diabetes UK. Diabetes Facts and Stats. [Online]. Diabetes UK. 2016. Available from: https://www.diabetes.org.uk/Documents/Position%20statements/DiabetesUK_Facts_Stats_Oct16.pdf. Cited November 2016.
- 14.
Diabetes UK. 42% of people with type 2 diabetes "not confident managing their condition". Diabetes UK. 17 June 2015. Available from https://www.diabetes.org.uk/About_us/News/42-percent-of-people-with-Type-2-diabetes-not-confident-managing-their-condition-/. Cited October 2016.
- 15.
British Medical Association, NHS Employers. 2016/17 General Medical Services (GMS) contract Quality and Outcomes Framework (QOF) Guidance for GMS contract 2016/17. NHS Employers. 2016. Available from: http://www.nhsemployers.org/~/media/Employers/Documents/Primary%20care%20contracts/QOF/2016-17/2016-17%20QOF%20guidance%20documents.pdf. Cited October 2016.
- 16.
Health and Social Care Information Centre. National Diabetes Audit 2015–16: Report 1: Care Processes and Treatment Targets.NHS Digital; 2017. Available from http://www.content.digital.nhs.uk/catalogue/PUB23241/nati-diab-rep1-audi-2015-16.pdf. Cited February 2017.
- 17.
Department of Health. The Primary Medical Services (Directed Enhanced Services) Directions (Northern Ireland) 2016. Department of Health. 2016. Available from: https://www.health-ni.gov.uk/sites/default/files/publications/health/pms-des-directions-2016.pdf. Cited November 2016.
- 18. Armour BS, Pitts MM, Maclean R, Cangialose C, Kishel M, Imai H, et al. The effect of explicit financial incentives on physician behavior. Archives of Internal Medicine. 2001 May; 161(10): p. 1261–6. pmid:11371253
- 19. Eijkenaar F. Key issues in the design of pay for performance programs. The European Journal of Health Economics. 2013 February; 14(1): p. 117–31. pmid:21882009
- 20. Flodgren G, Eccles MP, Shepperd S, Scott A, Parmelli E, Beyer FR. An overview of reviews evaluating the effectiveness of financial incentives in changing healthcare professional behaviours and patient outcomes. Cochrane Database Syst Rev. 2011 July; 7(7).
- 21. Dudley RA, Miller RH, Korenbrot TY, Luft HS. The impact of financial incentives on quality of health care. Milbank quarterly. 1998 December; 76(4): p. 649–86. pmid:9879306
- 22. Milstein R, Schreyoegg J. Pay for performance in the inpatient sector: A review of 34 P4P programs in 14 OECD countries. Health Policy. 2016 October; 120(10): p. 1125–40. pmid:27745916
- 23. Roland M, Campbell S, Bailey N, Whalley D, Sibbald B. Financial incentives to improve the quality of primary care in the UK: predicting the consequences of change. Primary Health Care Research and Development. Primary Health Care Research and Development. 2006; 7(01): p. 18–26. https://doi.org/10.1191/1463423606pc272oa.
- 24. Scott A, Sivey P, Ait Ouakrim D, Willenberg L, Naccarella L, Furler J, et al. The effect of financial incentives on the quality of health care provided by primary care physicians. Cochrane Database Syst Rev. 2011 September; 9(9). pmid:21901722
- 25.
Higgins JP, Green S. Cochrane handbook for systematic reviews of interventions Chichester: Wiley-Blackwell; 2008.
- 26. Downs SH, Black N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. Journal of epidemiology and community health. 1998 June; 52(6): p. 377–384. pmid:9764259
- 27. Woerle HJ, Neumann C, Zschau S, Tenner S, Irsigler A, Schirra J, et al. Impact of fasting and postprandial glycemia on overall glycemic control in type 2 diabetes: importance of postprandial glycemia to achieve target HbA1c levels. Diabetes Research and Clinical Practice. 2007 August; 77(2): p. 280–5. pmid:17240473
- 28.
Effective Practice and Organisation of Care (EPOC). Data extraction and management. EPOC Resources for review authors. Norwegian Knowledge Centre for the Health Services. [Online]. 2013. Available from: http://epoc.cochrane.org/epoc-specific-resources-review-authors. Cited October 2015.
- 29. Pinnock H, Barwick M, Carpenter CR, Eldridge s, Grandes G, Griffiths C et al. Standards for Reporting Implementation Studies (StaRI) Statement. BMJ. 2017 March; 365. pmid:28264797
- 30. Adams J, Giles EL, McColl E, Sniehotta FF. Carrots, sticks and health behaviours: a framework for documenting the complexity of financial incentive interventions to change health behaviours. Health Psychology Review. 2014 July; 8(3): p. 286–95. pmid:25053215
- 31. Ogilvie D, Fayter D, Petticrew M, Sowden A, Thomas S, Whitehead M, et al. The harvest plot: a method for synthesising evidence about the differential effects of interventions. BMC medical research methodology. 2008 February; 8(1). pmid:18298827
- 32. Beck JK, Logan KJ, Hamm RM, Sproat SM, Musser KM, Everhart PD, et al. Reimbursement for pediatric diabetes intensive case management: A model for chronic diseases? Pediatrics. 2004 January; 113(1): p. e47–50.
- 33. Chien AT, Eastman D, Li Z, Rosenthal MB. Impact of a pay for performance program to improve diabetes care in the safety net. Preventive Medicine. 2012 November; 55: p. S80–5. pmid:23046985
- 34. Conrad DA, Grembowski D, Perry L, Maynard C, Rodriguez H, Martin D. Paying physician group practices for quality: A statewide quasi-experiment. Healthcare. 2013 December; 1(3–4): p. 108–116. pmid:26249780
- 35. Fagan PJ, Schuster AB, Boyd C, Marsteller JA, Griswold M, Murphy SM, et al. Chronic Care Improvement in Primary Care: Evaluation of an Integrated Pay‐for‐Performance and Practice‐Based Care Coordination Program among Elderly Patients with Diabetes. Health services research. 2010 December; 45(6p1): p. 1763–82. pmid:20849553
- 36. Mandel KE, Kotagal UR. Pay for performance alone cannot drive quality. Archives of Pediatrics & Adolescent Medicine. 2007 July; 161(7): p. 650–5. pmid:17606827
- 37. Rosenthal MB, Frank RG, Li Z, Epstein AM. Early experience with pay-for-performance: From concept to practice. Journal of the American Medical Association. 2005 October; 294(14): p. 1788–93. pmid:16219882
- 38. Young GJ, Meterko M, Beckman H, Baker E, White B, Sautter KM, et al. Effects of paying physicians based on their relative performance for quality. Journal of General Internal Medicine. 2007 June; 22(6): p. 872–6. pmid:17443360
- 39. Gulliford MC, Ashworth M, Robotham D, Mohiddin A. Achievement of metabolic targets for diabetes by English primary care practices under a new system of incentives. Diabetic Medicine. Achievement of metabolic targets for diabetes by English primary care practices under a new system of incentives. Diabetic Medicine. 2007 May; 24(5): p. 505–11. pmid:17381507
- 40. Kontopantelis E, Reeves D, Valderas JM, Campbell S, Doran T. Recorded quality of primary care for patients with diabetes in England before and after the introduction of a financial incentive scheme: a longitudinal observational study. BMJ Qual Saf. 2013 January; 22(1): p. 53–64. pmid:22918988
- 41. Pape UJ, Huckvale K, Car J, Majeed A, Millett C. Impact of 'stretch' targets for cardiovascular disease management within a local pay-for-performance programme. PLOS ONE. 2015 March; 10(3): p. e0119185. pmid:25811487
- 42. Vamos EP, Pape UJ, Bottle A, Hamilton FL, Curcin V, Ng A, et al. Association of practice size and pay-for-performance incentives with the quality of diabetes management in primary care. Canadian Medical Association Journal. 2011 August. pmid:21810950
- 43. LeBlanc E, Bélanger M, Thibault V, Babin L, Greene B, Halpine S, et al. Influence of a Pay-for-Performance Program on Glycemic Control in Patients Living with Diabetes by Family Physicians in a Canadian Province. Canadian journal of diabetes. 2017 April; 41(2): p. 190–196. pmid:27908559
- 44. Pinnock H, Epiphaniou E, Sheikh A, Griffiths C, Eldridge S, Craig P, et al. Developing standards for reporting implementation studies of complex interventions (StaRI): a systematic review and e-Delphi. Implementation Science. 2015 March; 10:42. pmid:25888928
- 45. Glasziou P, Buchan H, Mar CD, Doust J, Harris M, Knight R, et al. When financial incentives do more good than harm: a checklist. BMJ. 2012 July; e5047: p. 345–50.
- 46. McDonald R, Cheraghi-Sohi S, Tickle M, Roland M, Doran T, Campbell S. The impact of incentives on the behaviour and performance of primary care professionals. Queen's Printer and Controller of HMSO; 2010. Available from: http://www.netscc.ac.uk/hsdr/files/adhoc/158-final-report.pdf. Cited January 2017.
- 47. Doran T, Fullwood C, Kontopantelis E, Reeves D. Effect of financial incentives on inequalities in the delivery of primary clinical care in England: analysis of clinical activity indicators for the quality and outcomes framework. The Lancet. 2008 September; 372(9640): p. 728–36.
- 48. Peinemann F, Tushabe DA, Kleijnen J. Using multiple types of studies in systematic reviews of health care interventions–a systematic review. PLOS ONE. 2013 December; 8(12). pmid:24416098
- 49. Song F, Hooper L, Loke Y. Publication bias: what is it? How do we measure it? How do we avoid it? Open Access Journal of Clinical Trials. 2013 July; 2013(5) p. 71–81.