Article Text
PDF
Abstract
Objectives Given the current excellent early mortality rates for paediatric cardiac surgery, stakeholders believe that this important safety outcome should be supplemented by a wider range of measures. Our objectives were to prospectively measure the incidence of morbidities following paediatric cardiac surgery and to evaluate their clinical and health-economic impact over 6 months.
Design The design was a prospective, multicentre, multidisciplinary mixed methods study.
Setting The setting was 5 of the 10 paediatric cardiac surgery centres in the UK with 21 months recruitment.
Participants Included were 3090 paediatric cardiac surgeries, of which 666 patients were recruited to an impact substudy.
Results Families and clinicians prioritised:
Acute neurological event, unplanned re-intervention, feeding problems, renal replacement therapy, major adverse events, extracorporeal life support, necrotising enterocolitis, postsurgical infection and prolonged pleural effusion or chylothorax.
Among 3090 consecutive surgeries, there were 675 (21.8%) with at least one of these morbidities. Independent risk factors for morbidity included neonatal age, complex heart disease and prolonged cardiopulmonary bypass (p<0.001). Among patients with morbidity, 6-month survival was 88.2% (95% CI 85.4 to 90.6) compared with 99.3% (95% CI 98.9 to 99.6) with none of the morbidities (p<0.001). The impact substudy in 340 children with morbidity and 326 control children with no morbidity indicated that morbidity-related impairment in quality of life improved between 6 weeks and 6 months. When compared with children with no morbidities, those with morbidity experienced a median of 13 (95% CI 10.2 to 15.8, p<0.001) fewer days at home by 6 months, and an adjusted incremental cost of £21 292 (95% CI £17 694 to £32 423, p<0.001).
Conclusions Evaluation of postoperative morbidity is more complicated than measuring early mortality. However, tracking morbidity after paediatric cardiac surgery over 6 months offers stakeholders important data that are of value to parents and will be useful in driving future quality improvement.
- paediatrics
- cardiac surgery
- outcome
- complications
- morbidity
- quality of life
This is an open access article distributed in accordance with the Creative Commons Attribution 4.0 Unported (CC BY 4.0) license, which permits others to copy, redistribute, remix, transform and build upon this work for any purpose, provided the original work is properly cited, a link to the licence is given, and indication of whether changes were made. See: https://creativecommons.org/licenses/by/4.0/.
Statistics from Altmetric.com
Strengths and limitations of this study
Our study is unique, given that the morbidity measures selected for study reflect the viewpoints of both lay people and clinicians, whereas previous work has tended to focus on clinical metrics only.
A limitation of our study is that although we were able to identify broad risk factors for morbidity after paediatric cardiac surgery, a larger dataset will be needed to generate more reliable risk adjustment methods.
A strength of our study was that it was multicentre, prospective and followed children up for 6 months after their operation, which is a longer time horizon than the usual 30-day period.
Background
Over 5000 paediatric cardiac surgery procedures are performed in the UK each year and early survival has improved to over 98% since comprehensive national audit commenced in 2000.1 2 Most stakeholders including clinicians, commissioners and users believe that while these early survival rates remain an important safety measure, it has become imperative to explore a broader range of measures for outcome in this complex field of practice. While there has been considerable research related to measuring, understanding and reducing perioperative mortality for paediatric cardiac surgery,3–5much less attention has been focused on surgical morbidities.
Morbidity is defined as a state of being unhealthy, or of experiencing an aspect of health that is ‘generally bad for you’. In this project, by ‘morbidity’ we mean a defined aspect of ill health associated with a specific operation. In our study, we aimed to identify which morbidities present the greatest burden on patients and health services following paediatric cardiac surgery. Views may differ between professionals and non-professionals as to what the term morbidity exactly refers to and which surgical morbidities are most important.6 Therefore, we set out to combine patients’ and carers’ perspectives with those of professional groups in defining a prioritised list of morbidities for prospective evaluation.
Over 4 years, we:
Identified and defined nine morbidities following paediatric heart surgery, taking into account views from patients, carers, psychologists, nurses and clinicians, which together captured important aspects of the clinical and health-economic burden;
Measured incidence of the defined morbidities in the UK patient population and in subgroups defined by case complexity;
Evaluated the impact of defined morbidities on quality of life and estimated their clinical and health economic burden.
Methods
Design
The design was a prospective, multicentre, multidisciplinary mixed methods study. Selection of morbidities was based on consensus methods. Morbidity incidence was evaluated with a prospective cross-sectional study. Measurement of morbidity impact entailed a prospective, case-matched, longitudinal study.
Setting
Five UK paediatric cardiac surgery centres representing a range of programme sizes, which care for half of all patients nationally.
Participants
The participants were children aged under 17 years with congenital heart disease (CHD).
Consent
Parents and children participating in focus groups and in the prospective study of morbidity impact provided written informed consent.
Which morbidities?
Between January 2014 and September 2015, we reviewed existing literature, ran three family focus groups and undertook a family online discussion forum moderated by the Children’s Heart Federation (a user group). Transcripts were thematically analysed and the resultant themes, together with the literature, helped to inform a long list of candidate surgical morbidities. A multidisciplinary group, with patient and carer representation, then ranked and selected a list of nine key morbidities using the nominal group technique and secret voting.7 This ‘selection panel’7 was informed in turn by clinical views on definitions and feasibility of routine monitoring for each candidate morbidity provided by an independent ‘definition panel’8 as reported in previous publications.
Incidence of morbidity
Between October 2015 and June 2017, we prospectively measured instances of morbidity within all consecutive surgical admissions across the study sites. Online supplementary appendix 18 provides the details of the criteria followed to define each individual morbidity, including the timeframe for diagnosis. Morbidities were attributed to the immediately preceding cardiac surgery and defined within the same hospitalisation. The only exceptions were unplanned re-operation, which was defined as an unanticipated procedure within 30 days and mediastinitis, which could be identified postdischarge by the operating surgeon.8 Data were regularly checked for completeness, clinical congruence and accuracy and, a 3-month sample of data was independently validated against the national audit data.
Supplemental material
As for the UK audit of 30-day mortality,9 all procedures >30 days apart on the same patient were included in the morbidity analysis. As a secondary outcome, we checked each patient’s survival status at 6 months after first appearance in the dataset, based on the individual centres National Congenital Heart Diseases Audit (NCHDA)2 data and local hospital records.
Impact of morbidity
Recruitment
Recruitment to the impact study ran between October 2015 and June 2017 for all but one site, where it stopped after 6 months due to resource constraints. We attempted to recruit all patients with morbidity from the wider population, when at least one parent spoke reasonable English, and the family were resident in the UK. When feasible, for each morbidity case, we recruited a patient with no morbidity, matched on treating centre, age and univentricular status. The recruitment strategy led to the recruitment of a sample that was evenly balanced between patients with morbidity and those with no morbidity, however we were not able to find a match for every morbidity patient. In order to account for the widest possible spectrum of important outcomes, we included the available data on children who subsequently died.
Measures of impact
We evaluated the impact of morbidities over the 6 months following surgery, based on the outcomes discussed below.
Quality of life and psychological burden on children and parents
We used age-specific measures at 6 weeks and 6 months following surgery. These were the PedsQL subscales (physical and psychosocial) and total scores. These scores range from 0 and 100, a higher score indicating better quality of life. PedsQL scores in a normal healthy population vary by age; expected scores for infants 0–12 months (which encompasses the median age for our cohort) are mean physical 84.98 (SD 9.45), mean psychosocial 80.47 (SD 12.64) and mean total 82.47 (SD 9.95).10–12
For the parents, we used the Patient Health Questionnaire-4 (PHQ-4), which comprises four questions, measuring anxiety and depression in adults. Individual items are scored from 0 to 3. Scores ≥3 for the first two questions suggest anxiety, and scores ≥3 for last two questions suggest depression.13 In the normal population, 4.8% have scores suggestive of anxiety and 6.6% have PHQ-4 scores suggestive of depression.14
Days at home over 6 months as an additional measure of disruption to family life
Length of inpatient stay following the index procedure was defined as the number of days between the operation and the date of discharge from the tertiary centre. Hospital stays that exceeded the 6-month follow-up period were censored after 183 days. All subsequent hospital admissions were captured and the total days spent in hospital including tertiary and secondary care admissions was subtracted from 183 days to generate a value for days at home by 6 months. Children who died in hospital were assigned a value of zero for this outcome.
Costs of the index hospitalisation
We calculated the cost of the inpatient stay in the tertiary centre following the index surgical procedure as a key indicator of the economic burden to the hospital provider (measured in 2016/17 UK£).
Costs were calculated as the summation of days in intensive care unit (ICU), days on the ward and all operating procedures within the defined period. For ICU stays, data were recorded on the level of care the patient received each day (enhanced care, high dependency, high dependency advanced, ICU basic, ICU basic enhanced, ICU advanced, ICU advanced enhanced and extracorporeal life support (ECLS)).15 Unit costs of ICU stays were daily costs for each level of care (ranging from £870 to £5440) applied to the number of days spent receiving that level of care. Unit costs per day for ward stays were obtained from the highest recruiting centre and varied according to the age of the patient (<2 years, £904; ≥2 years, £680). Unit costs for surgical procedures were costs per minute supplied by study sites; these varied by site and so we used the value for the site that recruited the largest number of patients to this study (£13.39 per min), which was similar to the mean value across all sites.
Statistical and health economic analyses
Patient sample size
We anticipated that between 3000 and 3300 surgical patients would be admitted across the five sites during the study period.2 We assumed that a clinically relevant difference in quality of life between matched pairs corresponded to a mean difference in quality of life score of at least 0.5 SD.16 To detect such a difference for PedsQL responses at 5% significance with 80% power requires a minimum of 32 matched pairs. Allowing for a 10% loss to follow-up rate, we aimed to recruit 36 matched pairs for each patient with morbidity, giving 80% power to detect a significant effect for any morbidity with a prevalence of at least 1.5%.
Analysis of risk factors for morbidity
Based on the whole sample of cardiac surgeries across the five sites over the study period, we explored risk factors for occurrence of morbidity. Clinical risk factor groups were derived from the finer diagnostic coding, based on previous peer-reviewed research by our group.9 17 We used multilevel logistic regression analysis to explore the role of preoperative, patient-level case mix factors on the occurrence of any morbidity versus no morbidity, accounting for multiple procedures within patients. First, a univariate model to predict risk of any morbidity versus none was fitted for each risk factor. The estimated ORs are presented along with 95% CIs. Then all factors significant on univariate analysis (p<0.1) were considered in a multivariable model. We used multiple imputation by chained equations to account for missing data. The imputation model included all risk factors considered in the univariate analysis, which we assumed included all predictors of missingness. We indicate missing data in our results. The multivariable models were derived by fitting a regression model for all significant predictors and estimates were combined using Rubin’s rules.18
Secondary outcome
The secondary outcome of survival at 6 months was calculated for all patients who had cardiac surgery at the sites within the study period. Unadjusted 6-month mortality rates were compared between morbidity groups using logistic regression.
Analysis of the impact of morbidity
In the patients recruited to the impact study, we analysed the ‘impact outcomes’ over 6 months postsurgery.
We used mixed effects regression models for PedsQL/PHQ-4 results to compare the impact of morbidity (any vs none) on outcome. All models were adjusted for clustering within matched pairs and significant covariates associated with incidence of morbidity. We used multiple imputation, by chained equations to account for missing data for those patients known to be alive at 6 weeks and 6 months, respectively.
We used quantile regression to estimate the effects of individual morbidities in terms of differences in median days at home by 6 months, since the measure was negatively skewed. All models were adjusted for clustering within matched pairs and significant covariates associated with incidence of morbidity. Given the high level of data completeness, imputation was not used.
The inclusion of hospital site made negligible difference to either of these analyses, and not included in the statistical models.
We modelled the relationship between morbidities and cost of index hospitalisation, adjusted for significant covariates associated with hospital costs. Costs were skewed and to account for this we used a generalised linear model with gamma family and log link, which has been recommended for modelling positively skewed data.19 Missing outcome values were imputed using an iterative Markov chain Monte Carlo procedure based on multivariate normal regression, generating 20 imputed datasets. The hospital site was included as a significant covariate in the health economic model.
All analyses were performed in Stata V.14.20
Patient and public involvement
The patient or user perspective lies at the core of the study methodology. Specifically, a key goal of the study was to consider the views of patients and parents when measures of morbidity are selected for future audit and benchmarking, in particular since emphasis may potentially differ between professionals and parents/patients.
Patient and family representatives from the Children’s Heart Federation (CHF) were involved in aspects of the study design including design and running of the focus groups and the online discussion forum.
Representatives of the CHF participated in the facilitated nominal group meetings to select morbidities for inclusion in the incidence and impact studies.
A member of the CHF and a parent representative sat on the project steering group.
Results
Which morbidities?
Our final selected7 and defined8 list of included morbidities were: acute neurological event, unplanned re-intervention, feeding problems, renal replacement therapy, major adverse events, ECLS, necrotising enterocolitis, postsurgical infection and prolonged pleural effusion or chylothorax.
We treated children with more than one of these events as a distinct group referred to as ‘multimorbidity’. Recognising ECLS as a very severe event, which nearly always occurs with other morbidities, we treated ECLS as standalone morbidity (and always excluded from the multiple morbidity group).21–25
There was some divergence between the views of clinicians and families about the fundamental issue of what the important morbidities linked to paediatric cardiac surgery are. Health professionals from tertiary centres tended to prioritise clearly clinical issues related to the heart (eg, use of ECLS and re-operation), whereas parents placed greater emphasis on holistic outcomes for their child (eg, feeding difficulties and child developmental problems).7
2.Incidence of morbidity
Descriptive results
We collected data on 3248 cardiac procedures and analysed 3090, after excluding 99 cardiac re-operations (a morbidity outcome) and 59 procedures that did not meet inclusion criteria.
The incidence of individual morbidities in isolation and overall for each is shown in figure 1.
Incidence of morbidities. The figure shows the distinction between occurrence as a single morbidity and occurrence in combination with other morbidities, with 95% CIs. Source: Reproduce from Brown et al35 2019.
Significant risk factors for morbidity
As shown in table 1, the most important risk factor for occurrence of ‘any morbidity’ was young age, particularly neonates, who were approximately five times as likely to experience a morbidity compared with children aged over 1 year. Children with more complex heart disease or children whose operation included a bypass time longer than 90 min were almost twice as likely to experience morbidity. Other important independent risk factors were: palliative or staged procedures, the presence of functionally univentricular heart and preprocedure severity of illness factors (eg, preprocedure mechanical ventilation or shock).
Summary of risk factors by any morbidity outcome
Secondary outcomes
Patient survival was highest and patient hospital stay was shortest for patients with none of the morbidities (table 2). The 6-month survival was significantly lower for patients with a single morbidity, for those with ECLS and multiple morbidities, compared with patients with none of the morbidities (p<0.001 for all).
Secondary outcomes of hospital stay and survival at 6 months by morbidity
Impact of morbidity
Patient sample
We recruited 60% of eligible families, amounting to 666 children of whom 340 (51%) had at least one morbidity. Of these, 19 died within 30 days and 39 died within 6 months. We pair matched 558 patients and 108 patients unmatched of whom 61 had morbidity; all of the patients were included in the statistical analysis.
Quality of life and anxiety—depression outcomes
For the 6 weeks data, a comparison between patients with missing versus non-missing data indicated the only difference was in the proportions with severity of illness factors and additional cardiac risk factors. Importantly, there was no difference in the proportion of patients with or without morbidity. At the 6 months mark, there was no difference in any baseline factor or morbidity occurrence.
All PedsQL scores were lower than in a healthy population (see ‘Methods’ section10–12 and table 3). In terms of our study objective to assess the impact of morbidity, the total PedsQL scores were significantly reduced for children with any morbidity at 6 weeks in comparison to children with none of the morbidities (case mix adjusted score reduction of −5.2 (95% CI −8.3 to –2.2, p<0.01). On a positive note, this difference narrowed to small non-significant reduction in total score by 6 months. Physical scores were affected more than psychosocial scores, and were still significantly impaired at 6 months.
Quality of life and parental anxiety/depression based on whether or not a morbidity was present
All parents experienced higher rates of both anxiety and depression than a healthy population (see ‘Methods’ section and table 3). The parents of children with morbidity were around 57% more likely to experience anxiety; and around 77% more likely to experience depression, at 6 weeks postoperation than parents of children without a morbidity. PHQ-4 scores had improved by 6 months, and although there remained a higher chance of both anxiety and depression with morbidity, the difference narrowed and was not significant.
Days at home by 6 months outcome
Children with none of the morbidities had a median of 174 days at home (IQR 169, 176) out of a possible 183 days in 6 months. The presence of any morbidity reduced the median days at home by 13 days over 6 months (95% CI 10.2 to 15.8, p<0.001). When individual morbidities were each considered in turn, the difference in the case mix adjusted median days at home was significantly lower at 6 months for all of them apart from ‘renal support’ (p<0.05).
Health economic outcome
The costs of the index hospitalisation were available for 613 patients (8% missing). The mean additional cost linked to having any of the selected morbidities was £21 292 (95% CI £17 694 to £32 423, p<0.001). In table 4, we present the adjusted marginal effects, which are the adjusted incremental costs linked to the stated morbidity, in comparison to the adjusted cost linked to patients with none of the selected morbidities. The greatest adjusted cost difference was for ECLS, where the adjusted mean difference in costs was £62 452 followed by multimorbidity, where the adjusted mean difference was £33 147 (p<0.01 for both). Significantly increased (p<0.05) costs were also found for unplanned re-intervention, feeding problems, renal support and prolonged pleural effusion. The remaining morbidities, representing the lowest number of patients per category, showed non-significant differences.
Cost of hospital stay following index surgical procedure by morbidity
Discussion
Overview of findings
This paper presents the results of the first prospective multicentre study of morbidity after paediatric cardiac surgery morbidity that measured outcome 6 months after operation. The results are novel and indicate that evaluation of morbidity adds considerably to the current main metric of 30-day or in-hospital survival.
We note the excellent outcomes in children who had none of the morbidities: their survival at 6 months postoperation was 99.3% and their median length of stay was 8 days, suggesting that the morbidities we selected do capture most of the complication-related adverse outcomes for this context.
Based on our impact substudy, occurrence of ECLS and multiple morbidities are particularly important adverse outcomes—they are associated with high mortality, high resource use and lower quality of life for surviving patients over 6 months after surgery. Future routine monitoring and public reporting for these should be considered by centres and the national audit.
In our engagement work, patients’ families consistently told us that outcomes affecting the child as a whole over the medium or long term are very important to them. We thus included morbidities such as feeding problems and acute neurological events but note that those types of outcome were the most complicated to capture, and we intend to publish additional material on these topics.
Limitations
We acknowledge that the definition, measurement, reporting and interpretation of morbidity are much more complex than for mortality. This activity requires significant staff resources and clinician buy in, in particular because some morbidities are challenging to measure and to interpret. The number of individual morbidities was low in some of our analyses, limiting interpretation. We have not captured every single morbidity that exists after children’s heart surgery.
Context
There have been previous attempts at reporting morbidity after paediatric cardiac surgery, however these have in general captured events within a hospital setting, whereas our study captures outcomes out to 6 months postsurgery.A single centre study generated an aggregate 'Morbidity Index' by assigning subjective weights to postoperative complications.26The Society of Thoracic Surgery in the USA, developed a ‘Morbidity Score’, based on data from their multicentre registry.27 We note that condensing diverse morbidities into a single score may lead to loss of information. Moreover, recent work on using graphical methods to routinely monitor a range of morbidities highlighted the complexity of graphically summarising multiple morbidities.28 The Pediatric Cardiac Critical Care Consortium (PC⁴) was set up in 2009, and provides partner sites with access to real-time, reliable and actionable data to be used for local quality improvements.29–32 However, membership of PC4 is voluntary for institutions on a subscription basis, the reported measures been selected by clinicians, the reporting of outcomes is accessible only to subscribing member institutions and these are limited to in-hospital measures.
Future practice and research
Neurodevelopmental problems are common in children with CHD undergoing surgery33; however, we detected acute neurological events (ANE) following only 2.1% of procedures. Therefore, it appears that perioperative ‘ANE’ represents the tip of the iceberg, and hence the scope of surveillance for child neurodevelopment in CHD needs to extend well beyond the perioperative period.
Despite their great importance to families, we note that participants reported subjectivity in the collection of data on ‘feeding problems’; hence, these were difficult to capture consistently. Additional research may help determine the best way to measure this important morbidity and to elucidate approaches to alleviate the impact of feeding problems in CHD.
Our measure of renal failure was the need for renal support, and although relatively easy data to collect this may not be the optimal method to capture this morbidity, given that there are differences in practice between clinicians.34 Further research may help us to understand the best approach to manage postoperative renal injury in CHD.
Our results perhaps unsurprisingly indicate that parents of children who suffer morbidities experience higher rates of anxiety and depression postoperatively. This emphasises the importance of supporting parents during this phase.
We used study data to co-develop parent and carer information resources, showing what the morbidities are and how their incidence and the length of stay may vary based on the complexity of the child’s condition. Parents told us that it helps to know that first, they are not alone in facing a morbidity second, clinical teams have seen morbidities before and know how to deal with them, and third, it is better as a parent to ‘be prepared’. Furthermore, parents indicated that information about impact such as nearly all children who experience a morbidity and recover will have a similar quality of life to children who did not experience a morbidity by the 6-month mark, was very helpful to know.
Within the scope of this project, a new Excel tool has been developed and piloted, which enables clinical teams to benchmark and report the local rates of morbidities with a quality assurance goal, such as in a mortality and morbidity conference. Furthermore, we have kept in close contact with the NCHDA and the Clinical Reference Group for CHD services. The NCHDA has already started to collect five of the nine morbidities within the nationally mandated dataset, using the definitions that we developed.
Acknowledgments
The authors would like to thank Martin Utley, Sheryl Snowball, Luke Maidment, Sarah Bohannon, Liz Smith, Kate Penny-Thomas, Joanne Webb, Sinead Cummins, John Stickley, Natasha Khan, Teresa Dickson, Ray Samson, Isobel Mcleod, Paul Wellman, Rhian Lakhani, Kathleen Selway, Carrie Cherrington, Andrew Parry, Rob Tulloh, Bill Gaynor, Rodney Franklin, Lisa Allera, Kate Bull, Trevor Ritchens, Branko Mimic, Jon Smith, Lyvonne Tume, Vibeke Hjortdal, Michael Vath, Tom Treasure, Anne Keatley Clarke, Bea Tuten, and all the patients who participated in the study.
References
Footnotes
Collaborators Cardiac Impact Study Group: Martin Utley, Sheryl Snowball, Luke Maidment, Sarah Bohannon, Liz Smith, Kate Penny-Thomas, Joanne Webb, Sinead Cummins, John Stickley, Natasha Khan, Teresa Dickson, Ray Samson, Isobel Mcleod, Paul Wellman, Rhian Lakhani, Kathleen Selway, Carrie Cherrington, Andrew Parry, Rob Tulloh, Bill Gaynor, Rodney Franklin, Lisa Allera, Kate Bull, Trevor Ritchens, Branko Mimic, Jon Smith, Lyvonne Tume, Vibeke Hjortdal, Michael Vath, Tom Treasure, Anne Keatley Clarke, Bea Tuten.
Contributors Designed the study and wrote the protocol: KB, CP, DR, JW, SM and VT. Clinical expertise: VT, DA, DB, SS, AM, KB, SMT, DB, PD and WR. Study implementation, protocol adjustments, data cleaning: KB, AJ, KS, VT, JC, DB, PD, SS, WR and SMT. Statistical analysis: DR, CP, SMT and KB. Health economic analysis: EH and SM. Contributed to the write up and signed off the paper: KB, CP, DR, JW, VT, DA, DB, JC, PD, EH, AJ, AM, SM, WR, KS, SS, SMT and TW.
Funding This project was funded by the National Institute for Health Research Health Services and Delivery Research programme (Project No: 12/5005/06). KB, DR, JW and VT were supported by the National Institute for Health Research Biomedical Research Centre at Great Ormond Street Hospital for Children NHS Foundation Trust and University College London.
Disclaimer The views and opinions expressed therein are those of the authors and do not necessarily reflect those of the NIHR HS&DR programme or the Department of Health.
Competing interests None declared.
Patient consent for publication Not required.
Ethics approval The study has ethical approval from London City Road Research Ethics Committee (14-LO-1442).
Provenance and peer review Not commissioned; externally peer reviewed.
Data availability statement For data to be made available specific ethical and HRA approval would be required.