Hostname: page-component-8448b6f56d-sxzjt Total loading time: 0 Render date: 2024-04-19T10:38:42.892Z Has data issue: false hasContentIssue false

Performance of surgical site infection risk prediction models in colorectal surgery: external validity assessment from three European national surveillance networks

Published online by Cambridge University Press:  20 June 2019

Rebecca Grant
Affiliation:
Infection Control Programme, University of Geneva Hospitals and Faculty of Medicine, Geneva, Switzerland Centre for Global Health, Institut Pasteur, Paris, France
Martine Aupee
Affiliation:
Coordination Center for Prevention and Control of Nosocomial Infections (CClin) Ouest, Rennes, France
Nicolas C. Buchs
Affiliation:
Service of Visceral Surgery, Department of Surgery, University of Geneva Hospitals and Faculty of Medicine, Geneva, Switzerland
Kristine Cooper
Affiliation:
National Infection Service, Public Health England, London, United Kingdom
Marie-Christine Eisenring
Affiliation:
Swissnoso, National Center for Infection Prevention, Bern, Switzerland Service of Infectious Diseases, Central Institute of the Valais Hospital, Sion, Switzerland
Theresa Lamagni
Affiliation:
National Infection Service, Public Health England, London, United Kingdom
Frédéric Ris
Affiliation:
Service of Visceral Surgery, Department of Surgery, University of Geneva Hospitals and Faculty of Medicine, Geneva, Switzerland
Juliette Tanguy
Affiliation:
Coordination Center for Prevention and Control of Nosocomial Infections (CClin) Ouest, Rennes, France
Nicolas Troillet
Affiliation:
Swissnoso, National Center for Infection Prevention, Bern, Switzerland Service of Infectious Diseases, Central Institute of the Valais Hospital, Sion, Switzerland
Stephan Harbarth
Affiliation:
Infection Control Programme, University of Geneva Hospitals and Faculty of Medicine, Geneva, Switzerland Swissnoso, National Center for Infection Prevention, Bern, Switzerland
Mohamed Abbas*
Affiliation:
Infection Control Programme, University of Geneva Hospitals and Faculty of Medicine, Geneva, Switzerland
*
Author for correspondence: Mohamed Abbas, Email:mohamed.abbas@hcuge.ch

Abstract

Objective:

To assess the validity of multivariable models for predicting risk of surgical site infection (SSI) after colorectal surgery based on routinely collected data in national surveillance networks.

Design:

Retrospective analysis performed on 3 validation cohorts.

Patients:

Colorectal surgery patients in Switzerland, France, and England, 2007–2017.

Methods:

We determined calibration and discrimination (ie, area under the curve, AUC) of the COLA (contamination class, obesity, laparoscopy, American Society of Anesthesiologists [ASA]) multivariable risk model and the National Healthcare Safety Network (NHSN) multivariable risk model in each cohort. A new score was constructed based on multivariable analysis of the Swiss cohort following colorectal surgery, then based on colon and rectal surgery separately.

Results:

We included 40,813 patients who had undergone elective or emergency colorectal surgery to validate the COLA score, 45,216 patients to validate the NHSN colon and rectal surgery risk models, and 46,320 patients in the construction of a new predictive model. The COLA score’s predictive ability was poor, with AUC values of 0.64 (95% confidence interval [CI], 0.63–0.65), 0.62 (95% CI, 0.58–0.67), 0.60 (95% CI, 0.58–0.61) in the Swiss, French, and English cohorts, respectively. The NHSN colon-specific model (AUC, 0.61; 95% CI, 0.61–0.62) and the rectal surgery–specific model (AUC, 0.57; 95% CI, 0.53–0.61) showed limited predictive ability. The new predictive score showed poor predictive accuracy for colorectal surgery overall (AUC, 0.65; 95% CI, 0.64–0.66), for colon surgery (AUC, 0.65; 95% CI, 0.65–0.66), and for rectal surgery (AUC, 0.63; 95% CI, 0.60–0.66).

Conclusion:

Models based on routinely collected data in SSI surveillance networks poorly predict individual risk of SSI following colorectal surgery. Further models that include other more predictive variables could be developed and validated.

Type
Original Article
Copyright
© 2019 by The Society for Healthcare Epidemiology of America. All rights reserved. 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

PREVIOUS PRESENTATION: Preliminary results of this study were presented (oral presentation no. O1177) at the 29th European Conference on Clinical Microbiology and Infectious Diseases on April 16, 2019, in Amsterdam, The Netherlands.

References

Cassini, A, Plachouras, D, Eckmanns, T, et al. Burden of six healthcare-associated infections on European population health: estimating incidence-based disability-adjusted life years through a population prevalence-based modelling study. PLoS Med 2016;13:e1002150.CrossRefGoogle ScholarPubMed
Troillet, N, Aghayev, E, Eisenring, MC, Widmer, A Swissnoso, First results of the Swiss National Surgical Site Infection Surveillance Program: who seeks shall find. Infect Control Hosp Epidemiol 2017:697704.CrossRefGoogle Scholar
Public Health England. Surveillance of surgical site infections in NHS hospitals in England, 2016 to 2017. Public Health England, December 2017. https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/666465/SSI_annual_report_NHS_hospitals_2016-17.pdf Accessed June 13 2019.Google Scholar
Le Réseau d’alerte d’investigation et de surveillance des infections nosocomiales (Raisin). [Surgical site infection Surveillance, France 2016]. Santé publique France, 2018.http://www.cpias-ile-de-france.fr/surveillance/iso/RappRAISIN2016.pdf Accessed June 13 2019.Google Scholar
Morris, MS, Graham, LA, Chu, DI, Cannon, JA, Hawn, MT., Oral antibiotic bowel preparation significantly reduces surgical site infection rates and readmission rates in elective colorectal surgery. Ann Surg 2015;261:10341040.CrossRefGoogle ScholarPubMed
Anderson, DJ, Podgorny, K, Berríos-Torres, SI, et al. Strategies to prevent surgical site infections in acute care hospitals: 2014 update. Infect Control Hosp Epidemiol 2014;35:605627.CrossRefGoogle ScholarPubMed
Zingg, W, Holmes, A, Dettenkofer, M, et al. Hospital organisation, management, and structure for prevention of health-care-associated infection: a systematic review and expert consensus. Lancet Infect Dis 2015;15:212224.CrossRefGoogle ScholarPubMed
Storr, J, Twyman, A, Zingg, W, et al. Core components for effective infection prevention and control programmes: new WHO evidence-based recommendations. Antimicrob Resist Infect Control 2017;6:6.CrossRefGoogle ScholarPubMed
Haley, RW, Culver, DH, White, JW, et al. The efficacy of infection surveillance and control programs in preventing nosocomial infections in US hospitals. Am J Epidemiol 1985;121:182205.CrossRefGoogle ScholarPubMed
Culver, DH, Horan, TC, Gaynes, RP, et al. Surgical wound infection rates by wound class, operative procedure, and patient risk index. National Nosocomial Infections Surveillance System. Am J Med 1991;91(3B):152S157S.CrossRefGoogle ScholarPubMed
Gaynes, RP, Culver, DH, Horan, TC, Edwards, JR, Richards, C, Tolson, JS., Surgical site infection (SSI) rates in the United States, 1992–1998: the National Nosocomial Infections Surveillance System basic SSI risk index. Clin Infect Dis 2001;33(suppl 2):S69S77.CrossRefGoogle ScholarPubMed
Mu, Y, Edwards, JR, Horan, TC, Berrios-Torres, SI, Fridkin, SK., Improving risk-adjusted measures of surgical site infection for the national healthcare safety network. Infect Control Hosp Epidemiol 2011;32:970986.CrossRefGoogle ScholarPubMed
Gervaz, P, Bandiera-Clerc, C, Buchs, NC, et al. Scoring system to predict the risk of surgical-site infection after colorectal resection. Br J Surg 2012;99:589595.CrossRefGoogle ScholarPubMed
Feng, C, Sidhwa, F, Cameron, DB, Glass, C, Rangel, SJ., Rates and burden of surgical site infections associated with pediatric colorectal surgery: insight from the National Surgery Quality Improvement Program. J Pediatr Surg 2016;51:970974.Google ScholarPubMed
Moons, KG, Altman, DG, Reitsma, JB, et al. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): explanation and elaboration. Ann Intern Med 2015;162:W1W73.CrossRefGoogle ScholarPubMed
Bergquist, JR, Thiels, CA, Etzioni, DA, Habermann, EB, Cima, RR., Failure of colorectal surgical site infection predictive models applied to an independent dataset: do they add value or just confusion? J Am Coll Surg 2016;222:431438.CrossRefGoogle ScholarPubMed
Dubinsky-Pertzov, B, Temkin, E, Harbarth, S, et al. Carriage of extended-spectrum beta-lactamase-producing Enterobacteriaceae and the risk of surgical site infection after colorectal surgery: a prospective cohort study. Clin Infect Dis 2018;68:16991704. doi: 10.1093/cid/ciy768.CrossRefGoogle Scholar
Nthumba, PM, Stepita-Poenaru, E, Poenaru, D, et al. Cluster-randomized, crossover trial of the efficacy of plain soap and water versus alcohol-based rub for surgical hand preparation in a rural hospital in Kenya. Br J Surg 2010;97:16211628.CrossRefGoogle Scholar
Meijerink, H, Lamagni, T, Eriksen, HM, Elgohari, S, Harrington, P, Kacelnik, O., Is it valid to compare surgical site infections rates between countries? Insights from a study of English and Norwegian surveillance systems. Infect Control Hosp Epidemiol 2017;38:162171.CrossRefGoogle ScholarPubMed
Santé Publique France. Surveillance des infections du site opératoire dans les établissements de santé. Réseau ISORaisin, France. Résultats 2017. February 2019.Google Scholar
Kuster, SP, Eisenring, MC, Sax, H, Troillet, N, Swissnoso. Structure, process, and outcome quality of surgical site infection surveillance in Switzerland. Infect Control Hosp Epidemiol 2017;38:11721181.CrossRefGoogle ScholarPubMed
Supplementary material: File

Grant et al. supplementary material

Appendix

Download Grant et al. supplementary material(File)
File 214.9 KB