Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

A pragmatic cluster randomised controlled trial of a tailored intervention to improve the initial management of suspected encephalitis

  • Ruth Backman,

    Roles Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliations Department of Clinical Infection, Microbiology and Immunology, Institute of Infection and Global Health, University of Liverpool, Liverpool, United Kingdom, Institute of Applied Health Research, University of Birmingham, Birmingham, United Kingdom

  • Robbie Foy,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Supervision, Validation, Writing – original draft, Writing – review & editing

    Affiliation Leeds Institute of Health Sciences, University of Leeds, Leeds, United Kingdom

  • Peter J. Diggle,

    Roles Data curation, Formal analysis, Investigation, Methodology, Validation, Writing – review & editing

    Affiliations Lancaster Medical School, Lancaster University, Lancaster, United Kingdom, Department Epidemiology and Population Health, Institute of Infection and Global Health, University of Liverpool, Liverpool, United Kingdom

  • Rachel Kneen,

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Validation, Writing – review & editing

    Affiliations Department of Clinical Infection, Microbiology and Immunology, Institute of Infection and Global Health, University of Liverpool, Liverpool, United Kingdom, Department of Neurology, Alder Hey Children’s NHS Foundation Trust, Liverpool, United Kingdom

  • Ava Easton,

    Roles Resources, Writing – review & editing

    Affiliations Department of Clinical Infection, Microbiology and Immunology, Institute of Infection and Global Health, University of Liverpool, Liverpool, United Kingdom, The Encephalitis Society, Malton, North Yorkshire, United Kingdom

  • Sylviane Defres,

    Roles Data curation, Investigation, Methodology, Validation, Writing – review & editing

    Affiliations Department of Clinical Infection, Microbiology and Immunology, Institute of Infection and Global Health, University of Liverpool, Liverpool, United Kingdom, Royal Liverpool and Broadgreen University Hospitals Trust, Liverpool, United Kingdom, NIHR Health Protection Research Unit in Emerging and Zoonotic Infections, University of Liverpool, Liverpool, United Kingdom

  • Fiona McGill,

    Roles Data curation, Validation, Writing – review & editing

    Affiliations Department of Clinical Infection, Microbiology and Immunology, Institute of Infection and Global Health, University of Liverpool, Liverpool, United Kingdom, Royal Liverpool and Broadgreen University Hospitals Trust, Liverpool, United Kingdom, NIHR Health Protection Research Unit in Emerging and Zoonotic Infections, University of Liverpool, Liverpool, United Kingdom

  • Benedict Daniel Michael,

    Roles Data curation, Investigation, Methodology, Validation, Writing – review & editing

    Affiliations Department of Clinical Infection, Microbiology and Immunology, Institute of Infection and Global Health, University of Liverpool, Liverpool, United Kingdom, The Walton Centre NHS Foundation Trust, Liverpool, United Kingdom

  • Tom Solomon ,

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Methodology, Resources, Supervision, Validation, Writing – review & editing

    tsolomon@liverpool.ac.uk

    Affiliations Department of Clinical Infection, Microbiology and Immunology, Institute of Infection and Global Health, University of Liverpool, Liverpool, United Kingdom, NIHR Health Protection Research Unit in Emerging and Zoonotic Infections, University of Liverpool, Liverpool, United Kingdom, The Walton Centre NHS Foundation Trust, Liverpool, United Kingdom

  • on behalf of the ENCEPH UK Programme Steering Committee

    ENCEPH UK Programme Steering Group Membership is provided in the Acknowledgments.

Abstract

Objective

To determine whether a tailored multifaceted implementation strategy improves the initial management of patients with suspected encephalitis.

Design

Pragmatic two arm cluster randomised controlled trial.

Setting

Hospitals within the United Kingdom.

Participants

Twenty-four hospitals nested within 12 postgraduate deaneries. Patients were identified retrospectively by searching discharge, microbiology, radiology and pharmacy records and included if they met clinical criteria or had a recorded suspicion of encephalitis.

Intervention

An implementation strategy designed to overcome barriers to change, comprising local action planning, education and training, feedback on performance, a lumbar puncture pack and a range of optional components.

Outcomes

The primary outcome was the proportion of patients with suspected encephalitis undergoing diagnostic lumbar puncture within 12 hours of admission and starting aciclovir treatment within six hours. Secondary outcomes included the proportions of adults and children who had a lumbar puncture, who had appropriate cerebrospinal fluid investigations, and who had appropriate radiological imaging within 24 hours of admission. Data were collected from patient records for 12 months before and 12 months during the intervention period, and analysed blind to allocation.

Results

13 hospitals were randomised to intervention and 11 to control (no intervention), with 266 and 223 patients with suspected encephalitis identified respectively. There was no significant difference in primary outcome between intervention and control hospitals (13.5% and 14.8% respectively, p = 0.619; treatment effect -0.188, 95% confidence interval -0.927 to 0.552), but both had improved compared to pre-intervention (8.5%).

Conclusion

The improvement in both intervention and control arms may reflect overall progress in management of encephalitis through wider awareness and education.

Trial registration

Controlled Trials: ISRCTN06886935.

Background

There is accumulating evidence that the clinical management of patients with suspected central nervous system (CNS) infections does not meet recommended standards, resulting in lost years and reduced quality of life [15]. In the United Kingdom (UK), encephalitis affects between five to nine people per 100,000 every year [6] and is most commonly caused by herpes simplex virus (HSV) type 1 [79]. Other causes, including antibody-associated encephalitis, are being recognised increasingly [10]. HSV encephalitis is treated with aciclovir and prompt treatment significantly improves patient outcomes [1113]. Long-term outcomes from encephalitis are still not understood fully but sequelae include disabilities such as concentration difficulties, behavioural and speech disorders, memory loss and epilepsy [1416], all of which impact on return to work [15].

HSV encephalitis is relatively rare but patients presenting with clinical features consistent with suspected encephalitis frequently seek medical advice [8]. Encephalitis typically presents with one or more of headache, fever, new-onset seizures, altered consciousness, and behavioural disturbances [17,18]. However, its variable and non-specific features often result in delayed diagnosis and treatment, especially in children who may only present with fever and irritability [5,19]. In addition, delays in performing one of the main diagnostic techniques, a lumbar puncture, may further hamper treatment [2024]. Previous studies have noted delays between two and 408 hours [2, 11], possibly due to a lack of training, difficulty in finding appropriate equipment, and delays for a computerised tomography (CT) scan [24]. Treatment with aciclovir is also often delayed, with admission to treatment times ranging from 30 minutes to 432 hours after admission [1,2,11] although the reasons behind this are less clear.

Clinical guidelines have been developed in response to these concerns [8,25]. However, dissemination of guidelines alone does not usually bring about significant changes in clinical practice [2628]. There is a growing evidence base on interventions to promote guideline implementation, but it remains difficult to predict with any confidence which intervention will work best for a given context and targeted behaviour [29]. Ideally, interventions to improve clinical behaviour should be tailored according to identified barriers and needs, preferably focusing on those most amenable to change [30]. Such strategies are often multifaceted, combining different interventions with the intention of targeting a range of barriers, although they are not necessarily more effective than single interventions [31].

The UK Medical Research Council advocates a systematic approach to the development and evaluation of such complex interventions [32,33]. We developed a tailored multifaceted implementation strategy to promote adherence to national guidelines on the initial management of suspected encephalitis [30,34] and evaluated its effectiveness within a cluster randomised trial.

Methods

Study design

We conducted a cluster randomised controlled trial with National Health Service (NHS) postgraduate deaneries as the unit of randomisation [35]. Deaneries are responsible for postgraduate medical training.

Participants

Hospitals.

This trial took place in the context of a wider research programme Understanding and Improving the Outcome of Encephalitis (ENCEPH UK) which comprised several studies. To reduce the likelihood of any unintended co-intervention effects we sought hospitals not directly participating in other ENCEPH UK studies. Sites had to have facilities to perform lumbar punctures and neuroimaging and be willing to be randomised to intervention or control arms. We recruited a range of hospitals providing secondary and tertiary (specialist) adult and paediatric care, to broadly represent national provision and ensure generalisable findings.

We were aware that trainee doctors, one key target intervention group, work and rotate between different hospitals within postgraduate deaneries. We therefore used deaneries as the unit of randomisation as randomising hospitals to intervention and control arms within the same deanery might have risked contamination.

We assessed all 266 acute hospital trusts in England, Wales and Scotland for eligibility. After excluding 47 participating in other ENCEPH UK studies and 10 specialist hospitals not usually providing routine care for suspected encephalitis patients (e.g. orthopaedics) we invited 209 hospitals to participate via senior members of medical staff.

Patients.

We identified patients with features suggestive of suspected encephalitis using criteria adapted from previous studies [1,9].

  • Acute or sub-acute (less than four weeks) alteration in consciousness, cognition, personality or behaviour persisting for more than twenty-four hours. Personality or behaviour change included agitation, psychosis, somnolence, insomnia, catatonia, mood liability, altered sleep pattern and (in children) new-onset enuresis or irritability. Plus any two of:
    • fever (≥38°C) or prodromal illness—acute or sub-acute
    • new-onset seizures; focal neurological signs of acute or sub-acute onset, including focal weakness, oromotor dysfunction, movement disorders (chorea, athetosis, dystonia, hemiballismus, stereotypies, orolingual dyskinesia and tics) Parkinsonism (bradykinesia, tremor, rigidity and postural instability) and amnesia
    • pleocytosis (cerebrospinal fluid [CSF] white cell count of more than four cells per microliter)
    • neuroimaging compatible with encephalitis
    • electroencephalogram (EEG) compatible with encephalitis
  • Clinical suspicion of encephalitis noted during the index presentation.
  • Clinical suspicion of encephalitis, and the patient died before investigations were completed.

Intervention

The intervention development and content has been published previously [30]. In brief, using theoretically informed semi-structured interviews based upon the Theoretical Domains Framework [36,37], we explored barriers and enablers to the recommended initial management of suspected encephalitis, specifically performing lumbar punctures and initiating antiviral therapy within 6 hours. This framework has previously been used to understand clinical behaviour across a wide range of healthcare settings [3745]. We matched behaviour change techniques [34] targeting clinicians to the most salient barriers and enablers and embedded them within an implementation package [30]. The implementation package comprised core interventions, delivered to all hospitals, and optional interventions, which hospitals could use depending on locally available resources and skills. Core interventions included educational and action planning meetings, feedback of pre-intervention audit data and provision of lumbar puncture kits within refillable boxes. Optional interventions included decision support via phone apps and algorithms, an online quiz, prompts and posters, personalised invitation letters to attend educational meetings and a quality improvement cycle pack (materials available via http://www.braininfectionsuk.org/RCTWebsite/). We presented the package at a one-day meeting of senior doctors and nurses from intervention hospitals. These clinical leads generally represented a range of specialties, mainly paediatrics, general medicine, neurology, infectious disease and microbiology, with varying levels of interest and expertise in brain infections. We emphasised their roles in directly delivering the various intervention components locally and recommended that they each convene an action planning meeting on return to their hospitals. All intervention sites received on-going support and materials by a researcher (RB) in addition to the core interventions. This was a pragmatic trial and all intervention sites could choose to what extent they engaged with intervention components although the core elements represented minimum requirements for participation [46]. Control sites received no intervention except for training and support to collect study data.

Outcomes

The primary outcome was a composite of the proportion of patients with suspected encephalitis whose care met both of the following criteria: a lumbar puncture performed within 12 hours of hospital admission unless clinically contraindicated; and intravenous aciclovir given within six hours of admission to hospital.

Secondary outcomes included the proportions of patients with suspected encephalitis who:

  • Were started on intravenous aciclovir within an appropriate dosage range for a neurological presentation (adults and children analysed separately).
  • Had a lumbar puncture performed within 12 hours of admission unless there was a clinical contraindication.
  • Had a lumbar puncture at any point during the index presentation.
  • Had either magnetic resonance imaging (MRI) or CT scan within 24 hours of admission.
  • Had a lumbar puncture, who had the following CSF investigations performed: calculation of the plasma to CSF glucose ratio and having HSV polymerase chain reaction (PCR) performed.

Data collection

We used retrospectively extracted pre-intervention data from case notes between 3rd February 2013 and 2nd February 2014 to provide data for the feedback intervention. We collected trial outcome data between 3rd February 2014 and 2nd February 2015 within the year following the launch of the implementation package.

Patients were identified during these two time periods using four methods; discharge code search for encephalitis, a microbiology search for patients who had had a lumbar puncture, patients who had received intravenous (IV) aciclovir for anything other than a dermatological condition and patients who had had either a CT head or MRI head. We used these combined approaches to maximise likelihood of case identification. The first two methods were compulsory at each site to reduce the likelihood of differences in case mix potentially resulting from different methods of detection confounding trial outcomes. We included both adult and paediatric cases, excluding neonates (up to four weeks) where management is different. We aimed to identify at least 20 cases per site with a maximum limit of 40 cases per site to preserve balance between sites. Given the large numbers of patients with records of CSF examination from all lumbar punctures, we asked local staff to order all cases by surname and date of birth before selecting every tenth case if there were less than 100 patients (i.e. a systematic 10% sample), and every twentieth case if there was over 100 patients (a systematic 5% sample), for eligibility screening. We used this approach to case identification to protect against post-randomisation selection bias.

Data were collected using structured case review forms. As no patient identifiable data were sent to the central trial team, we did not require patient consent as confirmed by the Declaration of Helsinki and the NHS Research Ethics Committee. We trained data collectors, mainly doctors who were undertaking speciality training and nurses, via face-to-face meetings and/or written briefing materials.

We collected data to assess time from admission to a range of investigations and interventions (e.g. lumbar puncture, aciclovir treatment and neuroimaging). We also collected data to assess the appropriateness of lumbar punctures and aciclovir dosages (contraindications, weight, and renal function). We reduced the number of items in the form following pre-intervention data collection to facilitate post-intervention data collection.

Sample size

Using preliminary unpublished data from another Brain Infections UK study of 315 patients across 26 hospitals in four deaneries, we estimated the standard deviations of the deanery and hospital random effects to be 0.244 and 1.108, respectively, and the pre-intervention proportion of adherence to the primary outcome to be 5%. Assuming a 15% absolute increase in adherence to the primary outcome measure to 20% in intervention hospitals and identification of 20 cases in each of 24 hospitals, we calculated the required sample size to achieve at least 80% power, testing at the 5% level of significance, as follows.

Using the proposed analysis plan (see “Analysis” below) we simulated data under the stated assumptions, analysed the data using the glmer() function of the lme4 package in R [47] and calculated the p-value of the generalised likelihood ratio test of the null hypothesis of no treatment effect. We then repeated the simulation and used the observed proportion of simulated p-values less than 0.05 as an estimate of the power, stopping the simulations when the negligible Monte Carlo error became negligible. This gave the required sample size per hospital as 20 patients; to allow for possible under-recruitment in some of the smaller hospitals, we therefore sought to recruit 25 patients per hospital, but to close recruitment when we achieved a total of at least 560 patients.

Randomisation

We used deaneries as the unit of randomisation to minimise contamination between hospitals within the same deanery. We defined two blocks of deaneries, a block of six where research teams were already actively involved in other ENCEPH UK studies prior to our RCT starting site recruitment, and a block of six where there were no such ongoing studies (Fig 1). No hospital was able to take part in this study if they were already involved in any other part of the ENCEPH UK programme. A statistician (PD) randomised equal numbers of clusters within each block to the intervention and routine arms, blinded to hospital identity. There was no concealment to randomisation allocation at the cluster level given the nature of the intervention.

thumbnail
Fig 1. ENCEPH Cluster RCT CONSORT flow diagram.

Fig 1 represents recruitment through both control and intervention arms in this study.

https://doi.org/10.1371/journal.pone.0202257.g001

Analysis

We assessed primary and secondary outcomes as described above. We estimated the appropriateness of paediatric aciclovir treatment using 5th and 95th percentiles of estimated weight and length [48] when values were missing. Where values for adult weight were missing, we assumed weights of 50–70kg for women and 60–80kg for men to allow us to estimate appropriateness of aciclovir dosage in adults. A reduced dose was considered appropriate in patients with recorded renal impairment.

The primary analysis fitted a generalised linear mixed model with binomial errors, logistic link, fixed effects for treatment (control versus intervention) and block (high or low level of previous involvement for the deanery in the ENCEPH UK research programme), and random effects for deanery and hospital [35]. Formally, if pbtdh denotes the probability of a positive outcome (y = 1) in block b, treatment arm t, deanery d and hospital h, the model is that: where the Ud are independent, Normally distributed with mean zero and variance and the Vh are independent, Normally distributed with mean zero and variance . The quantity of interest is the treatment effect, β1β0, where t = 0 and t = 1 denote control and intervention, respectively.

We fitted the model using the glmer() function of the lme4 package in R [48]. Model fit was checked by examining scatterplots of residuals against fitted values.

We also compared outcomes between adults and children by adding this as a blocking factor within the statistical analysis. The statistician (PD) remained blind to randomisation allocation for the analysis.

Patient involvement

A representative from the Encephalitis Society was involved in the study design with the particular remit of ensuring the research retained patient benefit as a primary objective, as well as providing subsequent opportunities for the study findings to be disseminated to a wider audience. Our intervention directly targeted healthcare professionals, aiming to help them overcome barriers to the timely and appropriate investigation and management of suspected encephalitis. However, as part of the intervention training the healthcare professionals received, a patient representative from the Encephalitis Society shared their experience of a non-timely diagnosis. This patient representative was an active member of the Programme Steering Committee and advised on the study design, outcome selection and conduct. The intervention was designed to promote best clinical practice, and thus there should have been no additional intervention burden to patients. Individual patient consent was not required as patient data were retrospectively collected by members of their own healthcare teams and anonymised.

Ethical review

This project was approved by Preston North West Research Ethics Committee on 3rd May 2013 (13/NW/0279).

Results

We recruited a total of 24 hospitals from 12 of the 19 UK teaching deaneries. Following randomisation by deanery, there were 13 hospitals within six intervention deaneries and 11 hospitals within six control deaneries. A mix of large tertiary and smaller district general hospitals was recruited, broadly representing national provision. We identified 489 patients with suspected encephalitis, 266 in intervention hospitals and 223 in control hospitals. The number of hospitals per deanery ranged from one to four and number of cases from one to 38 (mean 20.4). The mean patient age was lower in intervention hospitals (45 years, standard deviation [SD] of 30) compared with controls (51 [27.6] years) as was the percentage of males (45.7% and 50% respectively; Table 1) demonstrating similar characteristics across both study arms. Case ascertainment was similar across both the control and intervention arms. The CONSORT diagram summarises recruitment, participation, and analysis (Fig 1 and S1 Table).

There was marked variation between hospitals across both arms in adherence to the primary outcome (range 0% to 40%; interquartile range 4.71% to 21.74%). Across both intervention and control hospitals, overall pre-intervention adherence to the primary outcome was 8.5% (36 out of 422 patients) and post-intervention adherence was 14.1%.

Table 2 summarises crude estimates of the treatment effect for the primary and secondary outcomes without adjustment for clustering or covariate effects. Achievement of the primary outcome was 13.5% in intervention hospitals and 14.8% in controls.

thumbnail
Table 2. Crude trial primary and secondary outcomes unadjusted for clustering or covariate effects.

https://doi.org/10.1371/journal.pone.0202257.t002

Modelling indicated no significant difference between intervention and control hospitals for the primary outcome of a lumbar puncture performed within 12 hours of hospital admission and aciclovir given within 6 hours (estimated treatment effect -0.188 with standard error 0.377; p = 0.619; 95% confidence interval [CI] -0:927, 0.552). There was also no significant intervention effect for any of the seven secondary outcomes (Table 3). For the seventh secondary outcome of appropriate dosing of aciclovir administration, although across the whole sample, children were significantly less likely than adults to be prescribed correct doses of aciclovir (estimated effect -1.073 with standard error 0.412; p = 0.009; Table 4). There was no significant interaction between intervention and age group for this nor or any other secondary outcome (Table 5).

thumbnail
Table 3. Maximum likelihood estimates of intervention effect for secondary outcomes.

https://doi.org/10.1371/journal.pone.0202257.t003

thumbnail
Table 4. Estimates of fixed effects in the model for the secondary outcome, correct administration of aciclovir.

https://doi.org/10.1371/journal.pone.0202257.t004

thumbnail
Table 5. Maximum likelihood estimates of interaction effect between treatment and age group for secondary outcomes.

https://doi.org/10.1371/journal.pone.0202257.t005

Estimated variances of the random effects for deanery and hospital were 2.73x10-5 and 0.18, respectively. These were substantially smaller than we had anticipated, possibly because they had been estimated from an earlier dataset without covariates, whereas we were able to adjust for the effects of covariates in our actual analysis.

Discussion

A multifaceted implementation strategy based on identified barriers to change had no effect on the initial hospital management of patients with suspected encephalitis. Overall adherence to recommended practice remained low despite evidence of a modest overall improvement across both intervention and control sites compared with the pre-intervention period. Although most patients had a lumbar puncture at some point, less than a third had a lumbar puncture within 12 hours of admission. Furthermore, less than a third were prescribed aciclovir within six hours of admission. There are still major challenges facing any drive to improve initial care for suspected encephalitis. Our evaluation represents a clear advance on previous intervention studies targeting suspected encephalitis, improving validity by use of a randomised design and generalisability by including multiple sites across the UK [1,3,49]. Our theory-informed implementation strategy was tailored according to identified needs and barriers and based upon interventions and resources typically available to improve quality of care [30].

There were five main study limitations. First, there was a threat to internal validity of post-randomisation selection bias, whereby greater awareness of the trial amongst intervention compared with control hospitals could have influenced identification of cases of suspected encephalitis and differentially affected case mix and attainment of study outcomes. We standardised and maximised case identification by combining methods. The mean number of suspected cases identified per site, methods of identification and patient demographic factors were similar between intervention and control site. Second, retrospective data collection depended upon the quality of routine clinical recording, which was variable. There was a consistent lack of recording of patient weight upon admission across both trial arms. We therefore used estimates and assumptions to assess appropriateness of aciclovir dosage in adults and children. Third, following initial training and provision of materials, much intervention delivery was delegated to clinicians in each hospital; this is likely to have resulted in variable fidelity of intervention delivery. However, within a pragmatic trial, the implementation strategy reflected what could reasonably be achieved within limited national and local resources [46]. Fourth, our composite outcome measure may have set the bar too high, so that both performing lumbar punctures and prescribing aciclovir within limited time periods might have been too difficult to achieve within busy emergency care settings. However, we found no differences in any of the other less time-contingent secondary outcomes, suggesting that our primary outcome was not too strict. Fifth, our negative findings, as is generally the case, may yet be explained by a lack of statistical power. Basing our sample size upon an absolute increase of 15%, from 5% to 20%, in adherence to the primary outcome looks over-optimistic in hindsight. However, our estimates of effect size were within the ranges of those typically reported for other implementation trials [31], we had selected a primary endpoint with low baseline performance and hence considerable scope for improvement, and we had hoped to leverage additional effects by tailoring our intervention to identified barriers. Again, the absence of any signals suggesting an intervention benefit across any of the outcomes use indicates that a lack of statistical power is unlikely to explain our negative findings.

Our multifaceted implementation strategy was designed to address multiple barriers to the recommended management of suspected encephalitis. We provide further evidence that multifaceted strategies cannot be assumed to be more effective than single interventions although there is a lack of head-to-head comparisons and a risk of confounding by indication (i.e. investigators may select multiple interventions to address more challenging implementation problems).[50, 51] We also show that one approach to theory-guided, intervention tailoring did not work for this targeted problem and context.

One possible explanation for the lack of any intervention effect is that any modest intervention effects may have been overshadowed by wider improving trends in the management of patients with suspected encephalitis. Adherence to several outcomes, including time to lumbar puncture and time to aciclovir, in both trial arms was comparable or better than earlier studies [13,5,9,1113,1821,49]. We also observed an improvement in the primary outcome from 8.5% to 14.1% across all intervention and control hospitals over the study period; although this could partly be explained by changes we made following pre-intervention data collection to facilitate case identification. Furthermore, our implementation strategy aimed to deliver improvements over and above existing trends.

The most plausible explanation for the lack of intervention effect is that, coupled with variable fidelity of delivery, our intervention simply failed to target the key determinants of adherence to recommended practice and overcome multiple barriers and competing priorities within pressurised acute care settings. Other major and better resourced improvement initiatives targeting hospital care have also failed to translate into improved frontline patient care [52,53]. Our trial findings are a pertinent reminder of the need for rigorous, controlled evaluations of quality improvement strategies [54].

The majority of implementation studies have generally targeted the care of more prevalent, long-term conditions [30]. Although the presentation of suspected encephalitis as opposed to confirmed encephalitis is not uncommon, it is rarer compared with other emergencies, such as suspected stroke. It is likely that a more sustained or different type of approach may be necessary to embed recommended initial management into clinician cognitions and routines [51]. Nevertheless, it is still notable that there was some divergence between paediatric and adult outcomes, with non-significant trends towards timely lumbar puncture and aciclovir administration in intervention hospitals according to crude effect estimates. Our trial was insufficiently powered to detect any such sub-group effects but it may be the case that our intervention might have had greater leverage within the context of acute paediatric care, where there is a greater emphasis on the rapid detection and treatment of suspected CNS infections [5].

There is a growing evidence base on the effects of implementation strategies. For example, the relatively modest effects of audit and feedback can be enhanced by ensuring feedback is delivered in both written and verbal formats, is provided more than once, and includes both explicit targets and an action plan [55]. There are therefore opportunities to strengthen the content and delivery of implementation strategies [56], although any subsequent benefits need to be weighed up against the increased costs of more intensive strategies [57].

Conclusion

Clinicians struggle to achieve timely diagnosis and management of encephalitis in hospital emergency settings, leading to worse patient outcomes. A randomised trial of an implementation strategy tailored to identified barriers and enablers and comprising a range of interventions which could reasonably be delivered within available resources for quality improvement had no effect on patient care, though there were signals of improved management for children. The failure to show an effect in the intervention hospitals may partly be because of generally improved management over time in all hospitals. Different approaches, such as targeting by type of clinical presentation rather than by specific condition, need to be developed and evaluated to improve the care of suspected encephalitis and similar challenging clinical presentations.

Supporting information

S1 Table. CONSORT 2010 checklist of information to include when reporting a cluster randomised trial.

https://doi.org/10.1371/journal.pone.0202257.s001

(DOCX)

S1 File. Cluster RCT protocol V6.0.

Protocol approved by NHS Research Ethics Committee prior to start of trial recruitment.

https://doi.org/10.1371/journal.pone.0202257.s002

(PDF)

S2 File. Cluster RCT protocol V2.0.

Initial Protocol approved by NHS Research Ethics Committee.

https://doi.org/10.1371/journal.pone.0202257.s003

(PDF)

S3 File. The study data are available in the supporting information Files (Backman, RCT data 161018 for PONE).

https://doi.org/10.1371/journal.pone.0202257.s004

(XLSX)

Acknowledgments

We thank the hospitals and staff who took part in this trial from the following trusts: Blackpool Teaching Hospitals NHS Foundation Trust (Dr Peter Flegg, Dr Ruth Palmer, Dr Morris Gordon); Stockport NHS Foundation Trust (Dr Sarah Maxwell); University Hospitals Coventry and Warwickshire NHS Trust (Dr Magdy Sakr, Dr Prakash Satodia, Dr Brian Shields); Gateshead Health NHS Foundation Trust (Dr Vanessa Linnett); North Tees and Hartlepool Hospitals NHS Foundation Trust (Dr Beena Kurup); St Helens and Knowsley Teaching Hospitals NHS Trust (Dr Chakri Molugu, Dr Ratna Aumeer); Countess of Chester Hospital NHS Foundation Trust (Dr Ildiko Kustos, Dr Priti Rath, Dr Murthy Saladi); Sherwood Forest Hospitals NHS Foundation Trust (Dr Harry Wright, Dr Shereen Munatsi); Betsi Cadwaladr University Health Board (Dr Christian Subbe, Dr Michael Eisenhut); Luton and Dunstable Hospital NHS Foundation Trust (Dr Archana Joshi); Gloucestershire Hospitals NHS Foundation Trust (Dr David Olliffe); Doncaster and Bassetlaw Teaching Hospitals NHS Foundation Trust (Dr Nicholas Mallaband, Dr Alice Tipton); Northern Devon Healthcare NHS Trust (Dr Dermot Dalton); Bedford Hospital NHS Trust (Dr Devasena Subramanyam, Dr Thomas Larsen, Dr Nadezda Horakova); Dudley Group NHS Foundation Trust (Dr Hassan Paraiso); Cambridge University Hospitals NHS Foundation Trust (Dr Deepa Krishnakumar, Dr Manali Chitre); Portsmouth Hospitals NHS Trust (Dr Catherine Tuffrey, Dr Stephen Warriner); Brighton and Sussex University Hospitals NHS Trust (Dr Daniel Agranoff, Dr Ruth Wood, Dr Sophie Binks); Southport and Ormskirk Hospital NHS Trust (Dr Sharryn Gardner, Dr Alan Owens); West Suffolk NHS Foundation Trust (Dr Charlotte Brierley); University Hospitals of Leicester NHS Trust (Dr Martin Wiselka); Surrey and Sussex Healthcare NHS Trust (Dr Ben Mearns, Dr Nayeem Khan, Dr Martin Dachsel); Great Western Hospitals NHS Foundation Trust (Dr Tadas Zuromskis, Dr Laura Gonzales); Chesterfield Royal Hospital NHS Foundation Trust (Dr Nick Spittle, Dr Lucy Jones, Dr James Crossley). We also thank University of Liverpool which sponsored the study; The Encephalitis Society, and CS for their patient contribution to this work.

We also thank the ENCEPH UK Steering committee. ENCEPH-UK study group lead investigator Tom Solomon. ENCEPH-UK study group members: Ruth Backman (Institute of Infection and Global Health, University of Liverpool; Institute of Applied Health Research, University of Birmingham): Gus Baker (Department of Clinical Neuropsychology, The Walton Centre NHS Foundation Trust): Nicholas Beeching (Tropical Infectious Diseases Unit, Royal Liverpool University Hospital): Rachel Breen (Clinical Trials Unit, University of Liverpool): David Brown (Public Health England, London): Chris Cheyne (Institute of Translational Medicine, University of Liverpool): Enitan Carrol (Institute of Infection and Global Health, University of Liverpool; Alder Hey Hospital Children’s NHS Foundation Trust, Liverpool): Nick Davies (Department of Neurology, Chelsea and Westminster NHS Trust): Sylviane Defres (Institute of Infection and Global Health, University of Liverpool; Tropical Infectious Diseases Unit, Royal Liverpool University Hospital): Ava Easton (Institute of Infection and Global Health, University of Liverpool; The Encephalitis Society, Malton): Martin Eccles (Institute of Health and Society, Newcastle University): Robbie Foy (Leeds Institute of Health Sciences, Leeds University): Marta Garcia-Finana (Institute of Translational Medicine, University of Liverpool): Julia Granerod (Public Health England, London): Julia Griem (Institute of Psychiatry, Kings College London): Michael Griffiths (Institute of Infection and Global Health, University of Liverpool; Alder Hey Hospital Children’s NHS Foundation Trust, Liverpool): Alison Gummery (Institute of Infection and Global Health, University of Liverpool): Lara Harris (Institute of Psychiatry, Kings College London): Helen Hickey (Clinical Trials Unit, University of Liverpool): Helen Hill (Clinical Trials Unit, University of Liverpool): Ann Jacoby (Department of Clinical Neuropsychology, The Walton Centre NHS Foundation Trust): Hayley Hardwick (Institute of Infection and Global Health, University of Liverpool): Ciara Kierans (Institute of Psychology Health and Society, University of Liverpool): Michael Kopelman (Institute of Psychiatry, Kings College London): Jessie Cooper (Institute of Psychology Health and Society, University of Liverpool): Rachel Kneen (Institute of Infection and Global Health, University of Liverpool; Alder Hey Hospital Children’s NHS Foundation Trust, Liverpool): Gill Lancaster (Mathematics and Statistics, Lancaster University): Michael Levin (Paediatrics and International Child Health, Imperial College London): Rebecca McDonald (Research and Development Department, The Walton Centre NHS Foundation Trust): Antonieta Medina-Lara (Health Economics Group, University of Exeter Medical School): Esse Menson (Infectious Diseases and Immunology team, Evelina London Children’s Hospital): Benedict Michael (Institute of Infection and Global Health, University of Liverpool): Natalie Martin (Oxford Vaccine Group, University of Oxford): Manish Sadarangani (Oxford Vaccine Group, University of Oxford): Andrew Pennington (Research and Development Department, The Walton Centre NHS Foundation Trust): Andrew Pollard (Oxford Vaccine Group, University of Oxford): Julie Riley (Research and Development Department, The Walton Centre NHS Foundation Trust): Anne Christine Salter (Patient Representative, Encephalitis Society):Maria Thornton (Research and Development Department, The Walton Centre NHS Foundation Trust): Angela Vincent (Nuffield Department of Neurosciences, University of Oxford): Charles Warlow (Department of Neurosciences, Western General Hospital).

References

  1. 1. Michael BD, Sidhu M, Stoeter D, Roberts M, Beeching NJ, Bonington A, et al. Acute central nervous system infections in adults—a retrospective cohort study in the NHS North West region. QJM. 2010;103: 749–58. pmid:20657024
  2. 2. Bell DJ, Suckling R, Rothburn MM, Blanchard T, Stoeter D, Michael B, et al. Management of suspected herpes simplex virus encephalitis in adults in a UK teaching hospital. Clin Med (Northfield Il). Royal College of Physicians; 2009;9: 231–235.
  3. 3. Kelly C, Sohal A, Michael BD, Riordan A, Solomon T, Kneen R. Suboptimal management of central nervous system infections in children: a multi-centre retrospective study. BMC Pediatr. BioMed Central Ltd; 2012;12: 145. pmid:22958329
  4. 4. Rao S, Elkon B, Flett KB, Moss AFD, Bernard TJ, Stroud B, et al. Long-Term Outcomes and Risk Factors Associated With Acute Encephalitis in Children. J Pediatric Infect Dis Soc. Oxford University Press; 2015; piv075. pmid:26553786
  5. 5. Kneen R, Jakka S, Mithyantha R, Riordan A, Solomon T. The management of infants and children treated with aciclovir for suspected viral encephalitis. Arch Dis Child. 2010;95: 100–6. pmid:19457882
  6. 6. Granerod J, Cousens S, Davies NWS, Crowcroft NS, Thomas SL. New estimates of incidence of encephalitis in England. Emerg Infect Dis. 2013;19. pmid:23969035
  7. 7. Michael BD, Solomon T. Seizures and encephalitis: clinical features, management, and potential pathophysiologic mechanisms. Epilepsia. 2012;53 Suppl 4: 63–71. pmid:22946723
  8. 8. Solomon T, Michael BD, Smith PE, Sanderson F, Davies NWS, Hart IJ, et al. Management of suspected viral encephalitis in adults—Association of British Neurologists and British Infection Association National Guidelines. J Infect. 2012;64: 347–73. pmid:22120595
  9. 9. Granerod J, Ambrose HE, Davies NW, Clewley JP, Walsh AL, Morgan D, et al. Causes of encephalitis and differences in their clinical presentations in England: a multicentre, population-based prospective study. Lancet Infect Dis. 2010;10: 835–44. pmid:20952256
  10. 10. Dalmau J, Lancaster E, Martinez-Hernandez E, Rosenfeld MR, Balice-Gordon R. Clinical experience and laboratory investigations in patients with anti-NMDAR encephalitis. Lancet Neurol. NIH Public Access; 2011;10: 63–74. pmid:21163445
  11. 11. Hughes PS, Jackson AC. Delays in initiation of acyclovir therapy in herpes simplex encephalitis. Can J Neurol Sci. 2012;39: 644–8. Available: http://www.ncbi.nlm.nih.gov/pubmed/22931707 pmid:22931707
  12. 12. Raschilas F, Wolff M, Delatour F, Chaffaut C, De Broucker T, Chevret S, et al. Outcome of and prognostic factors for herpes simplex encephalitis in adult patients: results of a multicenter study. Clin Infect Dis. 2002;35: 254–60. pmid:12115090
  13. 13. Singh T, Fugate J, Hocker S, Wijdicks E, Aksamit A, Rabinstein A. Predictors of outcome in HSV encephalitis [Internet]. [cited 25 Nov 2015]. Available: http://download.springer.com/static/pdf/751/art%253A10.1007%252Fs00415-015-7960-8.pdf?originUrl=http%3A%2F%2Flink.springer.com%2Farticle%2F10.1007%2Fs00415-015-7960-8&token2=exp=1448471157~acl=%2Fstatic%2Fpdf%2F751%2Fart%25253A10.1007%25252Fs00415-015-796
  14. 14. McGrath N, Anderson NE, Croxson MC, Powell KF. Herpes simplex encephalitis treated with acyclovir: diagnosis and long term outcome. J Neurol Neurosurg Psychiatry. 1997;63: 321–326. pmid:9328248
  15. 15. Mailles A, De Broucker T, Costanzo P, Martinez-Almoyna L, Vaillant V, Stahl J-P. Long-term outcome of patients presenting with acute infectious encephalitis of various causes in France. Clin Infect Dis. 2012;54: 1455–64. pmid:22460967
  16. 16. Easton A. Life After Encephalitis: A Narrative Approach. Routledge; 2016.
  17. 17. Solomon T, Hart IJ, Beeching NJ. Viral encephalitis: a clinician’s guide. Pract Neurol. 2007;7: 288–305. pmid:17885268
  18. 18. Sili U, Kaya A, Mert A. Herpes simplex virus encephalitis: clinical manifestations, diagnosis and outcome in 106 adult patients. J Clin Virol. 2014;60: 112–8. pmid:24768322
  19. 19. Poissy J, Wolff M, Dewilde A, Rozenberg F, Raschilas F, Blas M, et al. Factors associated with delay to acyclovir administration in 184 patients with herpes simplex virus encephalitis. Clin Microbiol Infect. 2009;15: 560–4. pmid:19392906
  20. 20. Kneen R, Solomon T, Appleton R. The role of lumbar puncture in children with suspected central nervous system infection. BMC Pediatr. BioMed Central Ltd; 2002;2: 8. pmid:12350236
  21. 21. Hasbun R, Abrahams J, Jekel J, Quagliarello V. Computed Tomography of the Head before Lumbar Puncture in Adults with Suspected Meningitis—NEJM [Internet]. [cited 25 Nov 2015]. Available: http://www.nejm.org/doi/full/10.1056/NEJMoa010399
  22. 22. Heyderman RS, Lambert HP, O’Sullivan I, Stuart JM, Taylor BL, Wall RA. Early Management of Suspected Bacterial Meningitis and Meningococcal Septicaemia in Adults. J Infect. 2003;46: 75–77. pmid:12634067
  23. 23. Kneen R. The role of lumbar puncture in suspected CNS infection—a disappearing skill? Arch Dis Child. 2002;87: 181–183. pmid:12193421
  24. 24. Defres S, Mayer J, Backman R, Kneen R. Performing lumbar punctures for suspected CNS infections: experience and practice of trainee doctors. Br J Hosp Med (Lond). MA Healthcare London; 2015;76: 658–62. pmid:26551497
  25. 25. Kneen R, Michael BD, Menson E, Mehta B, Easton A, Hemingway C, et al. Management of suspected viral encephalitis in children—Association of British Neurologists and British Paediatric Allergy, Immunology and Infection Group national guidelines. J Infect. 2012;64: 449–77. pmid:22120594
  26. 26. Thomas RH, Smith PE. Encephalitis guidelines: a recipe for success? Clin Med (Northfield Il). Royal College of Physicians; 2009;9: 210–211.
  27. 27. Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud P-AC, et al. Why Don’t Physicians Follow Clinical Practice Guidelines? JAMA. American Medical Association; 1999;282: 1458. pmid:10535437
  28. 28. Gagliardi AR, Brouwers MC, Palda VA, Lemieux-Charles L, Grimshaw JM. How can we improve guideline use? A conceptual framework of implementability. Implement Sci. BioMed Central Ltd; 2011;6: 26. pmid:21426574
  29. 29. Grimshaw JM, Eccles MP, Lavis JN, Hill SJ, Squires JE. Knowledge translation of research findings. In: Implementation science : IS [Internet]. BioMed Central Ltd; 31 Jan 2012 [cited 16 Sep 2015] p. 50. https://doi.org/10.1186/1748-5908-7-50 pmid:22651257
  30. 30. Backman R, Foy R, Michael BD, Defres S, Kneen R, Solomon T. The development of an intervention to promote adherence to national guidelines for suspected viral encephalitis. Implement Sci. 2015;10: 37. pmid:25889994
  31. 31. Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, et al. Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. Root User; 2004;8: iii–iv, 1–72.
  32. 32. MedicalResearchCouncil, Craig P, Dieppe P, Macintyre S, Michie S, Nazzareth I, et al. Developing and evaluating complex intervention: new guidance [Internet]. [cited 25 Nov 2015]. Available: https://www.mrc.ac.uk/documents/pdf/complex-interventions-guidance/
  33. 33. Hawe P, Shiell A, Riley T. Complex interventions: how “out of control” can a randomised controlled trial be? BMJ. 2004;328: 1561–3. pmid:15217878
  34. 34. Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46: 81–95. pmid:23512568
  35. 35. Backman R, Foy R, Diggle PJ, Kneen R, Defres S, Michael BD, et al. The evaluation of a tailored intervention to improve the management of suspected viral encephalitis: protocol for a cluster randomised controlled trial. Implement Sci. BioMed Central Ltd; 2015;10: 14. pmid:25623603
  36. 36. Michie S, Johnston M, Francis J, Hardeman W, Eccles M. From Theory to Intervention: Mapping Theoretically Derived Behavioural Determinants to Behaviour Change Techniques. Appl Psychol. 2008;57: 660–680.
  37. 37. Cane J, O’Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. BioMed Central Ltd; 2012;7: 37. pmid:22530986
  38. 38. Tavender EJ, Bosch M, Gruen RL, Green SE, Knott J, Francis JJ, et al. Understanding practice: the factors that influence management of mild traumatic brain injury in the emergency department—a qualitative study using the Theoretical Domains Framework. Implement Sci. BioMed Central Ltd; 2014;9: 8. pmid:24418161
  39. 39. Curran JA, Brehaut J, Patey AM, Osmond M, Stiell I, Grimshaw JM. Understanding the Canadian adult CT head rule trial: use of the theoretical domains framework for process evaluation. Implement Sci. BioMed Central Ltd; 2013;8: 25. pmid:23433082
  40. 40. Islam R, Tinmouth AT, Francis JJ, Brehaut JC, Born J, Stockton C, et al. A cross-country comparison of intensive care physicians’ beliefs about their transfusion behaviour: a qualitative study using the Theoretical Domains Framework. Implement Sci. BioMed Central Ltd; 2012;7: 93. pmid:22999460
  41. 41. Duncan EM, Francis JJ, Johnston M, Davey P, Maxwell S, McKay GA, et al. Learning curves, taking instructions, and patient safety: using a theoretical domains framework in an interview study to investigate prescribing errors among trainee doctors. Implement Sci. BioMed Central Ltd; 2012;7: 86. pmid:22967756
  42. 42. Bussières AE, Patey AM, Francis JJ, Sales AE, Grimshaw JM, Brouwers M, et al. Identifying factors likely to influence compliance with diagnostic imaging guideline recommendations for spine disorders among chiropractors in North America: a focus group study using the Theoretical Domains Framework. Implement Sci. BioMed Central Ltd; 2012;7: 82. pmid:22938135
  43. 43. Boscart VM, Fernie GR, Lee JH, Jaglal SB. Using psychological theory to inform methods to optimize the implementation of a hand hygiene intervention. Implement Sci. BioMed Central Ltd; 2012;7: 77. pmid:22929925
  44. 44. Patey AM, Islam R, Francis JJ, Bryson GL, Grimshaw JM. Anesthesiologists’ and surgeons’ perceptions about routine pre-operative testing in low-risk patients: application of the Theoretical Domains Framework (TDF) to identify factors that influence physicians’ decisions to order pre-operative tests. Implement Sci. BioMed Central Ltd; 2012;7: 52. pmid:22682612
  45. 45. Francis JJ, O’Connor D, Curran J. Theories of behaviour change synthesised into a set of theoretical groupings: introducing a thematic series on the theoretical domains framework. Implement Sci. BioMed Central Ltd; 2012;7: 35. pmid:22531601
  46. 46. Loudon K, Treweek S, Sullivan F, Donnan P, Thorpe KE, Zwarenstein M. The PRECIS-2 tool: designing trials that are fit for purpose. BMJ. 2015;350: h2147. pmid:25956159
  47. 47. R Core Team. R: A Language and Environment for Statistical Computing [Internet]. Vienna; 2013. Available: https://www.r-project.org
  48. 48. Early years—UK-WHO growth charts and resources | RCPCH [Internet]. [cited 27 Nov 2015]. Available: http://www.rcpch.ac.uk/child-health/research-projects/uk-who-growth-charts/uk-who-growth-chart-resources-0-4-years/uk-who-0
  49. 49. Michael BD, Powell G, Curtis S, Bailey L, Almond S, McGill F, et al. Improving the diagnosis of central nervous system infections in adults through introduction of a simple lumbar puncture pack. Emerg Med J. 2013;30: 402–5. pmid:22707473
  50. 50. Squires JE, Sullivan K, Eccles MP, Worswick J, Grimshaw JM. Are multifaceted interventions more effective than single-component interventions in changing health-care professionals’ behaviours? An overview of systematic reviews. Implement Sci. BioMed Central; 2014;9: 152. pmid:25287951
  51. 51. Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, et al. Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. Cochrane database Syst Rev. 2010; CD005470. pmid:20238340
  52. 52. Barker AL, Morello RT, Wolfe R, Brand CA, Haines TP, Hill KD, et al. 6-PACK programme to decrease fall injuries in acute hospitals: cluster randomised controlled trial. BMJ. 2016;352. Available: http://www.bmj.com/content/352/bmj.h6781.long
  53. 53. Benning A, Ghaleb M, Suokas A, Dixon-Woods M, Dawson J, Barber N, et al. Large scale organisational intervention to improve patient safety in four UK hospitals: mixed method evaluation. BMJ. 2011;342. Available: http://www.bmj.com/content/342/bmj.d195.long
  54. 54. Auerbach AD, Landefeld CS, Shojania KG. The Tension between Needing to Improve Care and Knowing How to Do It. N Engl J Med. Massachusetts Medical Society; 2007;357: 608–613. pmid:17687138
  55. 55. Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane database Syst Rev. 2012;6: CD000259. pmid:22696318
  56. 56. Brehaut JC, Colquhoun HL, Eva KW, Carroll K, Sales A, Michie S, et al. Practice Feedback Interventions: 15 Suggestions for Optimizing Effectiveness. Ann Intern Med. American College of Physicians; 2016;164: 435–441. pmid:26903136
  57. 57. Mason J. When Is It Cost-effective to Change the Behavior of Health Professionals? JAMA. American Medical Association; 2001;286: 2988. pmid:11743840