Skip to main content

A multi-centre, pragmatic, three-arm, individually randomised, non-inferiority, open trial to compare immediate orally administered, immediate topically administered or delayed orally administered antibiotics for acute otitis media with discharge in children: The Runny Ear Study (REST): study protocol

Abstract

Background

Acute otitis media (AOM) is a common painful infection in children, with around 2.8 million cases presenting to primary care in England and Wales annually. Nearly all children who present to their general practitioner (GP) with AOM or AOM with discharge (AOMd) are treated with orally administered antibiotics. These can cause side effects; contribute to the growing problem of antimicrobial resistance, and more rarely, allergic reactions. Alternative treatments, such as an antibiotic eardrops, or ‘delayed’ orally administered antibiotics, could be at least as effective and safe as immediate orally administered antibiotics for children with AOMd.

Methods/design

REST is a pragmatic, three-arm, individually randomised, non-inferiority trial being conducted in 175 GP practices across the United Kingdom (UK). The study aims to recruit 399 children aged (≥ 12 months and < 16 years) presenting to their GP with AOMd. Children will be randomised to one of three arms: immediate ciprofloxacin 0.3% eardrops; delayed orally administered amoxicillin (clarithromycin if penicillin allergic) or immediate orally administered amoxicillin (clarithromycin).

Recruitment, including eligibility screening, randomisation and data collection, are conducted using the innovative, TRANSFoRm electronic trial management platform. Integrated within the primary care electronic medical records it provides automatic eligibility checking, part-filling of e-CRFs, study workflow management and routine NHS follow-up data collection. The primary outcome is time to resolution of all significant symptoms and will be collected by the parent using a Symptom Recovery Questionnaire (SRQ). Secondary outcomes, including cost-effectiveness, duration of moderately bad or worse symptoms and repeat AOMd episodes, will be collected at day-14 and at 3 months.

Discussion

It is unclear whether prescribing orally administered antibiotics to children with AOMd results in a reduction in symptoms or a shorter duration of illness. The REST trial should allow us to compare the non-inferiority of: immediate topically administered ciprofloxacin ear drops, or delayed orally administered amoxicillin (clarithromycin) against immediate orally administered amoxicillin (clarithromycin). We aim to recruit 399 patients from 175 practices in the UK. Using the TRANSFoRm software to randomise participants to the trial will enable recruitment for a relatively uncommon condition.

Trial registration

Name of Registry: ISCRTN

Registration Number: ISRCTN12873692. This contains all items required to comply with the World Health Organization Trial Registration Data Set

Date of Registration: 24 April 2018

Name of Registry: EudraCT

Registration Number: 2017-003635-10

Date of Registration: 6 September 2017

Peer Review reports

Background and rationale

Acute otitis media (AOM) is important to children, parents and the National Health Service (NHS). Firstly, the infection causes pain and distress to the child, disrupting sleep and family routines. In around 15% of cases, a rise in middle-ear pressure and/or inflammation weakening the tympanic membrane results in it bursting, discharging pus from the middle ear as a discharge (otorrhoea) [1]. Children with AOM and discharge (AOMd) have similar levels of pain and are more unwell at presentation than children with AOM [2, 3]. Moreover, children with AOMd have a worse prognosis, and higher rates of pain at 1 week, as reported by parents (carers), repeat AOM episodes and hearing problems at 3 months [2]. Estimates of parental costs (travel, over the counter (OTC) medicines and lost earnings) vary [4,5,6], with even the lowest suggesting £4 million in England and Wales per annum.

Over 90% of UK parents attend primary care health services for each episode of AOMd [7], with over 150,000 general practitioner (GP) consultations for AOMd in England and Wales per annum at a cost to the NHS of over £3 million [4, 5], which is more than for any other common symptom of acute infection.

More children with AOM and AOMd receive an orally administered antibiotic in the UK [8] and the United States [9] than for any other respiratory infection, with three quarters of GPs prescribing orally administered antibiotics to at least 80% of children diagnosed as such [10, 11]. Our 2015 audit, including 33 GP practices and 56,251 children, confirmed that immediate orally administered antibiotics is usual care for AOMd: 88% were given orally administered antibiotics of which 97% were given immediately.

There is strong evidence that children with AOMd benefit from immediate orally administered antibiotics. The number needed to treat with antibiotics is three to reduce the proportion of children with pain and/or fever at 3–7 days compared with placebo/no treatment [3]. The National Institute for Health and Care Excellence (NICE), therefore, recommends that immediate antibiotics should be considered [12]. Orally administered antibiotics do, however, also cause side effects, are associated with subsequent eczema and hay fever [13] and with population [14] and patient-level [15] antimicrobial resistance.

In response to the UK’s Antimicrobial Resistance Action Plan calls for research to preserve antibiotic effects [16] we have designed a trial of topically administered antibiotics in children with AOMd, aiming to reduce the use of systemic antibiotics. Perforation of the tympanic membrane provides a portal of entry into the middle ear for antibiotic drops instilled in the ear canal. In children with ventilation tubes (‘grommets’), it has been shown that topically administered antibiotics can reach the infected middle ear despite purulent discharge [17], and that compared with orally administered antibiotics, they are more effective in reducing the duration of otorrhoea, recurrence of AOM and have fewer side effects [17]. This study also showed that topically administered antibiotics are cost-effective [18]. However, further research is needed in children with AOMd without grommets, since the opening to the middle ear may be smaller and the tympanic membrane heals quickly, which could prevent the drops from reaching the middle ear. If topically administered and delayed antibiotics are shown to be non-inferior, we also need to understand the acceptability of such treatment to clinicians and parents and how to address any barriers to implementation.

We will address this evidence gap by assessing the clinical effectiveness and economic implications of immediate topically vs. delayed orally administered antibiotics and testing the hypotheses: (1) immediate antibiotics are better than placebo/no treatment for AOMd symptoms [3] and (2) delayed orally administered antibiotics are similar to immediate orally administered antibiotics in children with AOM (though with reduced antibiotic consumption) [1].

The REST study is a three-arm, randomised controlled trial (RCT) investigating the clinical effectiveness and economic implications of topically administered or delayed antibiotics compared with immediate orally administered antibiotics, powered for the duration and severity of the symptoms most important to parents, while also investigating adverse events, complications and AOM/AOMd recurrence. By testing two interventions that could reduce systemic antibiotic exposure (immediate topically administered and delayed orally administered antibiotics), this study is at the forefront of research to improve antimicrobial stewardship in AOMd.

Methods/design

Aims and objectives

The key aim of this research is to investigate the clinical effectiveness and economic impact of immediate topically or delayed orally administered antibiotics compared with immediate orally administered antibiotics for symptom duration in children presenting to primary care with AOM with discharge (AOMd).

Secondary objectives are to:

  • Estimate the short-term cost-implications of immediate topically or delayed orally administered antibiotics compared with immediate orally administered antibiotics from the perspective of the NHS

  • Compare the effects on duration of ‘moderately bad or worse’ symptoms; parent/legal guardian satisfaction with treatment; and adverse events

  • Compare hearing loss and rate of recurrence of AOM/AOMd at 3 months

  • Understand parent/legal guardian and clinician views of participating in a trial about AOMd, adherence and satisfaction with allocated treatment.

  • Evaluate the impact of treatment on carriage of antibiotic resistance in the gut

Trial design

This is a multi-site, pragmatic, three-arm, individually randomised (stratified by age < 2 vs. ≥ 2 years), non-inferiority, open trial. We compare (1) immediate topically administered ciprofloxacin 0.3% drops with (2) delayed orally administered antibiotics or (3) immediate orally administered antibiotic in children aged 12 months to 16 years with unilateral AOMd as the presenting symptom of recent-onset (≤ 7 days) AOM. The primary endpoint is collected by questionnaire at day 14 post recruitment. Secondary outcomes are collected both at 14 days and at 3 months by questionnaire.

This study is classified as a Type A study (low risk) by the Medicines and Healthcare Regulatory Agency (MHRA), with regulatory approval obtained on 4 May 2018.

The trial design includes an internal pilot recruitment phase of 6 months’ duration, primarily to verify that recruitment was possible before progression to the main phase of the trial.

The REST study utilises an integrated electronic trial management platform, TRANSFoRm, that was initially developed as part of the EU FP7 TRANSFoRm project (2009–2015) and evaluated in a 60-site clinical trial in Poland [19]. The system integrates as a plug-in within the host Electronic Health Record (EHR) system through the provider’s Application Programmer’s Interface (API). The key features of the system include:

  • Automated eligibility checking; the TRANSFoRm plug-in allows the EHR opened during a consultation to be automatically checked against the REST eligibility criteria

  • Consent – the TRANSFoRm platform allows the clinician to print the study consent form for the participant to sign a record of consent that can then be entered onto the platform initiating the trial’s workflow

  • An integrated randomisation system for immediate randomisation of participants during consultation

  • Trial-specific Electronic Case Report Forms (eCRFs) that are presented to clinicians at the appropriate appointments to complete. Some trial data is automatically retrieved from the SystmOne health record and used to part-fill the trial eCRF, which can be amended by the user

Upon submission of the eCRF the TRANSFoRm platform automatically records a record of trial activity in the participant’s health record. The study flow diagram is provided in Fig. 1 and the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) Checklist in Additional file 1.

Fig. 1
figure 1

Trial flow chart

Setting

We aim to recruit 175 SystmOne GP practices from all 15 UK CRN’s. The Clinical Research Network (CRN) invite research active SystmOne GP practices to express an interest in taking part in the study.

GP practice set-up

Interested practices are sent a local document pack by the study team and practices are asked to return a set of documents including a CV, Good Clinical Practice (GCP) certificates and a signed site contract. Sites undergo remote training in trial conduct and the use of the TRANSFoRm electronic platform.

A site is only greenlighted once all local documents have been completed and the principal investigator (PI) has completed the online training. At this point the TRANSFoRm electronic platform is installed onto the PI’s computer. Once a site is greenlighted, additional clinicians from that practice can complete the REST training package, be added to the site delegation log and the TRANSFoRm platform can be downloaded onto additional practice computers.

Participants and eligibility

Eligible participants are children aged ≥ 12 months to < 16 years whose parents/legal guardians are seeking primary medical care for acute-onset unilateral otorrhoea as the presenting symptom of recent-onset (≤ 7 days) AOM. Detailed inclusion and exclusion criteria are detailed in Table 1.

Table 1 Inclusion and exclusion criteria

Patient screening and recruitment

The process of patient screening and recruitment is detailed below:

  1. 1.

    Children aged ≥ 12 months to < 16 years accompanied by a parent/legal guardian present to their GP with suspected AOMd

  2. 2.

    GP invites parent and child to participate in the REST study and provides a parent information leaflet (child information leaflet for children over 6 years old)

  3. 3.

    GP seeks verbal agreement from parents and assesses the child for eligibility using the TRANSFoRm electronic platform

  4. 4.

    Informed consent/assent is sought from parents of eligible children, baseline data and contact details are collected via the TRANSFoRm platform

  5. 5.

    Child is randomised using the TRANSFoRm platform and, if allocated, the drops or immediate antibiotics on an FP10 prescription (Standard UK prescription) are issued.

Randomisation

After confirming eligibility and obtaining informed consent, participants will be randomised (stratified by age) to either (1) immediate topically administered ciprofloxacin 0.3% drops with (2) delayed orally administered antibiotics or (3) immediate orally administered antibiotics.

The randomisation sequence is generated by the Bristol Randomised Trials Collaboration (BRTC) and supplied to the TRANSFoRm electronic platform to be allocated to each successive participant recruited. A system for checking the correct randomisation allocation is built in to the TRANSFoRm platform. Clinicians will not be able to determine treatment allocation pre-randomisation.

Consent

Parent Information Sheets (Additional file 2) will be given to the parents of potentially eligible children and discussed before consent is sought. Informed consent will be obtained from the parent or legal guardian of each child. Assent will be obtained from all children over the age of 6 years. Parents will also be given be the opportunity to consent to stool-sample collections (with the additional option of the sample being retained for future research in microbial infections), declining to consent to this element of the study will not exclude participation from other elements of the study. Parents will also be given the opportunity to consent to information being collected about their child being used to support other research in the future, and to this being shared anonymously with other researchers.

Withdrawal

Participants remain in the trial unless they choose to withdraw, or if they are unable to continue. Parents can choose to completely withdraw their child or to withdraw from specific elements of the study without giving a reason. Any data collected up until this point will be retained for analysis. Information regarding the withdrawal criteria is detailed in the parent information leaflet.

Interventions

Choice of comparator

We selected ciprofloxacin 0.3% drops as our topically administered antibiotic because it:

  • Is active against all common otopathogens [2]

  • Is non-ototoxic

  • Is widely and routinely available in the UK

  • Is colourless so will not interfere with assessing otorrhoea

  • Will provide complementary evidence to the ZonMw-funded trial, which is using an antibiotic-steroid combination

We decided to avoid aminoglycoside drops because of concerns about potential ototoxicity. We have proposed delayed orally administered antibiotics as the second intervention since our previous trials [1, 20, 21] have achieved significant reductions in orally administered antibiotic consumption compared with immediate antibiotic prescribing (and similar symptom relief). Immediate orally administered amoxicillin (clarithromycin if allergic to penicillin) is the comparator as it reflects usual care and is well-tolerated.

Intervention description

Arm 1: (control) current usual care – orally administered amoxicillin suspension three times daily for 7 days (or orally administered clarithromycin twice daily for 7 days if allergic to penicillin).

Arm 2: (intervention) antibiotic drops, to be instilled three times daily into the discharging ear. Parents will be given written advice regarding how to administer the drops. This will include: (1) cleaning the outer ear of discharge that can be easily removed with a tissue; (2) tilting the child’s head to one side (to approximately 90°) when applying the eardrops; and (3) maintaining the tilt for a few minutes to improve penetration of the drops.

Arm 3:(intervention) a ‘delayed’ prescription for orally administered amoxicillin suspension antibiotics three times daily for 7 days (or orally administered clarithromycin twice daily for 7 days if allergic to penicillin). Parents will be given written advice to delay the prescription will consist of: (1) advising that the prescription is only ‘dispensed’ at a pharmacy if symptoms worsen or are not starting to improve by 4 days; and (2) safety-netting advice regarding the symptoms that should prompt review consultation (increasing pain, high temperatures, headaches, irritability or reduced feeding).

All groups will also receive standard advice to complete the antibiotic course and how to manage pain, fever and other symptoms (e.g. use of paracetamol/ibuprofen).

Post-trial care

Following participation in the study, children are returned to usual care by their GP. All participants will receive a summary of the results of the trial.

Outcome measures

The primary outcome measure is time to resolution of the following symptoms: pain, fever, being unwell, sleep disturbance, otorrhoea and episodes of distress. The primary outcome is the time until all symptoms are rated by parents as ‘no’ or ‘very slight’ problem. This will be recorded by parents in the Symptom Recovery Questionnaire (SRQ).

Secondary outcome measures:

  • Duration of ‘moderately bad or worse’ symptoms (pain, fever, being unwell, sleep disturbance, otorrhoea; episodes of distress/crying

  • Appetite and interference with normal activities up to 14 days

  • Antibiotic and analgesic use

  • Adverse events – diarrhoea, rash, vomiting, serious complications

  • Treatment adherence

  • Parent/legal guardian satisfaction with treatment

  • NHS resource use at 14 days

  • Repeat AOM and AOMd episodes, serious complications and the OM6 hearing questionnaire at 3 months;

  • Qualitative evaluation of recruitment, medication satisfaction, adherence and follow-up

  • Analysis of stool sample to assess burden of resistance

Assessment and follow-up

The components and timing of follow-up measures are shown in Fig. 2.

Fig. 2
figure 2

Participant recruitment and follow-up timeline. *Completed daily from day 1 to day 14

Clinician-recorded outcomes: baseline data collection form and contact form

During the consultation, clinicians will complete a baseline data collection form and contact detail form for all eligible participants. The baseline data collected includes acute clinical data and any relevant medical history relating to AOMd incidence.

A contact details form will record information from the parent/legal guardian including name, address, telephone number and availability to take calls from the research nurse.

Patient-reported outcomes

All parents/legal guardians are asked to complete a daily SRQ recording the symptoms identified by parents/legal guardians as important. The SRQ will be provided in electronic format via the TRANSFoRm app or in a paper version. The SRQ will provide a daily record of symptom burden and will be completed up to 14 days. The primary outcome will be collected using the SRQ with research nurse telephone calls on days 1, 3, 7, 10 and 14.

On day-7 and day-14 telephone calls, information on the use of healthcare resources including information about primary care contacts, use of 111, walk-in centres and hospital services will be obtained.

At month 3, use of hospital services will be collected by review of the patients’ EHR.

The final questionnaire will be sent 3 months after randomisation either electronically (web or iOS/Android app) via the TRANSFoRm platform or paper questionnaire. The questionnaire will ask about parent/legal guardian-reported hearing loss at 3 months as measured using the OM6 [22] questionnaire.

Storage and analysis of microbiological clinical samples

Plans for the collection, storage and evaluation of biological specimens can be found in Additional file 3.

Economic data collection

The economic evaluation will explore the relationship between cost and outcomes for the three proposed methods of treating AOMd. This will be done for the short term (14 days) to assess the cost-effectiveness of immediate topically or delayed orally administered antibiotics compared with immediate orally administered antibiotics, and the longer term (3 months) in order to capture the effects of any recurrence of symptoms and lasting side effects. The perspectives will be from the NHS, parents/carers, and lost productivity due to time off work and school.

During the trial, participants will complete a symptom diary which will record any use of healthcare resources not available from the GP notes (for example, community care and the use of 111 and walk-in centres) and non-healthcare costs incurred by parents/carers during the first 14 days such as travel costs, purchase of over-the-counter medications, childcare and loss of earnings due to time off work. We will also ask about time off nursery/school.

Qualitative data collection

The qualitative evaluation will explore the views and experiences of the trial processes, the acceptability of the different treatment options, and the barriers and facilitators to their use within, and future uptake outside the trial.

Purposive sampling [23] will select participants in order to capture maximum variation in views and experiences of a range of parents and primary care professionals. From parents who agree to trial participation and the interview, a purposive sample will be drawn in relation to site, arm of the trial, and socio-demographic variables such as socio-economic status. Parents who decline trial participation will also be invited to be interviewed. Primary care professionals involved in trial processes will also be purposively sampled in relation to site. Sample sizes will be determined by data saturation [23], such that no new themes are emerging from the data by the end of data collection. We anticipate including up to 20 clinicians, 20 participant parent interviews and 15 parent decliner/withdrawal telephone interviews.

In-depth interviews will be conducted with participating parents (from all arms of the trial) 14 days after randomisation [24]. Interviews with parents who declined to participate will be conducted within 7 of declining. These will be conducted by telephone at a time of the participant’s choosing. Interviews with primary care professionals will be conducted after 3–6 months of involvement in the trial to try to capture those with experience of recruitment. A flexible topic guide will be devised to ensure that the primary issues are covered across all interviews, but it will incorporate considerable flexibility to enable participants to introduce unanticipated issues, and they will be modified to reflect findings as they emerge. The researcher will use open-ended questioning techniques to elicit participants’ experiences and views of key events and participants will be asked to provide examples. Primary care professional’s interviews are expected to last around 30–45 min, parent interviews 30–40 min and those with parents who decline trial participation 10–20 min. Interviews will be recorded using a digital voice recorder, transcribed and anonymised to protect confidentiality.

Trial oversight

The study is overseen by a Trial Management Group that meet on a monthly basis and consist of the chief investigator (CI), grant holders, study sponsor and any other staff responsible for the delivery of the trial. The Trial Steering Committee (TSC) provides independent supervision of the trial and oversees trial progress. The TSC consists of an independent chair and three other independent members including a clinical trialist a statistician, a Patient and Public Involvement (PPI) representative and the CI. The Data Monitoring Committee (DMC) monitors patient safety and trial data efficacy and consists of an independent chair, three other independent members and the CI.

All serious adverse events (SAE’S) are recorded and notified as appropriate to the relevant authorities.

PPI

A comprehensive programme of PPI engagement was conducted during the set-up stage to inform the development of the symptom-diary data collection, of the parent- and child-facing trial documentation. PPI contributors attend both the Trial Management Group (TMG) and Trial Steering Committee (TSC) meetings, providing ongoing guidance. PPI members will help identify non-academic dissemination avenues, and will advise on materials for press releases, print media, social media and parent-facing materials, including presentation of results using a parent/child-friendly animation.

Data management and confidentiality

Study data is collected and stored using the TRANSFoRm [19] GCP-validated clinical trial platform that is integrated into the GP’s EHR system. Once a patient presents to the GP with one of the specified otitis media disease codes, eligibility screening is run in the background on their EHR. Should the patient be found suitable for inclusion in the study, the GP is asked to consent the patient/legal guardian. No data is captured in TRANSFoRm until the parent/legal guardian has consented to theirs and their child’s participation. The data is captured through electronic Case Report Forms (eCRFs) completed through the EHR system, and the Patient Reported Outcome Measures (PROMs) completed at set time points by the patient through a web portal on their mobile devices, tablets or desktop computers at home. The data is transmitted using a secure connection and stored inside an encrypted database hosted at King’s College London. A subset of participant information is additionally stored in the REDCap database hosted at the University of Bristol, added by a member of the REST study team.

Both the TRANSFoRm electronic platform and REDCap incorporate data entry and validation rules to reduce data-entry errors and double data entry. Trial staff will ensure that participant anonymity is maintained through protective and secure handling and storage of patient information at the trial centre’s. Data will be anonymised as soon as it is practical to do so in line with the Data Protection Act 1998. Participants’ data is securely held on the databases in line with data protection legislation.

To comply with the Fifth Principle of the Data Protection Act 1998 (this process will be reviewed and updated accordingly with any updates to the guidelines), personal data will not be kept for longer than is required for the purpose for which it has been acquired. Data will be held in compliance with the sponsor’s standard operating procedures.

Sample size

Our previous trial compared immediate with delayed antibiotic use [1]. Children with AOMd took a median of 3 days (interquartile range (IQR) 2, 4) to achieve the REST primary outcome. Our PPI advised a 1.25-day non-inferiority margin (equivalent to an absolute difference in cure rate of 19.5% at 3 days). A two-group non-inferiority trial normally assumes a 2.5% one-sided Type I error. Using a 1.25% Type I error to detect non-inferiority for two comparisons with 90% power, complete outcome data needed for 106 per arm is 399 with 20% attrition.

Statistical analysis

A flow of participants through the trial will be summarised in a Consolidated Standards of Reporting Trials (CONSORT) diagram. Descriptive statistics of baseline clinical and socio-demographic characteristics will be presented to describe the study sample and to ascertain comparability of the randomisation groups.

Data from the internal pilot phase of the study will be assessed against predefined/pre-agreed stop/go criteria to inform the decision as to whether to continue the trial to the ‘main’ phase. The proposed ‘traffic light’ (stop/go) criteria are based on descriptive statistics summarising recruitment, retention and adherence.

The primary analysis will be carried out under the intention-to-treat (ITT) principle, analysing participants as randomised without the imputation of missing data. Kaplan-Meier survival curves will be plotted to depict the probability of symptom resolution over time. Symptom resolution over the 14 days of follow-up will be compared between children allocated to immediate oral antibiotics and those allocated to each of the other treatment groups using a Cox proportional hazards regression model, adjusted for age (stratification variable). The primary outcome will also be analysed using an Accelerated Failure Time (AFT) model, which has previously been recommended for studies of resolution of infectious diseases as previous research has suggested that symptoms of AOM will be resolved in 90% of children by day 8.

The proportion of participants in the immediate topically and delayed orally administered antibiotics arms who achieve symptom resolution within 3 days will be compared (separately) to those in the immediate orally administered antibiotics arm. The absolute difference will be calculated and reported alongside the associated confidence interval, it will then be reported as to whether or not the lower limit of the confidence interval lies within the maximum unimportant difference.

Analysis of secondary outcomes will utilise regression models appropriate for the nature of the outcome measure (i.e. logistic regression for binary outcomes, Poisson or negative binomial regression for count data).

The primary analysis model will be repeated but with the outcome of symptom resolution being defined as when all symptoms are rated as being ‘normal/none’, ‘very slight problem’ or ‘slight problem’ (compared to the primary outcome of symptom resolution being defined as all symptoms being rated as ‘normal/none’ or ‘very slight problem’). The primary analysis will also be repeated under the per-protocol approach (rather than ITT). The sensitivity of the primary analysis to the impact of missing data will also be explored by repeating the analysis after the imputation of missing primary outcome data. The primary analysis and AFT model will be repeated with additional adjustment for any prognostic variable showing a marked imbalance at baseline (ascertained using descriptive statistics). Baseline characteristics will be investigated as potential treatment effect moderators, this will be done by including treatment group by moderator interaction terms into the primary analysis model (individually).

Economic data analysis

The primary economic evaluation will explore the relationship between cost and outcome for the three treatments for AOMd (immediate topically, delayed orally and immediately administered oral antibiotics) from an NHS perspective at 14 days post randomisation. This will take the form of a simple comparison of NHS costs and outcomes over a period of 2 weeks from randomisation.

A secondary cost analysis will evaluate the difference in NHS secondary care costs between the trial arms for the 3 months following randomisation.

All resources will be valued using unit costs from established sources. These will include Unit Costs of Health and Social Care [25] for primary and community care, NHS Reference Costs [26] for hospital care and the BNFC [27] for prescribed medication.

Differences in NHS resources and costs between the arms will be analysed initially using Ordinary Least Squares (OLS) regression. The distribution of residuals from the regression models will then be examined and a decision will be made as to whether OLS is appropriate or another type of regression model should be considered (e.g. Generalised Linear Models (GLM)).

A cost-consequence analysis will then be conducted in which the costs to the NHS of the three treatments at 14 days post randomisation will be compared with the primary clinical outcome. Areas of uncertainty in assumptions will be subjected to sensitivity analyses to test the robustness of the results.

Qualitative data analysis

Interview transcripts will be imported into NVivo 12 qualitative data analysis software. Analysis will begin shortly after data collection starts and will be ongoing and iterative – informing further data collection and identifying changes needed to the topic guide. Thematic analysis [28], utilising a data-driven inductive approach, will be used to identify and analyse patterns and themes of particular salience for participants and across the dataset using constant-comparison techniques [29, 30]. A subset of transcripts will be independently double-coded by members of the team (CC and JH); any discrepancies will be discussed within the team and resolved to achieve coding consensus and maximal rigour.

Blinding

Once the allocation is revealed, neither clinicians nor the child participant or their parent/legal guardian will remain blind to their allocated treatment. Codes will be assigned to the database, which will preserve blinding of study personnel. The senior statistician will remain blind to knowledge of which treatment is represented by each treatment code until the final results have been shared with the Data Monitoring Committee (DMC). Emergency unblinding will not be necessary in this trial since it is an open study.

Dissemination

We will publish the trial results in peer-reviewed journals and present at national and international meetings. With the assistance of our collaborators and PPI we will disseminate the study findings to an international audience. All participants will be offered a lay summary of the main findings of the study.

Discussion

This article outlines a pragmatic, three-arm, individually randomised trial, which aims to recruit from 175 GP practices across the UK. The aim is to establish evidence for the non-inferiority of: (1) immediate topical ear drops, ciprofloxacin 0.3%; (2) delayed orally administered amoxicillin (clarithromycin) or (3) immediate orally administered amoxicillin (clarithromycin). The non-inferiority will be based on time to resolution of all significant symptoms. Secondary outcomes will include cost-effectiveness, duration of moderately bad or worse symptoms and repeat AOMd episodes.

Recruitment of 399 children with AOMd over a 22-month period presented challenges around the design of the REST study. Only two to three patients’ children were expected to present at each GP practice over the 22-month recruitment period, requiring at least 175 GP practices to take part in the study.

In order to make this study feasible we needed to consider novel and streamline mechanism to facilitate greenlighting of sites, training of site staff, identification of eligible participants and the collection of high-quality data.

We employed several different strategies in order to address these elements of the study, these included:

  • Development of a remote training platform to deliver REST study training to GPs and staff at recruiting practices

  • A light-touch Green Light Process (GLP), maximising the number of staff at the GP practices able to recruit to the REST study by providing quick and accessible study-specific training

We used the TRANSFoRm electronic platform, (integrates into the health records) to automatically create a pop-up alert to the clinician when an eligible patient presents. The system automatically checked the participant’s eligibility and part-filled the study eCRFs reducing the efforts of the clinician to record study data.

Trial status

Currently, 50 SystmOne GP practices have been greenlighted across seven CRN regions in the UK. The first child was recruited to the study on 5 April 2019 with recruitment currently ongoing. A total of 22 children were recruited to the REST study, with recruitment being closed on 31 May 2020.

Protocol: Version 7.0, 31 October 2018

Open to recruitment: 7 April 2019

Planned recruitment closure date: 31 March 2020

Availability of data and materials

The datasets analysed during the current study will be available from the corresponding author on reasonable request.

Abbreviations

AOMd:

Acute otitis media with discharge

AE:

Adverse event

CI:

Chief investigator

CRF:

Case Report Form

EHR:

Electronic Health Record

GP:

General practitioner

NHS:

National Health Service

NICE:

National Institute of Health and Social Care

PI:

Principal investigator

TMG:

Trial Management Group

TSC:

Trial Steering Committee

DMC:

Data Monitoring Committee

References

  1. Little P, Gould C, Williamson I, et al. Pragmatic randomised controlled trial of two prescribing strategies for childhood acute otitis media. BMJ. 2001;322(7282):336–42.

    Article  CAS  Google Scholar 

  2. Smith L, Ewings P, Smith C, et al. Ear discharge in children presenting with acute otitis media: observational study from UK general practice. Br J Gen Pract. 2010;60(571):101–5. https://doi.org/10.3399/bjgp10X483148.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Rovers MM, Glasziou P, Appelman CL, et al. Antibiotics for acute otitis media: a meta-analysis with individual patient data. Lancet. 2006;368(9545):1429–35.

    Article  CAS  Google Scholar 

  4. Hollinghurst S, Gorst C, Fahey T, et al. Measuring the financial burden of acute cough in pre-school children: a cost of illness study. BMC Fam Pract. 2008;9(1):10. https://doi.org/10.1186/1471-2296-9-10.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Hollinghurst S, Redmond NM, Costelloe C, et al. Paracetamol plus ibuprofen for the treatment of fever in children (PITCH): economic evaluation of the randomised controlled trial. BMJ. 2008;337(7672):a1490. https://doi.org/10.1136/Bmj.A1490.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Wolleswinkel-van den Bosch JH, Stolk EA, Francois M, et al. The health care burden and societal impact of acute otitis media in seven European countries: results of an internet survey. Vaccine. 2010;28:G39–52. https://doi.org/10.1016/j.vaccine.2010.06.014.

    Article  PubMed  Google Scholar 

  7. Hay AD, Heron J, Ness A, et al. The prevalence of symptoms and consultations in pre-school children in the Avon Longitudinal Study of Parents and Children (ALSPAC): a prospective cohort study. Fam Pract. 2005;22(4):367–74. https://doi.org/10.1093/fampra/cmi-35.

    Article  PubMed  Google Scholar 

  8. Williamson I, Benge S, Mullee M, et al. Consultations for middle ear disease, antibiotic prescribing and risk factors for reattendance: a case-linked cohort study. Br J Gen Pract. 2006;56(524):170–5.

    PubMed  PubMed Central  Google Scholar 

  9. Finkelstein JA, Metlay JP, Davis RL, et al. Antimicrobial use in defined populations of infants and young children. Arch Pediatr Adolesc Med. 2000;154(4):395–400.

    Article  CAS  Google Scholar 

  10. Ashworth M, Charlton J, Ballard K, et al. Variations in antibiotic prescribing and consultation rates for acute respiratory infection in UK practices 1995-2000. Br J Gen Pract. 2005;55:603–8.

    PubMed  PubMed Central  Google Scholar 

  11. Ashworth M, Cox K, Latinovic R, et al. Why has antibiotic prescribing for respiratory illness declined in primary care? A longitudinal study using the General Practice Research Database. J Public Health. 2004;26(3):268–74.

    Article  Google Scholar 

  12. NICE. Respiratory tract infections: prescribing of antibiotics for self-limiting respiratory tract infections in adults and children in primary care, 2008. https://www.nice.org.uk/guidance/cg69. Accessed 30 Apr 2020.

    Google Scholar 

  13. Foliaki S, Pearce N, Bjorksten B, et al. Antibiotic use in infancy and symptoms of asthma, rhinoconjunctivitis, and eczema in children 6 and 7 years old: International Study of Asthma and Allergies in Childhood Phase III. J Allergy Clin Immunol. 2009;124(5):982–9. https://doi.org/10.1016/j.jaci.2009.08.017.

    Article  CAS  PubMed  Google Scholar 

  14. Goossens H, Ferech M, van der Stichel R, et al. Outpatient antibiotic use in Europe and association with resistance: a cross-national database study. Lancet. 2005;365:579–87.

    Article  Google Scholar 

  15. Costelloe C, Metcalfe C, Lovering A, et al. Effect of antibiotic prescribing in primary care on antimicrobial resistance in individual patients: systematic review and meta-analysis. BMJ. 2010;340:c2096. https://doi.org/10.1136/Bmj.C2096.

    Article  PubMed  Google Scholar 

  16. Department of Health. UK antimicrobial resistance strategy and action plan. London; 2000. http://antibiotic-action.com/wp-content/uploads/2011/07/DH-UK-antimicrobial-resistance-strategy-and-action-plan.pdf. Accessed 30 Apr 2020.

  17. van Dongen TMA, van der Heijden GJMG, Venekamp RP, et al. A trial of treatment for acute otorrhea in children with tympanostomy tubes. N Engl J Med. 2014;370(8):723–33. https://doi.org/10.1056/Nejmoa1301630.

    Article  PubMed  Google Scholar 

  18. van Dongen TM, Schilder AG, Venekamp RP, et al. Cost-effectiveness of treatment of acute otorrhea in children with tympanostomy tubes. Pediatrics. 2015;135(5):e1182–9. https://doi.org/10.1542/peds.2014-3141.

    Article  PubMed  Google Scholar 

  19. Delaney BC, Curcin V, Andreasson A, et al. Translational medicine and patient safety in Europe: TRANSFoRm—Architecture for the Learning Health System in Europe. Biomed Res Int. 2015;2015:961526. https://doi.org/10.1155/2015/961526.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Little P, Rumsby K, Kelly J, et al. Information leaflet and antibiotic prescribing strategies for acute lower respiratory tract infection: a randomized controlled trial. JAMA. 2005;293(24):3029–35.

    Article  CAS  Google Scholar 

  21. Little P, Williamson I, Warner G, et al. Open randomised trial of prescribing strategies in managing sore throat. BMJ. 1997;314(7082):722–7.

    Article  CAS  Google Scholar 

  22. Kubba H, Swan IRC, Gatehouse S. How appropriate is the OM6 as a discriminative instrument in children with otitis media? Arch Otolaryngol Head Neck Surg. 2004;130(6):705–9. https://doi.org/10.1001/archotol.130.6.705.

    Article  PubMed  Google Scholar 

  23. Sandelowski M. Sample size in qualitative research. Res Nurs Health. 1995;18:179–83.

    Article  CAS  Google Scholar 

  24. Britten N. Qualitative interviews in medical research. BMJ. 1995;311:251–3.

    Article  CAS  Google Scholar 

  25. Curtis L, Burns A. Unit costs of health and social care 2015: PSSRU University of Kent; 2015. p. 284. https://www.pssru.ac.uk/project-pages/unit-costs/unit-costs-2015/. Accessed 30 Apr 2020.

  26. Department of Health. NHS Reference costs 2014. https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/477919/2014-15_Reference_costs_publication.pdf. Accessed 30 Apr 2020.

  27. Royal Pharmaceutical Society of Great Britain. British National Formulary for Children. 2016.

    Google Scholar 

  28. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3:77–101.

    Article  Google Scholar 

  29. Boyatzis R. Transforming qualitative information: thematic analysis and code development. Thousand Oaks: Sage; 1998.

    Google Scholar 

  30. Charmay K. Constructing grounded theory: a practical guide through qualitative analysis. London: Sage; 2006.

    Google Scholar 

Download references

Acknowledgements

This study was designed and delivered in collaboration with the Bristol Randomised Trials Collaboration (BRTC), part of the Bristol Trials Centre. The University of Bristol is acting as sponsor for this trial and is responsible for overall oversight of the trial; the NHS Bristol, North Somerset and South Gloucestershire Group (CCG) host the trial. The authors would like to thank all of the participants, PIs and their teams at each of the REST study sites for their involvement. The authors would like to thank all 15 UK CRNs for their role in the study. The authors would also like to thank members of their TSC and DMC.

Funding

This research is funded by the National Institute for Health Research (NIHR) Health Technology Assessment (HTA) programme (funder ref.: 16/85/01). See Additional File 4 for the agree-to-fund letter. The views expressed in this publication are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health and Social Care.

Author information

Authors and Affiliations

Authors

Contributions

Alastair D Hay and Michael Moore are the co-chief investigators of REST; they conceived the study, participated in its design and coordination and helped to draft the manuscript. Kathryn Curtis developed the trial procedures, manuscript and managed the coordination of the study. Jodi Taylor also assisted with the coordination of the study and drafting the manuscript. Vibhore Prasad contributed to the study design and manuscript. Anne Schilder and Scott Wilkes also assisted with the study design. Vasa Curcin developed the TRANSFoRm electronic trials platform used in the study. Nicholas Turner and Richard Morris designed the statistical analysis. Christie Cabral and Jeremy Horwood developed the qualitative elements of the study. All authors contribute to the oversight of the study via the TMG, read and commented on manuscript drafts and approved the final manuscript.

Corresponding author

Correspondence to Jodi Taylor.

Ethics declarations

Ethics approval and consent to participate

The research protocol was given a favourable opinion by the South Central-Oxford B Research Ethics Committee on 22 May 2018. This ethics approval applies to all NHS sites taking part in the REST study. Parents/legal guardians will be asked for their permission for their child to participate in the study and will be asked to provide their written, informed consent prior to enrollment. Any amendments to the protocol will be reported accordingly to the regulatory bodies (see Additional File 5 for the confirmation of favourable opinion by the Ethics Committee letter).

Consent for publication

Not applicable

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

REST Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) Checklist.

Additional file 2.

The Runny Ear Study parent information sheet.

Additional file 3.

REST study microbiology protocol.

Additional file 4.

Agree-to-fund letter from the National Institute for Health Research (NIHR) Health Technology Assessment (NIHR HTA).

Additional file 5.

Confirmation of favourable opinion by Ethics Commitee Letter.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Curtis, K., Moore, M., Cabral, C. et al. A multi-centre, pragmatic, three-arm, individually randomised, non-inferiority, open trial to compare immediate orally administered, immediate topically administered or delayed orally administered antibiotics for acute otitis media with discharge in children: The Runny Ear Study (REST): study protocol. Trials 21, 463 (2020). https://doi.org/10.1186/s13063-020-04419-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13063-020-04419-7

Keywords