Elsevier

The Lancet

Volume 395, Issue 10228, 21–27 March 2020, Pages 986-997
The Lancet

Series
Generating comparative evidence on new drugs and devices before approval

https://doi.org/10.1016/S0140-6736(19)33178-2Get rights and content

Fewer than half of new drugs have data on their comparative benefits and harms against existing treatment options at the time of regulatory approval in Europe and the USA. Even when active-comparator trials exist, they might not produce meaningful data to inform decisions in clinical practice and health policy. The uncertainty associated with the paucity of well designed active-comparator trials has been compounded by legal and regulatory changes in Europe and the USA that have created a complex mix of expedited programmes aimed at facilitating faster access to new drugs. Comparative evidence generation is even sparser for medical devices. Some have argued that the current process for regulatory approval needs to generate more evidence that is useful for patients, clinicians, and payers in health-care systems. We propose a set of five key principles relevant to the European Medicines Agency, European medical device regulatory agencies, US Food and Drug Administration, as well as payers, that we believe will provide the necessary incentives for pharmaceutical and device companies to generate comparative data on drugs and devices and assure timely availability of evidence that is useful for decision making. First, labelling should routinely inform patients and clinicians whether comparative data exist on new products. Second, regulators should be more selective in their use of programmes that facilitate drug and device approvals on the basis of incomplete benefit and harm data. Third, regulators should encourage the conduct of randomised trials with active comparators. Fourth, regulators should use prospectively designed network meta-analyses based on existing and future randomised trials. Last, payers should use their policy levers and negotiating power to incentivise the generation of comparative evidence on new and existing drugs and devices, for example, by explicitly considering proven added benefit in pricing and payment decisions.

Introduction

A record-breaking number of new drugs and devices have entered the market in the last 10 years. In 2018, the US Food and Drug Administration (FDA) granted approval to 59 drugs and 106 devices (compared to an average of 28 drug approvals per year during the preceding decade), and the European Medicines Agency (EMA) approved 42 new drugs. In addition to new drugs for established therapeutic areas with large numbers of existing treatment options (eg, antidepressants for depression,1 statins for coronary heart disease,2 and HbA1c-lowering therapies for diabetes3), the research and development pipelines of pharmaceutical and device companies have delivered new therapies for rare diseases.4 For example, several new agents are now available for the treatment of multiple myeloma,5 chronic myeloid leukemia,6 Gaucher disease,7 and pulmonary arterial hypertension.8 This is good news for patients, since some of these novel therapies have turned out to be beneficial.9 For example, drugs like imatinib for chronic myeloid leukaemia and sofosbuvir for hepatitis C have transformed clinical outcomes, improving and extending the lives of patients with these serious and life-threatening conditions.10, 11 However, other new drugs like the HbA1c-lowering rosiglitazone have turned out to have differing benefit–risk profiles than expected in certain populations and subsequently been removed from some markets.12, 13, 14 Also, there have been several major safety crises related to high-risk medical devices, resulting in their market withdrawal, such as pelvic mesh,15 and metal contraceptive implants.16

The market entry of larger numbers of new drugs and devices might also paradoxically complicate treatment decisions if little or no data exist on the comparative benefits and harms of new versus existing alternatives. What the treatment of choice for a patient with condition x should be, is a key question for clinical practice.17 Without data on comparative benefits and harms, it might be difficult for patients and clinicians to identify the appropriate therapy.

In this Series, we describe and highlight some fundamental principles related to developing comparative data on drugs and devices, particularly if multiple options exist to treat the same condition. Our primary focus is on the FDA and EMA, which serve as gatekeepers to the largest pharmaceutical markets worldwide that collectively account for over 60% of total sales. In the USA, the FDA is also responsible for medical device regulation; in the EU, notified bodies designated by national authorities are responsible for conformity assessments of devices (table 1).18 FDA and EMA are tasked with the goals of granting expeditious access to promising new treatments while also requiring adequate data before approval to protect patients from ineffective and potentially harmful products. Regulatory agencies’ evidence standards for approval shape the quantity and quality of clinical studies generated on new drugs (and also devices in the USA).

In this first paper in the Series, we examine the availability of comparative effectiveness data, and outline how the current regulatory approaches to approving new medicines and devices address the evidence needs of patients, clinicians, and other decision makers in health systems. Recent policy changes aimed at speeding up the development, review, and approval of new products have complicated system-wide efforts to generate comparative data on drugs and devices before and after approval. We therefore propose strategies to improve the future availability of comparative data at the time of market entry. The second paper in the Series focuses on the generation of comparative evidence in the post-marketing period for drugs and devices but also interventions for which often no commercial developer and no dedicated regulatory system exist—eg, surgical interventions. The Comment accompanying the Series analyses the ethical tensions in comparative effectiveness research.

Section snippets

Availability of comparative evidence on new drugs and devices

Comparative evidence on newly approved drugs is limited for several reasons. One primary reason is that pharmaceutical manufacturers do not routinely collect such data in the studies leading to drug approval. In both the USA and Europe, the regulatory agencies’ statutory mandate is to evaluate a drug's benefit–risk balance and intended effects, not its comparative benefits and harms against existing alternatives. Placebo controls in randomised controlled trials (RCTs) can establish assay

Expedited programmes

Over the past few decades, legislatures and regulators have established several expedited development, review, and approval programmes for drugs (panel 2). An expedited programme also exists for high-risk medical devices in the USA, but not in Europe. Although expedited programmes differ in their scope and focus, which range from putting deadlines on regulatory review times to approving products on the basis of earlier stage data than what is typically required, their shared objective is to

A fragmented evidence base for decision making in health systems

When new drugs and devices lack active comparators at the time of approval, it has several important implications for stakeholders in health systems, including health technology assessment organisations, payers, clinicians, and patients. Several European health technology assessment organisations like the National Institute for Health and Care Excellence in England, Haute Autorité de Santé in France, and the Institute for Quality and Efficiency in Health Care in Germany explicitly require

Importance of generating comparative evidence before market entry

Comparative data on new drugs and devices usually does not emerge after regulatory approval. When drugs and devices are originally approved for particular indications without active-comparator RCTs, such data are unlikely to emerge in the post-marketing period.73 Even when post-marketing studies are required by the FDA and EMA, they can remain incomplete years after approval.28, 74, 75, 76, 77 Just about half of drugs with FDA accelerated approvals from 2009 and 2013 fulfilled their

Prioritising the generation of comparative data before approval

The evidence requirements for market authorisation of new treatments have important implications for the research conducted on new drugs and devices. Routine regulatory approval of drugs and high-risk devices on the basis of placebo-controlled or single-group studies might disincentivise manufacturers from investing in more clinically useful active-comparator trials. Manufacturers might also interpret regulatory flexibility in data requirements in certain areas as a shorter and cheaper route to

Conclusions

Comparative data on the benefits and harms of new and existing drugs that are essential to make evidence-based decisions in clinical practice and health policy are hard to come by. The broad use of expedited programmes in both the USA and Europe has compounded the already-substantial shortcomings of the available evidence on new drugs at the time of market entry, further complicating efforts to determine how new drugs fare against existing alternatives. Generation of comparative evidence is

References (127)

  • J Hoekman et al.

    Changing standards for drug approval: a longitudinal analysis of conditional marketing authorisation in the European Union

    Soc Sci Med

    (2019)
  • H Naci et al.

    Comparative tolerability and harms of individual statins: a study-level network meta-analysis of 246 955 participants from 135 randomized, controlled trials

    Circ Cardiovasc Qual Outcomes

    (2013)
  • SC Palmer et al.

    Comparison of clinical outcomes and adverse events associated with glucose-lowering drugs in patients with type 2 diabetes: a meta-analysis

    JAMA

    (2016)
  • A Sarpatwari et al.

    Evaluating the impact of the orphan drug act's seven-year market exclusivity period

    Health Aff (Millwood)

    (2018)
  • E Jabbour

    Chronic myeloid leukemia: First-line drug of choice

    Am J Hematol

    (2016)
  • A Van Rossum et al.

    Enzyme replacement or substrate reduction? A review of gaucher disease treatment options

    Hosp Pharm

    (2016)
  • EMT Lau et al.

    Epidemiology and treatment of pulmonary arterial hypertension

    Nat Rev Cardiol

    (2017)
  • AS Kesselheim et al.

    The most transformative drugs of the past 25 years: a survey of physicians

    Nat Rev Drug Discov

    (2013)
  • DL Longo

    Imatinib Changed Everything

    N Engl J Med

    (2017)
  • SE Nissen et al.

    Effect of rosiglitazone on the risk of myocardial infarction and death from cardiovascular causes

    N Engl J Med

    (2007)
  • J Woodcock et al.

    Regulatory action on rosiglitazone by the U.S. Food and Drug Administration

    N Engl J Med

    (2010)
  • D Cohen

    Rosiglitazone: what went wrong?

    BMJ

    (2010)
  • C Heneghan et al.

    Transvaginal mesh failure: lessons for regulation of implantable devices

    BMJ

    (2017)
  • SS Dhruva et al.

    Revisiting essure—toward safe and effective sterilization

    N Engl J Med

    (2015)
  • G Del Fiol et al.

    Clinical questions raised by clinicians at the point of care: a systematic review

    JAMA Intern Med

    (2014)
  • DB Kramer et al.

    Regulation of medical devices in the United States and European Union

    N Engl J Med

    (2012)
  • R Temple et al.

    Placebo-controlled trials and active-control trials in the evaluation of new treatments. Part 1: ethical and scientific issues

    Ann Intern Med

    (2000)
  • NH Goldberg et al.

    Availability of comparative efficacy data at the time of drug approval in the United States

    JAMA

    (2011)
  • JCF van Luijn et al.

    Availability of comparative trials for the assessment of new medicines in the European Union at the moment of market authorization

    Br J Clin Pharmacol

    (2007)
  • NS Downing et al.

    Clinical trial evidence supporting FDA approval of novel therapeutic agents, 2005–2012

    JAMA

    (2014)
  • J Kim et al.

    Esketamine for treatment-resistant depression—First FDA-approved antidepressant in a new class

    N Engl J Med

    (2019)
  • EMA/556923/2018 Committee for Medicinal Products for Human Use (CHMP) Assessment report: RXULTI. 2018

  • EMA/86928/2018 Committee for Medicinal Products for Human Use (CHMP) Assessment report: Segluromet. 2018

  • B Gyawali et al.

    US Food and Drug Administration approval of new drugs based on noninferiority trials in oncology: a dangerous precedent?

    JAMA Oncol

    (2019)
  • J Puthumana et al.

    Clinical trial evidence supporting FDA approval of drugs granted breakthrough therapy designation

    JAMA

    (2018)
  • H Naci et al.

    Characteristics of preapproval and postapproval studies for drugs granted accelerated approval by the US Food and Drug Administration

    JAMA

    (2017)
  • JA Beaver et al.

    A 25-year experience of US Food and Drug Administration accelerated approval of malignant hematology and oncology drugs and biologics: a review

    JAMA Oncol

    (2018)
  • T Hilal et al.

    Analysis of control arm quality in randomized clinical trials leading to anticancer drug approval by the US Food and Drug Administration

    JAMA Oncol

    (2019)
  • DN Lathyris et al.

    Industry sponsorship and selection of comparators in randomized clinical trials

    Eur J Clin Invest

    (2010)
  • SS Dhruva et al.

    Strength of study evidence examined by the FDA in premarket approval of cardiovascular devices

    JAMA

    (2009)
  • VK Rathi et al.

    Characteristics of clinical studies conducted over the total product life cycle of high-risk therapeutic medical devices receiving FDA premarket approval in 2010 and 2011

    JAMA

    (2015)
  • CE Chen et al.

    Inclusion of comparative effectiveness data in high-risk cardiovascular device studies at the time of premarket approval

    JAMA

    (2012)
  • JD Wallach et al.

    The US Food and Drug Administration's expedited approval programs: evidentiary standards, regulatory trade-offs, and potential improvements

    Clin Trials

    (2018)
  • H-G Eichler et al.

    Balancing early market access to new drugs with the need for benefit/risk data: a mounting dilemma

    Nat Rev Drug Discov

    (2008)
  • J Pace et al.

    Demands for access to new therapies: are there alternatives to accelerated access?

    BMJ

    (2017)
  • TJ Hwang et al.

    The FDA's expedited programs and clinical development times for novel therapeutics, 2012–2016

    JAMA

    (2017)
  • AS Kesselheim et al.

    Trends in utilization of FDA expedited drug development and approval programs, 1987–2014: cohort study

    BMJ

    (2015)
  • JJ Darrow et al.

    Nearly one-third of new drugs are no better than older drugs, and some are worse. Health Aff Blog. Oct 6, 2017

  • TJ Hwang et al.

    Efficacy, safety, and regulatory approval of food and drug administration-designated breakthrough and nonbreakthrough cancer medicines

    J Clin Oncol

    (2018)
  • SR Mostaghim et al.

    Safety related label changes for new drugs after approval in the US through expedited regulatory pathways: retrospective cohort study

    BMJ

    (2017)
  • Cited by (51)

    View all citing articles on Scopus
    View full text