SeriesGenerating comparative evidence on new drugs and devices before approval
Introduction
A record-breaking number of new drugs and devices have entered the market in the last 10 years. In 2018, the US Food and Drug Administration (FDA) granted approval to 59 drugs and 106 devices (compared to an average of 28 drug approvals per year during the preceding decade), and the European Medicines Agency (EMA) approved 42 new drugs. In addition to new drugs for established therapeutic areas with large numbers of existing treatment options (eg, antidepressants for depression,1 statins for coronary heart disease,2 and HbA1c-lowering therapies for diabetes3), the research and development pipelines of pharmaceutical and device companies have delivered new therapies for rare diseases.4 For example, several new agents are now available for the treatment of multiple myeloma,5 chronic myeloid leukemia,6 Gaucher disease,7 and pulmonary arterial hypertension.8 This is good news for patients, since some of these novel therapies have turned out to be beneficial.9 For example, drugs like imatinib for chronic myeloid leukaemia and sofosbuvir for hepatitis C have transformed clinical outcomes, improving and extending the lives of patients with these serious and life-threatening conditions.10, 11 However, other new drugs like the HbA1c-lowering rosiglitazone have turned out to have differing benefit–risk profiles than expected in certain populations and subsequently been removed from some markets.12, 13, 14 Also, there have been several major safety crises related to high-risk medical devices, resulting in their market withdrawal, such as pelvic mesh,15 and metal contraceptive implants.16
The market entry of larger numbers of new drugs and devices might also paradoxically complicate treatment decisions if little or no data exist on the comparative benefits and harms of new versus existing alternatives. What the treatment of choice for a patient with condition x should be, is a key question for clinical practice.17 Without data on comparative benefits and harms, it might be difficult for patients and clinicians to identify the appropriate therapy.
In this Series, we describe and highlight some fundamental principles related to developing comparative data on drugs and devices, particularly if multiple options exist to treat the same condition. Our primary focus is on the FDA and EMA, which serve as gatekeepers to the largest pharmaceutical markets worldwide that collectively account for over 60% of total sales. In the USA, the FDA is also responsible for medical device regulation; in the EU, notified bodies designated by national authorities are responsible for conformity assessments of devices (table 1).18 FDA and EMA are tasked with the goals of granting expeditious access to promising new treatments while also requiring adequate data before approval to protect patients from ineffective and potentially harmful products. Regulatory agencies’ evidence standards for approval shape the quantity and quality of clinical studies generated on new drugs (and also devices in the USA).
In this first paper in the Series, we examine the availability of comparative effectiveness data, and outline how the current regulatory approaches to approving new medicines and devices address the evidence needs of patients, clinicians, and other decision makers in health systems. Recent policy changes aimed at speeding up the development, review, and approval of new products have complicated system-wide efforts to generate comparative data on drugs and devices before and after approval. We therefore propose strategies to improve the future availability of comparative data at the time of market entry. The second paper in the Series focuses on the generation of comparative evidence in the post-marketing period for drugs and devices but also interventions for which often no commercial developer and no dedicated regulatory system exist—eg, surgical interventions. The Comment accompanying the Series analyses the ethical tensions in comparative effectiveness research.
Section snippets
Availability of comparative evidence on new drugs and devices
Comparative evidence on newly approved drugs is limited for several reasons. One primary reason is that pharmaceutical manufacturers do not routinely collect such data in the studies leading to drug approval. In both the USA and Europe, the regulatory agencies’ statutory mandate is to evaluate a drug's benefit–risk balance and intended effects, not its comparative benefits and harms against existing alternatives. Placebo controls in randomised controlled trials (RCTs) can establish assay
Expedited programmes
Over the past few decades, legislatures and regulators have established several expedited development, review, and approval programmes for drugs (panel 2). An expedited programme also exists for high-risk medical devices in the USA, but not in Europe. Although expedited programmes differ in their scope and focus, which range from putting deadlines on regulatory review times to approving products on the basis of earlier stage data than what is typically required, their shared objective is to
A fragmented evidence base for decision making in health systems
When new drugs and devices lack active comparators at the time of approval, it has several important implications for stakeholders in health systems, including health technology assessment organisations, payers, clinicians, and patients. Several European health technology assessment organisations like the National Institute for Health and Care Excellence in England, Haute Autorité de Santé in France, and the Institute for Quality and Efficiency in Health Care in Germany explicitly require
Importance of generating comparative evidence before market entry
Comparative data on new drugs and devices usually does not emerge after regulatory approval. When drugs and devices are originally approved for particular indications without active-comparator RCTs, such data are unlikely to emerge in the post-marketing period.73 Even when post-marketing studies are required by the FDA and EMA, they can remain incomplete years after approval.28, 74, 75, 76, 77 Just about half of drugs with FDA accelerated approvals from 2009 and 2013 fulfilled their
Prioritising the generation of comparative data before approval
The evidence requirements for market authorisation of new treatments have important implications for the research conducted on new drugs and devices. Routine regulatory approval of drugs and high-risk devices on the basis of placebo-controlled or single-group studies might disincentivise manufacturers from investing in more clinically useful active-comparator trials. Manufacturers might also interpret regulatory flexibility in data requirements in certain areas as a shorter and cheaper route to
Conclusions
Comparative data on the benefits and harms of new and existing drugs that are essential to make evidence-based decisions in clinical practice and health policy are hard to come by. The broad use of expedited programmes in both the USA and Europe has compounded the already-substantial shortcomings of the available evidence on new drugs at the time of market entry, further complicating efforts to determine how new drugs fare against existing alternatives. Generation of comparative evidence is
References (127)
- et al.
Comparative efficacy and acceptability of 21 antidepressant drugs for the acute treatment of adults with major depressive disorder: a systematic review and network meta-analysis
Lancet
(2018) - et al.
A look backward and forward in the regulatory and treatment history of multiple myeloma: approval of novel-novel agents, new drug development, and longer patient survival
Semin Oncol
(2016) - et al.
Sofosbuvir: the final nail in the coffin for hepatitis C?
Lancet Infect Dis
(2013) - et al.
Approvals of drugs with uncertain benefit-risk profiles in Europe
Eur J Intern Med
(2015) - et al.
The need for transparency of clinical evidence for medical devices in Europe
Lancet
(2018) - et al.
Strength of validation for surrogate end points used in the US Food and Drug Administration's approval of oncology drugs
Mayo Clin Proc
(2016) - et al.
Early benefit assessment of new drugs in Germany—results from 2011 to 2012
Health Policy
(2014) - et al.
A review of NICE appraisals of pharmaceuticals 2000–2016 found variation in establishing comparative clinical effectiveness
J Clin Epidemiol
(2019) Drugs, cancer and end-of-life care: a case study of pharmaceuticalization?
Soc Sci Med
(2015)- et al.
Percutaneous coronary interventional strategies for treatment of in-stent restenosis: a network meta-analysis
Lancet
(2015)
Changing standards for drug approval: a longitudinal analysis of conditional marketing authorisation in the European Union
Soc Sci Med
Comparative tolerability and harms of individual statins: a study-level network meta-analysis of 246 955 participants from 135 randomized, controlled trials
Circ Cardiovasc Qual Outcomes
Comparison of clinical outcomes and adverse events associated with glucose-lowering drugs in patients with type 2 diabetes: a meta-analysis
JAMA
Evaluating the impact of the orphan drug act's seven-year market exclusivity period
Health Aff (Millwood)
Chronic myeloid leukemia: First-line drug of choice
Am J Hematol
Enzyme replacement or substrate reduction? A review of gaucher disease treatment options
Hosp Pharm
Epidemiology and treatment of pulmonary arterial hypertension
Nat Rev Cardiol
The most transformative drugs of the past 25 years: a survey of physicians
Nat Rev Drug Discov
Imatinib Changed Everything
N Engl J Med
Effect of rosiglitazone on the risk of myocardial infarction and death from cardiovascular causes
N Engl J Med
Regulatory action on rosiglitazone by the U.S. Food and Drug Administration
N Engl J Med
Rosiglitazone: what went wrong?
BMJ
Transvaginal mesh failure: lessons for regulation of implantable devices
BMJ
Revisiting essure—toward safe and effective sterilization
N Engl J Med
Clinical questions raised by clinicians at the point of care: a systematic review
JAMA Intern Med
Regulation of medical devices in the United States and European Union
N Engl J Med
Placebo-controlled trials and active-control trials in the evaluation of new treatments. Part 1: ethical and scientific issues
Ann Intern Med
Availability of comparative efficacy data at the time of drug approval in the United States
JAMA
Availability of comparative trials for the assessment of new medicines in the European Union at the moment of market authorization
Br J Clin Pharmacol
Clinical trial evidence supporting FDA approval of novel therapeutic agents, 2005–2012
JAMA
Esketamine for treatment-resistant depression—First FDA-approved antidepressant in a new class
N Engl J Med
EMA/556923/2018 Committee for Medicinal Products for Human Use (CHMP) Assessment report: RXULTI. 2018
EMA/86928/2018 Committee for Medicinal Products for Human Use (CHMP) Assessment report: Segluromet. 2018
US Food and Drug Administration approval of new drugs based on noninferiority trials in oncology: a dangerous precedent?
JAMA Oncol
Clinical trial evidence supporting FDA approval of drugs granted breakthrough therapy designation
JAMA
Characteristics of preapproval and postapproval studies for drugs granted accelerated approval by the US Food and Drug Administration
JAMA
A 25-year experience of US Food and Drug Administration accelerated approval of malignant hematology and oncology drugs and biologics: a review
JAMA Oncol
Analysis of control arm quality in randomized clinical trials leading to anticancer drug approval by the US Food and Drug Administration
JAMA Oncol
Industry sponsorship and selection of comparators in randomized clinical trials
Eur J Clin Invest
Strength of study evidence examined by the FDA in premarket approval of cardiovascular devices
JAMA
Characteristics of clinical studies conducted over the total product life cycle of high-risk therapeutic medical devices receiving FDA premarket approval in 2010 and 2011
JAMA
Inclusion of comparative effectiveness data in high-risk cardiovascular device studies at the time of premarket approval
JAMA
The US Food and Drug Administration's expedited approval programs: evidentiary standards, regulatory trade-offs, and potential improvements
Clin Trials
Balancing early market access to new drugs with the need for benefit/risk data: a mounting dilemma
Nat Rev Drug Discov
Demands for access to new therapies: are there alternatives to accelerated access?
BMJ
The FDA's expedited programs and clinical development times for novel therapeutics, 2012–2016
JAMA
Trends in utilization of FDA expedited drug development and approval programs, 1987–2014: cohort study
BMJ
Nearly one-third of new drugs are no better than older drugs, and some are worse. Health Aff Blog. Oct 6, 2017
Efficacy, safety, and regulatory approval of food and drug administration-designated breakthrough and nonbreakthrough cancer medicines
J Clin Oncol
Safety related label changes for new drugs after approval in the US through expedited regulatory pathways: retrospective cohort study
BMJ
Cited by (51)
Using the phases of clinical development of medicines to describe clinical trials assessing other interventions is widespread but not useful
2023, Journal of Clinical EpidemiologyMarketing authorisation and pricing of FDA-approved cancer drugs in Brazil: a retrospective analysis
2023, The Lancet Regional Health - Americas