April 16, 2020: Why Randomized A vs B Comparisons Remain Uncommon in Clinical Trials

In an article published today in the New England Journal of Medicine, NIH Collaboratory investigators Drs. Greg Simon, Rich Platt, and Adrian Hernandez describe why it has been so challenging to meet the National Academy of Medicine’s 2020 goal for the development of a learning health system. If the goal had been met, 90% of clinical decisions would be based on accurate evidence gathered from health systems that continually learn from data collected as part of routine care.

Absent such evidence, the type of care provided is determined by the haphazard influences of financial incentives, clinicians’ anecdotal experiences, and patients’ or clinicians’ exposure to marketing messages. — Simon et al, New England Journal of Medicine, April 16, 2020

Most pragmatic trials, including the NIH Collaboratory Demonstration Projects and clinical trials conducted through the National Patient-Centered Clinical Research Network (PCORnet), have compared standard care with proposed improvements to standard care, or “A vs A-plus trials.” Trials that compare 2 alternative treatments that are in current use, or “A vs B trials,” are rarely done.

The authors describe both the barriers and the potential solutions for the development of more A vs B pragmatic clinical trials in pursuit of a learning health system.

“Achievement of the NAM’s goal of basing 90% of clinical decisions on accurate evidence remains distant, and meaningful progress will involve engagement by many parties,” write Simon and colleagues. “It will require health system leaders to consider rigorous evidence generation a core function of ordinary health care, research funders to prioritize practical questions relevant to population health and to support infrastructure for embedded research, research regulators to align consent procedures with incremental risks of research, and researchers to ask real-world questions that patients, caregivers, and clinicians want answered. But the first step is for everyone involved to honestly acknowledge the lack of evidence supporting the majority of common medical decisions and the urgent need for more relevant and efficient clinical research,” the authors continue.

The impetus for the article was an NIH Collaboratory workshop, Embedded Pragmatic Clinical Trials of Therapeutic A vs B Interventions. The workshop explored challenges and strategies for planning and implementing embedded pragmatic clinical trials that compare 2 or more therapeutic medical regimens.

The authors of the article are Adrian F. Hernandez, MD, MHS, professor of medicine and vice dean for clinical Research in the Duke University School of Medicine; Gregory E. Simon, MD, MPH, of the Kaiser Permanente Washington Health Research Institute; and Richard Platt, MD, MSc, of the Harvard Pilgrim Health Care Institute. All 3 institutions are part of the NIH Collaboratory Coordinating Center.

November 13, 2018: Summary of Workshop on Pragmatic Trials of Therapeutic A vs B Interventions Now Available

The NIH Collaboratory recently convened a workshop to explore embedded pragmatic clinical trials comparing two or more therapeutic medical interventions. These “A vs B” trials are meant to test existing, viable treatment alternatives where there is uncertainty about which treatment is best in which populations. There are unique barriers that make these types of pragmatic trials especially challenging to implement. For the workshop, a panel of experts gathered to discuss challenges and solutions regarding partnering with healthcare systems to conduct the trials, unique legal and ethical issues, and design and operational considerations. The summary of the workshop is now available: Workshop Summary: Embedded Pragmatic Clinical Trials of Therapeutic A vs. B Interventions

 

Additional Resources:

Embedded pragmatic clinical trials of therapeutic A vs. B interventions workshop videocast.

 

ePCTs of Therapeutic A vs. B Interventions: NIH-Hosted Workshop (May 2018)

May 16, 2018: This workshop explores challenges and strategies for planning and implementing ePCTs that compare two or more therapeutic medical regimens. Pragmatic trials differ from traditional clinical trials, as they test interventions or practices delivered in real-world settings. In addition to answering important clinical questions, ePCTs help to bridge the critical gap between clinical evidence, practice, and policy in healthcare delivery.

Agenda and Slides

Welcome and Introduction

David Shurtleff, PhD
Richard Hodes, MD
Catherine Meyers, MD
Wendy Weber, PhD, MPH

 

Panel 1: Partnering With Stakeholders to Conduct Embedded A vs. B Trials: Keys to Success

Moderator: Rich Platt, MD, MSc

Panel:

    • Steve Friedhoff, MD
    • Kenneth Sands, MD, MPH
    • Joseph Chin, MD

Panel 2: Examples in Action: Embedded A vs. B Trials

Moderator: Beverly Green, MD, MPH

Panel:

    • Ryan Ferguson, ScD, MPH
    • Susan Huang, MD, MPH
    • Michael Kappelman, MD, MPH

Panel 3: Maximizing the Pragmatic: Understanding Approaches to Design of Embedded A vs. B Trials

Moderator: Greg Simon, MD, MPH

Panel:

    • Scott Solomon, MD
    • Rachael Fleurence, PhD
    • Kourtney Davis, PhD, MSPH

Panel 4: Regulatory Aspects of Clinical Research and the Regulation of Products for Embedded A vs. B Pragmatic Trials

Moderator: Adrian Hernandez, MD

Panel:

    • Jacqueline Corrigan-Curay, MD, JD
    • Owen Faris, PhD
    • Julie Kaneshiro, MA

Panel 5: Ethical and IRB Approaches for a Successful Embedded A vs. B Pragmatic Trials Moderator:

Moderator: David Wendler, PhD

Panel:

    • Barbara Bierer, MD
    • Spencer Hey, PhD
    • Judith Carrithers, JD, MPA

Summary and Concluding Remarks

Moderator: Cathy Meyers, MD

Panel:

    • Adrian Hernandez, MD
    • Rich Platt, MD, MSc
    • Beverly Green, MD, MPH
    • Greg Simon, MD, MPH
    • Dave Wendler, PhD