Which PCTs Should Have a DMC?

Data and Safety Monitoring


Section 2


Which PCTs Should Have a DMC?

Contributors

Susan Ellenberg, PhD

Jeremy Sugarman, MD, MPH, MA

Doug Zatzick, MD

 

Contributing Editor

Gina Uhlenbrauck

Liz Wing, MA

While FDA regulations require sponsors to monitor their trials, there are different ways this can be accomplished. One method is an independent DMC, sometimes also referred to as a Data and Safety Monitoring Board (DSMB). These committees are independent of the trial sponsor and investigators; they should have no vested interest in the trial or its outcome. Current U.S. Food and Drug Administration (FDA) regulations impose no requirements for the use of DMCs except for research studies conducted in emergency settings in which the requirement for informed consent has been waived (21 CFR 50.24(a)(7)(iv)). Funding agencies impose broader requirements, as discussed later.

FDA guidance advises considering the following when determining whether a study warrants using a DMC:

  • Is it a large, multicenter study of long duration?
  • Is the study endpoint such that a finding at interim analysis might ethically require termination of the study before its planned completion?
  • Are there a priori reasons for a particular safety concern (e.g., particularly invasive treatment?)
  • Is there prior information suggesting the potential for serious toxicity due to the study treatment?
  • Is the study being performed in potentially fragile or vulnerable populations (e.g., children, pregnant women, very elderly, terminally ill, those with diminished mental capacity)?
  • Is the study being performed in a population at elevated risk of death or other serious outcomes, even when the study objective addresses a less serious endpoint?

If a study has one or more of these characteristics, the FDA recommends that sponsors consider the use of a DMC to further protect study participants.

Additional considerations include whether review by a DMC is practical (e.g., due to study length) and whether a DMC can help ensure the scientific validity of a trial. Examples of studies that may not need a DMC include short-term studies where a DMC is unlikely to have the opportunity to make a difference and studies with less serious outcomes (e.g., symptom relief) in which early termination is unlikely to be appropriate. As many PCTs will be large, multicenter studies with serious clinical outcomes, it is likely that most of these will warrant use of a DMC (Ellenberg et al. 2015).

Research sponsors may have their own policies outlining the type of data monitoring required and which studies must have a DMC. For example:

  • NIH policy requires most NIH-funded randomized trials to have a DMC if they are multicenter and pose any material risk to participants.
  • PCORI policy states that a DMC should be appointed if required by the IRB, regulatory agency, or determined appropriate “after considering factors such as potential risks; target study subject population, nature, and size; and the research project’s scope and complexity.”

PCT investigators should work with their sponsor(s) to to implement an appropriate data monitoring plan for the study and determine whether a DMC will be used. The NIH Collaboratory has made available brief descriptions of the data monitoring plans for all NIH Collaboratory Demonstration Projects as part of the publicly available ethical and regulatory descriptions for these trials. The data monitoring details are excerpted in the table below. Not all NIH Collaboratory Demonstration Projects use an independent DMC, but all have a data monitoring plan that was discussed with the NIH sponsor and determined to be in compliance with their policies. More details on data monitoring for some of these trials will be explored throughout the chapter.

 

Data Monitoring Plans Used in NIH Collaboratory Demonstration Projects

Demonstration Project Minimal risk? Uses a DMC? Monitoring plan
ABATE Infection Yes No The sponsor approved the trial’s data monitoring plan, and study-related event forms were distributed to all participating sites.
ACP PEACE Yes Yes Currently in the UG3 planning phase, the study plans to establish a DSMB that will include a biostatistician and researchers with expertise in geriatrics, oncology, advance care planning, and cluster trial design. Three DSMB members will review the protocol and identify any safety issues every 6 months.
EMBED Yes No Currently in the UG3 planning phase, the study plans to have an independent study monitor.
GGC4H Yes No Currently in the UG3 planning phase, the study plans to establish an institutional monitoring committee of experts that will meet twice yearly to review.
HiLo No Yes Currently in the UG3 planning phase, the study plans to convene an independent DSMB.
ICD-Pieces Yes Yes The study team tracked safety events, including the primary outcome (all-cause unplanned hospitalization), secondary outcomes (cardiovascular events, emergency department visits, and death), and safety events that are possible outcomes of the interventions (such as hypotension and hyperkalemia). The team regularly informs the DMC of these safety events. There are no plans for a formal interim analysis. The study team tracks the primary outcome rates by healthcare system and reports these to the sponsor and DMC quarterly. The study team and the NIH will review the intraclass correlation coefficient and recruitment goals based on the most updated data.
LIRE Yes No Two safety officers reviewed study data at regular intervals for any safety concerns. Safety endpoints are emergency department visits within 90 days of index image and death within 6 months
Nudge Yes Yes Currently in the UG3 planning phase, the study will convene a protocol review committee as a preliminary step before establishing an independent DSMB for the UH3 phase. Data monitoring plans are in place in each healthcare system to ensure accurate retrieval and storage behind appropriate firewalls.
PPACT Yes No An independent monitor identified by the study team and sponsor reviewed subject accrual, serious adverse events, and clinician/patient compliance with treatment every 6 months.
PRIM-ER Yes No Currently in the UG3 planning phase, the study has a data and safety monitoring plan that will draw on input from 3 experts with experience in palliative care research.
PROVEN Yes Yes The study team prepared formal data reports for the DMC biannual meetings, as well as ad hoc reports as requested. The statisticians are able to review unblinded interim data, but the PIs remain blinded.
SPOT Yes Yes Negotiating the terms and procedures for DMC monitoring was a major barrier leading to significant delay and extra expense.
STOP CRC Yes No The trial’s safety monitoring plan consisted of semi-annual review of study progress and adverse events by two independent monitors (a statistician and a gastroenterologist) who were approved by the sponsor.
TiME Yes Yes The DMC had the authority to make formal recommendations to the sponsor about early termination of the trial for futility, efficacy, or safety.
TSOS Yes Yes Outcomes monitored included adverse events (medication side effects, death), suicidality, loss to follow-up, and demographics.

Source: Demonstration Project ethics and regulatory documentation. For more information on the Demonstration Projects, including study population and primary outcome, see the Demonstration Projects table in the What Is a Pragmatic Clinical Trial chapter.

 

In sections that follow, we review special considerations for data monitoring in PCTs, including monitoring protocol adherence when information on “real-world” use is desired, issues associated with use of EHR data such as data quality and timeliness, complexities of monitoring adverse events in PCTs, whether PCTs should ever be stopped early due to futility, and any particular perspectives or expertise that may be useful on a DMC charged with monitoring PCTs.

SECTIONS

CHAPTER SECTIONS

REFERENCES

back to top

Ellenberg SS, Culbertson R, Gillen DL, Goodman S, Schrandt S, Zirkle M. 2015. Data monitoring committees for pragmatic clinical trials. Clin Trials. 12:530–536. doi:10.1177/1740774515597697.


Version History

December 13, 2018: Updated FDA guidance link; added the DMC plans for six new UG3 Demonstration Projects to the table; updated text as part of annual content update (changes made by L. Wing).

Published August 25, 2017

Citation:

Ellenberg S, Sugarman J, Zatzick D. Data and Safety Monitoring: Which PCTs Should Have a DMC?. In: Rethinking Clinical Trials: A Living Textbook of Pragmatic Clinical Trials. Bethesda, MD: NIH Health Care Systems Research Collaboratory. Available at: https://rethinkingclinicaltrials.org/chapters/design/planning-data-safety-monitoring/which-pcts-should-have-a-dmc/. Updated May 21, 2019. DOI: 10.28929/040.