June 4, 2018: New Article Explores Misleading Use of the Label “Pragmatic” for Some Randomized Clinical Trials

A recent study published in BMC Medicine found that many randomized controlled trials (RCTs) self-labeled as “pragmatic” were actually explanatory in nature, in that they assessed investigational medicines compared with placebo to test efficacy before licensing. Of the RCTs studied, one-third were pre-licensing, single-center, or placebo-controlled trials and thus not appropriately described as pragmatic.

Appropriately describing the design and characteristics of a pragmatic trial helps readers understand the trial’s relevance for real-world practice. The authors explain that RCTs suitably termed pragmatic compare the effectiveness of 2 available medicines or interventions prescribed in routine clinical care. The purpose of such pragmatic RCTs is to provide real-world evidence for which interventions should be recommended or prioritized.

The authors recommend that investigators use a standard tool, such as the CONSORT Pragmatic Trials extension or the PRECIS-2 tool, to prospectively evaluate the pragmatic characteristics of their RCTs. Use of these tools can also assist funders, ethics committees, and journal editors in determining whether an RCT has been accurately labeled as pragmatic.

The BMC Medicine article cites NIH Collaboratory publications by Ali et al. and Johnson et al., as well as the Living Textbook, in its discussion of pragmatic RCTs and the tools available to assess their relevance for real-world practice.

“Submissions of RCTs to funders, research ethics committees, and peer-reviewed journals should include a PRECIS-2 tool assessment done by the trial investigators. Clarity and accuracy on the extent to which an RCT is pragmatic will help [to] understand how much it is relevant to real-world practice.” (Dal-Ré et al. 2018)

December 7, 2017: Dr. Greg Simon Explains Individual, Cluster, and Stepped-Wedge Randomization in a New Prop Video

In a new video in the Living Textbook, Dr. Greg Simon describes the differences between individual, cluster, and stepped-wedge randomization using props, including marbles, Play-Doh, and glassware.

“In the end, it’s all about randomly assigning who gets which treatment, or who gets which treatment when, so that we’re able to make some un-biased judgement about which treatment is really better.” —Greg Simon, MD

NIH & FDA seek feedback on new clinical trial protocol template


As part of their ongoing effort to improve the speed and efficiency of conducting clinical trials, the NIH-FDA Joint Leadership Council has created a draft clinical trial protocol template. The template contains instructional and sample text intended to assist NIH-funded investigators in writing protocols for phase 2 or 3 clinical trials that require Investigational New Drug (IND) or Investigational Device Exemption (IDE) applications. Feedback is sought from investigators, investigator-sponsors, institutional review board members, and other stakeholders involved in protocol development and review.

Our goal is to provide an organized way for creative investigators to describe their plans so that others can understand them. – Dr. Pamela McInnes, NIH

Details on the rationale and development of the protocol template are on these blog posts:

Notice Number: NOT-OD-16-043. Responses accepted through April 17, 2016.

You can access the template document as well as a template shell, comment form, and other resources at NIH’s Clinical Research Policy website.

Active Bathing to Eliminate (ABATE) Infection Trial Completes Intervention Phase

The Active Bathing to Eliminate (ABATE) Infection trial (ClinicalTrials.gov #NCT02063867) has completed its intervention phase—the first NIH Health Care Systems Research Collaboratory UH3 Demonstration Project to reach this major milestone. The large-scale, cluster-randomized pragmatic clinical trial (PCT) was designed to assess an approach for reducing multidrug-resistant organisms and hospital-associated infections (HAIs) in nearly 200 non-critical care hospital units affiliated with Hospital Corporation of America (HCA) across the United States.

Susan Huang, MD, MPH
ABATE study PI Dr. Susan Huang

The ABATE study is led by principal investigator Dr. Susan Huang of the University of California, Irvine, who stated “We are elated to reach the successful completion of the trial thanks to an incredible investigative team at HCA, Harvard Pilgrim Health Care, Rush University, the University of Massachusetts Amherst, and UC Irvine. We look forward to what the trial data will tell us and hope that we can continue to find effective ways to protect patients from infection.”

In the ABATE study, patients hospitalized in non-critical care units were bathed either according to the hospital unit’s usual care procedures (the control group) or bathed with the topical antibacterial agent chlorhexidine (plus nasal administration of the antibiotic mupirocin for those patients who were colonized or infected with, or had a history of methicillin-resistant Staphylococcus aureus [MRSA] [the intervention group]). The study investigators will compare the number of unit-attributable, multidrug-resistant organisms in clinical cultures between the study arms; these organisms include vancomycin-resistant enterococci (VRE), MRSA, and gram-negative bacteria. In addition, the investigators will compare the number of unit-attributable infections in the bloodstream and urinary tract (all pathogens) and Clostridium difficile infections. Cultures were collected at baseline and post intervention and will be assessed to determine whether resistance emerged to decolonization products.


“We are elated to reach the successful completion of the trial thanks to an incredible investigative team at HCA, Harvard Pilgrim Health Care, Rush University, the University of Massachusetts Amherst, and UC Irvine.We look forward to what the trial data will tell us and hope that we can continue to find effective ways to protect patients from infection.”


Healthcare-associated infections caused by common bacteria, including MRSA and VRE, are a leading cause of preventable illness and death in the United States and are associated with upward of $6.5 billion in annual healthcare costs. Although these bacteria normally live on the skin or in the nose, under certain circumstances they can cause serious or even life-threatening infections. Hospitalized patients who are ill or who have weakened immune systems are especially at risk for such infections. Because these pathogens are resistant to many antibiotics, they can be difficult to treat.

In intensive care units (ICUs), reducing the amount of such bacteria (a process referred to as decolonization) by treating patients’ skin with chlorhexidine and their noses with mupirocin ointment has been shown to reduce MRSA infections and all-cause bacteremias. However, relatively little is known about the effects of decolonization in hospital settings outside of critical care units, although this is where the majority of such infections occur. The ABATE trial, in contrast, is testing its bathing and decolonization strategy in adult medical, surgical, oncology, and step-down units (pediatric, psychology, peri-partum, and bone marrow transplantation units were excluded).

Over the course of the study, more than a million showers and baths were taken, and all sites have completed the intervention. The next steps for the ABATE investigators are to finish strain collection over the coming weeks, and then clean, validate, and analyze the data over the coming months.


Resources: NIH Health Care Systems Collaboratory Demonstration Project. Active Bathing to Eliminate (ABATE) Infection trial. 2014. Available at: https://www.nihcollaboratory.org/demonstration-projects/Pages/ABATE.aspx. Accessed February 2, 2015.

Huang SS, Septimus E, Moody J, et al. Randomized Evaluation of Decolonization vs. Universal Clearance to Eliminate Methicillin-Resistant Staphylococcus aureus in ICUs (REDUCE MRSA Trial). 2012. Available at: https://idsa.confex.com/idsa/2012/webprogram/Paper36049.html. Accessed December 15, 1024.

Huang SS, Septimus E, Kleinman K, et al. Targeted versus universal decolonization to prevent ICU infection. N Engl J Med 2013;368:2255–2265. PMID: 23718152. doi: 10.1056/NEJMoa1207290.

PCORnet Posts Aspirin Study Protocol for Public Review and Comment


PCORnetThe National Patient-Centered Clinical Research Network (PCORnet) has recently made a draft protocol for its first randomized clinical trial available for stakeholder review. Researchers, clinicians, patients and the public are all invited to read the current draft of the study protocol and provide comments and feedback.

The ADAPTABLE Study (PDF), which will investigate whether lower- or higher-dose aspirin is better for preventing heart attack and stroke in patients at risk for heart disease, is PCORnet’s first randomized pragmatic clinical trial. Designed to leverage PCORnet’s Clinical Data Research Networks (CDRNs) and Patient-Powered Research Networks (PPRNs), the trial will serve as twofold purpose: answering a clinical question of direct importance for patients, families, and healthcare providers, and serving as a demonstration of PCORnet’s capabilities in conducting clinical research on a national scale.

Links to the proposed study protocol, a survey tool for capturing feedback, and other information about ADAPTABLE Study, including press releases, fact sheets, and infographics, are available at the link below:

ADAPTABLE: The Aspirin Study

Follow PCORnet on Twitter @PCORnetwork for updates on the ADAPTABLE #ClinicalTrial


Groundbreaking Suicide Prevention Trial has Enrolled Initial Patients

March 5, 2015

Dr. Greg Simon and the Suicide Prevention Team have enrolled the first participants in the Pragmatic Trial of Population-Based Programs to Prevent Suicide Attempt. This groundbreaking study was developed by researchers at Group Health Cooperative in Seattle, Washington, Health Partners Medical Group in Minnesota, and Kaiser Permanente of Colorado, in collaboration with patients who have experienced suicidal thoughts or survived suicide attempts themselves.

Over 9 million adults in the United States experience suicidal thoughts, and more than 1 million adults attempt suicide each year. However, patients at risk for suicidal behavior are not routinely identified, and successful interventions for depression and suicide are not routinely implemented. New evidence suggests that patients who report frequent thoughts of death or self-harm on a commonly-used depression questionnaire are at higher risk for suicide attempt and death over the following year.

This study aims to address the significant problem of suicide by identifying patients who are at risk for suicidal behavior and testing two suicide prevention strategies. Patients at participating institutions will complete a standard depression severity questionnaire during routine clinical care, and the results will be stored in their electronic health records (EHR). Investigators will use the responses in the EHR to identify at-risk individuals, and once identified, the patients will be randomly assigned to either usual care or to two treatment programs. The first is a collaborative care-management approach; the second is an online skills training program called “Now Matters Now,” which is designed to help people manage painful emotions and stressful situations.

Over the next 5 years, the team plans to enroll 19,500 adult patients. The study is an NIH Collaboratory Demonstration Project being overseen by the National Institute of Mental Health (NIMH).

Congratulations to Dr. Simon and his team for their achievement!

 

Surprises in a Randomized Trial: The Oregon Health Study


A recent article appearing on the New York Times blog The Upshot describes some unexpected findings from a randomized controlled experiment that evaluated the costs and benefits of an expansion of public health insurance. In 2008, the state of Oregon began a limited expansion of Medicaid benefits for uninsured, low-income adults. By way of a lottery and waiting list, the state chose some low-income residents to apply for Medicaid while others remained uninsured. The Oregon Health Insurance Experiment made use of this random assignment to study the effects of Medicaid on health care use, health outcomes, financial strain, and well-being among low-income adults. For 2 years, the researchers used an in-person data-collection protocol to assess a wide variety of outcomes. Among the unexpected findings:

Patients who got insurance used the emergency room more often than their uninsured peers, undermining a common argument in favor of expanded insurance coverage.

People who got Medicaid also had a much easier time finding doctors, countering views held by the programs’ critics that Medicaid can be worse than no insurance.

According to the study authors’ conclusions published in the New England Journal of Medicine, “Medicaid coverage yielded no significant improvements in measured physical health outcomes in the first 2 years, but it did increase use of health care services, raise rates of diabetes detection and management, lower rates of depression, and reduce financial strain.” Other study analyses are published in Science, among other journals.