May 3, 2019: Effect of Financial Bonus Sizes, Loss Aversion, and Increased Social Pressure on Physician Pay-for-Performance: A Randomized Trial and Cohort Study (Amol Navathe, MD, PhD)

Speaker

Amol S. Navathe, MD, PhD
Assistant Professor of Medicine and Health Policy
University of Pennsylvania

Topic

Effect of Financial Bonus Sizes, Loss Aversion, and Increased Social Pressure on Physician Pay-for-Performance: A Randomized Trial and Cohort Study

Keywords

Behavioral economics; Performance incentives; Evidence-based quality-of-care measures; Primary care quality; Pay for performance; Value-based medicine

Key Points

  • Pay-for-performance (P4P) programs are increasingly being used by health insurers and healthcare systems to incentivize physicians to practice higher value medicine, yet the evidence for P4P to affect quality and value of care remains mixed.
  • Behavioral economic principles in this study included increased social pressure and loss aversion added to larger bonus sizes to evaluate whether the intervention would lead to higher achievement of evidence-based quality measures.

Discussion Themes

Study findings included that, while a larger bonus size was associated with significantly improved quality for chronic care patients relative to a propensity-matched comparison group, adding increased social pressure and the opportunity for loss aversion did not lead to further quality improvement.

Attrition during the trial contributed some variability to the analysis.

Read more about pay for performance in healthcare in JAMA Network Open (Navathe et al, 2019) and NEJM Catalyst (2018).

Tags

#behavioraleconomics, #pctGR, @Collaboratory1

April 26, 2019: The VERITAS Trial: Virtual Exercise Rehabilitation at the Intersection of Evidence, Implementation, and Policy (Janet Prvu Bettger, ScD)

Speaker

Janet Prvu Bettger, ScD, FAHA
Associate Professor
Duke Department of Orthopaedic Surgery
Duke Clinical Research Institute

Topic

The VERITAS Trial: Virtual Exercise Rehabilitation at the Intersection of Evidence, Implementation, and Policy

Keywords

Rehabilitation; Virtual physical therapy; Patient outcomes; Physical therapy; Orthopaedic surgery; Total knee replacement; Digital technology; Telehealth

Key Points

  • The VERITAS trial evaluated the effects of physical therapy–supported virtual exercise compared with traditional home- or clinic-based physical therapy after total knee replacement. Outcome measures included 90-day health service use costs; patient-centered outcomes; and differential improvement from 6 weeks to 3 months.
  • The Center for Connected Health Policy found that while most states currently have established telehealth policies for primary care providers, these often do not include physical or occupational therapists.
  • Tele-rehabilitation facilitates communication between the patient and physical therapist in real time. The VERA™ technology provides a virtual physical therapist assistant for patients and clinicians, offering a digital interface that includes patient education, longitudinal functional assessments, telehealth video conferencing, personalized exercises, and remote monitoring of patient progress.

Discussion Themes

Study results support effectiveness and safety hypotheses: that tele-rehabilitation is noninferior to traditional physical therapy with respect to range of motion, walking speed, pain, or rehospitalization. However, it was not shown that the intervention is noninferior with respect to falls after hospital discharge.

Because virtual physical therapy interventions can save total costs, prevent readmissions, and improve mobility, it will be important to expand access to tele-rehabilitation and to advance policies that include physical therapists.

Read more about the VERITAS project and at ClinicalTrials.gov.

Tags

#telehealth, #pctGR, @Collaboratory1

March 29, 2019: ICD-Pieces: Lessons Learned in an Ongoing Trial (Miguel Vazquez, MD, George (Holt) Oliver, MD, PhD)

Speakers

Miguel A. Vazquez, MD
Professor of Medicine
Clinical Chief Nephrology Division
UT Southwestern Medical Center

George (Holt) Oliver, MD, PhD
Vice President Clinical Informatics
Parkland Center for Clinical Innovation

Topic

ICD-Pieces: Lessons Learned in an Ongoing Trial

Keywords

Multiple chronic conditions; Chronic kidney disease; Hypertension; Diabetes; Pieces™; Electronic health record; Parkland Center for Clinical Innovation; Primary care; U.S. Department of Veterans Affairs

Key Points

  • Improving Chronic Disease Management with Pieces™ (ICD-Pieces) is an NIH Collaboratory Demonstration Project that is implementing a novel technology platform (Pieces) to enable the use of electronic health record data in the management of chronic kidney disease, diabetes, and hypertension within primary care practices.
  • The aim of the study is to reduce hospitalizations, emergency department visits, readmissions, and cardiovascular events and deaths for patients with multiple chronic conditions.
  • ICD-Pieces is employing centralized clinical decision support across 4 large, diverse healthcare systems in addition to the use of Practice Facilitators within primary care.

Discussion Themes

In embedded pragmatic clinical trials conducted in real-world settings, it is important to anticipate changes over the course of the study, which could involve changes at every level, from staff turnover to changes in national policies or standards.

As one of the largest healthcare providers in the world for patients with chronic kidney disease, the VA has been an effective healthcare system partner in the ICD-Pieces trial.

When partnering with healthcare systems, it is important to align goals and plan together, minimize disruption, anticipate and adapt to changes, and create a sustainable foundation for future studies.

Learn more about ICD-Pieces on their website.

Tags

#pctGR, @Collaboratory1

March 5, 2019: New Living Textbook Section on Using Death as an Endpoint

Using death as an endpoint in pragmatic clinical trials is challenging because there are no standardized processes for ascertaining patient deaths in the United States. If a patient dies outside of a clinical care system, ascertaining if and how a death has occurred is considerably complicated. There are multiple sources of vital statistics data, each with different amounts of lag time, linking approaches, costs, and specificity of information. For example, some sources include cause of death while others include only fact of death; some have a lag time of a few months and some may take over a year; some charge by the individual file and some have an annual subscription fee.

This section of the Living Textbook describes different death data sources, how to obtain information from them, and the pros and cons of each.

“Death identification and adjudication may be more complicated with pragmatic clinical trials (PCTs) that rely on data collected from the patient’s electronic health record (EHR), medical claims, self-report, or medical devices.” —Eisenstein E, et al. Choosing and Specifying Endpoints and Outcomes: Using Death as an Endpoint. In: Rethinking Clinical Trials: A Living Textbook of Pragmatic Clinical Trials.

The sources of data described in this section include the Death Master File, the Medicare Master Beneficiary Summary File, state vital statistics, the Fact of Death File, the National Death Index, and call centers. The section also presents a case study to illustrate a hybrid death identification and verification approach used in the ToRsemide compArisoN with furoSemide FOR Management of Heart Failure (TRANSFORM-HF) PCT (ClinicalTrials.gov Identifier: NCT03296813).

 

February 21, 2019: Living Textbook Offers New Content on Design and Analysis of Pragmatic Clinical Trials

Members of the NIH Collaboratory’s Biostatistics and Study Design Core contributed 3 new sections to the Living Textbook exploring issues in the design and analysis of pragmatic clinical trials. The new sections offer insights into emerging issues in embedded pragmatic clinical trials and lessons learned from the NIH Collaboratory’s first round of Demonstration Projects.

  • The Designing to Avoid Identification Bias section addresses a type of selection bias that can occur in pragmatic clinical trials that use information from electronic health records to determine study population eligibility and in which the study intervention influences who undergoes screening or receives a diagnosis in clinical care.
  • The Alternative Cluster Randomized Designs section describes alternative design choices for cluster randomized trials and their implications for statistical power and sample size calculations. Modified cluster randomized designs, such as cluster randomization with crossover, may reduce the sample size required for a pragmatic clinical trial and may be particularly feasible in trials embedded in healthcare systems with electronic health records.
  • Case Study: STOP CRC Trial explores challenges in design and analysis that were faced in the Strategies and Opportunities to Stop Colorectal Cancer in Priority Populations (STOP CRC) trial, one of the NIH Collaboratory Demonstration Projects. The case study illustrates how the study team dealt with pragmatic issues during the planning and conduct of the trial.

In addition to contributing content to the Living Textbook, the Biostatistics and Study Design Core works with the NIH Collaboratory Demonstration Projects to address challenges in their statistical plans and study designs during the planning phase and to develop guidance and technical documents related to study design and biostatistical issues relevant to pragmatic clinical trials.

February 15, 2019: Improving Qualification of Investigators: Recommendations from the Clinical Trials Transformation Initiative (Christine M. Hildebrand, PA-C, Janette Panhuis)

Speakers

Christine M. Hildebrand, PA-C
Physician Assistant
Sub-Investigator
Clinical Operations Lead
Amici Clinical Research

Janette Panhuis
Chief Operating Officer
Population Health Research Institute
David Braley Research Institute

Topic

Improving Qualification of Investigators: Recommendations from the Clinical Trials Transformation Initiative

Keywords

CTTI; Investigator qualifications; Investigator training; Site team training; Good clinical practice; Clinical trials

Key Points

  • There is little evidence that good clinical practice (GCP) training alone sufficiently qualifies investigators in the conduct of clinical trials. What is needed is a targeted and risk-based approach to educating clinical trial investigators and their delegates in GCP principles.
  • A culture shift is needed that eliminates the distinction between “qualification” and “preparation” and moves toward investigators and their delegates assuming greater ownership of training and documenting evidence of their qualification.
  • CTTI recommendations outline how to confirm that site teams are qualified while also reducing inefficiencies in training and increasing preparation for successful study execution.

Discussion Themes

Investigators and site teams come to the table with different levels of research experience, training, and credentials. How can we effectively address gaps in skills and knowledge of GCP principles?

With respect to pragmatic trials conducted within healthcare systems, are there approaches to site monitoring that address issues related to turnover of PIs and clinical and research staff?

Greater ownership of GCP training and qualification by investigators and delegates can lead to active remediation of deficiencies at the clinical site.

CTTI recommendations are meant to be adaptable to the protocol, even when conducted in a real-world clinical setting using electronic health records.

For recommendations and tools for improving investigator qualification, visit CTTI’s Investigator Qualification website.

Tags

#ClinicalTrials, #GCPtraining, #pctGR, @Collaboratory1 @CTTI_Trials

January 22, 2019: New Self-Paced ePCT Training Course Available

The NIH Collaboratory is pleased to announce the availability of a new self-paced, 10-module introductory course on how to design, conduct, and disseminate embedded PCTs (ePCTs). This course presents condensed material from the inaugural ePCT Training Workshop held in 2018 and provides users with important things to know and do when designing an ePCT, along with helpful links to additional learning resources within the Living Textbook.

Also available in the Living Textbook are links to videocast workshops hosted by the NIH on a range of ePCT topics including:

  • Embedded PCTs of therapeutic A versus B interventions
  • Unique opportunities for disseminating, implementing, and sustaining evidence-based practices into clinical care
  • Ethical and regulatory issues of PCTs

For these and other ePCT resources, visit the Training Resources webpage.

January 4, 2019: TRANSFORMing Research for Patients With Heart Failure (Robert Mentz, MD, Kevin Anstrom, PhD, Eric Eisenstein, DBA, Stephen Greene, MD, Eric Velazquez, MD)

Speakers

Robert J. Mentz, MD
Associate Professor of Medicine
Duke University School of Medicine

Kevin J. Anstrom, PhD
Professor of Biostatistics and Bioinformatics
Director of Biostatistics, Duke Clinical Research Institute
Duke University School of Medicine

Eric Eisenstein, DBA
Associate Professor in Medicine
Duke University School of Medicine

Stephen J. Greene, MD
Fellow, Division of Cardiology and Duke Clinical Research Institute
Duke University School of Medicine

Eric J. Velazquez. MD, FACP, FACC, FASE, FAHA
Robert W. Berliner Professor of Medicine, Yale University
Chief, Cardiovascular Medicine, Yale New Haven Hospital
Physician-in-Chief, Heart and Vascular Center, Yale New Haven Health

Topic

TRANSFORMing Research for Patients With Heart Failure

Keywords

Pragmatic clinical trial; Heart failure; PRECIS-2; Hospitalization; TRANSFORM-HF; Clinical equipoise; Electronic health records; National Heart, Lung, and Blood Institute (NHLBI)

Key Points

  • The traditional approach to conducting clinical trials is unsustainable in many respects, including operational complexities, low enrollment rates, high costs, and failure to leverage existing resources. Incorporating pragmatic elements in the design of trials may improve efficiencies and conduct.
  • TRANSFORM-HF is a pragmatic trial evaluating torsemide versus furosemide treatment for long-term clinical outcomes among patients hospitalized for heart failure. Study randomization is 1:1, and the primary endpoint is all-cause mortality.
  • Advantages of trials with pragmatic designs include real-world effectiveness; broad patient/provider groups; reduced number and complexity of visits; streamlined data collection; potential for faster results; and results that will be more generalizable.

Discussion Themes

The clinical question involving starting a treatment (Should we start with furosemide or torsemide?) versus switching a treatment (Should we attempt to switch patients from furosemide to torsemide?) would seem to lead to different study designs.

While the peer review process for funding TRANSFORM-HF was challenging and required modifying the approach, it ultimately led to a better design.

Read more about PRECIS-2 domains along the explanatory-pragmatic continuum of a clinical trial in the Living Textbook.

Tags

#HeartFailure, #pctGR, @Collaboratory1, @robmentz, @SJGreene_md, @YaleCardiology, @ericjvelazquez

November 12, 2018: Participate in the NIH Office of Disease Prevention’s Research Expertise Survey

The National Institutes of Health (NIH) Office of Disease Prevention (ODP) needs your help to enhance the quality of research supported by the NIH. The ODP is building a directory of experts in research methods and study designs that can help NIH Scientific Review Officers identify the most appropriate reviewers for NIH research applications. Adding your name and expertise to the directory is easy – simply share your methodological and content area expertise by filling out the ODP’s Prevention Research Expertise Survey (PRES).


 

The survey covers 7 areas related (but not limited) to prevention research:

  • Study Design Topics
  • Research Methods
  • Content Topics
  • Settings
  • Populations
  • Regions
  • Income Categories

The PRES takes approximately 15-25 minutes and is strictly voluntary. Based on your skill set and interest, NIH or Department of Health and Human Services (HHS) staff may invite you to serve as a peer reviewer for research applications, or you may be asked to sit on a panel, committee, or workgroup; or to speak at a seminar or workshop. Your responses and information will not be shared with anyone outside of HHS.

The ODP believes the participation of highly qualified methods experts will enhance the quality of peer review; improve the rigor, reproducibility, and impact of research supported by the NIH; and ultimately lead to stronger clinical practice, health policy, and community health programs.

The ODP is the lead office at the NIH responsible for assessing, facilitating, and stimulating research in disease prevention and disseminating the results of this research to improve public health. For more information about the ODP and its work, visit the ODP website.

Thank you in advance for taking the survey – your participation helps improve the rigor, impact, and value of research supported by the NIH.