May 14, 2025: New Living Textbook Chapter Provides Guidance for Investigators Facing Tough Decisions After a Trial Ends

Icon for the Health Care Systems Interactions CorePragmatic clinical trials embedded in healthcare systems rely on partnerships between investigators and healthcare system leaders to conduct research. As the end of a pragmatic trial approaches, research teams and their partners often face uncertainties around this undefined phase when researchers are waiting on results. End-of-trial decision-making, including whether to sustain an intervention, has implications for research teams, healthcare systems, and patients.

A new chapter of the Living Textbook of Pragmatic Clinical Trials, published this week, describes the challenges investigators face during this common period of ambiguity and offers considerations for decision-making that honors researchers’ responsibilities and fosters ongoing collaboration with healthcare system partners while awaiting trial results:

  • Section 1 introduces possible trial outcomes and describes the intersection of posttrial responsibilities, sustainment, and deimplementation.
  • Section 2 provides case studies describing how research teams from 3 NIH Collaboratory Trials approached end-of-trial decision-making.
  • Section 3 focuses on considerations for investigators and an end-of-trial decision-making framework.
  • Section 4 provides approaches that investigators might take to support research teams and healthcare system partners as they navigate the last part of a trial, before outcomes are known.

The chapter was developed by members of the NIH Pragmatic Trials Collaboratory’s Health Care Systems Interactions Core.

November 28, 2023: Workshop Summary Now Available From ‘Getting the Right Evidence to Decision-Makers Faster’

The workshop summary is now available from the NIH Pragmatic Trials Collaboratory’s recent workshop, “Getting the Right Evidence to Decision-Makers Faster.” The 2-day workshop explored the critical cycle of evidence generation by researchers to decision-making by healthcare system leaders to implement the findings of pragmatic clinical trials conducted within healthcare systems.

The workshop included 4 panels:

  • Panel 1: How Have Health Systems Made Decisions Based on Evidence Collected in PCTs?

    • Panelists: Devon Check, Vincent Mor, Lynn DeBar, Kathryn Glassberg, Douglas Zatzick, Eileen Bulger, Susan Huang, Kenneth Sands, Edward Septimus; Moderator: Gregory Simon
  • Panel 2: How Do We Generate the Right Evidence to Support Decision-Makers?

    • Panelists: Kenneth Sands, Eileen Bulger, Edward Septimus, Amy Kilbourne, Rosa Gonzalez-Guarda, Patrick Heagerty; Moderator: Hayden Bosworth
  • Panel 3: Learning Faster

    • Panelists: Gloria Coronado, Natalia Morone, Corita Grudzen, Kevin Chan, Pearl O’Rourke, Cheryl Boyce, Andrea Cook; Moderator: Kevin Weinfurt
  • Panel 4: Potential Structures and Incentives for Faster Learning

    • Panelists: David Chambers, Wynne Norton, Tisha Wiley, Kenneth Sands, Edward Septimus, Gloria Coronado, Natalia Morone, Corita Grudzen; Moderator: Richard Platt

Access the complete workshop materials, including slides and videocast recordings, as well as the keynote presentation by Andrew Bindman, executive vice president and chief medical officer for Kaiser Permanente.

Photo of Greg Simon

Swimming with the Sharks: Translation of Pragmatic Trial Results

Swimming with the Sharks: Translation of Pragmatic Trial Results

Description

To illustrate the importance of health system leader engagement, we gathered healthcare systems leaders for a panel modeled after the Shark Tank TV show. In the video, Dr. Greg Simon is tasked with convincing healthcare system leadership to invest in implementing the intervention from the Suicide Prevention Outreach Trial (SPOT).

Biography

Photo of Greg SimonGregory Simon, MD, MPH
Senior Investigator, Kaiser Permanente Washington Health Research Institute
SPOT NIH Collaboratory Trial PI
Health Care Systems Interactions Core Chair

Related

Deciding Who to Engage

View more content from the Disseminating, Implementing, and Sustaining Evidence-Based Practices into Clinical Care: NIH-Hosted Workshop.

Patient-Centered Outcomes Research: Approaches for Patient and Community Engagement

Patient-Centered Outcomes Research: Approaches for Patient and Community Engagement

Description

The Patient-Centered Outcomes Institute (PCORI) is an independent, non-profit research organization dedicated to funding real-world questions that will inform patients and other health care stakeholders. In this video, Dr. Anne Trontell, Associate Director of PCORI, shares the importance of early and continuous investment in engaging patients, stakeholders, and communities.

Speaker

Anne Trontell, MD, MPH
Associate Director in the Clinical Effectiveness and Decision Science Program
Patient-Centered Outcomes Research Institute

 

Related

Building Partnerships and Teams to Ensure a Successful Trial

Steven George, PT, PhD

Implementation and Intervention Complexity in Pragmatic Clinical Trials

Implementation and Intervention Complexity in Pragmatic Clinical Trials

Description

In this interview, Dr. Stephen George discusses how complexity can change as you work in partnership with the people who will be implementing the intervention. The complexity of an intervention has to be simple enough to be feasible in the context of the research setting.

Biography

Steven George, PT, PhDSteven George, PhD
Professor in Orthopaedic Surgery, Duke University

 

 

Related Content

Living Textbook: Intervention Delivery and Complexity

Read our news and view the full presentation.

Headshot of Dr. Julie Fritz

Reaching Rural Populations: BeatPain Utah

Reaching Rural Populations: BeatPain Utah

Description

Long-term solutions to disparities in health will involve focused partnerships and community engagement. In this video, the BeatPain Utah team shares their strategies for reaching and enrolling rural and frontier populations. Key characteristics of good partnerships are shared goals, mutual respect of expertise, and shared resources and data.

Speakers

Julie Fritz, PhD, PTHeadshot of Dr. Julie Fritz
Associate Dean for Research College of Health, School of Medicine, University of Utah
BeatPain Utah NIH Collaboratory Trial PI

David Wetter, PhD
Interim Chief, Division of Health System Innovation & Research, University of Utah

Related

Participant Recruitment

Community-Based Participatory Research Practices in the GRACE Trial

Community-Based Participatory Research Practices in the GRACE Trial

Description

Building trust in communities is critical for long-term partnerships between patients and researchers. In this video, Dr. Judith Schlaeger, Co-PI of the GRACE Trial, describes her team's efforts to engage patients and community-based organizations.

Biography

Headshot of Dr. Judith Schlaeger

Judith Schlaeger, PhD, CNM, LAc, FACNM, FAAN
Associate Professor, University of Illinois Chicago
GRACE NIH Collaboratory Trial co-PI

 

Related

Deciding Who to Engage

View the full Grand Rounds video

Ensuring Participant Representativeness: STOP CRC

Ensuring Participant Representativeness: STOP CRC

Description

The STOP CRC trial investigators deployed many strategies to ensure the inclusion of all populations in their trial, including piloting the trial, refining the materials based on patient feedback, assembling an advisory board, and conducting plan-do-study-act cycles at the sites. This video describes their experiences with building partnerships throughout this process.

Biography

Amanda Petrik, PhD
Kaiser Permanente Center for Health Research

Gloria Coronado, PhD
Kaiser Permanente Center for Health Research
STOP CRC NIH Collaboratory Trial co-PI

Related

Participant Recruitment

View the full Grand Rounds video

Photo of Greg Simon

Engaging With Stakeholders in Pragmatic Clinical Trials

Engaging With Stakeholders in Pragmatic Clinical Trials

Description

In this video, Dr. Greg Simon shares how to engage with a range of stakeholders, both early and throughout the process of pragmatic clinical trials. Stakeholders at the local site will have practical advice about how to get the research done, and healthcare system leaders may be more interested in the value added by the research.

Speaker

Gregory Simon, MD, MPH
Senior Investigator, Kaiser Permanente Washington Health Research Institiute
SPOT NIH Collaboratory Trial PI
Health Care Systems Interactions Core Chair
Coordinating Center Leadership

Related

Embedded ePCT Team Composition

Building a Study Team for a Pragmatic Clinical Trial

Building a Study Team for a Pragmatic Clinical Trial

Description

Embedded pragmatic clinical trials require many different kinds of expertise, from the PI and Co-PI and biostatisticians to research assistants, communications specialists and more. It is important to recruit the team before all of the decisions are made and to keep the team engaged for the duration of the trial. This video offers strategies for building your team.

Speaker

Lesley Curtis, PhDHeadshot of Dr. Lesley Curtis
Professor of Population Health Sciences and Medicine, Duke University
Duke Clinical Research Institute
Collaboratory Steering Committee Chair

Related

Building Partnerships and Teams to Ensure a Successful Trial