Getting the Right Evidence to Decision-Makers Faster: Insights From the NIH Pragmatic Trials Collaboratory: NIH-Hosted Workshop (June 2023)

June 20-21, 2023: This two-day workshop explores the critical cycle of evidence generation to decision by health system leaders to implement the findings of pragmatic clinical trials (PCTs) conducted within health care systems.

Agenda and Slides

Day 1: June 20

Welcome and Introduction

Wendy Weber, ND, PhD, MPH

Keynote: Learning Health Systems: Reflections from the C-Suite

Andrew B. Bindman, MD

Session 1: How Have Health Systems Made Decisions Based on Evidence Collected in PCTs?

Review of Collaboratory Experience
Devon Check, PhD

Moderator: Gregory Simon, MD, MPH

Panel:

Session 2: How Do We Generate the Right Evidence to Support Decision-Makers?

Moderator: Hayden Bosworth, PhD

Panel:

Summary and Concluding Remarks

Wendy Weber, ND, PhD, MPH
Richard Platt, MD, MSc
Gregory Simon, MD, MPH
Hayden Bosworth, PhD

 

Day 2: June 21

Welcome and Introduction

Wendy Weber, ND, PhD, MPH

Session 3: Learning Faster

Moderator/Speaker: Kevin Weinfurt, PhD

Panel:

Session 4: Potential Structures and Incentives for Faster Learning

Moderator: Richard Platt, MD, MSc

Panel:

  • David Chambers, DPhil
  • Wynne Norton, PhD
  • Tisha Wiley, MD

Respondents:

  • Kenneth Sands, MD
  • Edward Septimus, MD
  • Gloria Coronado, PhD
  • Natalia Morone, MD, MS
  • Corita Grudzen, MD, MSHS

Summary and Concluding Remarks

Wendy Weber, MD, PhD, MPH
Kevin Weinfurt, PhD
Richard Platt, MD, MSc

 

May 8, 2023: Pragmatic Trials Workshop Offered at AcademyHealth Conference

Logo for AcademyHealthThe NIH Pragmatic Trials Collaboratory is partnering with AcademyHealth to offer a 1.5-day preconference workshop at the 2023 Annual Research Meeting in Seattle, Washington.

The workshop, “Driving Tomorrow’s Outcomes Through Clinical Research in Real-World Settings,” will cover the essentials of embedded healthcare systems research, along with strategies for conducting clinical trials that provide real-world evidence necessary to inform both practice and policy. Attendees will participate in facilitated, hands-on learning activities and interact with principal investigators of pragmatic clinical trials embedded in healthcare systems, including NIH Collaboratory Trials.

Firsthand experiences and case studies from the NIH Collaboratory will support and illustrate the topics presented and demonstrate how pragmatic trials embedded in real-world settings are driving tomorrow’s outcomes. Speakers will include program officers and senior staff from NIH Institutes, Centers, and Offices and senior investigators from the NIH Collaboratory Trials and the Coordinating Center leadership.

The learning objectives of the workshop include:

  • To clarify the definition of embedded pragmatic clinical trials and explain their utility.
  • To introduce attendees to the unique characteristics and challenges of designing, conducting, and implementing these trials within diverse healthcare systems.
  • To increase the capacity of health services researchers to address important clinical questions with pragmatic trials in real-world settings, driving tomorrow’s research outcomes.

Workshop details and registration
Friday, June 23, 2023, 8:15 a.m.-4:25 p.m.
Saturday, June 24, 2023, 8:00 a.m.-12:00 p.m.
Seattle Convention Center
Seattle, Washington

Intervention Complexity Calculator

Intervention Complexity Calculator

The Intervention Complexity Calculator was developed as a standard tool to capture intervention complexity with the intent to enhance communication challenges of intervention delivery.

This version of the tool is most likely to be useful to the trial team and its health care system partners during trial planning and conduct. The tool was developed with an awareness of intervention complexity literature, but it was not our intent to create a comprehensive classification approach. We expect that this tool may further evolve with as more pragmatic trials are conducted and feedback is received on the tool performance.

For further details, see the Living Textbook Chapter on Intervention Complexity.

April 20, 2023: Workshop on Essentials of Embedded Pragmatic Clinical Trials Offered at AcademyHealth 2023 Annual Research Meeting

Logo for AcademyHealthThe NIH Pragmatic Trials Collaboratory is partnering with AcademyHealth to offer a 1.5 day pre-conference workshop at the 2023 Annual Research Meeting in Seattle, Washington. The workshop, “Driving Tomorrow’s Outcomes Through Clinical Research in Real-World Settings: Essentials of Embedded Pragmatic Clinical Trials Workshop,” will provide an introduction to the investigative opportunities for embedded health systems research, along with strategies for conducting clinical trials that provide real-world evidence necessary to inform both practice and policy. Workshop attendees will have the opportunity to participate in facilitated, hands-on learning activities and to interact with Principal Investigators of current and past embedded pragmatic clinical trials (ePCTs).

Firsthand ePCT experiences and case studies from the NIH Pragmatic Trials Collaboratory will support and illustrate the topics presented and demonstrate how ePCTs in real-world settings are driving tomorrow’s outcomes. Speakers will include program officers and senior staff from NIH Institutes and senior investigators from the NIH Collaboratory Trials and the Coordinating Center Leadership.

The learning objectives of the workshop include:

  • To clarify the definition of ePCTs and explain their utility.
  • To introduce attendees to the unique characteristics and challenges of designing, conducting, and implementing ePCTs within diverse health care systems.
  • To increase the capacity of health services researchers to address important clinical questions with ePCTs in real-world settings, driving tomorrow’s research outcomes.

Workshop details and registration
Friday, June 23, 2023, 8:15 a.m.-4:25 p.m.
Saturday, June 24, 2023, 8:00 a.m.-12:00 p.m.
Seattle Convention Center, Seattle, WA

Changing Trials for Changing Times: Essentials of Embedded Pragmatic Clinical Trials Workshop: Health Care Systems Research Network Conference (February 2023)

February 20, 2023: The NIH Pragmatic Trials Collaboratory hosted a Pre-Conference Workshop at the Health Care Systems Research Network 2023 Annual Conference. This training workshop introduces concepts in the design, conduct, and implementation of embedded pragmatic clinical trials (ePCTs) and provides firsthand ePCT experiences and case studies from the NIH Pragmatic Trials Collaboratory Trials.

Agenda and Slides

Morning Sessions

Welcome and Introduction

Wendy Weber, ND, PhD, MPH

Session 1: What are Embedded Pragmatic Clinical Trials (ePCTs)?
Wendy Weber, ND, PhD, MPH

Session 2: Engaging Stakeholders & Aligning with Health System Partners
Emily O’Brien, PhD

Session 3: Objectives and Trial Design: An Overview of Hybrid Designs
Patrick Heagerty, PhD

Session 4: Measuring Outcomes
Emily O’Brien, PhD

Session 5: ePCT Design and Analysis
Patrick Heagerty, PhD

Session 6:  ePCTs in Context: Panel Discussion with NIH Collaboratory Trial PIs
Moderator: Kevin Weinfurt, PhD

*This session includes the Case Study Presentations.

 

Afternoon Sessions

Session 7: Pilot & Feasibility Testing
Wendy Weber, ND, PhD, MPH

Session 8: Ethical & Regulatory Oversight Considerations
Stephanie Morain, PhD, MPH

Session 9: Writing a Compelling Grant Application
Beda Jean-Francois, PhD

Session 10: ePCTs in Context: Panel Discussion with NIH Collaboratory Trial PIs
Moderator: Kevin Weinfurt, PhD

*This session includes the Case Study Presentations.

Session 11: Next Steps
Kevin Weinfurt, PhD

 

Ethical & Regulatory Dimensions of Pragmatic Clinical Trials: Special Grand Rounds Series (September 2022-February 2023)

In 2022-2023, the NIH Pragmatic Trials Collaboratory used its popular PCT Grand Rounds platform to host a special workshop series to examine ethical and regulatory challenges in pragmatic clinical trials. The series included moderated panel discussions, in which the NIH Collaboratory's Ethics and Regulatory Core brought together bioethicists, investigators, and regulatory experts to share lessons learned, discuss empirical findings, and explore remaining uncertainties.

Grand Rounds Sessions

September 9, 2022, 1:00 pm ET: Keynote: Building an Academic Learning Health System: Why Is It So Hard?

Speaker: Steven Joffe, MD, MPH
Moderator: Stephanie Morain, PhD, MPH

October 14, 2022, 1:00 pm ET: Responding (or Not) to Signals of Potential Clinical Significance in Pragmatic Clinical Trials 

Speakers: Joseph Ali, JD; Leslie J. Crofford, MD; Tanya Matthews, PhD
Moderator: Stephanie Morain, PhD, MPH

November 11, 2022, 1:00 pm ET: Data Sharing and Pragmatic Clinical Trials: Law and Ethics Amidst a Changing Policy Landscape 

Speakers: Stephanie Morain, PhD, MPH; Kayte Spector-Bagdady, JD, MBioethics
Moderator: P. Pearl O’Rourke, MD

December 9, 2022, 1:00 pm ET: The Stepped-Wedge Cluster Randomized Trial: Friend or Foe?

Speakers: David Magnus, PhD; Monica Taljaard, PhD
Moderator: Stephanie Morain, PhD, MPH

January 13, 2023, 1:00 pm ET: Ethical Considerations When Vulnerable Populations Are Subjects in Pragmatic Trials

Speaker: Emily A. Largent, JD, PhD, RN
Moderator: Stephanie Morain, PhD, MPH

February 10, 2023, 1:00 pm ET: Informing and Consenting: What Are the Goals?

Speakers: P. Pearl O’Rourke, MD; David S. Wendler, PhD, MA; Miguel Vazquez, MD; P. Michael Ho, MD, PhD
Moderator: Stephanie Morain, PhD, MPH

 

Dissemination & Implementation Research Methods and Embedded Pragmatic Trials: Strategies for Designing Studies That Inform Care for Diverse Populations: AcademyHealth Conference on the Science of Dissemination and Implementation in Health (December 2022)

December 11, 2022: The NIH Pragmatic Trials Collaboratory hosted a Pre-Conference Workshop at the 15th AcademyHealth Annual Conference on the Science of Dissemination and Implementation in Health. This training workshop introduces concepts in the design, conduct, and implementation of embedded pragmatic clinical trials (ePCTs), and provides firsthand ePCT experiences and case studies from the NIH Pragmatic Trials Collaboratory Trials.

Agenda and Slides

Morning Sessions

Welcome and Introduction

Wendy Weber, ND, PhD, MPH

Session 1: What are Embedded Pragmatic Clinical Trials (ePCTs)?
Wendy Weber, ND, PhD, MPH

Session 2: Engaging Stakeholders & Aligning with Health System Partners
Emily O’Brien, PhD

Session 3: Objectives and Trial Design: An Overview of Hybrid Designs
Emily O’Brien, PhD

Session 4: Measuring Outcomes
Emily O’Brien, PhD

Session 5: ePCT Design
David Murray, PhD

Session 6: ePCT Analysis
David Murray, PhD

Session 7:  ePCTs in Context: Panel Discussion with NIH Collaboratory Trial PIs
Moderator:  Emily O’Brien, PhD

*This session includes the Case Study Presentations.

 

Afternoon Sessions

Session 8: Pilot & Feasibility Testing
Wendy Weber, ND, PhD, MPH

Session 9: Ethical & Regulatory Oversight Considerations
Stephanie Morain, PhD, MPH

Session 10: ePCTs in Context: Panel Discussion with NIH Collaboratory Trial PIs
Moderator: Wendy Weber, ND, PhD, MPH

*This session includes the Case Study Presentations.

Session 11: Assembling an ePCT Team & Writing a Grant Application
Beda Jean-Francois, PhD

Session 12: Next Steps
Wendy Weber, ND, PhD, MPH

 

Critical Questions for Pragmatic Clinical Trialists: Insights From the NIH Pragmatic Trials Collaboratory’s First Decade: NIH-Hosted Workshop (June 2022)

June 15-16, 2022: This workshop is an opportunity to glean the most salient lessons learned from an experienced group of pragmatic trial investigators who will openly share the challenges they have encountered, solutions they have developed, and thoughts for the future. 

Agenda and Slides

Day 1: June 15, 2022

Welcome and Introduction

Wendy Weber, ND, PhD, MPH
Helene Langevin, MD

Keynote: Pragmatic Clinical Trials: The Role of Nursing Science

Shannon N. Zenk, PhD, MPH, RN, FAAN

Session 1: Can We Squeeze More Value Out of Electronic Health Records?

Moderator: Keith Marsolo, PhD

Panel:

  • ICD-Pieces™: Improving Chronic Disease Management with Pieces (Miguel Vazquez, MD)
  • LIRE: Lumbar Imaging with Reporting of Epidemiology (Jeffrey (Jerry) Jarvik, MD, MPH)
  • NOHARM: Nonpharmacologic Options in Postoperative Hospital-based and Rehabilitation Pain Management (Andrea Cheville, MD)
  • SPOT: Suicide Prevention Outreach Trial (Greg Simon, MD, MPH)

Session 2: Should We Be Considering a Different Study Design?

Moderator: Patrick Heagerty, PhD

Panel:

Summary and Concluding Remarks

Lesley Curtis, PhD
Wendy Weber, ND, PhD, MPH
Keith Marsolo, PhD
Patrick Heagerty, PhD

Day 2: June 16, 2022

Welcome and Introduction

Wendy Weber, ND, PhD, MPH
Helene Langevin, MD

Session 3: What Is the Most Effective Use of the 1-Year Planning Phase?

Moderator: Wendy Weber, ND, PhD, MPH

Panel:

Session 4: How Do We Implement Interventions in Complex Health Care Systems?

Moderator: Steven George, PT, PhD

Panel:

  • STOP CRC: Strategies and Opportunities to Stop Colorectal Cancer in Priority Populations (Gloria Coronado, PhD)
  • ICD-Pieces™: Improving Chronic Disease Management with Pieces (Miguel Vazquez, MD)
  • GGC4H: Guiding Good Choices for Health: Testing Feasibility and Effectiveness of Universal Parent-Focused Prevention in Three Healthcare Systems (Margaret Kuklinski, PhD)
  • GRACE: Hybrid Effectiveness-Implementation Trial of Guided Relaxation and Acupuncture for Chronic Sickle Cell Disease Pain (Miriam Ezenwa, PhD, MSN, BSN, RN, FAAN)

Summary and Concluding Remarks

Lesley Curtis, PhD
Wendy Weber, ND, PhD, MPH
Steven George, PT, PhD