Skip to content

COVID-19 Resources

Access the latest information on COVID-19 for clinical researchers
  • Home
  • About
    • NIH Collaboratory
      • Coordinating Center
      • NIH Collaboratory Trials
      • Core Working Groups
      • Steering Committee
      • Distributed Research Network
      • Our Impact
    • Living Textbook
      • Table of Contents
      • How to Use This Site
  • Resources
    • Data and Resource Sharing
    • Training Resources
    • Tools for Researchers
    • Publications
    • Knowledge Repository
  • Webinar
  • Podcast
  • News
    • News Feed
    • Calendar
    • Subscribe
return to home
Subscribe to Newsletter go to twitter feed go to linkedin go to blue sky feed
Search
NIH Collaboratory
Living Textbook of
Pragmatic Clinical Trials

COVID-19 Resources

Access the latest information on COVID-19 for clinical researchers
home button

Rethinking Clinical Trials

A Living Textbook of Pragmatic Clinical Trials

  • Design
    • What is a Pragmatic Clinical Trial?
    • Decentralized Pragmatic Clinical Trials
    • Developing a Compelling Grant Application
    • Experimental Designs and Randomization Schemes
    • Endpoints and Outcomes
    • Analysis Plan
    • Using Electronic Health Record Data
    • Building Partnerships and Teams to Ensure a Successful Trial
    • Intervention Delivery and Complexity
    • Patient Engagement
  • Data, Tools & Conduct
    • Assessing Feasibility
    • Acquiring Real-World Data
    • Assessing Fitness-for-Use of Real-World Data
    • Study Startup
    • Participant Recruitment
    • Monitoring Intervention Fidelity and Adaptations
    • Patient-Reported Outcomes
    • Clinical Decision Support
    • Mobile Health
    • Electronic Health Records–Based Phenotyping
    • Navigating the Unknown
  • Dissemination & Implementation
    • Data Sharing and Embedded Research
    • Dissemination Approaches for Different Audiences
    • Implementation
    • End-of-Trial Decision-Making
  • Ethics & Regulatory
    • Privacy Considerations
    • Identifying Those Engaged in Research
    • Collateral Findings
    • Consent, Disclosure, and Non-Disclosure
    • Data and Safety Monitoring
    • Ethical Considerations of Data Sharing in Pragmatic Clinical Trials
    • Ethics for AI and ML
    • IRB Responsibilities and Procedures

Introduction

CHAPTER SECTIONS

Real World Evidence: Clinical Decision Support


Section 1

Introduction

Expand Contributors

Brian Douthit, PhD, RN-BC
Rachel Richesson, PhD, MPH
Keith Marsolo, PhD
Edward R. Melnick, MD, MHS
Corita R. Grudzen, MD
Lesley Curtis, PhD

Contributing Editor
Karen Staman, MS

The use of clinical decision support (CDS) functionality is increasingly playing a prominent role in pragmatic clinical trials (PCTs)—either by enabling conduct of the trial, supporting the delivery of new interventions or being the intervention under evaluation. The key to its success has been the automation and knowledge transformation of certain tasks. Well-built CDS can save time and relieve cognitive burden on the part of the end-user. CDS can additionally assist research teams in identifying potential participants, initiating recruitment, and optimizing outcome collection. There are several examples of CDS used to support the NIH Collaboratory Trials.

In the Primary Palliative Care for Emergency Medicine (PRIM-ER) trial, CDS is used to identify seriously ill patients in the emergency department who might benefit from palliative care (Grudzen et al 2019). Here, the tool automates the process of cohort identification by querying the EHR for patient-level factors and automatically calculating risk scores. Without such a tool, manual calculations and individual searches would need to be done. Instead, this process is facilitated by the use of CDS and delivers alerts to clinicians to prioritize care and assessment. In this case, this study is supporting the testing of a new intervention with CDS as its mode of delivery.

In contrast, in the Emergency Department-Initiated Buprenorphine for Opioid Use Disorder (EMBED) trial, investigators tested CDS to identify and facilitate management of patients with opioid use disorder in the emergency department (Ahmed et al 2019; Melnick et al 2019a; Melnick et al 2019b; Ray et al 2019). Buprenorphine is a well-established therapy that is commonly used in settings other than the emergency department. Here, CDS was tested as the intervention itself and was bundled with implementation and engagement efforts (Melnick et al. 2022 ). CDS brings new potential to established interventions, expanding their effectiveness and ability to be dessiminated and implemented.

This chapter aims to define CDS, describe best practices for designing and evaluating decision support, and examine special considerations for using CDS in PCTs.

Next Section

SECTIONS

CHAPTER SECTIONS

sections

  1. Introduction
  2. Definitions and Uses
  3. Uses in PCTs: Experiences From the NIH Collaboratory Trials
  4. Designing and Building CDS Tools for Pragmatic Clinical Trials
  5. Evaluating CDS
  6. Disseminating and Sharing CDS
  7. Additional Resources

Resources

EMBED Pragmatic Trial of User-Centered Clinical Decision Support to Implement Emergency Department-Initiated Buprenorphine for Opioid Use Disorder; NIH Collaboratory Grand Rounds; November 2, 2018

Primary Palliative Care for Emergency Medicine (PRIM-ER); NIH Collaboratory Grand Rounds; November 16, 2018

REFERENCES

back to top

Ahmed OM, Mao JA, Holt SR, et al. 2019. A scalable, automated warm handoff from the emergency department to community sites offering continued medication for opioid use disorder: lessons learned from the EMBED trial stakeholders. J Subst Abuse Treat. 102:47-52. doi:10.1016/j.jsat.2019.05.006. PMID: 31202288.

Grudzen CR, Brody AA, Chung FR, et al. 2019. Primary Palliative Care for Emergency Medicine (PRIM-ER): protocol for a pragmatic, cluster-randomised, stepped wedge design to test the effectiveness of primary palliative care education, training and technical support for emergency medicine. BMJ Open. 9(7):e030099. doi:10.1136/bmjopen-2019-030099. PMID: 31352424.

Melnick ER, Holland WC, Ahmed OM, et al. 2019a. An integrated web application for decision support and automation of EHR workflow: a case study of current challenges to standards-based messaging and scalability from the EMBED trial. JAMIA Open. ooz053. doi:10.1093/jamiaopen/ooz053. PMID: 32025639.

back to top

Melnick ER, Jeffery MM, Dziura JD, et al. 2019b. User-centred clinical decision support to implement emergency department-initiated buprenorphine for opioid use disorder: protocol for the pragmatic group randomised EMBED trial. BMJ Open. 9(5):e028488. doi:10.1136/bmjopen-2018-028488. PMID: 31152039.

Clinical Decision Support. https://www.ahrq.gov/cpi/about/otherwebsites/clinical-decision-support/index.html. Accessed October 14, 2022.

Ray JM, Ahmed OM, Solad Y, et al. 2019. Computerized clinical decision support system for emergency department-initiated buprenorphine for opioid use disorder: user-centered design. JMIR Hum Factors. 6(1):e13121. doi:10.2196/13121. PMID: 30810531.


Version History

October 24, 2020: Minor updates to the text. Added new reference (changes made by K. Staman & L. Stewart)

July 2, 2020: Minor corrections to layout and formatting (changes made by D. Seils).

Published May 29, 2020

current section :

Introduction

  1. Introduction
  2. Definitions and Uses
  3. Uses in PCTs: Experiences From the NIH Collaboratory Trials
  4. Designing and Building CDS Tools for Pragmatic Clinical Trials
  5. Evaluating CDS
  6. Disseminating and Sharing CDS
  7. Additional Resources

Citation:

Douthit B, Richesson RL, Marsolo K, et al. Real World Evidence: Clinical Decision Support: Introduction. In: Rethinking Clinical Trials: A Living Textbook of Pragmatic Clinical Trials. Bethesda, MD: NIH Pragmatic Trials Collaboratory. Available at: https://rethinkingclinicaltrials.org/chapters/conduct/real-world-evidence-clinical-decision-support/clinical-decision-support-introduction/. Updated December 3, 2025. DOI: 10.28929/130.

Footer Menu

  • How to Use This Site
  • About NIH Collaboratory
  • Enrollment Reporting
  • Grand Rounds
  • Funding Statement
Link to Twitter Link to LinkedIn Link to Blue Sky Link to NIH Collaboratory email

Reference in this Web site to any specific commercial products, process, service, manufacturer, or company does not constitute its endorsement or recommendation by the U.S. Government or National Institutes of Health (NIH). NIH is not responsible for the contents of any “off-site” Web page referenced from this server.

Log in
Privacy Statement
WordPress is a content management system and should not be used to upload any PHI as it is not an environment for which we exercise oversight, meaning you the author are responsible for the content you post. Please use this system accordingly. Site Map