Skip to content

COVID-19 Resources

Access the latest information on COVID-19 for clinical researchers
  • Home
  • About
    • NIH Collaboratory
      • Coordinating Center
      • NIH Collaboratory Trials
      • Core Working Groups
      • Steering Committee
      • Distributed Research Network
      • Our Impact
    • Living Textbook
      • Table of Contents
      • How to Use This Site
  • Resources
    • Data and Resource Sharing
    • Training Resources
    • Tools for Researchers
    • Publications
    • Knowledge Repository
  • Webinar
  • Podcast
  • News
    • News Feed
    • Calendar
    • Subscribe
return to home
Subscribe to Newsletter go to twitter feed go to linkedin go to blue sky feed
Search
NIH Collaboratory
Living Textbook of
Pragmatic Clinical Trials

COVID-19 Resources

Access the latest information on COVID-19 for clinical researchers
home button

Rethinking Clinical Trials

A Living Textbook of Pragmatic Clinical Trials

  • Design
    • What is a Pragmatic Clinical Trial?
    • Decentralized Pragmatic Clinical Trials
    • Developing a Compelling Grant Application
    • Experimental Designs and Randomization Schemes
    • Endpoints and Outcomes
    • Analysis Plan
    • Using Electronic Health Record Data
    • Building Partnerships and Teams to Ensure a Successful Trial
    • Intervention Delivery and Complexity
    • Patient Engagement
  • Data, Tools & Conduct
    • Assessing Feasibility
    • Acquiring Real-World Data
    • Assessing Fitness-for-Use of Real-World Data
    • Study Startup
    • Participant Recruitment
    • Monitoring Intervention Fidelity and Adaptations
    • Patient-Reported Outcomes
    • Clinical Decision Support
    • Mobile Health
    • Electronic Health Records–Based Phenotyping
    • Navigating the Unknown
  • Dissemination & Implementation
    • Data Sharing and Embedded Research
    • Dissemination Approaches for Different Audiences
    • Implementation
    • End-of-Trial Decision-Making
  • Ethics & Regulatory
    • Privacy Considerations
    • Identifying Those Engaged in Research
    • Collateral Findings
    • Consent, Disclosure, and Non-Disclosure
    • Data and Safety Monitoring
    • Ethical Considerations of Data Sharing in Pragmatic Clinical Trials
    • Ethics for AI and ML
    • IRB Responsibilities and Procedures

Interoperability

CHAPTER SECTIONS

Using Electronic Health Record Data in Pragmatic Clinical Trials


Section 2

Interoperability

Expand Contributors
Rachel Richesson, MS, PhD, MPH
Keith A. Marsolo, PhD
Richard Platt, MD, MSc
Gregory Simon, MD, MPH
Lesley Curtis, PhD
Reesa Laws, BS
Adrian Hernandez, MD, MSH
Jon Puro, MPA-HA
Doug Zatzick, MD
Erik van Eaton, MD, FACS
Vincent Mor, PhD

Contributing Editor
Karen Staman, MS

Interoperability between electronic health record systems has the potential to benefit patients, payers, health systems, researchers, and clinicians because interoperability enables data gathered as a part of care to be used to support care between systems, quality improvement, and research.  However, in actual practice, interoperability has been hard to achieve.

Historically, the focus of interoperability of data has been on the ability to share information between settings, and the strategy has been to identify various standards for data (eg, data formatting). Over the years, these standards have become more mature, and health organizations have growing incentives (due to both regulation and changes in healthcare reimbursement, and payment to reward quality care) to share patient data across care teams and organizations.

A final rule to implement provisions of the 21st Century Cures Act was intended to advance interoperability and support the access, exchange, and use of electronic health information by patients and their caregivers. The rule establishes the United States Core Data for Interoperability (USCDI) standard, which sets forth data classes and elements that support nationwide interoperability; it also includes a broad range of data elements, such as clinical notes, test results, and medications. Specific standards that are mandated as part of the final rule include:

  • Systematized Nomenclature of Medicine – Clinical Terms (SNOMED CT)
    • SNOMED is a standard set of clinical terminology that includes clinical findings, disorders, and observable findings related to health, designed to support electronic health information exchange.
  • Logical Observation Identifiers, Names and Codes (LOINC)
    • LOINC is a standard that allows users to map health data, such as labs, vital signs, and clinical documents to support data exchange across systems.
  • RxNorm
    • RxNorm is a free, publicly available resource from the National Library of Medicine that provides “normalized” names and unique identifiers that make it possible to clearly identify a given drug. RxNorm coding allows information about medications to be exchanged across EHRs.
    • Concept Unique Identifier (RxCUI)
      • The RxCUI is a unique, unambiguous identifier that is assigned to an individual drug entity in RxNorm and used to relate to all things associated with that drug. The RxCUI is used to link one entity in RxNorm to every other entity it’s related to, such as name to ingredient to class.
  • International Classification of Diseases, version 10 (ICD-10)
    • Provides standard codes for medical conditions, diagnoses, and institutional procedures

While having a defined interface standard solves one part of the interoperability problem (ie, syntatic interoperability), as long as data are natively captured in nonstandard formats such as using local codes for greater specificity, they will need to be mapped to terminologies before they are truly interoperable (ie, semantic interoperability). Previous federal attempts to foster interoperability resulted in highly variable implementations (D’Amore et al. 2014), so study teams should be prepared to validate the data that they receive via these new interfaces. Additionally, teams on retrospective studies also should be prepared to budget for staff to map internal use codes to standard terminologies. There have been efforts to define more standardized content that are exchanged between systems, such as through the US Core Data for Interoperability (USCDI), so the situation may improve over time. These efforts may have limited impact on data that have been previously collected, so teams on retrospective studies also should be prepared to budget for staff to map internal use codes to standard terminologies.

Historically, the exchange of data within the healthcare industry for operational purposes has occurred via the exchange of messages that often looked like structured documents, while researchers would often receive population or cohort-level extracts from reporting databases or data warehouses.  More recent efforts have established the use of techniques like application programming interfaces (APIs), which tend to send and receive data in more piecemeal fashion (e.g., a record or an observation at a time).  APIs provide a standard interface, make it easier to develop new applications that can interact with healthcare data, but given that data are requested an observation or a record at a time, it can be more difficult to understand the information that is NOT being delivered. For instance, if an investigator were interested in receiving hemoglobin lab results for a set of patients using an API, they would requesting results via a LOINC code.  That would return the lab results that have been mapped to LOINC, but they would not have knowledge about any hemoglobin tests that were not mapped to LOINC by the institution, for instance any historical results that were only mapped to an internal code or reference. Ideally all of them will be captured, but it is possible that the data were generated starting on the day they turned on the interface (ie, only prospective results), or perhaps represent results from the most recent lab system upgrade. Since it is not possible to request all data for an entire population via an API (the way data would be validated by looking at trends and distributions if extracted via a database), users view results one patient at a time, making it very difficult to identify problems since any given patient may have significant gaps in their data due to normal practice patterns. While the use of APIs and the adoption of standards like the USCDI have been generally positive for the healthcare industry in terms of standardization, we are still in the early stages, somewhere between “buyer beware” and “trust, but verify.”

Additionally, care must be taken to make sure that information collected at one site actually matches information at another site. The process of extracting, transforming, and loading data from one system to another can require the “janitorial” work of mapping and data cleaning (Lohr 2014).

To advance interoperability among EHRs and registries, the Pew Data Interoperability Project was developed as a collaboration between the Duke Clinical Research Institute and the Pew Charitable Trusts. In a Grand Rounds describing the project (Envisioning Data Liquidity – The Pew Data Interoperability Project). Dr. James E. Tcheng, suggests that standardization is best accomplished through “native” data standardization, as opposed to standardizing data after it has been collected. For registries, the keys to success are well-defined clinical concepts, specified representation of the concepts and data in database systems, and integrating data capture into the workflow.

Patient Access to Data

New developments in regulation and technology—particularly related to patient- or consumer-mediated data exchange—are changing the nature of how researchers might access data (Cimino et al 2014; Bracha et al 2019). To implement provisions of the 21st Century Cures Act, on May 1, 2020, the Office of the National Coordinator for Health Information Technology (ONC), now the Assistant Secretary for Technology Policy / Office of the National Coordinator for Health IT, and the Centers for Medicare and Medicaid Services (CMS) announced a final rule; one aspect of the rule is intended to support the access, exchange, and use of electronic health information by patients and their caregivers.

“Patients should be able to access their electronic medical record at no extra cost. Providers should be able to choose their IT tools that allow them to provide the best care for patients, without excessive costs or technical barriers.” —ONC Cures Act Final Rule Fact Sheet

To enable the access and exchange of healthcare data, the rule requires standardized, open application programming interfaces (APIs) to be built using HL7’s FHIR (Fast Health Interoperability Standard). Part of the intention of the rule is to promote competition and support provider and patient independence and prevent information blocking.

Previous Section Next Section

 

SECTIONS

CHAPTER SECTIONS

sections

  1. Introduction
  2. Interoperability
  3. Data as a Surrogate for Clinical Phenomena
  4. Developing and Refining the Research Questions
  5. Specific Uses for EHR Data in PCTs
  6. Estimating and Identifying the Study Population and Assessing Baseline Prognostic Characteristics
  7. Implementing and Monitoring the Delivery of an Intervention
  8. Assessing Outcomes
  9. The Research Question Drives the Data Requirements
  10. Additional Resources

Resources

The Big Picture: Healthcare Data and Interoperability

In this video, Dr. Lesley Curtis explores how data flow into EHRs and move between systems, the role of data standards, and the barriers to building a more streamlined and connected healthcare system.

Grand Rounds

May 10, 2019: Treating Data as an Asset: Data Entrepreneurship in the Service of Patients (Eric Perakslis, PhD)

November 9, 2018: Data Linkage Within, Across, and Beyond PCORnet (Thomas W. Carton, PhD, MS, Keith Marsolo, PhD)

October 19, 2018: A New Path Forward for Using Decentralized Clinical Trials (Jeffry Florian, PhD, Annemarie Forrest, Penny Randall, MD, MBA)

Podcast

November 20, 2018: Data Linkage Within, Across, and Beyond PCORnet (Thomas W. Carton, PhD, MS, Keith Marsolo, PhD)

REFERENCES

back to top

Bracha Y, Bagwell J, Furberg R, Wald JS. 2019. Consumer-Mediated Data Exchange for Research: Current State of US Law, Technology, and Trust. JMIR Med Inform. (2):e12348. doi: 10.2196/12348. PMID: 30946692.

Cimino JJ, Frisse ME, Halamka J, et al. 2014. Consumer-mediated health information exchanges: the 2012 ACMI debate. J Biomed Inform. 48:5-15. doi: 10.1016/j.jbi.2014.02.009. PMID: 24561078.

 

back to top

D’Amore, JD, Mandel JC, Kreda DA, et al. 2014. Are Meaningful Use Stage 2 Certified EHRs ready for interoperability? Findings from the SMART C-CDA Collaborative. J Am Med Informat Assoc. 21:1060-1068. https://doi.org/10.1136/amiajnl-2014-002883.

Lohr S. 2014. For big-data scientists, ‘janitor work’ is key hurdle to insights. New York Times. August 17, 2014. https://www.nytimes.com/2014/08/18/technology/for-big-data-scientists-hurdle-to-insights-is-janitor-work.html.


Version History

October 7, 2025: Updated text as part of annual review (changes made by K. Staman).

August 26, 2022: Minor corrections as part of annual update (changes made by K. Staman).

Update January 18, 2021: Added EHR Workshop video module to resource bar (changes made by K. Staman).

Published July 3, 2020.

current section :

Interoperability

  1. Introduction
  2. Interoperability
  3. Data as a Surrogate for Clinical Phenomena
  4. Developing and Refining the Research Questions
  5. Specific Uses for EHR Data in PCTs
  6. Estimating and Identifying the Study Population and Assessing Baseline Prognostic Characteristics
  7. Implementing and Monitoring the Delivery of an Intervention
  8. Assessing Outcomes
  9. The Research Question Drives the Data Requirements
  10. Additional Resources

Citation:

Richesson R, Platt R, Simon G, et al. Using Electronic Health Record Data in Pragmatic Clinical Trials: Interoperability. In: Rethinking Clinical Trials: A Living Textbook of Pragmatic Clinical Trials. Bethesda, MD: NIH Pragmatic Trials Collaboratory. Available at: https://rethinkingclinicaltrials.org/chapters/design/using-electronic-health-record-data-pragmatic-clinical-trials-top/interoperability/. Updated February 17, 2026. DOI: 10.28929/201.

Footer Menu

  • How to Use This Site
  • About NIH Collaboratory
  • Enrollment Reporting
  • Grand Rounds
  • Funding Statement
Link to Twitter Link to LinkedIn Link to Blue Sky Link to NIH Collaboratory email

Reference in this Web site to any specific commercial products, process, service, manufacturer, or company does not constitute its endorsement or recommendation by the U.S. Government or National Institutes of Health (NIH). NIH is not responsible for the contents of any “off-site” Web page referenced from this server.

Log in
Privacy Statement
WordPress is a content management system and should not be used to upload any PHI as it is not an environment for which we exercise oversight, meaning you the author are responsible for the content you post. Please use this system accordingly. Site Map