Skip to content

COVID-19 Resources

Access the latest information on COVID-19 for clinical researchers
  • Home
  • About
    • NIH Collaboratory
      • Coordinating Center
      • NIH Collaboratory Trials
      • Core Working Groups
      • Steering Committee
      • Distributed Research Network
      • Our Impact
    • Living Textbook
      • Table of Contents
      • How to Use This Site
  • Resources
    • Data and Resource Sharing
    • Training Resources
    • Tools for Researchers
    • Publications
    • Knowledge Repository
  • Webinar
  • Podcast
  • News
    • News Feed
    • Calendar
    • Subscribe
return to home
Subscribe to Newsletter go to twitter feed go to linkedin go to blue sky feed
Search
NIH Collaboratory
Living Textbook of
Pragmatic Clinical Trials

COVID-19 Resources

Access the latest information on COVID-19 for clinical researchers
home button

Rethinking Clinical Trials

A Living Textbook of Pragmatic Clinical Trials

  • Design
    • What is a Pragmatic Clinical Trial?
    • Decentralized Pragmatic Clinical Trials
    • Developing a Compelling Grant Application
    • Experimental Designs and Randomization Schemes
    • Endpoints and Outcomes
    • Analysis Plan
    • Using Electronic Health Record Data
    • Building Partnerships and Teams to Ensure a Successful Trial
    • Intervention Delivery and Complexity
    • Patient Engagement
  • Data, Tools & Conduct
    • Assessing Feasibility
    • Acquiring Real-World Data
    • Assessing Fitness-for-Use of Real-World Data
    • Study Startup
    • Participant Recruitment
    • Monitoring Intervention Fidelity and Adaptations
    • Patient-Reported Outcomes
    • Clinical Decision Support
    • Mobile Health
    • Electronic Health Records–Based Phenotyping
    • Navigating the Unknown
  • Dissemination & Implementation
    • Data Sharing and Embedded Research
    • Dissemination Approaches for Different Audiences
    • Implementation
    • End-of-Trial Decision-Making
  • Ethics & Regulatory
    • Privacy Considerations
    • Identifying Those Engaged in Research
    • Collateral Findings
    • Consent, Disclosure, and Non-Disclosure
    • Data and Safety Monitoring
    • Ethical Considerations of Data Sharing in Pragmatic Clinical Trials
    • Ethics for AI and ML
    • IRB Responsibilities and Procedures

Missing Data and Intention-to-Treat Analyses

CHAPTER SECTIONS

Analysis Plan


Section 5

Missing Data and Intention-to-Treat Analyses

Expand Contributors

Rui Wang, PhD
Fan Li, PhD
Andrea J. Cook, PhD
Elizabeth R. DeLong, PhD
For the NIH Pragmatic Trials Collaboratory Biostatistics and Study Design Core

Contributing Editor
Damon M. Seils, MA

In many randomized clinical trials, the primary analysis is an intention-to-treat (ITT) analysis, an approach based on the treatment assignment as randomized rather than the actual treatment received. One rationale for the ITT approach is that it evaluates the real-world effects of the intervention. However, a common misconception is that the ITT analysis will be unbiased regardless of crossover or missing data.

To understand the effects of crossover and dropout in an ITT analysis, it is useful to understand the 2 types of treatment effect that are generally of interest: the ITT effect and the average causal effect. The ITT effect measures the intervention effect as randomized; the average causal effect measures the intervention effect as actually received. In the ideal situation with perfect compliance and no missing outcome data, the ITT effect and the average causal effect are identical. This section of the Living Textbook considers the population-level causal effects in situations in which there is noncompliance or missing outcome data. Missingness in covariates may require further consideration.

In the presence of treatment noncompliance, the ITT effect and the average causal effect usually are not the same. In the absence of study dropout, the ITT effect can be estimated using standard methods and ignoring noncompliance. However, the ITT effect is diluted by crossover. A large crossover rate diminishes the ITT effect and reduces the statistical power of the analysis.

In the presence of dropout, the validity of a complete-case ITT analysis (that is, a standard analysis ignoring missing data) requires an untestable assumption that there is no selection bias by study dropout. This assumption will be violated, for example, if those who drop out of the study are "sicker" than those who do not. In such situations, even when the dropout pattern does not differ across treatment arms, the resulting naive estimators ignoring missing data would be biased for the originally targeted population-level ITT effect, provided the ITT effect in "sicker" participants is different from the general population. When the dropout pattern differs across treatment arms, the resulting naive estimators would be biased even for the ITT effect in the population represented by participants remaining in the trial. This assumption can be weakened to no selection bias by study dropout within levels of a set of measured baseline factors. Under such assumptions, valid ITT effect estimates can be obtained through methods that adjust for measured baseline selection bias due to study dropout (such as inverse probability weighting or g-estimation).

For a detailed explanation using the causal counterfactual framework to understand these issues, see "Analyses of Randomized Controlled Trials in the Presence of Noncompliance and Study Dropout," a white paper from the NIH Pragmatic Trials Collaboratory’s Biostatistics and Study Design Core.

Previous Section Next Section

SECTIONS

CHAPTER SECTIONS

sections

  1. Introduction
  2. Intraclass Correlation
  3. Unequal Cluster Sizes
  4. Accounting for Residual Confounding in the Analysis
  5. Missing Data and Intention-to-Treat Analyses
  6. Electronic Health Record Data Extraction
  7. Unanticipated Changes
  8. Interim Reassessment of Sample Size in Cluster Randomized Trials
  9. Case Study: STOP CRC Trial

Resources


Methods for Handling Missing Data in Cluster Randomized Trials
NIH Pragmatic Trials Collaboratory PCT Grand Rounds; January 5, 2024

Analyses of Randomized Controlled Trials in the Presence of Noncompliance and Study Dropout
Working document from the Biostatistics and Study Design Core


Version History

April 30, 2024: Added an item to the Resources sidebar as part of the annual content update (changes made by D. Seils).

June 23, 2022: Updated the name of the NIH Collaboratory in the contributors list and made nonsubstantive changes as part of the annual content update (changes made by D. Seils).

July 2, 2020: Minor corrections to layout and formatting (changes made by D. Seils).

May 27, 2020: Reordered the sections of this chapter as part of the annual content update (changes made by D. Seils).

May 1, 2020: Made nonsubstantive changes to the Resources sidebar as part of the annual content update (changes made by D. Seils).

Published August 5, 2019.

current section :

Missing Data and Intention-to-Treat Analyses

  1. Introduction
  2. Intraclass Correlation
  3. Unequal Cluster Sizes
  4. Accounting for Residual Confounding in the Analysis
  5. Missing Data and Intention-to-Treat Analyses
  6. Electronic Health Record Data Extraction
  7. Unanticipated Changes
  8. Interim Reassessment of Sample Size in Cluster Randomized Trials
  9. Case Study: STOP CRC Trial

Citation:

Wang R, Li F, Cook AJ, DeLong ER; for the NIH Health Care Systems Research Collaboratory Biostatistics and Study Design Core. Analysis Plan: Missing Data and Intention-to-Treat Analyses. In: Rethinking Clinical Trials: A Living Textbook of Pragmatic Clinical Trials. Bethesda, MD: NIH Pragmatic Trials Collaboratory. Available at: https://rethinkingclinicaltrials.org/chapters/design/analysis-plan-top/missing-data-and-intention-to-treat-analyses/. Updated July 9, 2025. DOI: 10.28929/110.

Footer Menu

  • How to Use This Site
  • About NIH Collaboratory
  • Enrollment Reporting
  • Grand Rounds
  • Funding Statement
Link to Twitter Link to LinkedIn Link to Blue Sky Link to NIH Collaboratory email

Reference in this Web site to any specific commercial products, process, service, manufacturer, or company does not constitute its endorsement or recommendation by the U.S. Government or National Institutes of Health (NIH). NIH is not responsible for the contents of any “off-site” Web page referenced from this server.

Log in
Privacy Statement
WordPress is a content management system and should not be used to upload any PHI as it is not an environment for which we exercise oversight, meaning you the author are responsible for the content you post. Please use this system accordingly. Site Map