Toward Causal Inference in Cluster Randomized Trials: Estimands and Reflection on Current Practice

Methods: Minds the Gap Webinar Series
“Toward Causal Inference in Cluster Randomized Trials: Estimands and Reflection on Current Practice”
Fan Li, PhD; Yale School of Public Health
National Institutes of Health, Office of Disease Prevention

Cluster randomized trials (CRTs) involve randomizing groups of individuals to different interventions. While model-based methods are extensively studied for analyzing CRTs, there has been little reflection around the treatment effect estimands at the outset. In the first part of this presentation, we describe two relevant estimands that can be addressed through CRTs and point out that they can differ when the treatment effects vary according to cluster sizes. As a cautionary note, we demonstrate how choices between different analytic approaches can impact the interpretation of results by fundamentally changing the question being asked. In the second part, we revisit the linear mixed model as the most commonly used method for analyzing CRTs. The linear mixed model makes stringent assumptions, including normality, linearity, and typically a compound symmetric correlation structure, all of which may be challenging to verify. However, under certain conditions, we show that the linear mixed model consistently estimates the average causal effect under arbitrary misspecification of its working model. Under equal randomization, its model-based variance estimator, surprisingly, remains consistent under model misspecification, justifying the use of confidence intervals output by standard software. These results hold under both simple and stratified randomization, and serve as an important causal inference justification for linear mixed models. Caveats and extensions of our findings will also be mentioned.

For more information, visit https://prevention.nih.gov/education-training/methods-mind-gap/toward-causal-inference-cluster-randomized-trials-estimands-and-reflection-current-practice.

Methods: Mind the Gap Webinar July 14: Overview of Statistical Models for the Design and Analysis of Stepped Wedge Cluster Randomized Trials

Speaker: 

Fan Li, PhD
Yale University School of Public Health

Description:

The stepped-wedge cluster randomized design has received increasing attention in pragmatic clinical trials (PCTs) and implementation science research. Since the design’s introduction, a variety of mixed-effects model extensions have been proposed for the design and analysis of PCTs. In this talk, Dr. Fan Li of Yale University will provide a general model representation and regard various model extensions as alternative ways to characterize secular trends, intervention effects, and sources of heterogeneity. He will also review key model ingredients and clarify their implications for the design and analysis of stepped-wedge trials.

Registration required: 

https://www.prevention.nih.gov/education-training/methods-mind-gap/overview-statistical-models-design-and-analysis-stepped-wedge-cluster-randomized-trials

Cluster Randomized Trial Design Featured in JAMA’s Guide to Statistics and Methods Series


A new article published this week in JAMA describes the cluster randomized trial design. The article is part of JAMA’s Guide to Statistics and Methods series, which publishes explanations of analytic and methodologic approaches used in current research articles to help clinicians better understand the research.

In “Cluster Randomized Trials: Evaluating Treatments Applied to Groups,” Drs. William J. Meurer and Roger J. Lewis define cluster randomization, describe its advantages and limitations, and provide guidance on interpreting cluster randomized trials. The article discusses aspects of a recent cluster randomized trial, the RESTORE trial, as an example.

In RESTORE, pediatric intensive care units were randomized to assess the effects of a nurse-implemented sedation protocol for children with acute respiratory failure on mechanical ventilation. As Meurer and Lewis point out, “interventions that involve training multidisciplinary health care teams are practically difficult to conduct using individual-level randomization, as health care practitioners cannot easily unlearn a new way of taking care of patients.” Cluster randomized designs are therefore often used for this type of research, and it is important for clinicians to be able to understand and evaluate these studies.


Reference:
Meurer WJ, Lewis RJ. Cluster randomized trials: evaluating treatments applied to groups. JAMA. 2015;313:2068-2069. PMID: 26010636. doi:10.1001/jama.2015.5199.