Monitoring Intervention Fidelity and Adaptations
Section 4
Frameworks for Characterizing Fidelity and Adaptations
Whether study teams choose to use a formal framework to characterize or report on adaptations to their study interventions, tracking such modifications will be key to ensuring that you understand the internal validity of the study. One prominent framework is FRAME.
FRAME
The Framework for Reporting Adaptations and Modifications-Enhanced (FRAME) is an approach developed, and recently expanded, by Wiltsey Stirman and colleagues to help study teams identify and report modifications to interventions or implementation strategies—planned and unplanned (Stirman 2013; Wiltsey Stirman 2019). FRAME, an update and synthesis of earlier adaptation research and models (Glasgow et al. 1999), helps researchers compare the impact of a modification with the impact on fidelity to the intervention. The FRAME approach can be used to track and document aspects of the intervention’s implementation such as why, when, and where the change occurred; the nature of the change; the target of the change; and, importantly, the goal of the change—for example, to improve effectiveness, increase reach or engagement, or reduce cost.
As an example, a recent study documented the process and outcomes of adapting the Savvy Caregiver Program (SCP) for Korean American dementia caregivers according to the 8 domains in FRME:
- What was modified,
- Who participated in recommending and deciding the modification to be made,
- When the modification occurred
- Whether the modification was planned
- Whether the modification was fidelity-consistent
- Whether the modification was temporary
- At what level of delivery, the modification was made, and
- Why the modification was made.(Jang et al. 2024)
The study team found that the primary reasons for adaptations were to improve he primary for engagement (62.5%) and fit with recipients (43.8%)(Jang et al. 2024).
The authors state: “The FRAME categorization provided a detailed understanding of the process and nature of adapting the SCP [Savvy Caregiver Program] and served as a foundation for further implementation and scale-up. FRAME not only serves as a guide for adapting evidence-based interventions but also promotes their replicability and scalability (Jang et al. 2024).
Other Frameworks
RE-AIM
The RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework was designed to help study teams evaluate “essential program elements including external validity that can improve the sustainable adoption and implementation of effective, generalizable, evidence-based interventions” (Glasgow et al. 1999; www.re-aim.org). Read more about RE-AIM in the Dissemination and Implementation Chapter.
RAPICE
The approach called Rapid Assessment Procedure Informed Clinical Ethnography (RAPICE) uses ethnographic methods to collect and analyze qualitative data about a clinical intervention in a relatively short period (Palinkas and Zatzick 2019).
Additional Considerations
The Living Textbook identifies other considerations related to potential changes to the intervention:
- The section on designing the analysis plan discusses unanticipated changes, such as changes to the study population, organizational structure, or clinical practice and standards that may have an impact on the analysis of your study.
- The section on using electronic health record (EHR) data in clinical research discusses how EHR data can support the process of monitoring the fidelity of the intervention.
- If the ePCT intervention proves effective, the section on dissemination provides information on frameworks for dissemination and implementation.
SECTIONS
REFERENCES
Glasgow RE, Vogt TM, Boles SM. 1999. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 89:1322-1327. doi:10.2105/ajph.89.9.1322. PMID: 10474547.
Glasgow RE, Harden SM, Gaglio B, et al. 2019. RE-AIM Planning and Evaluation Framework: adapting to new science and practice with a 20-year review. Front Public Health. 7:64-64. doi:10.3389/fpubh.2019.00064. PMID: 30984733.
Jang Y, Hepburn K, Haley WE, et al. 2024. Examining cultural adaptations of the savvy caregiver program for Korean American caregivers using the framework for reporting adaptations and modifications-enhanced (FRAME). BMC Geriatr. 24:79. doi:10.1186/s12877-024-04715-w.
Palinkas LA, Zatzick D. 2019. Rapid Assessment Procedure Informed Clinical Ethnography (RAPICE) in pragmatic clinical trials of mental health services implementation: methods and applied case study. Adm Policy Ment Health. 46:255-270. doi:10.1007/s10488-018-0909-3. PMID: 30488143.
Stirman SW, Miller CJ, Toder K, Calloway A. 2013. Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implement Sci. 8:65. doi:10.1186/1748-5908-8-65. PMID: 23758995.