New study snapshots and updated ethics and regulatory documentation are now available for the LungSMART and STEP-2 trials. One year into the studies, and after receiving approval to transition to the implementation phase, the research teams reviewed and updated the minutes of their initial consultations with the Ethics and Regulatory Core.
LungSMART and STEP-2 are the first NIH Collaboratory Trials to be supported by grant awards from the National Cancer Institute.
LungSMART
Left to right: LungSMART investigators Drs. David Wetter, Guilherme Del Fiol, and Ken Kawamoto
LungSMART, led by Dave Wetter, Guilherme Del Fiol, and Ken Kawamoto of the University of Utah, is testing a combination of text messages, an interactive chatbot, and educational videos delivered by text message to address barriers to completing lung cancer screening among patients receiving care in safety net community health centers. Learn more about LungSMART.
STEP-2
Left to right: STEP-2 investigators Drs. Rachel Winer, Amanda Petrik, and Jasmin Tiro
STEP-2, led by Rachel Winer of the University of Washington, Amanda Petrik of the Kaiser Permanente Center for Health Research, and Jasmin Tiro of the University of Chicago, is evaluating the comparative effectiveness and cost-effectiveness of in-clinic vs mailed distribution of human papillomavirus (HPV) self-collect kits to improve cervical cancer screening rates among patients receiving care in community health centers. Learn more about STEP-2.
The study design paper for TAICHIKNEE has been published online in BMJ Open. Congratulations to the study team on reaching this important milestone for all NIH Collaboratory Trials!
TAICHIKNEE is comparing the effects of web-based tai chi interventions versus routine care for individuals experiencing knee pain due to osteoarthritis. The practice of tai chi integrates physical, psychosocial, and behavioral components and has exhibited clinically significant improvements in chronic knee osteoarthritis pain conditions. The results of the study will inform widespread adoption of mind-body approaches for knee osteoarthritis across healthcare systems.
The study is being led by principal investigators Chenchen Wang of Tufts University; Helen Lavretsky of the University of California, Los Angeles; and Eric Roseen and Robert Saper of the Boston University Chobanian and Avedisian School of Medicine. TAICHIKNEE is supported within the NIH Pragmatic Trials Collaboratory through a cooperative agreement from the National Center for Complementary and Integrative Medicine.
In a study that used large language models (LLMs) to adjudicate documented goal-concordant care from longitudinal electronic health record (EHR) data, LLM-based ratings and rationales were broadly consistent with human adjudication. The study suggests that LLM-based tools show promise as complementary adjudicators of such records in research that would otherwise rely on labor-intensive manual chart review.
The proof-of-concept study used data from the ACP PEACE trial and one other pragmatic clinical trial of advance care planning interventions. ACP PEACE, an NIH Collaboratory Trial, evaluated the delivery of a video decision aid to patients together with goals-of-care communication skills training to oncology clinicians.
In the study, LLM-based ratings compared favorably with human ratings in a highly structured review of longitudinal records for goal-concordant care. However, the study also highlighted the subjectivity of such assessments. The authors stress that LLM-based tools should be viewed as complements to human review, rather than replacements, especially in complex and ambiguous cases.
Among participants in the GRACE trial with sickle cell disease, depressive symptoms were associated with worse pain outcomes both directly and indirectly through pain catastrophizing. The study is the first to observe the mediating role of catastrophizing between depression and pain outcomes in adults with sickle cell disease and chronic pain.
Adults with sickle cell disease often have chronic pain and experience symptoms of depression more frequently than the general population and other patients with chronic pain. Depression and pain catastrophizing are known to exacerbate pain outcomes. However, the mediating role of catastrophizing between depression and pain outcomes is less well studied.
Using baseline data from the GRACE trial, researchers confirmed that depression was common in adults with sickle cell disease and chronic pain and was associated with worse pain outcomes. They also found that pain catastrophizing partly linked depressive symptoms to worse pain outcomes. The findings suggest that integrated pain-focused interventions that target both depression and catastrophizing may be useful.
GRACE, an NIH Collaboratory Trial, is a pragmatic clinical trial embedded in 3 large healthcare systems to assess the effectiveness of guided relaxation and acupuncture treatments to improve pain control for patients with sickle cell disease. GRACE is supported within the NIH Pragmatic Trials Collaboratory through the NIH HEAL Initiative by a grant administered by the National Center for Complementary and Integrative Health. Learn more about GRACE.
Dr. Natalia Morone, principal investigator for OPTIMUM
In medically underserved communities, patients’ prior experience with virtual doctor visits influenced their willingness to participate in a telehealth-delivered mindfulness program for chronic low back pain.
The analysis from the OPTIMUM trial was published online in JMIR mHealth and uHealth.
OPTIMUM, an NIH Collaboratory Trial, studied the addition of mindfulness-based group telehealth visits to usual care for patients with chronic low back pain, with the goal of improving pain outcomes.
Mindfulness-based stress reduction is included in evidence-based guidelines for initial treatment of chronic low back pain. However, attending in-person group sessions can be difficult for patients facing transportation, scheduling, or economic barriers. While telehealth-based delivery offers a promising solution, little is known about how patients’ comfort and familiarity with digital health tools affect their enrollment in online programs.
Researchers from the OPTIMUM team conducted a cross-sectional analysis of participants from a safety net health center and a federally qualified health center to evaluate how sociodemographic characteristics, internet access, and other factors related to telehealth experience and willingness to enroll in the trial. The authors concluded that targeted outreach and engagement strategies may help to support broader implementation of telehealth for chronic low back pain.
OPTIMUM is supported within the NIH Pragmatic Trials Collaboratory through the NIH HEAL Initiative by a grant award administered by the National Center for Complementary and Integrative Health. Learn more about OPTIMUM.
Dr. Jennifer Kawi, Dr. Jane Bolin, and Dr. Hulin Wu, principal investigators for APA-SM
A strategy of engagement with rural partners in the APA-SM trial led to codesign of a feasible, culturally relevant study intervention for use in rural settings.
The results were published online in Frontiers in Pain Research.
APA-SM, an NIH Collaboratory Trial, is testing a 4-week auricular point acupressure telehealth intervention for self-management of chronic pain in rural communities in South Carolina and Texas. The study also includes implementation outcomes, a cost-effectiveness analysis, and an evaluation of predictive factors for treatment response.
During the planning phase of the project, the researchers tailored the study intervention for rural settings after hosting community advisory board meetings, holding focus group interviews with rural partners, and conducting a pilot feasibility study. These complementary approaches “improved the program’s cultural relevance, feasibility, and acceptability in rural settings.”
APA-SM is led by principal investigators Jennifer Kawi and Hulin Wu of UTHealth Houston and Jane Bolin of Texas A&M University. The study is supported within the NIH Pragmatic Trials Collaboratory through the NIH HEAL Initiative by the National Center for Complementary and Integrative Health, with additional oversight from the National Institute of Neurological Disorders and Stroke.
Dr. Andrea Cheville and Dr. Jon Tilburt, co–principal investigators for NOHARM
In the NOHARM trial, a strategy to promote nondrug pain management after surgery reduced exposure to opioids without worsening pain interference, physical function, and other patient-reported outcomes.
“Electronic health record (EHR)–enabled strategies that emphasize patient-centered decision-making and education may reduce opioid exposure while maintaining patient-centered outcomes, reinforcing the ongoing need for patient education to address opioid-related harms,” said Andrea Cheville, co–principal investigator for NOHARM and a professor of physical medicine and rehabilitation at Mayo Clinic.
The results of the study were published online in JAMA Network Open.
Pain after surgery is often treated with opioid medications, which for some patients can lead to prolonged opioid use, impaired recovery, and postoperative complications. Clinical guidelines recommend incorporating nondrug approaches into postoperative pain management, but barriers to their routine use have hindered widespread adoption of these strategies.
The NOHARM study team, led by Cheville and co–principal investigator Jon Tilburt, conducted a cluster randomized trial in 6 high-volume surgical centers in Arizona, Florida, Minnesota, and Wisconsin. The EHR-based intervention included an educational guide for patients about nondrug pain care modalities, clinical decision support prompting clinicians to reinforce patients’ nondrug pain care choices, and a collection of educational and self-management resources. The components of the intervention were delivered at multiple points along the perioperative care continuum.
“Partnering with allied health staff, including nurses, physical therapists, and occupational therapists, allowed us to systematically connect patients with nonpharmacologic pain management resources while formalizing processes that could be scaled across practices and sites,” said Tilburt, a professor of medicine at Mayo Clinic.
In the study’s stepped-wedge design, clusters of surgical procedures defined by surgical department and site were randomly assigned to 1 of 5 sequences. At 7-month intervals, the sequences began with a 6-month usual care period and crossed over to the intervention. A total of 68,141 surgical procedures were included in the analysis, of which 25,088 were performed during the usual care period and 43,053 were performed during the intervention period.
The researchers found no change in patient-reported pain interference and physical function. However, the intervention reduced exposure to opioids after surgery, including administration of opioids in the hospital and prescription of opioids at discharge. These reductions in opioid exposure were achieved without worsening patient-reported outcomes, opioid-related adverse events, or other safety outcomes.
“Pragmatic trials in large healthcare systems often feel like a sprint during implementation, requiring navigation of stakeholder buy-in, operational challenges, and EHR integration,” Cheville said. “The NIH Collaboratory’s ongoing support throughout the clinical trial provided our team with a trusted sounding board for addressing unanticipated challenges and informing key decisions.”
NOHARM is supported within the NIH Pragmatic Trials Collaboratory through the NIH HEAL Initiative by a grant award from the National Institute of Neurological Disorders and Stroke administered by the National Institute on Aging. Learn more about NOHARM.
Text message reminders to support cardiovascular medication adherence can be a low-cost tool for healthcare systems, according to a recent analysis from the Nudge study.
The report was published online in the American Journal of Managed Care.
The Nudge study, an NIH Collaboratory Trial led by Michael Ho of Kaiser Permanente Colorado and Sheana Bull of the Colorado School of Public Health, was a randomized trial embedded in 3 healthcare systems that tested a variety of text messaging strategies to encourage patients to refill their cardiovascular medications. The study enrolled more than 9,000 patients.
The research team measured the costs of implementing and maintaining the 3 text messaging strategies that were tested in the Nudge study. They found that the monthly cost per patient was $2.76, suggesting that medication adherence support via text message may be a low-cost solution for some healthcare systems.
Nudge was supported within the NIH Pragmatic Trials Collaboratory by a grant administered by the National Heart, Lung, and Blood Institute. Learn more about Nudge.
A new article from the NOHARM team describes the strategies the team identified for supporting posttrial sustainment of the study intervention. Their experience highlights the importance of planning for sustainment and offers lessons for designers of future pragmatic clinical trials.
NOHARM, an NIH Collaboratory Trial led by Andrea Cheville and Jon Tilburt of Mayo Clinic, is testing an electronic health record–embedded educational bundle that encourages incorporation of nonpharmacologic pain care into perioperative pain management.
The study team interviewed members of the trial’s sustainment committee and reviewed the committee’s meeting minutes to identify strategies and challenges. The strategies and challenges were grouped into 6 themes:
automation of low-touch intervention components
reliance on internal institutional champions
intentional handoff communication
institutional attention
relaxed implementation fidelity
continuous evaluation
The study team highlighted the importance of planning ahead for sustainment, thinking beyond trial settings, and using theoretically grounded approaches.
NOHARM is supported within the NIH Pragmatic Trials Collaboratory by a grant award administered by the National Institute on Aging through the NIH HEAL Initiative. Learn more about NOHARM.
Dr. Andrea Cheville and Dr. Jon Tilburt, co–principal investigators for NOHARM
Left to right: LungSMART investigators Dr. David Wetter, Dr. Guilherme Del Fiol, and Dr. Ken Kawamoto
Using the interactive text messaging intervention from the LungSMART trial as a case study, researchers demonstrated the application of a proposed framework for assessing the fit of custom large language models (LLMs) in public health interventions.
The report was published online in the Journal of Medical Internet Research.
Integration of custom LLMs into health chatbots and other clinical and public health workflows is increasingly common. However, these novel tools can produce errors and unpredictable results and can be difficult to evaluate, raising ethical and practical challenges for teams seeking to use them.
Researchers from LungSMART, an NIH Collaboratory Trial, developed an “acceptance criteria framework” to guide assessments of an LLM’s performance before its deployment in real-world practice. They demonstrated the framework by applying it to an LLM being developed for the interactive chatbot component of the LungSMART intervention.
LungSMART, led by Dave Wetter, Guilherme Del Fiol, and Ken Kawamoto of the University of Utah, is testing a combination of text messages, an interactive chatbot, and educational videos delivered by text message to address barriers to completing lung cancer screening among patients receiving care in safety net community health centers.
LungSMART is supported within the NIH Pragmatic Trials Collaboratory by a grant from the National Cancer Institute. Learn more about LungSMART.