Evaluation of intervention fidelity of a complex psychosocial intervention Lifestyle Matters: a randomised controlled trial

Intervention Fidelity to VITAL Start (Video Intervention to Inspire Treatment Adherence for Life) in a Randomized Controlled Trial Among Women Living With HIV in Malawi

BACKGROUND.

Intervention effectiveness in a randomized controlled trial is attributed to intervention fidelity. Measuring fidelity has increasing significance to intervention research and validity. The purpose of this article is to describe a systematic assessment of intervention fidelity for VITAL Start (Video intervention to Inspire Treatment Adherence for Life)-a 27-minute video-based intervention designed to improve antiretroviral therapy adherence among pregnant and breastfeeding women.

METHOD.

Research Assistants (RAs) delivered VITAL Start to participants after enrolment. The VITAL Start intervention had three components: a pre-video orientation, video viewing, and post-video counseling. Fidelity assessments using checklists comprised self (RA assessment) and observer (Research Officers, also known as ROs) assessment. Four fidelity domains (adherence, dose, quality of delivery, and participant responsiveness) were evaluated. Score scale ranges were 0 to 29 adherence, 0 to 3 dose, 0 to 48 quality of delivery and 0 to 8 participant responsiveness. Fidelity scores were calculated. Descriptive statistics summarizing the scores were performed.

RESULTS.

In total, eight RAs delivered 379 VITAL Start sessions to 379 participants. Four ROs observed and assessed 43 (11%) intervention sessions. The mean scores were 28 (SD = 1.3) for adherence, 3 (SD = 0) for dose, 40 (SD = 8.6) for quality of delivery, and 10.4 (SD = 1.3) for participant responsiveness.

CONCLUSION.

Overall, the RAs successfully delivered the VITAL Start intervention with high fidelity. Intervention fidelity monitoring should be an important element of randomized control trial design of specific interventions to ensure having reliable study results.

Occupational Therapists' Perspectives on Community Implementation of Interventions Unfamiliar to Older Adults

BACKGROUND AND OBJECTIVES

There is an increasing push for broad implementation of evidence-based interventions (EBIs) targeting older adults. Successful delivery of EBIs in communities requires therapists to adhere to protocols and to be responsive to contextual factors. This study explored the real-world implementation of an EBI, the Multiple-component Cognitive Intervention using Simulated Everyday Tasks (MCI-SET) in Taiwan from therapists' perspectives on fidelity, challenges, and strategies for program delivery.

RESEARCH DESIGN AND METHODS

We used a convergent mixed-methods design. Quantitative data were collected from the 13-item Perceived Fidelity Questionnaire (PFQ), assessing the perceived importance, proficiency, and adherence to the essential skills of MCI-SET. Qualitative data were collected via 2 World Café discussions on implementation challenges and strategies, which were recorded, transcribed verbatim, and analyzed using thematic analysis. Quantitative and qualitative findings were then compared and integrated to enrich the interpretation.

RESULTS

47 occupational therapists completed the PFQ. They rated community-oriented skills as more important, demonstrated greater proficiency, and achieved higher adherence. Qualitative analysis revealed that therapists need to increase and sustain participation by strategically introducing the program, adapting the intervention protocol to make it engaging, relevant to everyday issues, and tailored to local needs, and building rapport. Both quantitative and qualitative findings highlighted the importance of community engagement skills and the adaptability of intervention to implementation and sustainability in communities.

DISCUSSION AND IMPLICATIONS

Real-world scale-up of EBIs requires tailored adaptations responsive to community contexts, especially when initially introducing an intervention unfamiliar to the community. This emphasizes the need for a dynamic fidelity concept.

Implementation fidelity of intravenous ferric carboxymaltose administration for iron deficiency anaemia in pregnancy: a mixed-methods study nested in a clinical trial in Nigeria

BACKGROUND

Iron deficiency anaemia is common among pregnant women in Nigeria. The standard treatment is oral iron therapy, which can be sub-optimal due to side effects. Intravenous ferric carboxymaltose (FCM) is an evidenced-based alternative treatment with a more favourable side effect profile requiring administration according to a standardized protocol. In this study, we assessed the fidelity of administering a single dose of FCM according to protocol and identified factors influencing implementation fidelity.

METHODS

We used a mixed-method approach with a sequential explanatory design nested in a clinical trial across 11 facilities in Lagos and Kano States, Nigeria. Guided by a conceptual framework of implementation fidelity, we quantitatively assessed adherence to protocol by directly observing every alternate FCM administration, using an intervention procedure checklist, and compared median adherence by facility and state. Qualitative fidelity assessment was conducted via in-depth interviews with 14 skilled health personnel (SHP) from nine purposively selected health facilities, using a semi-structured interview guide. We analyzed quantitative data using descriptive and inferential statistics in Stata and used thematic analysis to analyze the transcribed interviews in NVivo.

RESULTS

A total of 254 FCM administrations were observed across the 11 study sites, with the majority in secondary (63%), followed by primary healthcare facilities (PHCs) (30%). Overall, adherence to FCM administration as per protocol was moderate (63%) and varied depending on facility level. The lowest level of adherence was observed in PHCs (36%). Median, adherence level showed significant differences by facility level (p = 0.001) but not by state (p = 0.889). Teamwork and availability of protocols are facilitation strategies that contributed to high fidelity. However, institutional/ logistical barriers are contextual factors that influenced the varied fidelity levels observed in some facilities.

CONCLUSIONS

Collaborative teams and access to operating protocols resulted in high fidelity in some facilities. However, in some PHCs, fidelity to FCM was low due to contextual factors and intervention complexities, thereby influencing the quality of delivery. In Nigeria, scale-up of FCM will require attention to staff strength, teamwork and availability of administration protocols, in order to optimize its impact on anaemia in pregnancy.

What is known about the role of external facilitators during the implementation of complex interventions in healthcare settings? A scoping review

OBJECTIVE

To synthesise current knowledge about the role of external facilitators as an individual role during the implementation of complex interventions in healthcare settings.

DESIGN

A scoping review was conducted. We reviewed original studies (between 2000 and 2023) about implementing an evidence-based complex intervention in a healthcare setting using external facilitators to support the implementation process. An information specialist used the following databases for the search strategy: MEDLINE, CINAHL, APA PsycINFO, Academic Search Complete, EMBASE (Scopus), Business Source Complete and SocINDEX.

RESULTS

36 reports were included for analysis, including 34 different complex interventions. We performed a mixed thematic analysis to synthesise the data. We identified two primary external facilitator roles: lead facilitator and process expert facilitator. Process expert external facilitators have specific responsibilities according to their role and expertise in supporting three main processes: clinical, change management and knowledge/research management.

CONCLUSIONS

Future research should study processes supported by external facilitators and their relationship with facilitation strategies and implementation outcomes. Future systematic or realist reviews may also focus on outcomes and the effectiveness of external facilitation.

Development and validation of the Overall Fidelity Enactment Scale for Complex Interventions (OFES-CI)

BACKGROUND

In many quality improvement (QI) and other complex interventions, assessing the fidelity with which participants 'enact' intervention activities (ie, implement them as intended) is underexplored. Adapting the evaluative approach used in objective structured clinical examinations, we aimed to develop and validate a practical approach to assessing fidelity enactment-the Overall Fidelity Enactment Scale for Complex Interventions (OFES-CI).

METHODS

We developed the OFES-CI to evaluate enactment of the SCOPE QI intervention, which teaches nursing home teams to use plan-do-study-act (PDSA) cycles. The OFES-CI was piloted and revised early in SCOPE with good inter-rater reliability, so we proceeded with a single rater. An intraclass correlation coefficient (ICC) was used to assess inter-rater reliability. For 27 SCOPE teams, we used ICC to compare two methods for assessing fidelity enactment: (1) OFES-CI ratings provided by one of five trained experts who observed structured 6 min PDSA progress presentations made at the end of SCOPE, (2) average rating of two coders' deductive content analysis of qualitative process evaluation data collected during the final 3 months of SCOPE (our gold standard).

RESULTS

Using Cicchetti's classification, inter-rater reliability between two coders who derived the gold standard enactment score was 'excellent' (ICC=0.93, 95% CI=0.85 to 0.97). Inter-rater reliability between the OFES-CI and the gold standard was good (ICC=0.71, 95% CI=0.46 to 0.86), after removing one team where open-text comments were discrepant with the rating. Rater feedback suggests the OFES-CI has strong face validity and positive implementation qualities (acceptability, easy to use, low training requirements).

CONCLUSIONS

The OFES-CI provides a promising novel approach for assessing fidelity enactment in QI and other complex interventions. It demonstrates good reliability against our gold standard assessment approach and addresses the practicality problem in fidelity assessment by virtue of its suitable implementation qualities. Steps for adapting the OFES-CI to other complex interventions are offered.

The efficacy of thought field therapy and its impact on heart rate variability in student counseling: A randomized controlled trial

CONTEXT

Thought Field Therapy is an evidence-based method validated by 17 clinical trials, including five Randomized Controlled Trials. This study investigates whether a single Thought Field Therapy session can improve psychological issues such as stress, depression, and performance anxiety in university students.

METHODS

Fifty university students were randomly assigned to an intervention group or a waitlist control group. The intervention group received a single counseling session of Thought Field Therapy and was assessed by Subjective Units of Distress and Heart Rate Variability before and after the session. The waitlist group received Thought Field Therapy and was administered the Profile of Mood States Second Edition. All participants completed the latter after a waiting period of 1-3 weeks.

RESULTS

The 39 students who received Thought Field Therapy showed significantly higher Heart Rate Variability post-compared to pre-therapy (p < .001). The 33 students who were assessed for Subjective Units of Distress also reported significant improvements (p < .001) by a 91% reduction in distress for an average duration of 36 minutes. The Profile of Mood States Second Edition score did not show significant improvements in the intervention group (n = 24) as compared to the control group (n = 15).

CONCLUSION

A brief intervention of Thought Field Therapy can reduce stress and psychological distress among university students, and increase their physiological resilience in a limited timeframe, after a single session of counseling. However, the single session did not suffice to significantly improve their psychological conditions over the long term.