Was it a HIIT? A process evaluation of a school-based high-intensity interval training intervention

BACKGROUND

Despite a growing body of research investigating high-intensity interval training (HIIT) in schools, there are limited process evaluations investigating their implementation. This is concerning because process evaluations are important for appropriately interpreting outcome findings and augmenting intervention design. This manuscript presents a process evaluation of Making a HIIT, a school-based HIIT intervention.

METHODS

The Making a HIIT intervention spanned 8 weeks and was completed at three schools in Greater Brisbane, Australia. Ten classes (intervention group) completed 10-min teacher-led HIIT workouts at the beginning of health and physical education (HPE) lessons, and five classes (control group) continued with regular HPE lessons. The mixed methods evaluation was guided by the Framework for Effective Implementation by Durlak and DuPre.

RESULTS

Program reach: Ten schools were contacted to successfully recruit three schools, from which 79% of eligible students (n = 308, x ¯ age: 13.0 ± 0.6 years, 148 girls) provided consent. Dosage: The average number of HIIT workouts provided was 10 ± 3 and the average number attended by students was 6 ± 2. Fidelity: During HIIT workouts, the percentage of time students spent at ≥ 80% of maximum heart rate (HRmax) was 55% (interquartile range (IQR): 29%-76%). Monitoring of the control group: During lessons, the intervention and control groups spent 32% (IQR: 12%-54%) and 28% (IQR: 13%-46%) of their HPE lesson at ≥ 80% of HRmax, respectively. Responsiveness: On average, students rated their enjoyment of HIIT workouts as 3.3 ± 1.1 (neutral) on a 5-point scale. Quality: Teachers found the HIIT workouts simple to implement but provided insights into the time implications of integrating them into their lessons; elements that helped facilitate their implementation; and their use within the classroom. Differentiation: Making a HIIT involved students and teachers in the co-design of HIIT workouts. Adaption: Workouts were modified due to location and weather, the complexity of exercises, and time constraints.

CONCLUSION

The comprehensive evaluation of Making a HIIT provides important insights into the implementation of school-based HIIT, including encouragings findings for student enjoyment and fidelity and recommendations for improving dosage that should be considered when developing future interventions.

TRIAL REGISTRATION

ACTRN, ACTRN12622000534785 , Registered 5 April 2022 - Retrospectively registered.

The state of reporting context and implementation in peer-reviewed evaluations of water, sanitation, and hygiene interventions: A scoping review

INTRODUCTION

To accurately assess evidence from environmental and public health field trials, context and implementation details of the intervention must be weighed with trial results; yet these details are under and inconsistently reported for water, sanitation, and hygiene (WASH), limiting the external validity of the evidence.

METHODS

To quantify the level of reporting of context and implementation in WASH evaluations, we conducted a scoping review of the 40 most cited evaluations of WASH interventions published in the last 10 years (2012-2022). We applied criteria derived from a review of existing reporting guidance from other sectors including healthcare and implementation science. We subsequently reviewed main articles, supplements, protocols, and other associated resources to assess thoroughness of context and implementation reporting.

RESULTS

Of the final 25 reporting items we searched for, four-intervention name, approach, location, and temporality-were reported by all studies. Five items-theory, implementer qualifications, dose intensity, targeting, and measured fidelity-were not reported in over a third of reviewed articles. Only two studies (5%) reported all items in our checklist. Only 74% of items were found in the main article, while the rest were found in separate papers (7%) or not at all (19%).

DISCUSSION

Inconsistent reporting of WASH implementation illustrates a major challenge in the sector. It is difficult to know what interventions are actually being evaluated and how to compare evaluation results. This inconsistent and incomplete implementation reporting limits the ability of programmers and policy makers to apply the available evidence to their contexts. Standardized reporting guidelines would improve the application of the evidence for WASH field evaluations.

Assessing the implementation fidelity, feasibility, and sustainability of community-based house improvement for malaria control in southern Malawi: a mixed-methods study

BACKGROUND

Despite significant success in the fight against malaria over the past two decades, malaria control programmes rely on only two insecticidal methods: indoor residual spraying and insecticidal-treated nets. House improvement (HI) can complement these interventions by reducing human-mosquito contact, thereby reinforcing the gains in disease reduction. This study assessed the implementation fidelity, which is the assessment of how closely an intervention aligns with its intended design, feasibility, and sustainability of community-led HI in southern Malawi.

METHODS

The study, conducted in 22 villages (2730 households), employed a mixed-methods approach. Implementation fidelity was assessed using a modified framework, with longitudinal surveys collecting data on HI coverage indicators. Quantitative analysis, employing descriptive statistics, evaluated the adherence to HI implementation. Qualitative data came from in-depth interviews, key informant interviews, and focus groups involving project beneficiaries and implementers. Qualitative data were analysed using content analysis guided by the implementation fidelity model to explore facilitators, challenges, and factors affecting intervention feasibility.

RESULTS

The results show that HI was implemented as planned. There was good adherence to the intended community-led HI design; however, the adherence could have been higher but gradually declined over time. In terms of intervention implementation, 74% of houses had attempted to have eaves closed in 2016-17 and 2017-18, compared to 70% in 2018-19. In 2016-17, 42% of houses had all four sides of the eaves closed, compared to 33% in 2018-19. Approximately 72% of houses were screened with gauze wire in 2016-17, compared to 57% in 2018-19. High costs, supply shortages, labour demands, volunteers' poor living conditions and adverse weather were reported to hinder the ideal HI implementation. Overall, the community described community-led HI as feasible and could be sustained by addressing these socioeconomic and contextual challenges.

CONCLUSION

Our study found that although HI was initially implemented as planned, its fidelity declined over time. Using trained volunteers facilitated the fidelity and feasibility of implementing the intervention. A combination of rigorous community education, consistent training, information, education and communication, and intervention modifications may be necessary to address the challenges and enhance the intervention's fidelity, feasibility, and sustainability.

Can the delivery of behavioural support be improved in the NHS England Low-Calorie Diet Programme? An observational study of behaviour change techniques

BACKGROUND

Previous research has illustrated a drift in the fidelity of behaviour change techniques (BCTs) during the design of the pilot NHS England Low-Calorie Diet (NHS-LCD) Programme. This study evaluated a subsequent domain of fidelity, intervention delivery. Two research questions were addressed: (1) To what extent were BCTs delivered with fidelity to providers programme plans? (2) What were the observed barriers and facilitators to delivery?

METHODS

A mixed-methods sequential explanatory design was employed. Remote delivery of one-to-one and group-based programmes were observed. A BCT checklist was developed using the BCT Taxonomy v1; BCTs were coded as present, partially delivered, or absent during live sessions. Relational content analysis of field notes identified observed barriers and facilitators to fidelity.

RESULTS

Observations of 122 sessions across eight samples and two service providers were completed. Delivery of the complete NHS-LCD was observed for five samples. Fidelity ranged from 33% to 70% across samples and was higher for group-based delivery models (64%) compared with one-to-one models (46%). Barriers and facilitators included alignment with the programme's target behaviours and outcomes, session content, time availability and management, group-based remote delivery, and deviation from the session plan.

CONCLUSIONS

Overall, BCTs were delivered with low-to-moderate fidelity. Findings indicate a dilution in fidelity during the delivery of the NHS-LCD and variation in the fidelity of programmes delivered across England. Staff training could provide opportunities to practice the delivery of BCTs. Programme-level changes such as structured activities supported by participant materials and with sufficient allocated time, might improve the delivery of BCTs targeting self-regulation.

A RCT to explore the effectiveness of supporting adherence to nebuliser medication in adults with cystic fibrosis: fidelity assessment of study interventions

BACKGROUND

A multi-component self-management intervention 'CFHealthHub' was developed to reduce pulmonary exacerbations in adults with Cystic Fibrosis (CF) by supporting adherence to nebuliser medication. It was evaluated in a randomized controlled trial (RCT) involving 19 CF centres, with 32 interventionists, 305 participants in the intervention group, and 303 participants in the standard care arm. Ensuring treatment fidelity of intervention delivery was crucial to ensure that the intervention produced the expected outcomes.

METHODS

Fidelity of the CFHealthHub intervention and standard care was assessed using different methods for each of the five fidelity domains defined by the Borrelli framework: study design, training, treatment delivery, receipt, and enactment. Study design ensured that the groups received the intended intervention or standard care. Interventionists underwent training and competency assessments to be deemed certified to deliver the intervention. Audio-recorded intervention sessions were assessed for fidelity drift. Receipt was assessed by identifying whether participants set Action and Coping Plans, while enactment was assessed using click analytics on the CFHealthHub digital platform.

RESULTS

Design: There was reasonable agreement (74%, 226/305) between the expected versus actual intervention dose received by participants in the CFHealthHub intervention group. The standard care group did not include focused adherence support for most centres and participants. Training: All interventionists were trained. Treatment delivery: The trial demonstrated good fidelity (overall fidelity by centre ranged from 79 to 97%), with only one centre falling below the mean threshold (> 80%) on fidelity drift assessments. Receipt: Among participants who completed the 12-month intervention, 77% (205/265) completed at least one action plan, and 60% (160/265) completed at least one coping plan. Enactment: 88% (268/305) of participants used web/app click analytics outside the intervention sessions. The mean (SD) number of web/app click analytics per participant was 31.2 (58.9). Additionally, 64% (195/305) of participants agreed to receive notifications via the mobile application, with an average of 53.6 (14.9) notifications per participant.

CONCLUSIONS

The study demonstrates high fidelity throughout the RCT, and the CFHealthHub intervention was delivered as intended. This provides confidence that the results of the RCT are a valid reflection of the effectiveness of the CFHealthHub intervention compared to standard care.

TRIAL REGISTRATION

ISRCTN registry: ISRCTN55504164 (date of registration: 12/10/2017).

An assessment of adaptation and fidelity in the implementation of an audit and feedback-based intervention to improve transition to adult type 1 diabetes care in Ontario, Canada

BACKGROUND

The fit between an intervention and its local context may affect its implementation and effectiveness. Researchers have stated that both fidelity (the degree to which an intervention is delivered, enacted, and received as intended) and adaptation to the local context are necessary for high-quality implementation. This study describes the implementation of an audit and feedback (AF)-based intervention to improve transition to type 1 diabetes adult care, at five sites, in terms of adaptation and fidelity.

METHODS

An audit and feedback (AF)-based intervention for healthcare teams to improve transition to adult care for patients with type 1 diabetes was studied at five pediatric sites. The Framework for Reporting Adaptations and Modifications to Evidence-based Implementation Strategies (FRAME-IS) was used to document the adaptations made during the study. Fidelity was determined on three different levels: delivery, enactment, and receipt.

RESULTS

Fidelity of delivery, receipt, and enactment were preserved during the implementation of the intervention. Of the five sites, three changed their chosen quality improvement initiative, however, within the parameters of the study protocol; therefore, fidelity was preserved while still enabling participants to adapt accordingly.

CONCLUSIONS

We describe implementing a multi-center AF-based intervention across five sites in Ontario to improve the transition from pediatric to adult diabetes care for youth with type 1 diabetes. This intervention adopted a balanced approach considering both adaptation and fidelity to foster a community of practice to facilitate implementing quality improvement initiatives for improving transition to adult diabetes care. This approach may be adapted for improving transition care for youth with other chronic conditions and to other complex AF-based interventions.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03781973. Registered 13 December 2018. Date of enrolment of the first participant to the trial: June 1, 2019.

Fidelity-consistency and deliberateness of modifications in parenting programs

BACKGROUND

Evidence-based interventions (EBIs) are frequently modified in practice. It is recommended that decisions to modify EBIs should be made deliberately to ensure fidelity-consistency, yet the relationship between fidelity-consistency and deliberateness is not well understood. This study aims to explore modifications in a sample of practitioners delivering evidence-based parenting programs (i.e., interventions to strengthen parent-child relationships, reduce harmful interactions, and improve child health and well-being). The study investigated three research questions: (1) What kind of modifications are made during the delivery of parenting programs? (2) To what degree are the identified modifications consistent with the core functions of each program? and (3) Is deliberateness associated with the fidelity-consistency of the identified modifications?

METHODS

In total, 28 group leaders of five widely disseminated parenting programs in Sweden participated in five focus groups, and two participants from each group also participated in individual interviews (n = 10). A content analysis approach was used where the identification of modifications was directed by the Framework for Reporting Adaptations and Modifications-Enhanced (FRAME) and then assessed for fidelity-consistency and four levels of deliberateness (universal, situational, conditional, and unintentional). Chi-square tests were performed to compare consistent and inconsistent modifications, and logistic regression was performed to explore whether deliberateness predicted consistency.

RESULTS

A total of 137 content modifications were identified, covering most of the content modification categories in FRAME. The most common were tailoring/tweaking/refining, adding elements, shortening/condensing, lengthening/extending, and integrating another treatment. Modifications were mostly fidelity-consistent but consistency varied greatly among categories. Furthermore, modifications made unintentionally or situationally were more likely to be fidelity-inconsistent.

CONCLUSIONS

These results indicate that explicit consideration of modifications and their impact could be essential for sustaining the fidelity-consistent use of EBIs, even as such interventions are continuously modified.

Improving the implementation of KiVa antibullying program with tailored support: Study protocol for a cluster randomized controlled trial

BACKGROUND

There are no evidence-based models to support the implementation of school-based bullying prevention programs. Our primary objective is to examine the impact of tailored support on the implementation of the KiVa antibullying program. Our second objective is to evaluate whether the offered support influences student outcomes (e.g., victimization, bullying perpetration). We also assess the cost-effectiveness of the provided support and conduct a process evaluation.

METHODS

In a cluster randomized control trial (cRCT), we compare program fidelity between schools that receive implementation support and those that do not. Twenty-four (N = 24) schools in Finland were randomized to either the IMPRES condition (receiving support, n = 12) or the control group (KiVa as usual, n = 12). In the IMPRES condition, pre-assessment and staff training were organized, and a selected team of staff members received four mentoring sessions during one academic year. Staff and students answer questionnaires at the end of school year 0, at post-intervention (year 1) and again at the 1-year follow-up (year 2). Our primary outcomes concern two main program components - universal and indicated actions - reflecting program fidelity. As secondary outcomes, we examine the level of bullying victimization and perpetration as well as students' perception of several program fidelity indicators. Finally, we assess several tertiary outcomes, collect resource data and conduct qualitative interviews to perform additional analyses.

CONCLUSION

This trial will inform us of whether implementation support can boost program fidelity and have a distal impact on bullying prevalence.

TRIAL REGISTRATION

ISRCTN15558617 https://doi.org/10.1186/ISRCTN15558617.

Process evaluation of the Yéego! Program to increase healthy eating and gardening among American Indian elementary school children

BACKGROUND

American Indian children are at increased risk for obesity and diabetes. School-based health promotion interventions are one approach to promoting healthy behaviors to reduce this risk, yet few studies have described their implementation and fidelity. We conducted a qualitative process evaluation of the Yéego! Healthy Eating and Gardening Program, a school-based intervention to promote healthy eating among Navajo elementary school children. The intervention included a yearlong integrated curriculum, as well as the construction and maintenance of a school-based garden.

METHODS

Our process evaluation included fidelity checklists completed by program staff and qualitative interviews with program staff and classroom teachers after the intervention was implemented. We used content analysis to identify themes.

RESULTS

We identified several themes related to evidence of delivery adherence, program satisfaction, and lessons learned about delivery. Intervention staff followed similar procedures to prepare for and deliver lessons, but timing, teaching styles, and school-level factors also impacted overall implementation fidelity. Teachers and students had positive perceptions of the program, especially lessons that were highly visual, experiential, and connected to Navajo culture and the surrounding community. Teachers and program staff identified ways to enhance the usability of the curriculum by narrowing the scope, relating content to student experiences, and aligning content with school curriculum standards.

CONCLUSIONS

The program was implemented with moderately high fidelity across contexts. We identified areas where modifications could improve engagement, acceptability, efficacy, and sustainability of the program. Our results have implications for the evaluation and dissemination of school-based health interventions to promote healthy eating among children, especially in American Indian communities.

Developing the Workforce of the Digital Future: mHealth Competency and Fidelity Measurement in Community-Based Care

Integrating mobile health (mHealth) interventions into settings that serve diverse patient populations requires that prerequisite professional competencies are delineated and that standards for clinical quality assurance can be pragmatically assessed. Heretofore, proposed mHealth competencies have been broad and have lacked a framework to support specific applications. We outline the meta-competencies identified in the literature relevant to mHealth interventions and demonstrate how these meta-competencies can be integrated with population- and intervention-related competencies to help guide a pragmatic approach to competency assessment. We present a use case based on FOCUS-an evidence-based mHealth intervention designed for individuals with serious mental illness and currently being implemented in geographically and demographically diverse community behavioral health settings. Subsequent to identifying the cross-cutting competencies relevant to the target population (outpatients experiencing psychotic symptoms), substratal intervention (Cognitive Behavioral Therapy for psychosis), and treatment modality (mHealth), we detail the development process of an mHealth fidelity monitoring system (mHealth-FMS). We adhered to a published sequential 5-step process to design a fidelity monitoring system that aligns with our integrated mHealth competency framework and that was guided by best practices prescribed by the Treatment Fidelity Workgroup of the National Institutes of Health Behavior Change Consortium. The mHealth-FMS is intended to enhance both clinical and implementation outcomes by grounding the mHealth interventionist and the system of care in which they operate in the core functions, tasks, knowledge, and competencies associated with system-integrated mHealth delivery. Future research will explore acceptability and feasibility of the mHealth-FMS.

Fidelity to the Consensus Auditory-Perceptual Analysis of Voice (CAPE-V): A Pilot Study

OBJECTIVES

Auditory-perceptual measurements of voice are among the most common diagnostic tools used during a voice evaluation and are considered a gold standard for documenting voice disorders. The goal of this pilot study was to examine the fidelity of clinicians in the administration of the Consensus Auditory-Perceptual Evaluation of Voice (CAPE-V) and its published protocol. This investigation aimed to determine how the CAPE-V is being used by clinicians and researchers and the extent to which users deviate from the published procedure.

STUDY DESIGN

Survey METHODS: Data were collected by surveying a group (N = l7) of speech-language pathologists who regularly evaluate and treat patients with voice disorders. Survey results revealed that few of the sampled speech-language pathologists follow exactly the standardized instructions for administering the CAPE-V. Considerable variability in CAPE-V administration, including tasks and stimuli examined, was found across respondents.

CONCLUSIONS

This exploratory project may be used to develop a larger national survey study investigating fidelity to the CAPE-V and to motivate recommendations for possible revisions to the instrument and its protocol for administration.

Process evaluation of the 90-90-90 targets of surge project in Addis Ababa, Ethiopia: a case study evaluation

BACKGROUND

Human Immunodeficiency Virus (HIV) is a major public health problem that continues to pose an enormous challenge to mankind's survival worldwide. In urban Ethiopia, the HIV prevalence among adults aged 15-49 years is 2.9%, while in Addis Ababa, it is 3.4%. To take the edge off, the Ethiopian government has been implementing the 90-90-90 strategy also known as the surge project, in urban cities. However, the implementation of the program has not been evaluated. Thus, we evaluated the process of the 90-90-90 targets of the surge project in Addis Ababa, Ethiopia.

METHODS

We conducted a case study with concurrent mixed-methods evaluation. We used indicator-driven evaluation dimensions -availability and accommodation dimensions from the health services access and compliance and fidelity from implementation fidelity frameworks to test the program process theory with a total of 52 indicators. We interviewed a total of 419 clients and 210 healthcare providers and reviewed 417 clients' cards and 17 registries. We also conducted 30 key informant interviews and resource inventory. A binary logistic regression analysis was done to identify factors associated with clients' satisfaction. We transcribed and translated the qualitative data and analysed thematically. Finally, we judged the overall process of the surge project based on the pre-seated judgmental criteria as; needs urgent improvement, needs improvement and well implemented.

RESULTS

We found that 90% of the project process was as per the program process theory measured by the availability of resources (95.8%), compliance (88.0%), fidelity (84.7%), and accommodation of services (89.3%). We found a shortage of human power, test kits, and viral load testing machines. The commitment of health care providers, provider-client interaction, and clients' satisfaction with the service at card rooms were found to be poor. Moreover, being aged 15-24, being married and government government-employed were negatively associated with clients' satisfaction with antiretroviral therapy services.

CONCLUSION

The process of the surge project needs improvement. Moreover, the achievements of the first two 90-90 targets were poor. Therefore, implementers need to take intensified action for the availability of resources and to improve the commitment of healthcare providers through refreshment training.

Simulated cardiopulmonary bypass: a high fidelity model for developing and accessing clinical perfusion skills

BACKGROUND

Traditionally, novice perfusionists learn and practice clinical skills, during live surgical procedures. The profession's accrediting body is directing schools to implement simulated cardiopulmonary bypass (CPB) into the curriculum. Unfortunately, no CPB simulation models have been validated. Here we describe the design and application of a CPB simulation model.

METHODS

A CPB patient simulator was integrated into a representative operative theater and interfaced with a simple manikin, a heart-lung machine (HLM), clinical perfusion circuitry, and equipment. Participants completed a simulation scenario designed to represent a typical CPB procedure before completing an exit survey to assess the fidelity and validity of the experience. Questions were scored using a 5-point Likert scale.

RESULTS

Participants (n = 81) contributed 953 opinions on 40 questions. The participants reported that the model of simulated CPB (1) realistically presented both the physiologic and technical parameters seen during CPB (n = 347, mean 4.37, SD 0.86), (2) accurately represented the psychological constructs and cognitive mechanisms of the clinical CPB (n = 139, mean 4.24, SD 1.08), (3) requires real clinical skills and reproduces realistic surgical case progression (n = 167, mean 4.38, SD 0.86), and (4) would be effective for teaching, practicing, and assessing the fundamental skills of CPB (n = 300, mean 4.54, SD 0.9). Participants agreed that their performance in the simulation scenario accurately predicted their performance in a real clinical setting (n = 43, mean 4.07, SD 1.03) CONCLUSION: This novel simulation model of CPB reproduces the salient aspects of clinical CPB and may be useful for teaching, practicing, and assessing fundamental skills.

Application of xanthan and locust bean gum mix or sorbitol in the jelly formulation to improved jelly 3D printing using a fused deposition modeling printer

This study examined the impacts of applying a xanthan and locust bean gum mix or sorbitol to a jelly formulation on the rheological parameters necessary for 3D printing a jelly applying the fused deposition modeling method. A jelly formulation was fortified with a gum mix (xanthan gum:locust bean gum = 0.625:0.375) at 1% (w/w), or added with sorbitol instead of sugar. Both treatments increased the values of storage modulus and yield stress, related to fidelity and shape retention, and adding the gum mix, in particular, increased the gel strength. Applying these treatments to the formulation that lacks the rheological parameters and gel strength required for 3D printing changed those values in a direction fulfilling the material requirements. This research confirmed that the application of xanthan and locust bean gum mix or sorbitol could adjust the properties of materials used in 3D printing for improved printability.

Process and Implementation Elements of Measurement Feedback Systems: A Systematic Review

Measurement feedback systems (MFS) can help guide treatment and improve clinical outcomes. Studies of MFS are heterogeneous both in execution and results, and the effects of MFS seem restricted by limited attention to process and implementation elements and by limited adoption by health professionals. The current systematic review mapped the use of process and implementation elements in MFS studies. An overview of therapists' use of and attitudes toward MFS is provided. Three-level meta-analyses were used to test theoretically informed process and implementation elements as moderators of the effects of MFS. Hypotheses and general propositions from Clinical Performance Feedback Intervention Theory (CP-FIT) were used to organize the elements of the studies and were used as moderator variables. Previous studies on MFS interventions have had a limited focus on implementation efforts and process elements that may increase the effects of MFS and their use among therapists. Efforts have sparsely been made to reduce barriers to MFS use, and several studies have reported limited engagement with MFS among therapists. Therapists' attitudes toward MFS, feedback, or standardized measures were heterogeneously reported, making data synthesis challenging. Identified process and implementation elements were not significantly associated with effect sizes in the studies and the results did not support the propositions of CP-FIT. The lack of statistically significant associations may be due to limited reporting of details about process and implementation aspects. More research designed to test hypotheses regarding process and implementation elements is needed to improve the use and effects of MFS. Future studies should aspire to report findings in a manner that allows for an understanding of the implementation process and therapists' adoption of these systems.

Implementation and engagement of the SMART Work & Life sitting reduction intervention: an exploratory analysis on intervention effectiveness

BACKGROUND

To enhance the impact of interventions, it is important to understand how intervention engagement relates to study outcomes. We report on the level of implementation and engagement with the SMART Work & Life (SWAL) programme (delivered with (SWAL plus desk) and without a height-adjustable desk (SWAL)) and explore the effects of different levels of this on change in daily sitting time in comparison to the control group.

METHODS

The extent of intervention delivery by workplace champions and the extent of engagement by champions and participants (staff) with each intervention activity was assessed by training attendance logs, workplace champion withdrawal dates, intervention activities logs and questionnaires. These data were used to assess whether a cluster met defined criteria for low, medium, or high implementation and engagement or none of these. Mixed effects linear regression analyses tested whether change in sitting time varied by: (i) the number of intervention activities implemented and engaged with, and (ii) the percentage of implementation and engagement with all intervention strategies.

RESULTS

Workplace champions were recruited for all clusters, with 51/52 (98%) attending training. Overall, 12/27 (44.4%) SWAL and 9/25 (36.0%) SWAL plus desk clusters implemented all main intervention strategies. Across remaining clusters, the level of intervention implementation varied. Those in the SWAL (n = 8 (29.6%) clusters, 80 (32.1%) participants) and SWAL plus desk (n = 5 (20.0%) clusters, 41 (17.1%) participants) intervention groups who implemented and engaged with the most intervention strategies and had the highest percentage of cluster implementation and engagement with all intervention strategies sat for 30.9 (95% CI -53.9 to -7.9, p = 0.01) and 75.6 (95% CI -103.6 to -47.7, p < 0.001) fewer minutes/day respectively compared to the control group at 12 month follow up. These differences were larger than the complete case analysis. The differences in sitting time observed for the medium and low levels were similar to the complete case analysis.

CONCLUSIONS

Most intervention strategies were delivered to some extent across the clusters although there was large variation. Superior effects for sitting reduction were seen for those intervention groups who implemented and engaged with the most intervention components and had the highest level of cluster implementation and engagement.

TRIAL REGISTRATION

ISRCTN11618007. Registered on 24 January 2018. https://www.isrctn.com/ISRCTNISRCTN11618007 .

Champion and audit and feedback strategy fidelity and their relationship to depression intervention fidelity: A mixed method study

Background

Globally, mental health disorders rank as the greatest cause of disability. Low and middle-income countries (LMICs) hold a disproportionate share of the mental health burden, especially as it pertains to depression. Depression is highly prevalent among those with non-communicable diseases (NCDs), creating a barrier to successful treatment. While some treatments have proven efficacy in LMIC settings, wide dissemination is challenged by multiple factors, leading researchers to call for implementation strategies to overcome barriers to care provision. However, implementation strategies are often not well defined or documented, challenging the interpretation of study results and the uptake and replication of strategies in practice settings. Assessing implementation strategy fidelity (ISF), or the extent to which a strategy was implemented as designed, overcomes these challenges. This study assessed fidelity of two implementation strategies (a 'basic' champion strategy and an 'enhanced' champion + audit and feedback strategy) to improve the integration of a depression intervention, measurement based care (MBC), at 10 NCD clinics in Malawi. The primary goal of this study was to assess the relationship between the implementation strategies and MBC fidelity using a mixed methods approach.

Methods

We developed a theory-informed mixed methods fidelity assessment that first combined an implementation strategy specification technique with a fidelity framework. We then created corresponding fidelity indicators to strategy components. Clinical process data and one-on-one in-depth interviews with 45 staff members at 6 clinics were utilized as data sources. Our final analysis used descriptive statistics, reflexive-thematic analysis (RTA), data merging, and triangulation to examine the relationship between ISF and MBC intervention fidelity.

Results

Our mixed methods analysis revealed how ISF may moderate the relationship between the strategies and MBC fidelity. Leadership engagement and implementation climate were critical for clinics to overcome implementation barriers and preserve implementation strategy and MBC fidelity. Descriptive statistics determined champion strategy fidelity to range from 61 to 93% across the 10 clinics. Fidelity to the audit and feedback strategy ranged from 82 to 91% across the 5 clinics assigned to that condition. MBC fidelity ranged from 54 to 95% across all clinics. Although correlations between ISF and MBC fidelity were not statistically significant due to the sample of 10 clinics, associations were in the expected direction and of moderate effect size. A coefficient for shared depression screening among clinicians had greater face validity compared to depression screening coverage and functioned as a proximal indicator of implementation strategy success.

Conclusion

Fidelity to the basic and enhanced strategies varied by site and were influenced by leadership engagement and implementation climate. Champion strategies may benefit from the addition of leadership strategies to help address implementation barriers outside the purview of champions. ISF may moderate the relationship between strategies and implementation outcomes.

What do we not know (yet) about recovery colleges? A study protocol on their (cost-)effectiveness, mechanisms of action, fidelity and positioning

BACKGROUND

Recovery Colleges (RCs) have spread across the globe as a new way of supporting people with mental vulnerabilities in their recovery journey. RCs focus on 'learning' rather than 'curing' and in that line facilitate a transition from being a passive, dependent patient/client to an active, empowered student learning to live life, despite vulnerabilities. Peer support and co-creation are central in RCs, as peers learn from each other by sharing personal experiences with mental vulnerabilities in an accessible, inspiring and stimulating atmosphere. The implementation of RCs is highly encouraged internationally, and as a result RCs and related self-help initiatives increasingly emerge. However, high-quality research on RCs is scarce and there is a call for thorough investigation of (cost-)effectiveness, mechanisms of action, cross-border fidelity and positioning of RCs. In response, this research project aims to fill these gaps.

METHODS

This research project entails (1) a prospective quasi-experimental effectiveness study and economic evaluation, (2) a multifaceted qualitative study to elaborate on the mechanisms of action of RCs for those involved (3) a study to develop a (Dutch) Fidelity Measure of Recovery Colleges, and (4) an organisational case study to describe the positioning of RCs in relation to other mental health care services and community-based initiatives. Following the ideals of co-creation and empowerment in RCs we conduct this research project in co-creation with RC students from Enik Recovery College in Utrecht, the Netherlands.

DISCUSSION

This research project will lead to one of the first longitudinal controlled quantitative evaluations of both cost-effectiveness and effectiveness of RC attendance in a broad sense (beyond attending courses alone). Moreover, we will gather data on a micro level (i.e., impact on RC students), meso level (i.e., organisational fidelity) and macro level (i.e., positioning in the care and support domain), capturing all important perspectives when scrutinizing the impact of complex systems. Finally, we will demonstrate the validity and value of embracing experiential knowledge in science as a complementary source of information, leading to a more profound understanding of what is researched.

TRIAL REGISTRATION

The prospective quasi-experimental study has been pre-registered at clinicaltrails.gov (#NCT05620212).

The Association Between Facilitator Competent Adherence and Outcomes in Parenting Programs: a Systematic Review and SWiM Analysis

There is increasing interest about the fidelity with which interventions are implemented because it is theorized that better implementation fidelity by facilitators is associated with better participant outcomes. However, in the parenting program literature, there is mixed evidence on the relationship between implementation fidelity and outcomes. This paper provides a synthesis of the evidence on the relationship between facilitator delivery and outcomes in the parenting program literature. Following PRISMA guidelines, this paper synthesizes the results of a systematic review of studies on parenting programs aiming to reduce violence against children and child behavior problems. Specifically, it examines associations between observational measures of facilitator competent adherence and parent and child outcomes. A meta-analysis was not feasible due to study heterogeneity. As a result, Synthesis Without Meta-Analysis guidelines were followed. Searches in electronic databases, reference searching, forward citation tracking, and expert input identified 9653 articles. After screening using pre-specified criteria, 18 articles were included. The review found that most studies (n = 13) reported a statistically significant positive relationship with at least one parent or child outcome. However, eight studies reported inconsistent findings across outcomes, and four studies found no association with outcomes. The results suggest that better facilitator competent adherence is generally associated with positive parent and child outcomes. However, this finding is weakened by the methodological heterogeneity of included studies and due to the wide variety of ways in which studies conceptualized competent adherence-outcome relationships.

Bst polymerase - a humble relative of Taq polymerase

DNA polymerases are a superfamily of enzymes synthesizing DNA using DNA as a template. They are essential for nucleic acid metabolism and for DNA replication and repair. Modern biotechnology and molecular diagnostics rely heavily on DNA polymerases in analyzing nucleic acids. Among a variety of discovered DNA polymerases, Bst polymerase, a large fragment of DNA polymerase I from Geobacillus stearothermophilus, is one of the most commonly used but is not as well studied as Taq polymerase. The ability of Bst polymerase to displace an upstream DNA strand during synthesis, coupled with its moderate thermal stability, has provided the basis for several isothermal DNA amplification methods, including LAMP, WGA, RCA, and many others. Bst polymerase is one of the key components defining the robustness and analytical characteristics of diagnostic test systems based on isothermal amplification. Here, we present an overview of the biochemical and structural features of Bst polymerase and provide information on its mutated analogs.

Assessing the feasibility, acceptability, and fidelity of a tele-retinopathy-based intervention to encourage greater attendance to diabetic retinopathy screening in immigrants living with diabetes from China and African-Caribbean countries in Ottawa, Canada: a protocol

BACKGROUND

Diabetic retinopathy is a leading cause of preventable blindness in Canada. Clinical guidelines recommend annual diabetic retinopathy screening for people living with diabetes to reduce the risk and progression of vision loss. However, many Canadians with diabetes do not attend screening. Screening rates are even lower in immigrants to Canada including people from China, Africa, and the Caribbean, and these groups are also at higher risk of developing diabetes complications. We aim to assess the feasibility, acceptability, and fidelity of a co-developed, linguistically and culturally tailored tele-retinopathy screening intervention for Mandarin-speaking immigrants from China and French-speaking immigrants from African-Caribbean countries living with diabetes in Ottawa, Canada, and identify how many from each population group attend screening during the pilot period.

METHODS

We will work with our health system and patient partners to conduct a 6-month feasibility pilot of a tele-retinopathy screening intervention in a Community Health Centre in Ottawa. We anticipate recruiting 50-150 patients and 5-10 health care providers involved in delivering the intervention for the pilot. Acceptability will be assessed via a Theoretical Framework of Acceptability-informed survey with patients and health care providers. To assess feasibility, we will use a Theoretical Domains Framework-informed interview guide and to assess fidelity, and we will use a survey informed by the National Institutes of Health framework from the perspective of health care providers. We will also collect patient demographics (i.e., age, gender, ethnicity, health insurance status, and immigration information), screening outcomes (i.e., patients with retinopathy identified, patients requiring specialist care), patient costs, and other intervention-related variables such as preferred language. Survey data will be descriptively analyzed and qualitative data will undergo content analysis.

DISCUSSION

This feasibility pilot study will capture how many people living with diabetes from each group attend the diabetic retinopathy screening, costs, and implementation processes for the tele-retinopathy screening intervention. The study will indicate the practicability and suitability of the intervention in increasing screening attendance in the target population groups. The study results will inform a patient-randomized trial, provide evidence to conduct an economic evaluation of the intervention, and optimize the community-based intervention.

The Case for Assessing and Reporting on Facilitator Fidelity: Introducing the Fidelity of Implementation in Parenting Programs Guideline

The sizeable body of evidence indicating that parenting programs have a positive impact on children and families highlights the potential public health benefits of their implementation on a large scale. Despite evidence and global attention, beyond the highly controlled delivery of parenting programs via randomized trials, little is known about program effectiveness or how to explain the poorer results commonly observed when implemented in community settings. Researchers, practitioners, and policymakers must work together to identify what is needed to spur adoption and sustainment of evidence-based parenting programs in real-world service systems and how to enhance program effectiveness when delivered via these systems. Collecting, analyzing, and using facilitator fidelity data is an important frontier through which researchers and practitioners can contribute. In this commentary, we outline the value of assessing facilitator fidelity and utilizing the data generated from these assessments; describe gaps in research, knowledge, and practice; and recommend directions for research and practice. In making recommendations, we describe a collaborative process to develop a preliminary guideline-the Fidelity of Implementation in Parenting Programs Guideline or FIPP-to use when reporting on facilitator fidelity. Readers are invited to complete an online survey to provide comments and feedback on the first draft of the guideline.

Supplementary Information

The online version contains supplementary material available at 10.1007/s43477-023-00092-5.

Assessing the Adoption, Acceptability and Fidelity of the Alcohol Use Disorders Test for Alcohol Use Disorders screening in HIV Clinics in Malawi

BACKGROUND

Alcohol use disorders (AUD) are a common cause of poor treatment outcomes among people with HIV (PWH). In Malawi, routine screening for AUD among PWH is unavailable. We piloted the utility of the Alcohol Use Disorders Identification Test (AUDIT) in screening for AUD among PWH and assessed its adoption, acceptability and fidelity in HIV clinics in Malawi.

METHODS

We implemented the AUDIT tool at Mchinji, Kapiri and Kochirira hospitals in Mchinji District between April and May 2021. AUD were defined and classified based on WHO classification as low-risk, harmful/hazardous alcohol use or alcohol dependence. We calculated the prevalence of AUD, the proportion of providers who conducted AUD screening (adoption) and the proportion of providers who conducted AUD screening as intended (fidelity) and compared between clinics. Lastly, we assessed acceptability through a survey among providers.

RESULTS

Out of 2036 PWH, 875 (43%) were screened for AUD and 51% were female, mean age was 41 years (SD±12) and 338 (39%) had AUD. Adoption was highest at Mchinji (58%) compared to Kapiri (31%) and Kochiria (29%) (P<0.001). Overall Fidelity was 96%, and it was highest at Kapiri (99%) compared to Mchinji (95%) and Kochirira (98%) (P=0.01). AUD screening with AUDIT was highly acceptable as most providers agreed or completely agreed that the AUDIT was important (100%), easy to use (96%), satisfactory (96%), agreed to continue use (61%) and recommended it for other facilities in the district (100%).

CONCLUSION

AUD were common among PWH. While the adoption of AUDIT for AUD screening was moderate, acceptability and fidelity were high. The impact of AUD on HIV treatment outcomes needs to be assessed to determine the role of routine AUD screening in HIV clinics in Malawi.

Examining the Link Between Implementation Fidelity, Quality, and Effectiveness of Teacher-Delivered Anti-Bullying Interventions in a Randomized Controlled Trial

This study examined the relation between both implementation fidelity and quality and the outcomes of two different anti-bullying interventions targeting distinct processes involved in bullying: moral disengagement and social norms. In total, 34 French-speaking Belgian teachers from six elementary schools were trained to deliver either the moral disengagement or the social norms intervention to their Grade 4-6 students (N = 747, 50.4% boys) in a randomized controlled trial. Students reported their moral disengagement, perceived injunctive class norm toward bullying, and bullying behaviors in the fall and spring of the 2018-2019 school year. Teachers' implementation fidelity and quality were assessed through direct observation in each class by two independent raters with a satisfying interrater reliability. A multiplicative moderated mediation model using latent change scores revealed that both greater fidelity and quality amplified students' decrease in moral disengagement, which was accompanied by a decrease in bullying. Importantly, when quality was sufficient, fidelity did not matter. However, higher fidelity could compensate for a lack of quality. Contrary to expectations, there was no significant change in students' perceptions of the class injunctive norm, even under ideal implementation conditions. Alternative mediators should thus be considered. Because implementation by teachers inevitably fluctuates, anti-bullying program components should be evaluated under various implementation conditions to determine their cost-effectiveness ratio and to gain insights into how anti-bullying programs work.

Making a HIIT: Methods for quantifying intensity in high-intensity interval training in schools and validity of session rating of perceived exertion

Using the data from Making a HIIT, this paper aimed to: 1) investigate the different heart rate (HR) quantification methods reported in school-based high-intensity interval training (HIIT) studies; and 2) assess the criterion validity of session rating of perceived exertion (RPE). During an 8-week HIIT intervention, 213 students (13.1 (0.6) years; 46% female) completed 10-minute HIIT workouts during physical education lessons. In total, 1057 HR and RPE measurements were collected across 68 HIIT workouts. For aim 1, the average and peak HR across all participants and workouts were 79% (8%) and 92% (6%) of HRmax, respectively. The average RPE was 6 (2) points on a 10-point scale. An average of 51% of students in a class had an average HR ≥ 80% for each workout. The between-person variation for peak and average HR were 19% and 30% , respectively. Both average and peak HR decreased by 0.5% each week (p < 0.001). To assess aim 2, a within-participant correlation was calculated for the internal training load produced using HR and RPE data. The correlation was 0.39 (p < 0.001), which suggests utility of using RPE when HR is not a viable option.

Significant improvement of fidelity for encoded quantum bell pairs at long and short-distance communication along with generalized circuit

Quantum entanglement is a unique criterion of the quantum realm and an essential tool to secure quantum communication. Ensuring high-fidelity entanglement has always been a challenging task owing to interaction with the hostile channel environment created due to quantum noise and decoherence. Though several methods have been proposed, correcting almost all arbitrary errors is still a gigantic task. As one of the main contributions of this work, a new model for 'large distance communication' has been proposed, which may correct all bit flip errors or other errors quite extensively if proper encoding and subspace measurements are used. To achieve this purpose, at the very first step, the idea of differentiating the 'long-distance communication' and 'short-distance applications' has been introduced. Short-distance is determined by the maximum range of applying unitary control gates by the qubit technology. How the error correcting ability of Quantum codes change for short and long-distance application is investigated in this work, which was not explored in previous literatures as far as we know. At the beginning, we have applied stabilizer formalism and Repetition Code for decoding to distinguish the error correcting ability in long and short distance communication. Particularly for short-distance communication, it has been demonstrated that a 'properly encoded' bell state can identify all the bit flip, or phase flip errors with 100% accuracy theoretically. In contrast, if the bell states are used in long-distance communication, the error-detecting and correcting ability reduces at huge amounts. To increase the fidelity significantly and correct the errors quite extensively for long-distance communication, a new model based on classical communication protocol has been suggested. All the required circuits in these processes have been generalized for arbitrary (even) numbers of ancilla qubits during encoding. Proposed analytical results have also been verified with the Simulation results of IBM QISKIT QASM.

Development and Evaluation of a Pragmatic Measure of Adherence to Dialectical Behavior Therapy: The DBT Adherence Checklist for Individual Therapy

This paper presents two studies conducted to develop and evaluate a new pragmatic measure of therapist adherence to Dialectical Behavior Therapy (DBT): the DBT Adherence Checklist for Individual Therapy (DBT AC-I). Study 1 used item response analysis to select items from the gold standard DBT Adherence Coding Scale (DBT ACS) using archival data from 1271 DBT sessions. Items were then iteratively refined based on feedback from 33 target end-users to ensure relevance, usability, and understandability. Study 2 examined the psychometric properties of the DBT AC-I as a therapist self-report and observer-rated measure in 100 sessions from 50 therapist-client dyads, while also evaluating predictors of therapist accuracy in self-rated adherence. When used as a therapist self-report measure, concordance between therapist and observer ratings was at least moderate (AC1 ≥ 0.41) for all DBT AC-I items but overall concordance (ICC = 0.09) as well as convergent (r = 0.05) and criterion validity (AUC = 0.54) with the DBT ACS were poor. Higher therapist accuracy was predicted by greater DBT knowledge and adherence as well as more severe client suicidal ideation. When used by trained observers, the DBT AC-I had excellent interrater reliability (ICC = 0.93), convergent validity (r = 0.90), and criterion validity (AUC = 0.94). While therapists' self-rated adherence on the DBT AC-I should not be assumed to reflect their actual adherence, some therapists may self-rate accurately. The DBT AC-I offers an effective and relatively efficient method of evaluating adherence to DBT when used by trained observers.

Evaluating change in a pressured healthcare system: a cross-sectional study of implementation outcomes using routine data indicators and proxies

BACKGROUND

Implementation evaluation should focus on implementation success, guided by theories and frameworks. With high staff vacancies in the health services, it is important to consider pragmatic methods of data collection for implementation evaluation. This paper presents a cross-sectional rapid evaluation of a handheld medical device designed for remote examinations, piloted in Northern England. By using downloaded device data and administrative records mapped to domains from the implementation outcomes framework, this evaluation offers a pragmatic example of assessing implementation success.

METHODS

The pilot design was pragmatic: sites volunteered, decided which services to use the device in, and launched when ready. The pilot and evaluation together lasted 1 year. Data was downloaded from the devices, and administrative records for the pilot accessed. Variables were mapped to five of the implementation outcomes, after reviewing with the device manufacturer and pilot team to assess robustness.

RESULTS

N=352 care episodes were recorded using the device with 223 patients. Out of 19 sites 'signed up' to the pilot, 5 launched and delivered 10 of 35 proposed projects: a site and project adoption rate of 26 and 29%, respectively. Six sites signed up to an extension period; three had launched and three had not during the original timelines, indicating some sustainability. Feasibility was high, with only one in seven care episodes needing to be repeated due to poor device quality or error (sound/audio/internet). Fidelity of device usage was low for two of the eight available device examinations. Device and staffing costs were high but potential cost savings were attributable to fewer in-person appointments.

CONCLUSIONS

Through using device and administrative data, this evaluation minimised burden on busy healthcare staff yet was still guided by an evaluation framework. Five out of the eight implementation outcomes were measured, including sustainability and costs. The findings give insight into implementation challenges, particularly around adoption. For future research, it is recommended to engage with staff to prioritise outcome measurements and to focus on meaningful interpretation of indicators.

The use of GRADE-CERQual in qualitative evidence synthesis: an evaluation of fidelity and reporting

BACKGROUND

GRADE-CERQual (Confidence in the Evidence from Reviews of Qualitative Research) is a methodological approach to systematically and transparently assess how much confidence decision makers can place in individual review findings from qualitative evidence syntheses. The number of reviews applying GRADE-CERQual is rapidly expanding in guideline and other decision-making contexts. The objectives of this evaluation were, firstly, to describe the uptake of GRADE-CERQual in qualitative evidence synthesis by review authors and, secondly, to assess both reporting of and fidelity to the approach.

METHODS

The evaluation had two parts. Part 1 was a citation analysis and descriptive overview of the literature citing GRADE-CERQual. Authors worked together to code and chart the citations, first by title and abstract and second by full text. Part 2 was an assessment and analysis of fidelity to, and reporting of, the GRADE-CERQual approach in included reviews. We developed fidelity and reporting questions and answers based on the most recent guidance for GRADE-CERQual and then used NVivo12 to document assessments in a spreadsheet and code full-text PDF articles for any concerns that had been identified. Our assessments were exported to Excel and we applied count formulae to explore patterns in the data. We employed a qualitative content analysis approach in NVivo12 to sub-coding all the data illustrating concerns for each reporting and fidelity criteria.

RESULTS

233 studies have applied the GRADE-CERQual approach, with most (n = 225, 96.5%) in the field of health research. Many studies (n = 97/233, 41.6%) were excluded from full fidelity and reporting assessment because they demonstrated a serious misapplication of GRADE-CERQual, for example interpreting it as a quality appraisal tool for primary studies or reviews. For the remaining studies that applied GRADE-CERQual to assess confidence in review findings, the main areas of reporting concern involved terminology, labelling and completeness. Fidelity concerns were identified in more than half of all studies assessed.

CONCLUSIONS

GRADE-CERQual is being used widely within qualitative evidence syntheses and there are common reporting and fidelity issues. Most of these are avoidable and we highlight these as gaps in knowledge and guidance for applying the GRADE-CERQual approach.

Ten years of implementation outcomes research: a scoping review

BACKGROUND

Proctor and colleagues' 2011 paper proposed a taxonomy of eight implementation outcomes and challenged the field to address a research agenda focused on conceptualization, measurement, and theory building. Ten years later, this paper maps the field's progress in implementation outcomes research. This scoping review describes how each implementation outcome has been studied, research designs and methods used, and the contexts and settings represented in the current literature. We also describe the role of implementation outcomes in relation to implementation strategies and other outcomes.

METHODS

Arksey and O'Malley's framework for conducting scoping reviews guided our methods. Using forward citation tracing, we identified all literature citing the 2011 paper. We conducted our search in the Web of Science (WOS) database and added citation alerts sent to the first author from the publisher for a 6-month period coinciding with the WOS citation search. This produced 1346 titles and abstracts. Initial abstract screening yielded 480 manuscripts, and full-text review yielded 400 manuscripts that met inclusion criteria (empirical assessment of at least one implementation outcome).

RESULTS

Slightly more than half (52.1%) of included manuscripts examined acceptability. Fidelity (39.3%), feasibility (38.6%), adoption (26.5%), and appropriateness (21.8%) were also commonly examined. Penetration (16.0%), sustainability (15.8%), and cost (7.8%) were less frequently examined. Thirty-two manuscripts examined implementation outcomes not included in the original taxonomy. Most studies took place in healthcare (45.8%) or behavioral health (22.5%) organizations. Two-thirds used observational designs. We found little evidence of progress in testing the relationships between implementation strategies and implementation outcomes, leaving us ill-prepared to know how to achieve implementation success. Moreover, few studies tested the impact of implementation outcomes on other important outcome types, such as service systems and improved individual or population health.

CONCLUSIONS

Our review presents a comprehensive snapshot of the research questions being addressed by existing implementation outcomes literature and reveals the need for rigorous, analytic research and tests of strategies for attaining implementation outcomes in the next 10 years of outcomes research.

Adherence to Injury Prevention Exercise Programmes in Amateur Adolescent and Adult Football: A Detailed Description of Programme Use from a Randomised Study

BACKGROUND

Injury prevention exercise programmes (IPEPs) efficaciously reduce injuries. However, it is challenging to achieve sufficient adherence across a season. The main aim was to describe adherence to IPEPs in three groups of coaches and players partaking in a cluster randomised trial. Secondary aims were to describe perceptions of IPEPs, use of programme material, and overall preventive strategies.

METHODS

This is a sub-study analysing data from a three-armed randomised trial with teams randomised to use either a comprehensive IPEP (extended Knee Control) or an adductor strength programme, and non-randomised teams that already used a self-chosen IPEP regularly at study start (comparison group). Teams were instructed to use their respective intervention across the 2020 football season. Male and female, adolescent (≥ 14 years of age), and adult amateur players took part. Coaches and players responded to weekly and end-of-season questionnaires. Data were presented descriptively.

RESULTS

Weekly player data were reported by 502 players (weekly response rate 65%), 289 (58%) responded to end-of-season questionnaires. Teams in the extended Knee Control and comparison group used their respective IPEP in 483/529 (91%) and 585/641 (91%) of training sessions, and teams in the adductor group in in 199/315 (63%) sessions. Regarding utilisation fidelity, 42-52% of players in each group used 1-10 repetitions per exercise. Seven out of 17 teams in the adductor group had progressed as recommended in terms of number of repetitions. Two teams (10%) in the extended Knee Control group, and 7/24 of comparison teams used the same exercises across the season. Coaches accessed the IPEPs by different means (printed material, films, workshops, etc.), but half did not use the provided digital material. The players appreciated that the IPEPs could reduce injury risk and that they improved their exercise performance, but disliked that they had less time for football and that the exercises were boring. Forty-nine players had experienced pain during IPEP performance.

CONCLUSIONS

Adherence with the IPEPs was generally high. To meet different coach needs, programme material should be available via different digital and printed resources. The number of players reporting pain during IPEP performance is a noteworthy finding.

TRIAL REGISTRATION

Clinical Trials gov identifier: NCT04272047. Registered February 17, 2020. https://clinicaltrials.gov/ct2/show/NCT04272047 .

Role of early childhood educators' demographic characteristics and perceived work environment in implementation of a preschool health promotion intervention

BACKGROUND

Research has indicated that the effectiveness of intervention programs is affected by how well these programs are implemented, but key gaps remain in our understanding of the factors that promote or inhibit implementation. This study examined how demographic characteristics and perceived work environment among early childhood educators were associated with implementation outcomes of the Increased Health and Wellbeing in Preschools (DAGIS) intervention, which was conducted as a cluster randomized trial.

METHODS

Participants included 101 educators from 32 intervention preschool classrooms. Data were analyzed at the classroom level, as the DAGIS intervention was delivered in preschool classrooms consisting of several educators instead of individual implementers. Linear regression was used to estimate the associations of educators' demographic characteristics and perceived work environment with different aspects of implementation (i.e., dose delivered; dose received - exposure; dose received - satisfaction; and perceived quality, as well as a total sum score based on these four dimensions). Municipality was controlled in the adjusted models.

RESULTS

Findings indicated that having a higher proportion of educators with a Bachelor's or Master's degree in education within the classroom was associated with higher dose received - exposure and higher total degree of implementation, and the significance of the models was unaffected by adjustment for municipality. Moreover, having a higher proportion of educators younger than 35 years within the classroom was associated with higher dose received - exposure. However, the association was non-significant when adjusted for municipality. No other educator factor (i.e., work experience in years and perceived support from coworkers, group work, and innovative climate) predicted implementation outcomes.

CONCLUSIONS

Higher educational attainment and younger age among educators at the classroom level were associated with higher scores for some of the implementation outcomes. Educators' work experience in years at the current preschool and in early childhood education, support from coworkers, group work, and innovative climate were not significantly associated with any implementation outcomes. Future research should explore ways to improve educators' implementation of interventions aimed at promoting children's health behaviors.

Examining fidelity reporting within studies of foundational reading interventions for elementary students with or at risk for dyslexia

Early access to evidence-based reading intervention improves outcomes for students with or at risk for reading difficulties. Additionally, teacher implementation of reading interventions plays a key role in the efficacy of reading interventions. Previous research suggests the influence of intervention implementation fidelity on student language and literacy outcomes is more significant for lower-performing students and students with disabilities, such as dyslexia. However, recent syntheses have suggested that less than half of reading intervention studies report treatment fidelity data. This meta-analysis examined fidelity reporting within reading intervention studies for students with or at risk for dyslexia in Grades K-5. We aimed to record the frequency and extent of fidelity reporting, explore associations between study or intervention features and fidelity reporting, and compare mean intervention effect sizes for studies reporting fidelity and those that did not. A total of 51 studies were included. Results indicated that 75% of studies reported fidelity data. Studies reporting fidelity primarily focused on adherence and dosage data with little to no information reported for other dimensions of fidelity (i.e., quality, responsiveness, differentiation). Suggestions for improving reporting of treatment fidelity data are discussed.

Efficient and effective measurement of provider competence in community-based substance use treatment settings: Performance of the Motivational Interviewing Coach Rating Scale (MI-CRS)

OBJECTIVE

Efficient and effective fidelity measurement is necessary to improve rigor and reduce burden of motivational interviewing (MI) implementation studies for both fidelity outcomes and quality improvement strategies. This article reports on such a measure developed with rigorous methodology and tested in community-based substance abuse treatment settings.

METHODS

This scale development study analyzed data from a National Institute on Drug Abuse study testing the Leadership and Organizational Change for Implementation (LOCI) strategy. Utilizing item response theory (IRT) methods and Rasch modeling, we analyzed coded recordings (N = 1089) of intervention sessions of 238 providers from 60 substance use treatment clinics across nine agencies in an implementation trial focusing on MI.

RESULTS

These methods yielded a reliable and valid 12-item scale representing single construct dimensionality, strong item-session maps, good rating scale functionality, and item fit. Separation reliability and absolute agreement for adjacent categories was high. No items were significantly misfitting, though one was borderline. The LOCI community providers were less likely to be scored in the advanced competence range and items were more difficult compared to the original development sample.

CONCLUSIONS

The 12-item Motivational Interviewing Coach Rating Scale (MI-CRS) showed excellent performance in a large sample of community-based substance use treatment providers using real recordings. The MI-CRS is the first efficient and effective fidelity measure appropriate for diverse ethnic groups, with interventions that are MI only or interventions that integrate MI with other treatments, and with adolescents and adults. Follow-up coaching by trained supervisors may be needed for community-based providers to achieve the highest level of MI competence.

Five-year fidelity assessment of an evidence-based parenting program (GenerationPMTO): inter-rater reliability following international implementation

BACKGROUND

Implementing evidence-based programs in community service settings introduces the challenge of ensuring sustained fidelity to the original program. We employ a fidelity measure based on direct observation of practitioners' competence and adherence to the evidence-based parenting program (EBPP) GenerationPMTO following installation in national and international sites. Fidelity monitoring is crucial, especially when the program purveyor transfers administration of the program to the community as was done in this case. In previous studies, the Fidelity of Implementation rating system (FIMP) was used to evaluate practitioners' fidelity to the GenerationPMTO intervention in six countries following implementation showing high levels of adherence up to 17 years post certification. Other studies showed FIMP to have predictive validity. The present study provides inter-rater reliability data for this fidelity tool across teams of the purveyor, Implementation Sciences International, Inc./ISII, and national and international sites over a five-year period.

METHODS

Data assess inter-rater reliability in terms of percent agreement and intraclass correlation (ICC) for the purveyor's two fidelity teams and the fidelity teams in seven implementation sites.

RESULTS

Results report stable good to excellent levels of inter-rater reliability and ICCs as well as good attendance at fidelity meetings for all fidelity teams.

CONCLUSIONS

This observational method of assessing fidelity post implementation is a promising approach to enable EBPPs to be transferred safely from purveyors to communities while maintaining reliable fidelity to the intervention.

Trends in Reporting Procedural Integrity: A Comparison

Procedural integrity refers to the extent to which an independent variable is implemented as described. Measuring procedural integrity is one important factor when considering internal and external validity of experiments. Experimental articles in behavior-analytic journals have rarely reported procedural-integrity data. The purpose of this study was to update previous reviews of whether articles published in the Journal of Applied Behavior Analysis reported procedural integrity, spanning a period from 1980 to 2020, and compare reporting in JABA to recent reviews of studies published in Behavior Analysis in Practice (2008-2019) and the Journal of Organizational Behavior Management (2000-2020). Procedural integrity continues to be underreported across all three journals, but an increasing trend in reporting procedural integrity is evident in the Journal of Applied Behavior Analysis and Behavior Analysis in Practice. In addition to our recommendations and implications for research and practice, we provide examples and resources to assist researchers and practitioners with recording and reporting integrity data.

Adaptations to scale-up an early childhood education and care physical activity intervention for real-world availability - Play Active

BACKGROUND

Adaptations for scale-up are ubiquitous but are rarely described in detail. Adaptations may be a key reason for the "scale-up penalty" which is when there is a reduction in intervention effect size following scale-up. The Play Active intervention consists of a physical activity policy for early childhood education and care (ECEC) services, with accompanying implementation support strategies. It was first implemented with 81 ECEC services in Perth, Western Australia, in 2021 - with significant positive changes in physical activity practice uptake. The aim of this paper is to describe the extent, type, fidelity consistency, goals, size, scope, and proposed impact of proposed adaptations to the implementation support strategies for scaling-up Play Active.

METHODS

Proposed adaptations were defined as planned changes, made prior to making the intervention available. The authors created a list of adaptations from a comparison of the Play Active implementation support strategies, before and after adaptation for proposed statewide availability across Western Australia, Queensland and South Australia, Australia. We used the Framework for Reporting Adaptations and Modifications-Enhanced Implementation Strategies (FRAME-IS) to code adaptations to implementation support strategies. Three authors coded each adaptation and rated their size, scope and proposed impact.

RESULTS

Fifty-three adaptations to Play Active were identified. Most (68%) were proposed for the 'content' of implementation strategies, including aspects of their delivery. In practice, this involved changing the delivery mode of implementation support strategies from phone call and email support, to website-based delivery. More than half (56%) of adaptations involved 'adding elements' for scale-up. Most adaptations were 'fidelity consistent' (95%). The main goals for adaptations were related to 'increasing the acceptability, appropriateness, or feasibility' (45%), 'decreasing the costs' (19%) and 'increasing adoption of the evidence-based practice' (19%). Adaptations were small to medium in size, with most proposed to have a positive (87%) or neutral (8%) effect on the effectiveness of the intervention, rather than negative (4%).

CONCLUSIONS

A large number of small, fidelity-consistent, adaptations were proposed for Play Active scale-up. Overall, the process of reporting adaptations was found to be feasible. To understand the impact of these adaptations, it will be important to re-evaluate implementation, effectiveness and process outcomes, at-scale.

Technical challenges of studying early human development

Recent years have seen exciting progress across human embryo research, including new methods for culturing embryos, transcriptional profiling of embryogenesis and gastrulation, mapping lineage trajectories, and experimenting on stem cell-based embryo models. These advances are beginning to define the dynamical principles of development across stages, tissues and organs, enabling a better understanding of human development before birth in health and disease, and potentially leading to improved treatments for infertility and developmental disorders. However, there are still significant roadblocks en route to this goal. Here, we highlight technical challenges to studying early human development and propose ways and means to overcome some of these constraints.

Fidelity to the ACT SMART Toolkit: an instrumental case study of implementation strategy fidelity

BACKGROUND

Evidence-based practices (EBPs) are shown to improve a variety of outcomes for autistic children. However, EBPs often are mis-implemented or not implemented in community-based settings where many autistic children receive usual care services. A blended implementation process and capacity-building implementation strategy, developed to facilitate the adoption and implementation of EBPs for autism spectrum disorder (ASD) in community-based settings, is the Autism Community Toolkit: Systems to Measure and Adopt Research-based Treatments (ACT SMART Toolkit). Based on an adapted Exploration, Adoption decision, Preparation, Implementation, Sustainment (EPIS) Framework, the multi-phased ACT SMART Toolkit is comprised of (a) implementation facilitation, (b) agency-based implementation teams, and (c) a web-based interface. In this instrumental case study, we developed and utilized a method to evaluate fidelity to the ACT SMART Toolkit. This study responds to the need for implementation strategy fidelity evaluation methods and may provide evidence supporting the use of the ACT SMART Toolkit.

METHODS

We used an instrumental case study approach to assess fidelity to the ACT SMART Toolkit during its pilot study with six ASD community agencies located in southern California. We assessed adherence, dose, and implementation team responsiveness for each phase and activity of the toolkit at both an aggregate and individual agency level.

RESULTS

Overall, we found that adherence, dose, and implementation team responsiveness to the ACT SMART Toolkit were high, with some variability by EPIS phase and specific activity as well as by ASD community agency. At the aggregate level, adherence and dose were rated notably lowest during the preparation phase of the toolkit, which is a more activity-intensive phase of the toolkit.

CONCLUSIONS

This evaluation of fidelity to the ACT SMART Toolkit, utilizing an instrumental case study design, demonstrated the potential for the strategy to be used with fidelity in ASD community-based agencies. Findings related to the variability of implementation strategy fidelity in the present study may also inform future adaptations to the toolkit and point to broader trends of how implementation strategy fidelity may vary by content and context.

The unrecognized role of fidelity in effectiveness-implementation hybrid trials: simulation study and guidance for implementation researchers

BACKGROUND

Effectiveness-implementation hybrid designs are a relatively new approach to evaluate efficacious interventions in real-world settings while concurrently gathering information on the implementation. Intervention fidelity can significantly influence the effectiveness of an intervention during implementation. However little guidance exists for applied researchers conducting effectiveness-implementation hybrid trials regarding the impact of fidelity on intervention effects and power.

METHODS

We conducted a simulation study based on parameters from a clinical example study. For the simulation, we explored parallel and stepped-wedge cluster randomized trials (CRTs) and hypothetical patterns of fidelity increase during implementation: slow, linear, and fast. Based on fixed design parameters, i.e., the number of clusters (C = 6), time points (T = 7), and patients per cluster (n = 10) we used linear mixed models to estimate the intervention effect and calculated the power for different fidelity patterns. Further, we conducted a sensitivity analysis to compare outcomes based on different assumptions for the intracluster-correlation coefficient and the cluster size.

RESULTS

Ensuring high fidelity from the beginning is central to achieve accurate intervention effect estimates in stepped-wedge and parallel CRTs. The importance of high fidelity in the earlier stages is more emphasized in stepped-wedge designs than in parallel CRTs. In contrast, if the increase of fidelity is too slow despite relatively high starting levels, the study will likely be underpowered and the intervention effect estimates will also be biased. This effect is more accentuated in parallel CRTs, here reaching 100% fidelity within the next measurement points is crucial.

CONCLUSIONS

This study discusses the importance of intervention fidelity for the study`s power and highlights different recommendations to deal with low fidelity in parallel and stepped-wedge CRTs from a design perspective. Applied researchers should consider the detrimental effect of low fidelity in their evaluation design. Overall, there are fewer options to adjust the trial design after the fact in parallel CRT as compared to stepped-wedge CRTs. Particular emphasis should be placed on the selection of contextually relevant implementation strategies.

Implementing Adolescent Wellbeing and Health Programs in Schools: Insights from a Mixed Methods and Multiple Informant Study

Determining the factors that influence implementation of school-based wellbeing and health programs is essential for achieving desired program effects. Using a convergent mixed-methods, multiple informant design, this study considered factors that influence implementation of health programs for ninth grade students and in what ways implementation is differentially perceived by multiple informants (i.e., participants, instructors, and independent observers). Two types of programs-mindfulness and health education-were implemented with ninth graders (N = 70) in three schools situated in low-resourced urban neighborhoods. Study outcomes were derived from four data sources: (1) focus group participants (N = 45); (2) program instructor fidelity ratings; (3) independent observer fidelity ratings and notes; and (4) instructor open-ended session responses. Using thematic and mixed methods integration analyses, we identified themes related to implementation promoting or challenging factors. Theme names differed when data sources were separately analyzed by informant. Mixed methods integration analysis indicated that four themes were common across all informant groups: (1) competent, attentive, and engaging instructors are essential; (2) programs should involve interactive components (e.g., physical activities, applied learning opportunities); (3) adequate time for program delivery is key for student exposure and engagement; and (4) students' availability and preferences should guide program scheduling. A fifth theme, unique to instructor and observer perspectives, was that program implementation was negatively impacted by distractions from multiple sources, including instructors, students, and settings. Recommendations from students, instructors, and observers for implementation optimization are discussed.

Co-design of a behaviour change intervention to equip geriatricians and pharmacists to proactively deprescribe medicines that are no longer needed or are risky to continue in hospital

BACKGROUND

Trials of hospital deprescribing interventions have demonstrated limited changes in practitioner behaviour. Our previous research characterised four barriers and one enabler to geriatricians and pharmacists deprescribing in hospital that require addressing by a behaviour change intervention. Six behaviour change techniques (BCTs) have also been selected by the target audience using the hospital Deprescribing Implementation Framework (hDIF). This research aimed to co-design and operationalise the content, mode of delivery and duration/intensity of the six selected BCTs to develop the CompreHensive geriAtRician-led MEdication Review (CHARMER) deprescribing intervention.

METHODS

We established co-design panels at three hospitals representing contextual factors likely to influence CHARMER implementation. Panels comprised geriatricians, pharmacists and other hospital staff likely to be involved in implementation. We convened two rounds of co-design workshops with each hospital to design a prototype for each BCT, which went for feedback at a final workshop attended by all three hospital panels.

RESULTS

The six BCTs were co-designed into an intervention comprising:(^1&2) Pharmacists' workshop with pros and cons of deprescribing activities, and videos of salient patient cases³ Regular geriatrician and pharmacist deprescribing briefings⁴ Videos of geriatricians navigating challenging deprescribing consultations⁵ Hospital deprescribing action plan⁶ Dashboard to benchmark deprescribing activitiesAutomated prompts to flag high-risk patients for deprescribing and a primary and secondary care deprescribing forum were proposed as additional BCTs by stakeholders. These were later excluded as they were not fidelitous to the theoretical determinants of geriatricians' and pharmacists' deprescribing behaviours.

CONCLUSIONS

This study illustrates the integration of theory and co-design methodology with the target audience and staff likely to be involved in implementation of a hospital deprescribing behaviour change intervention. The development of an intervention that remains faithful to the underpinning mechanisms of action of behaviour change is a strength of this approach.

Description of the nationally implemented National Health Service digital diabetes prevention programme and rationale for its development: mixed methods study

BACKGROUND

The National Health Service (NHS) Digital Diabetes Prevention Programme (DDPP) is a behaviour change programme for adults in England who are at high risk of developing type 2 diabetes. Four independent providers deliver the NHS-DDPP following a competitive tendering process. Although providers work to a single service specification, there is potential for some variation in the service across providers. This study (1) assesses fidelity of the structural features of the design of the NHS-DDPP compared to the service specification, (2) describes the structural features of delivery of the NHS-DDPP as implemented (3) reports developers' views on how the structural components of the NHS-DDPP were developed and why changes were made following implementation.

METHODS

Using mixed methods, we conducted a document review of providers' NHS-DDPP design and delivery documentation, and extracted information using the Template for Intervention Description and Replication checklist, which was adapted to capture features of digital delivery. Documentation was supplemented by content analysis of interviews with 12 health coaches involved in delivering the NHS-DDPP. Semi-structured interviews were also conducted with 6 programme developers employed by the digital providers.

RESULTS

Provider plans for the NHS-DDPP show relatively high fidelity to the NHS service specification. Despite this, there was wide variation in structural features of delivery of the NHS-DDPP across providers, particularly for delivery of 'support' (e.g. use, dose and scheduling of health coaching and/or group support). Interviews with developers of the programmes showed that much of this variation is likely to be attributable to the origin of each provider's programme, which was usually a pre-existing programme that was adapted to conform to the NHS-DDPP service specification. The NHS-DDPP is continually improved and developed based on user experience feedback and research conducted by the providers.

CONCLUSION

Indirect evidence suggests that variation in delivery of support could affect effectiveness of the NHS-DDPP. A priority for future research is ascertaining whether the variation in delivery of the NHS-DDPP across providers is related to any differences in health outcomes. It is recommended that future rounds of commissioning the NHS-DDPP pre-specify the type of support participants should receive, including expected dose and scheduling.

The Role of Intervention Fidelity, Culture, and Individual-Level Factors on Health-Related Outcomes Among Hispanic Adolescents with Unhealthy Weight: Findings from a Longitudinal Intervention Trial

Previous studies have suggested the impact of intervention fidelity on the management and prevention of chronic diseases; however, little is known about the effect of the contributing determinants (at multiple levels of influence) that can impact health-related interventions intending to improve the health status of Hispanic adolescents with overweight or obesity. The current study aimed to assess whether fidelity (i.e., dosage and quality of the program delivery), acculturation (i.e., orientation to the American culture, retention of Hispanic cultural values), and individual-level socio-demographic characteristics (i.e., income, education) predict changes in family processes (e.g., parent control), which in turn may affect adolescent health-related outcomes including body mass index (BMI), physical activity, dietary intake, and adolescents' health-related quality of life. A pathway analysis model was utilized to explore the study variables among 140 Hispanic parent-adolescent dyads randomized to Familias Unidas Health and Wellness (FUHW) intervention. Results indicated that fidelity was significantly associated with changes in parent-adolescent communication, parent monitoring, limit-setting, and control. Parents' education was associated with changes in parent limit-setting, and parent Hispanicism was associated with changes in parent limit-setting and discipline. The examination between family processes and adolescent health outcomes revealed that parents' higher discipline and improved communication with their adolescents were significantly associated with improved adolescents' quality of life, and parent control was positively associated with physical activity and negatively associated with BMI in adolescents. Our findings demonstrated the significant contribution of intervention fidelity and participants' characteristics in parenting strategies leading to adolescents' health outcomes to prevent obesity-related chronic diseases. Future research is needed to investigate the effect of environmental and organizational factors on the delivery of the intervention materials.

Bacterial thermophilic DNA polymerases: A focus on prominent biotechnological applications

DNA polymerases are the enzymes able to replicate the genetic information in nucleic acid. As a result, they are necessary to copy the complete genome of every living creature before cell division and sustain the integrity of the genetic information throughout the life of each cell. Any organism that uses DNA as its genetic information, whether unicellular or multicellular, requires one or more thermostable DNA polymerases to thrive. Thermostable DNA polymerase is important in modern biotechnology and molecular biology because it results in methods such as DNA cloning, DNA sequencing, whole genome amplification, molecular diagnostics, polymerase chain reaction, synthetic biology, and single nucleotide polymorphism detection. There are at least 14 DNA-dependent DNA polymerases in the human genome, which is remarkable. These include the widely accepted, high-fidelity enzymes responsible for replicating the vast majority of genomic DNA and eight or more specialized DNA polymerases discovered in the last decade. The newly discovered polymerases' functions are still being elucidated. Still, one of its crucial tasks is to permit synthesis to resume despite the DNA damage that stops the progression of replication-fork. One of the primary areas of interest in the research field has been the quest for novel DNA polymerase since the unique features of each thermostable DNA polymerase may lead to the prospective creation of novel reagents. Furthermore, protein engineering strategies for generating mutant or artificial DNA polymerases have successfully generated potent DNA polymerases for various applications. In molecular biology, thermostable DNA polymerases are extremely useful for PCR-related methods. This article examines the role and importance of DNA polymerase in a variety of techniques.

The Canadian Healthy Life Trajectories Initiative (HeLTI) Trial: a study protocol for monitoring fidelity of a preconception-lifestyle behaviour intervention

BACKGROUND

In evaluating technology-based behaviour change interventions, it is increasingly important to have a monitoring plan for intervention fidelity. It is important to maintain intervention fidelity to ensure that the theory-based intervention that is being tested is what causes the observed changes, particularly for eHealth behaviour change interventions. In this protocol, we outline the intervention fidelity and monitoring protocol for Healthy Life Trajectory Initiative (HeLTI) Canada, a randomized controlled trial evaluating the effect of a preconception-early childhood technology-based intervention delivered by public health nurses among pregnancy-planning women and their partners to optimize child growth and development.

METHODS

The HeLTI Canada fidelity protocol is based on the National Institutes of Health Behaviour Change Consortium (NIH BCC) Treatment Fidelity Framework, outlining the following components of intervention fidelity: study design, provider training, intervention delivery, intervention receipt, and intervention enactment. The intervention fidelity components and associated monitoring strategies were developed to align with the HeLTI Canada approach. Strategies for intervention fidelity monitoring include a pre-post written evaluation of training, standardization of provider training, use and monitoring of activity logs, and intervention session checklists. Possible challenges to intervention fidelity include provider turnover due to the length of the trial and lack of ability to directly monitor participant behaviour change in real-life settings. Details about intervention fidelity monitoring are provided in detail. The study launched in January 2021 and is currently recruiting.

DISCUSSION

Using the NIH BCC Treatment Fidelity Framework, HeLTI Canada has a robust framework for monitoring and reporting intervention fidelity to improve intervention validity, ability to assess intervention effectiveness, and transparency.

TRIAL REGISTRATION

ISRCN ISRCTN13308752 . Registered on February 29, 2019.

Does Treatment Fidelity of the Early Start Denver Model Impact Skill Acquisition in Young Children with Autism?

There is increasing evidence supporting the effectiveness of the Early Start Denver Model (ESDM) for children on the autism spectrum. However, substantial variability in response to the ESDM has been reported across participants. We examined the plausible yet untested hypothesis that variations in the fidelity level of therapists delivering the intervention contribute to variability in children's response to the ESDM. Videotaped sessions (n = 40) of toddlers on the autism spectrum who received the ESDM from trained therapists were coded to obtain measures of therapist fidelity and children's learning in response to the therapists' instruction. Variations in overall fidelity, along with variations in most items included in the ESDM fidelity checklist, contributed to the children's learning response during the sessions.

Engineering a DNA polymerase from Pyrobaculum calidifontis for improved activity, processivity and extension rate

Positively charged amino acids in the DNA polymerase domain are important for interaction with DNA. Two potential residues in the palm domain of Pca-Pol, a DNA polymerase from Pyrobaculum calidifontis, were identified and mutated to arginine in order to improve the properties of this enzyme. The mutant proteins were heterologously produced in Escherichia coli. Biochemical characterization revealed that there was no significant difference in pH, metal ion, buffer preferences, 3' - 5' exonuclease activity and error rate of the wild-type and the mutant enzymes. However, the specific activity, processivity and extension rate of the mutant enzymes increased significantly. Specific activity of one of the mutants (G522R-E555R) was nearly 9-fold higher than that of the wild-type enzyme. These properties make G522R-E555R mutant enzyme a potential candidate for commercial applications.

Treatment fidelity in a pragmatic clinical trial of music therapy for premature infants and their parents: the LongSTEP study

BACKGROUND

Treatment fidelity (TF) refers to methodological strategies used to monitor and enhance the reliability and validity of interventions. We evaluated TF in a pragmatic RCT of music therapy (MT) for premature infants and their parents.

METHODS

Two hundred thirteen families from seven neonatal intensive care units (NICUs) were randomized to receive standard care, or standard care plus MT during hospitalization, and/or during a 6-month period post-discharge. Eleven music therapists delivered the intervention. Audio and video recordings from sessions representing approximately 10% of each therapists' participants were evaluated by two external raters and the corresponding therapist using TF questionnaires designed for the study (treatment delivery (TD)). Parents evaluated their experience with MT at the 6-month assessment with a corresponding questionnaire (treatment receipt (TR)). All items as well as composite scores (mean scores across items) were Likert scales from 0 (completely disagree) to 6 (completely agree). A threshold for satisfactory TF scores (≥4) was used in the additional analysis of dichotomized items.

RESULTS

Internal consistency evaluated with Cronbach's alpha was good for all TF questionnaires (α ≥ 0.70), except the external rater NICU questionnaire where it was slightly lower (α 0.66). Interrater reliability measured by intraclass correlation coefficient (ICC) was moderate (NICU 0.43 (CI 0.27, 0.58), post-discharge 0.57 (CI 0.39, 0.73)). Gwet's AC for the dichotomized items varied between 0.32 (CI 0.10, 0.54) and 0.72 (CI 0.55, 0.89). Seventy-two NICU and 40 follow-up sessions with 39 participants were evaluated. Therapists' mean (SD) TD composite score was 4.88 (0.92) in the NICU phase and 4.95 (1.05) in the post-discharge phase. TR was evaluated by 138 parents. The mean (SD) score across intervention conditions was 5.66 (0.50).

CONCLUSIONS

TF questionnaires developed to assess MT in neonatal care showed good internal consistency and moderate interrater reliability. TF scores indicated that therapists across countries successfully implemented MT in accordance with the protocol. The high treatment receipt scores indicate that parents received the intervention as intended. Future research in this area should aim to improve the interrater reliability of TF measures by additional training of raters and improved operational definitions of items.

TRIAL REGISTRATION

Longitudinal Study of music Therapy's Effectiveness for Premature infants and their caregivers - "LongSTEP".

CLINICALTRIALS

gov Identifier: NCT03564184. Registered on June 20, 2018.

Predicted utility modulates working memory fidelity in the brain

The predicted utility of information stored in working memory (WM) is hypothesized to influence the strategic allocation of WM resources. Prior work has shown that when information is prioritized, it is remembered with greater precision relative to other remembered items. However, these paradigms often complicate interpretation of the effects of predicted utility on item fidelity due to a concurrent memory load. Likewise, no fMRI studies have examined whether the predicted utility of an item modulates fidelity in the neural representation of items during the memory delay without a concurrent load. In the current study, we used fMRI to investigate whether predicted utility influences fidelity of WM representations in the brain. Using a generative model multivoxel analysis approach to estimate the quality of remembered representations across predicted utility conditions, we observed that items with greater predicted utility are maintained in memory with greater fidelity, even when they are the only item being maintained. Further, we found that this pattern follows a parametric relationship where more predicted utility corresponded to greater fidelity. These precision differences could not be accounted for based on a redistribution of resources among already-remembered items. Rather, we interpret these results in terms of a gating mechanism that allows for pre-allocation of resources based on predicted value alone. This evidence supports a theoretical distinction between resource allocation that occurs as a result of load and resource pre-allocation that occurs as a result of predicted utility.