Treatment fidelity of motivational interviewing delivered by a school nurse to increase girls' physical activity

Fidelity of motivational interviewing training for dental hygiene students

Use of Motivational Interviewing (MI), a patient centered counseling strategy in the health professions, has demonstrated efficacy. Given the varied training associated with the delivery of health interventions, it is essential adherence and competence are equivocally assured. Motivational Interviewing Treatment Integrity (MITI) coding evaluated our recorded standardized patient oral assessment and planning sessions to identify the skills in which MI-trained students (n = 26) performed compared to student counterparts (n = 24) not trained in the MI curriculum. The full integration of MI in those receiving the MI curriculum resulted in the dental hygiene students with higher ratings for all global ratings, behavioral counts, and summary scores. MI-trained mean scores for evocation, collaboration, autonomy support, empathy, and direction ranged from 4.16(±0.43) to 3.85 (±0.67). All students receiving MI training reached competence in all 5 of the referenced MITI global variables: evocation, collaboration, autonomy support, empathy, and direction. The most substantial improvements for MITI behavioral and summary variables were in Giving Information, MI Adherence, and proportion of Open-Ended Questions. Complex Reflections, and subsequently Ratios of Complex Reflections to Open-Ended Questions were notably below proficiency in the MI group. Knowing which elements were adhered to well and which were lacking helps inform student MI learning outcomes. Results inform the design of MI training curricula to address areas of weakness and maximize performance across all MI fidelity domains.

Measuring implementation fidelity of school-based obesity prevention programmes: a systematic review

Background

Until now, there is no clear overview of how fidelity is assessed in school-based obesity prevention programmes. In order to move the field of obesity prevention programmes forward, the current review aimed to 1) identify which fidelity components have been measured in school-based obesity prevention programmes; 2) identify how fidelity components have been measured; and 3) score the quality of these methods.

Methods

Studies published between January 2001–October 2017 were selected from searches in PubMed, EMBASE, PsycINFO, CINAHL, Cochrane Library and ERIC. We included studies examining the fidelity of obesity prevention programmes (nutrition and/or physical activity and/or sitting) at school (children aged 4–18 year) measuring at least one component of implementation fidelity. A data extraction was performed to identify which and how fidelity components were measured. Thereafter, a quality assessment was performed to score the quality of these methods. We scored each fidelity component on 7 quality criteria. Each fidelity component was rated high (> 75% positive), moderate (50–75%) or low (< 50%).

Results

Of the 26,294 retrieved articles, 73 articles reporting on 63 different studies were included in this review. In 17 studies a process evaluation was based on a theoretical framework. In total, 120 fidelity components were measured across studies: dose was measured most often (N = 50), followed by responsiveness (N = 36), adherence (N = 26) and quality of delivery (N = 8). There was substantial variability in how fidelity components were defined as well as how they were measured. Most common methods were observations, logbooks and questionnaires targeting teachers. The quality assessment scores ranged from 0 to 86%; most fidelity components scored low quality (n = 77).

Conclusions

There is no consensus on the operationalisation of concepts and methods used for assessing fidelity in school-based obesity prevention programmes and the quality of methods used is weak. As a result, we call for more consensus on the concepts and clear reporting on the methods employed for measurements of fidelity to increase the quality of fidelity measurements. Moreover, researchers should focus on the relation between fidelity and programme outcomes and determine to what extent adaptations to programmes have been made, whilst still being effective.

Electronic supplementary material

The online version of this article (10.1186/s12966-018-0709-x) contains supplementary material, which is available to authorized users.

Treatment Fidelity of a Nurse-Led Motivational Interviewing-Based Pre-Treatment in Pain Rehabilitation

Treatment fidelity and proficiency of a nurse-led motivational interviewing (MI)-based pre-treatment and control condition was evaluated. A random sample was scored by means of the Motivational Interviewing Treatment Integrity (MITI) scale, and a second rater was in charge. MI fidelity was satisfactory for three out of five ratings. Most mean ratings were higher in the MI-based intervention, but differences were not statistically significant. The threshold for beginning MI proficiency was only exceeded for one score and one additional measure. In general, higher levels of fidelity in the intervention condition confirmed that MI was partially applied there. Although the quality of MI delivery as well as mixed inter-rater reliabilities of the fidelity scores leaves room for improvement, robust findings between the two raters were found. These results suggest the need for rigor selection of MI counselors on beforehand, and continuous supervision. Furthermore, fidelity check in studies using MI is needed.

Strategies for enhancing the implementation of school-based policies or practices targeting risk factors for chronic disease

BACKGROUND

A number of school-based policies or practices have been found to be effective in improving child diet and physical activity, and preventing excessive weight gain, tobacco or harmful alcohol use. Schools, however, frequently fail to implement such evidence-based interventions.

OBJECTIVES

The primary aims of the review are to examine the effectiveness of strategies aiming to improve the implementation of school-based policies, programs or practices to address child diet, physical activity, obesity, tobacco or alcohol use.Secondary objectives of the review are to: Examine the effectiveness of implementation strategies on health behaviour (e.g. fruit and vegetable consumption) and anthropometric outcomes (e.g. BMI, weight); describe the impact of such strategies on the knowledge, skills or attitudes of school staff involved in implementing health-promoting policies, programs or practices; describe the cost or cost-effectiveness of such strategies; and describe any unintended adverse effects of strategies on schools, school staff or children.

SEARCH METHODS

All electronic databases were searched on 16 July 2017 for studies published up to 31 August 2016. We searched the following electronic databases: Cochrane Library including the Cochrane Central Register of Controlled Trials (CENTRAL); MEDLINE; MEDLINE In-Process & Other Non-Indexed Citations; Embase Classic and Embase; PsycINFO; Education Resource Information Center (ERIC); Cumulative Index to Nursing and Allied Health Literature (CINAHL); Dissertations and Theses; and SCOPUS. We screened reference lists of all included trials for citations of other potentially relevant trials. We handsearched all publications between 2011 and 2016 in two specialty journals (Implementation Science and Journal of Translational Behavioral Medicine) and conducted searches of the WHO International Clinical Trials Registry Platform (ICTRP) (http://apps.who.int/trialsearch/) as well as the US National Institutes of Health registry (https://clinicaltrials.gov). We consulted with experts in the field to identify other relevant research.

SELECTION CRITERIA

'Implementation' was defined as the use of strategies to adopt and integrate evidence-based health interventions and to change practice patterns within specific settings. We included any trial (randomised or non-randomised) conducted at any scale, with a parallel control group that compared a strategy to implement policies or practices to address diet, physical activity, overweight or obesity, tobacco or alcohol use by school staff to 'no intervention', 'usual' practice or a different implementation strategy.

DATA COLLECTION AND ANALYSIS

Citation screening, data extraction and assessment of risk of bias was performed by review authors in pairs. Disagreements between review authors were resolved via consensus, or if required, by a third author. Considerable trial heterogeneity precluded meta-analysis. We narratively synthesised trial findings by describing the effect size of the primary outcome measure for policy or practice implementation (or the median of such measures where a single primary outcome was not stated).

MAIN RESULTS

We included 27 trials, 18 of which were conducted in the USA. Nineteen studies employed randomised controlled trial (RCT) designs. Fifteen trials tested strategies to implement healthy eating policies, practice or programs; six trials tested strategies targeting physical activity policies or practices; and three trials targeted tobacco policies or practices. Three trials targeted a combination of risk factors. None of the included trials sought to increase the implementation of interventions to delay initiation or reduce the consumption of alcohol. All trials examined multi-strategic implementation strategies and no two trials examined the same combinations of implementation strategies. The most common implementation strategies included educational materials, educational outreach and educational meetings. For all outcomes, the overall quality of evidence was very low and the risk of bias was high for the majority of trials for detection and performance bias.Among 13 trials reporting dichotomous implementation outcomes-the proportion of schools or school staff (e.g. classes) implementing a targeted policy or practice-the median unadjusted (improvement) effect sizes ranged from 8.5% to 66.6%. Of seven trials reporting the percentage of a practice, program or policy that had been implemented, the median unadjusted effect (improvement), relative to the control ranged from -8% to 43%. The effect, relative to control, reported in two trials assessing the impact of implementation strategies on the time per week teachers spent delivering targeted policies or practices ranged from 26.6 to 54.9 minutes per week. Among trials reporting other continuous implementation outcomes, findings were mixed. Four trials were conducted of strategies that sought to achieve implementation 'at scale', that is, across samples of at least 50 schools, of which improvements in implementation were reported in three trials.The impact of interventions on student health behaviour or weight status were mixed. Three of the eight trials with physical activity outcomes reported no significant improvements. Two trials reported reductions in tobacco use among intervention relative to control. Seven of nine trials reported no between-group differences on student overweight, obesity or adiposity. Positive improvements in child dietary intake were generally reported among trials reporting these outcomes. Three trials assessed the impact of implementation strategies on the attitudes of school staff and found mixed effects. Two trials specified in the study methods an assessment of potential unintended adverse effects, of which, they reported none. One trial reported implementation support did not significantly increase school revenue or expenses and another, conducted a formal economic evaluation, reporting the intervention to be cost-effective. Trial heterogeneity, and the lack of consistent terminology describing implementation strategies, were important limitations of the review.

AUTHORS' CONCLUSIONS

Given the very low quality of the available evidence, it is uncertain whether the strategies tested improve implementation of the targeted school-based policies or practices, student health behaviours, or the knowledge or attitudes of school staff. It is also uncertain if strategies to improve implementation are cost-effective or if they result in unintended adverse consequences. Further research is required to guide efforts to facilitate the translation of evidence into practice in this setting.

Methods used to address fidelity of receipt in health intervention research: a citation analysis and systematic review

BACKGROUND

The American Behaviour Change Consortium (BCC) framework acknowledges patients as active participants and supports the need to investigate the fidelity with which they receive interventions, i.e. receipt. According to this framework, addressing receipt consists in using strategies to assess or enhance participants' understanding and/or performance of intervention skills. This systematic review aims to establish the frequency with which receipt is addressed as defined in the BCC framework in health research, and to describe the methods used in papers informed by the BCC framework and in the wider literature.

METHODS

A forward citation search on papers presenting the BCC framework was performed to determine the frequency with which receipt as defined in this framework was addressed. A second electronic database search, including search terms pertaining to fidelity, receipt, health and process evaluations was performed to identify papers reporting on receipt in the wider literature and irrespective of the framework used. These results were combined with forward citation search results to review methods to assess receipt. Eligibility criteria and data extraction forms were developed and applied to papers. Results are described in a narrative synthesis.

RESULTS

19.6% of 33 studies identified from the forward citation search to report on fidelity were found to address receipt. In 60.6% of these, receipt was assessed in relation to understanding and in 42.4% in relation to performance of skill. Strategies to enhance these were present in 12.1% and 21.1% of studies, respectively. Fifty-five studies were included in the review of the wider literature. Several frameworks and operationalisations of receipt were reported, but the latter were not always consistent with the guiding framework. Receipt was most frequently operationalised in relation to intervention content (16.4%), satisfaction (14.5%), engagement (14.5%), and attendance (14.5%). The majority of studies (90.0%) included subjective assessments of receipt. These relied on quantitative (76.0%) rather than qualitative (42.0%) methods and studies collected data on intervention recipients (50.0%), intervention deliverers (28.0%), or both (22.0%). Few studies (26.0%) reported on the reliability or validity of methods used.

CONCLUSIONS

Receipt is infrequently addressed in health research and improvements to methods of assessment and reporting are required.

Consideration of treatment fidelity to improve manual therapy research

OBJECTIVES

The purpose of this paper was to define treatment fidelity, review its use in health care research and suggest how it may be utilized in manual therapy research to improve the reliability and validity of the literature.

RESULTS

We offer an outline and a table of how manual therapy research may benefit from the concept of treatment fidelity.

DISCUSSION

While treatment fidelity is a newer concept, and has not been integrated into Physical Therapy or Manual Therapy research, when utilized, it can have positive effects on the reliability and validity of the techniques we evaluate.

Motivating patient adherence to allergic rhinitis treatments

Patient nonadherence significantly burdens the treatment of allergic rhinitis (AR). Fewer than half of prescribed doses of intranasal corticosteroid medication are taken. The challenges for immunotherapies are even greater. While sustained treatment for 3 to 5 years is required for full benefit, most patients receiving immunotherapy, either subcutaneous or sublingual, stop treatment within the first year. Although research into interventions to improve AR adherence is lacking, lessons learned from adherence interventions in other chronic health conditions can be applied to AR. Two well-established, overriding models of care-the chronic care model and patient-centered care-can improve adherence. The patient-centered care model includes important lessons for allergy providers in their daily practice, including understanding and targeting modifiable barriers to adherence. Additionally, recent studies have begun to leverage health information and communication technologies to reach out to patients and promote adherence, extending patient-centered interventions initiated by providers during office visits.

How to Measure Motivational Interviewing Fidelity in Randomized Controlled Trials: Practical Recommendations

Many randomized controlled trials in which motivational interviewing (MI) is a key intervention make no provision for the assessment of treatment fidelity. This methodological shortcoming makes it impossible to distinguish between high- and low-quality MI interventions, and, consequently, to know whether MI provision has contributed to any intervention effects. This article makes some practical recommendations for the collection, selection, coding and reporting of MI fidelity data, as measured using the Motivational Interviewing Treatment Integrity Code. We hope that researchers will consider these recommendations and include MI fidelity measures in future studies.

School nurses' experiences with motivational interviewing for preventing childhood obesity

Motivational interviewing is a counseling method used to bring about behavior change; its application by school nurses for preventing obesity in children is still new. This study, based on in-depth interviews with 12 school nurses, shows how school nurses adapted motivational interviewing and integrated it into their daily practice along with other methods they knew from the past. Three dilemmas for school nurses were revealed: when the child was severely overweight and the parents did not perceive this as a problem, when the child and the parents were at different stages of motivation to change, and when applying an individualized approach such as motivational interviewing for preventing a complex societal problem, in this instance obesity. The study raises an important issue to consider, with implications for school nursing and obesity prevention: motivational interviewing as either a counseling method or a prevention strategy.

Impact of a Healthy Nails Program on Nail-Biting in Turkish Schoolchildren

This study was conducted to examine the effect of a healthy nails program on nail-biting in Turkish schoolchildren. This quasi-experimental study was of pretest–posttest control group design. A total of 50 students of a primary school formed the intervention group, while 53 students from the same school formed the control group. Data were collected with a demographic form, a nail-biting follow-up form, and photographs of the fingernails. It was found that 68.9% of students were biting seven or more of their nails; 46.6% had damaged nail beds. In the intervention group, the rate of the children who were not biting their nails (baseline = 0%, 4th week = 56.0%, 8th week = 64.0%) increased significantly compared to the control group (baseline = 0%, 4th week = 15.1%, 8th week = 18.9%). Outcomes indicate the efficacy of the healthy nails program in reducing the nail-biting problem in schoolchildren.

Pilot intervention to increase physical activity among sedentary urban middle school girls: a two-group pretest-posttest quasi-experimental design

The primary purpose of the study was to determine whether girls in one school receiving nurse counseling plus an after-school physical activity club showed greater improvement in physical activity, cardiovascular fitness, and body composition than girls assigned to an attention control condition in another school (N = 69). Linear regressions controlling for baseline measures showed no statistically significant group differences, but the directionality of differences was consistent with greater intervention group improvement for minutes of moderate to vigorous physical activity/hour (t = 0.95, p = .35), cardiovascular fitness (t = 1.26, p = .22), body mass index (BMI; t = -1.47, p = .15), BMI z score (t = -1.19, p = .24), BMI percentile (t = -0.59, p = .56), percentage body fat (t = -0.86, p = .39), and waist circumference (t = -0.19, p = .85). Findings support testing with a larger sample.