Practitioner perspectives on evidence-based practice

Behavioral Parent Training for ADHD Reduces Situational Severity of Child Noncompliance and Related Parental Stress

Objective: Parents are more likely to seek treatment when a child's behaviors cause impairment and increase parental burden. Thus, it is important to document the effectiveness of behavioral parent training (BPT) on the pervasiveness and severity of children's behavior and related parental distress. Method: Data were obtained from 304 parents of school-aged children with attention-deficit hyperactivity disorder (ADHD) attending BPT groups in an outpatient setting. Results: After BPT, parents reported fewer and less severe problematic situations related to child noncompliance, particularly for chores, homework, mealtimes, and peer interactions. Parents also reported significantly reduced stress related to parenting a child with ADHD. Improvements in Nonfamilial Transactions and Task Performance were associated with reductions in degree of parental stress. Conclusion: BPT offered in a real-world clinical setting has meaningful impacts on the child behaviors that lead parents to seek treatment and reduces stress related to parenting a child with ADHD.

Adaptive Interventions in Child and Adolescent Mental Health

The treatment or prevention of child and adolescent mental health (CAMH) disorders often requires an individualized, sequential approach to intervention, whereby treatments (or prevention efforts) are adapted over time based on the youth's evolving status (e.g., early response, adherence). Adaptive interventions are intended to provide a replicable guide for the provision of individualized sequences of interventions in actual clinical practice. Recently, there has been great interest in the development of adaptive intervenions by investigators working in CAMH. The development of such replicable, real-world, individualized sequences of decision rules to guide the treatment or prevention of CAMH disorders represents an important "next step" in interventions research. The primary purpose of this special issue is to showcase some recent work on the science of adaptive interventions in CAMH. In this overview article, we review why individualized sequences of interventions are needed in CAMH, provide an introduction to adaptive interventions, briefly describe each of the articles included in this special issue, and describe some exciting areas of ongoing and future research. A hopeful outcome of this special issue is that it encourages other researchers in CAMH to pursue creative and significant research on adaptive interventions.

Do evidence-based interventions work when tested in the "real world?" A systematic review and meta-analysis of parent management training for the treatment of child disruptive behavior

Evidence-based interventions are often unavailable in everyday clinical settings. This may partly reflect practitioners' assumptions that research evidence does not reflect "real-world" conditions. To examine this further, we systematically assessed the clinical effectiveness of parent management training (PMT) for the treatment of child disruptive behavior across different real-world practice contexts. We identified 28 relevant randomized controlled trials from a systematic search of electronic bibliographic databases and conducted a meta-analysis of child outcomes across trials. Planned subgroup analyses involved comparisons between studies grouped according to individual real-world practice criteria and total real-world practice criteria scores, reflecting the extent to which PMT was delivered by non-specialist therapists, to a clinic-referred population, in a routine setting, and as part of a routine service. Meta-analysis revealed a significant overall advantage for PMT compared with waitlist control conditions. Subgroup analyses did not demonstrate significant differences in effect size estimates according to the total number of real-world practice criteria met by studies. Moreover, no consistent relationships were found between specific practice criteria and effect size estimates. In conclusion, PMT appears to be an effective treatment for children with disruptive behavior problems. There was no clear evidence that conducting PMT in real-world practice contexts is a deterrent to achieving effective child behavior outcomes, although relative advantage to "usual care" was not directly examined and the power of the analysis was limited as a result of significant heterogeneity. More research is needed to investigate whether this finding is generalizable to other psychological interventions. Suggestions are also made for developing more differentiated criteria to assist with evaluating the specific applicability of research evidence to different care providers.

A learning collaborative supporting the implementation of an evidence-informed program, the "4Rs and 2Ss for children with conduct difficulties and their families"

In this qualitative study the authors examine factors associated with the successful implementation and plans for continued use of an evidence-informed intervention, the 4Rs and 2Ss Program for Strengthening Families, in a sample of 29 New York State, Office of Mental Health licensed child mental health clinics. A learning collaborative (LC) approach was used as a vehicle for supporting training and implementation of the program. The PRISM theoretical framework ( Feldstein & Glasgow, 2008 ) was used to guide the data analysis. Data were analyzed using a multi-phase iterative process, identifying influences on implementation at multiple levels: the program (intervention), the external environment, implementation and sustainability infrastructure, and recipient characteristics. Clinics that were more proactive evidenced staff with advanced organizational skills were able to take advantage of the trainings and supports offered by the LC and fared better in their ability to adopt the intervention. The ability to adapt the intervention to the specific constraints of the clinics was a strong influence on continued use following the end of the LC. These preliminary results suggest that the supports provided by the LC are useful in consolidating information about the process of implementing evidence-informed interventions in community mental health settings. The impact of these supports is also based on their interactions with specific clinic contextual factors.

Improvement in symptoms versus functioning: how do our best treatments measure up?

We examined the effects of redefining standards of evidence for treatments targeting childhood mental health problems by expanding outcomes beyond symptom reduction to include functioning. Over 750 treatment protocols from 435 randomized controlled trials were rated based on empirical evidence. Nearly two-thirds (63.9%) demonstrated at least a minimum level of evidence for reducing symptoms; however, only 18.8% of treatments demonstrated evidence for reducing functional impairment. Of those treatments with empirical support for symptom reduction, the majority did not demonstrate empirical support for improvement in functioning because measures of functioning were not included in the studies in which these treatments were tested. However, even when measures of functioning were included, it was much more difficult for treatments to achieve improvement. Among treatments that achieved improvement in functioning, the most notable were Collaborative Problem Solving for disruptive behavior and Cognitive Behavioral Therapy plus Medication for traumatic stress because they demonstrated no support for symptom reduction but good support for improvement in functioning. Results are discussed within the context of evaluating the standards of evidence for treatments and the opportunity to move towards a multidimensional framework whose utility has the potential to exceed the sum of its parts.

Integrative module-based family therapy: application and training

The field of marriage and family therapy is currently at a crossroads. The challenge for contemporary therapists is how to incorporate the wisdom of previous models with the accountability that comes from evidence-based practice. The Integrative Module-Based Family Therapy treatment model provides a formalized series of steps that clinicians can use in their case planning and implementation. It is based on nine clinically relevant modules for assessment and intervention that are consistent with current best practices and empirically supported treatments. It thus meets the need for a structured family therapy practice and training approach that is respectful of the "art" of family therapy while still adhering to the principles of the "science" of evidence-based treatment.

Research-practice gaps in child mental health

OBJECTIVES

To present a framework for classifying research-practice gaps to increase clarity in the discourse on evidence-informed practice and policy as it applies to child mental health.

METHOD

The development of the framework was informed by the research literature about the effectiveness of clinic- and community-based interventions for the prevention and treatment of child mental health problems, patterns of uptake of these interventions, and the research literature about evidence-informed practice and policy.

RESULTS

Four types of research-practice gaps are proposed: (1) the failure to implement interventions found to be effective, and the implementation of interventions (2) that have been demonstrated to cause harm, (3) that have evidence of no effect, and (4) where the effectiveness is unknown because of the lack of rigorous evaluation. Examples from child mental health are provided for each type.

CONCLUSIONS

This framework could guide an agenda aimed at reducing research-practice gaps in child mental health. A range of strategies may be required to address the different types of gaps.

Lessons learned in implementing evidence-based practices: implications for psychiatric administrators

Factors related to the dissemination and implementation of evidence-based practices (EBPs) are discussed. Extensive effort is required to successfully implement and sustain EBPs that improve clinical outcomes. There is a rapid rate of discovery of new EBPs. Examples of large-scale implementations of EBPs in mental health are described with emphasis on the factors thought critical for success. The need for designing systems which can cost-effectively implement new EBPs is highlighted. Finally, the implications for psychiatric administrators are discussed.