The Old Solutions Are the New Problem: How Do We Better Use What We Already Know About Reducing the Burden of Mental Illness?

Common Elements Approaches to Implementation Research and Practice: Methods and Integration with Intervention Science

We propose that common elements approaches can advance implementation research and practice and facilitate pragmatic use of intervention and implementation evidence. Common elements are practices or processes frequently shared by interventions or implementations. Traditional common elements methodologies use synthesis, distillation, and statistics to describe and evaluate the merit of common ingredients in effective interventions. Recent developments include identifying and testing common configurations of elements, processes, and context variables across the literature of effective interventions and implementations. While common elements thinking has grown popular in intervention science, it has rarely been utilized in implementation science, and specifically, combined with the intervention literature. The goals of this conceptual methodology paper are to (1) provide an overview of the common elements concept and how it may advance implementation research and usability for practice, (2) give a step-by-step guide to systematic common elements reviews that synthesizes and distills the intervention and implementation literature together, and (3) offer recommendations for advancing element-level evidence in implementation science. A narrative review of the common elements literature was conducted with attention to applications to implementation research. A six-step guide to using an advanced common elements methodology was provided. Examples of potential results are presented, along with a review of the implications for implementation research and practice. Finally, we reviewed methodological limitations in current common elements approaches, and identified steps towards realizing their potential. Common elements methodologies can (a) synthesize and distill the implementation science literature into practical applications, (b) generate evidence-informed hypotheses about key elements and determinants in implementation and intervention processes and mechanisms, and (c) promote evidence-informed precision tailoring of intervention and implementation to context. To realize this potential, common elements approaches need improved reporting of details from both successful and unsuccessful intervention and implementation research, more data availability, and more testing and investigation of causal processes and mechanisms of change from diverse theories.

Supplementary Information

The online version contains supplementary material available at 10.1007/s43477-023-00077-4.

Using Artificial Intelligence to Enhance Ongoing Psychological Interventions for Emotional Problems in Real- or Close to Real-Time: A Systematic Review

Emotional disorders are the most common mental disorders globally. Psychological treatments have been found to be useful for a significant number of cases, but up to 40% of patients do not respond to psychotherapy as expected. Artificial intelligence (AI) methods might enhance psychotherapy by providing therapists and patients with real- or close to real-time recommendations according to the patient’s response to treatment. The goal of this investigation is to systematically review the evidence on the use of AI-based methods to enhance outcomes in psychological interventions in real-time or close to real-time. The search included studies indexed in the electronic databases Scopus, Pubmed, Web of Science, and Cochrane Library. The terms used for the electronic search included variations of the words “psychotherapy”, “artificial intelligence”, and “emotional disorders”. From the 85 full texts assessed, only 10 studies met our eligibility criteria. In these, the most frequently used AI technique was conversational AI agents, which are chatbots based on software that can be accessed online with a computer or a smartphone. Overall, the reviewed investigations indicated significant positive consequences of using AI to enhance psychotherapy and reduce clinical symptomatology. Additionally, most studies reported high satisfaction, engagement, and retention rates when implementing AI to enhance psychotherapy in real- or close to real-time. Despite the potential of AI to make interventions more flexible and tailored to patients’ needs, more methodologically robust studies are needed.

A Second and Third Look at FIRST: Testing Adaptations of A Principle-Guided Youth Psychotherapy

Objective: We examined the acceptability, integrity, and symptom trajectories associated with FIRST, a principle-guided treatment for youth internalizing and externalizing problems designed to support efficient uptake and implementation.Method: We conducted two open trials of an adapted FIRST, focusing on uptake and implementation by novice trainees in a university-affiliated clinic, limiting treatment duration to six sessions, and benchmarking findings against a 2017 FIRST trial with community therapists. In Study 1, trainees received a two-day training and weekly two-hour supervision (N = 22 youths, ages 7-17, 50% female, 54.54% Caucasian, 4.55% Latinx). In Study 2, trainees received a one-day training and weekly one-hour supervision, delivering the six-session FIRST in a predetermined sequence (N = 26 youths, ages 11-17, 42.31% female, 65.38% Caucasian, 7.69% Latinx). In Study 3, the original study therapists - now practitioners - evaluated FIRST's effectiveness and implementation difficulty, and reported their own post-study FIRST use.Results: Acceptability (treatment completion, session attendance, caregiver participation) and integrity (adherence, competence) were comparable across Study 1, Study 2 and the 2017 trial. Improvement effect sizes across ten outcome measures were in the large range in all three trials: M ES = 1.10 in the 2017 trial, 0.83 in Study 1, and 0.81 in Study 2. Study 3 showed high effectiveness ratings, low difficulty ratings, and continued use of FIRST by a majority of clinicians.Conclusions: Across two open trials and a follow-up survey, FIRST showed evidence of acceptability and integrity, with youth symptom reduction comparable to that in prior research.

Partnering with School Providers to Co-Design Mental Health Interventions: An Open Trial of Act & Adapt in Urban Public Middle Schools

Schools are well positioned to provide access to youth mental health services, but implementing effective programs that promote emotional and behavioral functioning in school settings is complicated by the poor fit of interventions developed in research settings to complex school contexts. The current study formed a research-practice partnership with two urban public schools and mental health providers employed by those schools (N = 6, 100% female, 50% Black/African American, 50% White/Caucasian) in the adaptation of a depression prevention intervention, Act & Adapt. The intervention was modified by decreasing meeting time and streamlining session content, increasing flexibility, making intervention materials more similar to academic curriculum, and increasing the focus on managing disruptive behavior within group sessions. In an open trial, 6^th grade students (N = 22; 59% boys, 31% Hispanic, 22% Black/African American, 4% Asian, 30% White/Caucasian) at both schools who were identified as clinically "at risk" reported improvements from baseline to post-intervention and at one-year follow-up on measures of emotional and behavioral difficulties and coping strategies, with parallel results by caregiver report. The providers reported satisfaction with the intervention, and qualitative analyses of provider focus groups suggested both barriers and facilitators to research-practice collaborations to implement mental health interventions in schools.

Pediatric Consultation-Liaison: Patient Characteristics and Considerations for Training in Evidence-Based Practices

Consultation-liaison services are an integral part of many pediatric hospital settings, yet characteristics of this patient population have not been extensively documented. The current study is a retrospective one-year chart review of the consultation-liaison service at a large pediatric hospital in the Southwestern United States. The purpose of this study is twofold: (1) to characterize this hospital's CL population and (2) to use these characteristics to identify preliminary evidence-based practices that should be considered for CL provider training. Identifying evidence-based practice elements that align with the characteristics of consultation-liaison patient populations may inform trainings for consultation-liaison staff. This would help to ensure that youth seen in hospital consultation-liaison services are getting the best available services, which is critical given the shortened time frame available to work with this patient population.

Common Elements of Practice, Process and Implementation in Out-of-School-Time Academic Interventions for At-risk Children: a Systematic Review

Academic achievement is a strong preventive factor against marginalization. Children at risk of academic failure and drop out can benefit from out-of-school-time academic (OSTA) interventions. Wide-scaled implementation and sustainment of effective interventions remain a struggle across education, welfare, and health. The need for approaches to increase implementability, effectiveness, and efficiency of interventions is pressing. Advancements in the field of education and mental health suggest identifying and studying discrete elements that are common across interventions for the purpose of hypothesis generation, intervention optimization, design improvement, and implementation. This review identified OSTA interventions for primary school children at risk of academic failure. Common elements methodology was used to code practice elements (n = 62), process elements (n = 49), and implementation elements (n = 36) in 30 effective and six ineffective OSTA interventions in matrices. Based on frequency counts, common practice, process, and implementation elements across the interventions were identified, and given frequency count values (FV) reflecting how often elements were included in effective studies as opposed to in ineffective studies. The five common practice elements with the highest FVs were homework support, training in positive parental school involvement, positive reinforcement, structured tutoring, and psychoeducation. The most common process element was regular support to intervention receiver, and the most common implementation element was quality monitoring. Common combinations of elements were also identified and given FVs. Results from this review can inform efforts to design or optimize OSTA interventions, and inform education, implementation, and practice to improve academic achievement for children at risk.

A systematic review of prevention programs targeting depression, anxiety, and stress in university students

BACKGROUND

Given the prevalence of anxiety, depression, and stress among university students, it is important to assess the effectiveness of prevention programs for these problems. Beyond examining effect sizes, applying a common elements approach can enhance our understanding of which practice elements are most frequently included in symptom-reducing programs.

METHOD

This review examined effective (i.e., outcome-producing) prevention programs targeting depression, anxiety, and/or stress in university students. Programs could be delivered in a group-based, online/computer-delivered, or self-administered format and at the universal, selective, or indicated prevention level.

RESULTS

The resulting sample of 62 articles covered 68 prevention programs for college, graduate, or professional students across 15 countries. Average effect sizes for programs were moderate (overall g = 0.65), regardless of delivery format or prevention level. The most common practice elements (overall and for programs producing large effects) were: psychoeducation (72%), relaxation (69%), and cognitive monitoring/restructuring (47%). Many programs were limited by: (a) symptom target-outcome mismatches, (b) disproportionately female samples, and (c) inconsistently reported adherence data.

LIMITATIONS

Commonness of practice elements across outcome-producing interventions does not imply their extensiveness nor unique contribution to effectiveness. Coding was based on information in articles rather than manuals, and inter-rater reliability was moderate for some practice elements.

CONCLUSION

The outcome-producing prevention programs in our sample had common practice elements and produced moderate reduction in symptoms overall. Future research of depression, anxiety, and stress prevention programs for university students can investigate practice elements' unique and combined impact on outcomes, further explore under-tested practice elements, and use findings to inform intervention design.

Agile science: creating useful products for behavior change in the real world

Evidence-based practice is important for behavioral interventions but there is debate on how best to support real-world behavior change. The purpose of this paper is to define products and a preliminary process for efficiently and adaptively creating and curating a knowledge base for behavior change for real-world implementation. We look to evidence-based practice suggestions and draw parallels to software development. We argue to target three products: (1) the smallest, meaningful, self-contained, and repurposable behavior change modules of an intervention; (2) “computational models” that define the interaction between modules, individuals, and context; and (3) “personalization” algorithms, which are decision rules for intervention adaptation. The “agile science” process includes a generation phase whereby contender operational definitions and constructs of the three products are created and assessed for feasibility and an evaluation phase, whereby effect size estimates/casual inferences are created. The process emphasizes early-and-often sharing. If correct, agile science could enable a more robust knowledge base for behavior change.

Applying new evidence standards to youth cognitive behavioral therapies - A review

This review included 136 published randomized controlled trials (RCTs) of youth cognitive behavioral therapy (CBT) treatments. We aimed to test the premise that evidence-based youth treatments can be better differentiated from each other by applying more nuanced standards of evidence. Accordingly, we applied three standards to this article sample to determine how many treatments produced significant results: (a) on multiple target symptom measures, (b) at follow-up, and/or (c) against an active comparison group. We identified how many trials met standards individually and in combination. Although 87 of the 136 articles produced at least one significant treatment result at post-assessment, the subsets of "passing" articles were smaller and varied for any one of our three standards, with only 11 articles (8%) meeting all three standards simultaneously. Implications are discussed regarding the definition of "evidence-based," the need for multi-parameter filtering in treatment selection and clinical decision making, and future directions for research. We ultimately argue the value in assessing youth treatments for different types of evidence, which is better achieved through dynamic sets of standards, rather than a single approach to assessing general strength of evidence.

Providers' attitudes toward evidence-based practices: is it just about providers, or do practices matter, too?

Evidence-based practice (EBP) attitudes were measured in a sample of Los Angeles County mental health service providers. Three types of data were collected: provider demographic characteristics, attitudes toward EBP in general, and attitudes toward specific EBPs being implemented in the county. Providers could reliably rate characteristics of specific EBPs, and these ratings differed across interventions. Preliminary implementation data indicate that appealing features of an EBP relate to the degree to which providers use it. These findings suggest that assessing EBP-specific attitudes is feasible and may offer implementation-relevant information beyond that gained solely from providers' general attitudes toward EBP.

Behavior change interventions: the potential of ontologies for advancing science and practice

A central goal of behavioral medicine is the creation of evidence-based interventions for promoting behavior change. Scientific knowledge about behavior change could be more effectively accumulated using "ontologies." In information science, an ontology is a systematic method for articulating a "controlled vocabulary" of agreed-upon terms and their inter-relationships. It involves three core elements: (1) a controlled vocabulary specifying and defining existing classes; (2) specification of the inter-relationships between classes; and (3) codification in a computer-readable format to enable knowledge generation, organization, reuse, integration, and analysis. This paper introduces ontologies, provides a review of current efforts to create ontologies related to behavior change interventions and suggests future work. This paper was written by behavioral medicine and information science experts and was developed in partnership between the Society of Behavioral Medicine's Technology Special Interest Group (SIG) and the Theories and Techniques of Behavior Change Interventions SIG. In recent years significant progress has been made in the foundational work needed to develop ontologies of behavior change. Ontologies of behavior change could facilitate a transformation of behavioral science from a field in which data from different experiments are siloed into one in which data across experiments could be compared and/or integrated. This could facilitate new approaches to hypothesis generation and knowledge discovery in behavioral science.

Acceptance and Commitment Therapy modules: Differential impact on treatment processes and outcomes

A modular, transdiagnostic approach to treatment design and implementation may increase the public health impact of evidence-based psychosocial interventions. Such an approach relies on algorithms for selecting and implementing treatment components intended to have a specific therapeutic effect, yet there is little evidence for how components function independent of their treatment packages when employed in clinical service settings. This study aimed to demonstrate the specificity of treatment effects for two components of Acceptance and Commitment Therapy (ACT), a promising candidate for modularization. A randomized, nonconcurrent, multiple-baseline across participants design was used to examine component effects on treatment processes and outcomes in 15 adults seeking mental health treatment. The ACT OPEN module targeted acceptance and cognitive defusion; the ACT ENGAGED module targeted values-based activation and persistence. According to Tau-U analyses, both modules produced significant improvements in psychiatric symptoms, quality of life, and targeted therapeutic processes. ACT ENGAGED demonstrated greater improvements in quality of life and values-based activation. ACT OPEN showed greater improvements in symptom severity, acceptance, and defusion. Both modules improved awareness and non-reactivity, which were mutually targeted, though using distinct intervention procedures. Both interventions demonstrated high treatment acceptability, completion, and patient satisfaction. Treatment effects were maintained at 3-month follow up. ACT components should be considered for inclusion in a modular approach to implementing evidence-based psychosocial interventions for adults.

Psychosocial Treatment of Bipolar Disorder: Clinician Knowledge, Common Approaches, and Barriers to Effective Treatment

OBJECTIVE

Nonphysician mental health clinicians were surveyed to understand their knowledge about bipolar disorder, treatment approaches, and perceived barriers to optimal treatment.

METHODS

Nonphysician mental health clinicians (N=55) from five community mental health clinics reported on their therapeutic approach, knowledge, and skill related to treatment of bipolar disorder. Chi square and t tests were used to detect differences in responses by clinician characteristics.

RESULTS

Most clinicians wished to improve their treatment for bipolar disorder. They felt best prepared to provide counseling and least prepared to identify medication side effects. Among psychotherapies, CBT was the most familiar to clinicians. Although knowledgeable overall about bipolar disorder, the clinicians were less knowledgeable about pharmacotherapy. The most commonly reported treatment barrier was comorbid substance use disorders.

CONCLUSIONS

Clinicians would benefit from additional training in effective therapeutic approaches for bipolar disorder as well as information about pharmacotherapy and supporting individuals with comorbid substance use problems.

Interventions and Models of Their Delivery to Reduce the Burden of Mental Illness: Reply to Commentaries

Our article in the January issue of Perspectives on Psychological Science (Kazdin & Blase, 2011) recommended developing a portfolio of models to deliver psychotherapeutic interventions with the goals of reaching a larger and more diverse segment of the population in need of mental health services and reducing the burden of mental illness. The commentaries offer several novel extensions to advance the goals. Among the topics raised in the commentaries are the role of moderating influences, the importance of a public health model for intervention research and application, the need to organize and manage our knowledge base and current treatments more effectively, the potential utility of priming-based interventions, the importance of cost measures, and novel applications to extend treatment broadly to veterans in need of services. The commentaries stimulated additional points to address the original goals including the utility of identifying interventions (e.g., lifestyle changes) that can reach many people in need and that can have broad outcome effects on mental and physical health, the importance of "disruptive innovations" (i.e., innovations that qualitatively change the nature of what and how services are delivered) from a business perspective, and the need for improved assessment to track the burden of mental illness in an ongoing way and to evaluate subgroups not being reached with our current interventions.

Disseminating evidence-based psychological treatments for eating disorders

The research-practice gap is of concern in the treatment of eating disorders. Despite the existence of empirically supported treatments, few receive them. The barriers to wider dissemination and implementation of evidence-based treatment include clinician attitudes towards such treatments and the lack of sufficient numbers of suitably trained therapists to provide treatment. In this review we discuss these barriers in the context of the wider issue of the dissemination and implementation of psychological treatments and review the research with regard to the treatment of eating disorders. Particular emphasis is placed on examining recent efforts to expand the availability and reach of treatments by making treatment delivery and training more scalable. We highlight promising developments and areas where further research is needed.

Using the core curriculum on childhood trauma to strengthen clinical knowledge in evidence-based practitioners

The high prevalence of trauma exposure in mental health service-seeking populations, combined with advances in evidence-based practice, competency-based training, common-elements research, and adult learning make this an opportune time to train the mental health workforce in trauma competencies. The Core Curriculum on Childhood Trauma (CCCT) utilizes a five-tiered conceptual framework (comprising Empirical Evidence, Core Trauma Concepts, Intervention Objectives, Practice Elements, and Skills), coupled with problem-based learning, to build foundational trauma knowledge and clinical reasoning skills. We present findings from three studies: Study 1 found that social work graduate students' participation in a CCCT course (N = 1,031) was linked to significant pre-post increases in self-reported confidence in applying core trauma concepts to their clinical work. Study 2 found significant pre-post increases in self-reported conceptual readiness (N = 576) and field readiness (N = 303) among social work graduate students participating in a "Gold Standard Plus" educational model that integrated classroom instruction in core trauma concepts, training in evidence-based trauma treatment (EBTT), and implementation of that EBTT in a supervised field placement. Students ranked the core concepts course as an equivalent or greater contributor to field readiness compared to standard EBTT training. Study 3 used qualitative methods to "distill" common elements (35 intervention objectives, 59 practice elements) from 26 manualized trauma interventions. The CCCT is a promising tool for educating "next-generation" evidence-based practitioners who possess competencies needed to implement modularized, individually tailored trauma interventions by strengthening clinical knowledge, clinical reasoning, and familiarity with common elements.

MAPping Los Angeles County: taking an evidence-informed model of mental health care to scale

We describe the scaling up of an evidence-informed model of care, Managing and Adapting Practice (MAP) in Los Angeles County, California. MAP complemented an array of evidence-based programs selected by the county as part of a large system reform effort designed to improve care for children and adolescents. In addition, we discuss the MAP model for training therapists and present data both on how the training model performed and on the outcomes of youths treated by therapists trained in MAP. We examined the success of two different training pathways for MAP therapists: (a) national training model and (b) MAP agency supervisor model (i.e., train the trainer). We also examined utilization of MAP and outcomes of clients served by MAP. Both the national training and MAP agency supervisor model were successful in producing MAP therapists in a timely fashion and with acceptable competency scores. Furthermore, a large number of clients were receiving MAP services. Finally, outcomes for youth treated with MAP were strong, with effect sizes ranging from .59 to .80 on the Youth Outcome Questionnaire. These data support the notion that scaling up a mental health services approach in a system can be achieved through a strong and broad partnership among relevant stakeholders, can involve a train-the-trainer model, and can result in strong outcomes for clients.

Engineering youth service system infrastructure: Hawaii's continued efforts at large-scale implementation through knowledge management strategies

Hawaii's Child and Adolescent Mental Health Division provides a unique illustration of a youth public mental health system with a long and successful history of large-scale quality improvement initiatives. Many advances are linked to flexibly organizing and applying knowledge gained from the scientific literature and move beyond installing a limited number of brand-named treatment approaches that might be directly relevant only to a small handful of system youth. This article takes a knowledge-to-action perspective and outlines five knowledge management strategies currently under way in Hawaii. Each strategy represents one component of a larger coordinated effort at engineering a service system focused on delivering both brand-named treatment approaches and complimentary strategies informed by the evidence base. The five knowledge management examples are (a) a set of modular-based professional training activities for currently practicing therapists, (b) an outreach initiative for supporting youth evidence-based practices training at Hawaii's mental health-related professional programs, (c) an effort to increase consumer knowledge of and demand for youth evidence-based practices, (d) a practice and progress agency performance feedback system, and (e) a sampling of system-level research studies focused on understanding treatment as usual. We end by outlining a small set of lessons learned and a longer term vision for embedding these efforts into the system's infrastructure.

Improving community-based mental health care for children: a commentary

In their article, "Improving Community-Based Mental Health Care for Children," Garland and colleagues explore and confront quality issues that are endemic to outpatient specialty mental health care for children in the United States. Their article presents evidence supporting the lack of effectiveness of usual care and draws on implementation science to explore areas for improving the quality of outpatient mental health care for young people. This commentary accepts these basic arguments and strategies, explores policy options that support the suggested reforms, and examines evidence-based programs in a broader context that draws on the systems of care approach. Specific issues addressed in this commentary include workforce capacity, policy options for improving care quality, provider incentives, systematic implementation supports, strategies to incorporate evidence-based approaches into practice, youth-guided and family-driven care, and the need to expand the definition of evidence-based practice to include the concepts of community-defined evidence and practice-based evidence.

Standardized functions for smartphone applications: examples from maternal and child health

Millennium Development Goals (MDGs) are unlikely to be met in most low- and middle-income countries (LMIC). Smartphones and smartphone proxy systems using simpler phones, equipped with the capabilities to identify location/time and link to the web, are increasingly available and likely to provide an excellent platform to support healthcare self-management, delivery, quality, and supervision. Smart phones allow information to be delivered by voice, texts, pictures, and videos as well as be triggered by location and date. Prompts and reminders, as well as real-time monitoring, can improve quality of health care. We propose a three-tier model for designing platforms for both professional and paraprofessional health providers and families: (1) foundational functions (informing, training, monitoring, shaping, supporting, and linking to care); (2) content-specific targets (e.g., for MDG; developmentally related tasks); (3) local cultural adaptations (e.g., language). We utilize the Maternal and Child Health (MCH) MDG in order to demonstrate how the existing literature can be organized and leveraged on open-source platforms and provide examples using our own experience in Africa over the last 8 years.

Disruptive innovations for designing and diffusing evidence-based interventions

Evidence-based therapeutic and preventive intervention programs (EBIs) have been growing exponentially. Yet EBIs have not been broadly adopted in the United States. In order for our EBI science to significantly reduce disease burden, we need to critically reexamine our scientific conventions and norms. Innovation may be spurred by reexamining the traditional biomedical model for validating, implementing, and diffusing EBI products and science. The model of disruptive innovations suggests that we reengineer EBIs on the basis of their most robust features in order to serve more people in less time and at lower cost. A disruptive innovation provides a simpler and less expensive alternative that meets the essential needs for the majority of consumers and is more accessible, scalable, replicable, and sustainable. Examples of disruptive innovations from other fields include minute clinics embedded in retail chain drug stores, $2 generic eyeglasses, automated teller machines, and telemedicine. Four new research approaches will be required to support disruptive innovations in EBI science: synthesize common elements across EBIs; experiment with new delivery formats (e.g., consumer controlled, self-directed, brief, paraprofessional, coaching, and technology and media strategies); adopt market strategies to promote and diffuse EBI science, knowledge, and products; and adopt continuous quality improvement as a research paradigm for systematically improving EBIs, based on ongoing monitoring data and feedback. EBI science can have more impact if it can better leverage what we know from existing EBIs in order to inspire, engage, inform, and support families and children to adopt and sustain healthy daily routines and lifestyles.