Designing the Future of Children's Mental Health Services

Development of a method for Making Optimal Decisions for Intervention Flexibility during Implementation (MODIFI): a modified Delphi study

BACKGROUND

Intervention adaptation is often necessary to improve the fit between evidence-based practices/programs and implementation contexts. Existing frameworks describe intervention adaptation processes but do not provide detailed steps for prospectively designing adaptations, are designed for researchers, and require substantial time and resources to complete. A pragmatic approach to guide implementers through developing and assessing adaptations in local contexts is needed. The goal of this project was to develop Making Optimal Decisions for Intervention Flexibility during Implementation (MODIFI), a method for intervention adaptation that leverages human centered design methods and is tailored to the needs of intervention implementers working in applied settings with limited time and resources.

METHOD

MODIFI was iteratively developed via a mixed-methods modified Delphi process. Feedback was collected from 43 implementation research and practice experts. Two rounds of data collection gathered quantitative ratings of acceptability and inclusion (Round 1) and feasibility (Round 2), as well as qualitative feedback regarding MODIFI revisions analyzed using conventional content analysis.

RESULTS

In Round 1, most participants rated all proposed components as essential but identified important avenues for revision which were incorporated into MODIFI prior to Round 2. Round 2 emphasized feasibility, where ratings were generally high and fewer substantive revisions were recommended. Round 2 changes largely surrounded operationalization of terms/processes and sequencing of content. Results include a detailed presentation of the final version of the three-step MODIFI method (Step 1: Learn about the users, local context, and intervention; Step 2: Adapt the intervention; Step 3: Evaluate the adaptation) along with a case example of its application.

DISCUSSION

MODIFI is a pragmatic method that was developed to extend the contributions of other research-based adaptation theories, models, and frameworks while integrating methods that are tailored to the needs of intervention implementers. Guiding teams to tailor evidence-based interventions to their local context may extend for whom, where, and under what conditions an intervention can be effective.

Study protocol for a randomized controlled trial of supportive parents - coping kids (SPARCK)-a transdiagnostic and personalized parent training intervention to prevent childhood mental health problems

BACKGROUND

To meet the scientific and political call for effective prevention of child and youth mental health problems and associated long-term consequences, we have co-created, tested, and optimized a transdiagnostic preventive parent-training intervention, Supportive parents - coping kids (SPARCK), together with and for the municipal preventive frontline services. The target group of SPARCK is parents of children between 4 and 12 years who display symptoms of anxiety, depression, and/or behavioral problems, that is, indicated prevention. The intervention consists of components from various empirically supported interventions representing different theorical models on parent-child interactions and child behavior and psychopathology (i.e., behavioral management interventions, attachment theory, emotion socialization theory, cognitive-behavioral therapy, and family accommodation intervention). The content and target strategies of SPARCK are tailored to the needs of the families and children, and the manual suggests how the target strategies may be personalized and combined throughout the maximum 12 sessions of the intervention. The aim of this project is to investigate the effectiveness of SPARCK on child symptoms, parenting practices, and parent and child stress hormone levels, in addition to later use of specialized services compared with usual care (UC; eg. active comparison group).

METHODS

We describe a randomized controlled effectiveness trial in the frontline services of child welfare, health, school health and school psychological counselling services in 24 Norwegian municipalities. It is a two-armed parallel group randomized controlled effectiveness and superiority trial with 252 families randomly allocated to SPARCK or UC. Assessment of key variables will be conducted at pre-, post-, and six-month follow-up.

DISCUSSION

The current study will contribute with knowledge on potential effects of a preventive transdiagnostic parent-training intervention when compared with UC. Our primary objective is to innovate frontline services with a usable, flexible, and effective intervention for prevention of childhood mental health problems to promote equity in access to care for families and children across a heterogeneous service landscape characterized by variations in available resources, personnel, and end user symptomatology.

TRIAL REGISTRATION

ClinicalTrials.gov ID: NTCT05800522.

HCI Contributions in Mental Health: A Modular Framework to Guide Psychosocial Intervention Design

Many people prefer psychosocial interventions for mental health care or other concerns, but these interventions are often complex and unavailable in settings where people seek care. Intervention designers use technology to improve user experience or reach of interventions, and HCI researchers have made many contributions toward this goal. Both HCI and mental health researchers must navigate tensions between innovating on and adhering to the theories of change that guide intervention design. In this paper, we propose a framework that describes design briefs and evaluation approaches for HCI contributions at the scopes of capabilities, components, intervention systems, and intervention implementations. We show how theories of change (from mental health) can be translated into design briefs (in HCI), and that these translations can bridge and coordinate efforts across fields. It is our hope that this framework can support researchers in motivating, planning, conducting, and communicating work that advances psychosocial intervention design.

Partnership-building considerations for implementation science in learning health systems: a case study of the Implementation Science Collaborative in Alberta, Canada

Introduction

Implementation of health innovations is inherently collaborative, requiring trans-sectoral partnerships between implementation researchers, innovation teams, and implementation practitioners. Implementation science has been shown to improve implementation successes; however, challenges that hinder partnerships to advance implementation science continue to persist. Using a whole-system approach to assess and respond to implementation science partnership barriers may shed light on effective responses.

Methods

We conducted a case study of Alberta's learning health system, using semi-structured group and individual interviews to create a nuanced understanding of the considerations required for implementation research collaborations. We interviewed 53 participants representing 21 offices in the health system, academia, professional associations, and government who regularly plan, evaluate, and/or study health system implementation initiatives in Alberta. Using the Partnership Model for Research Capacity Building, we identified current facilitators and challenges for partnerships for conducting and using implementation science, at different levels of Alberta's health-research ecosystem.

Results

Alberta's healthcare system is well set up to readily embed intervention effectiveness and efficacy research. Infrastructure was also in place to strengthen implementation practice. However, weaknesses around exchanging knowledge and skills, providing feedback and mentoring, and accommodating diversity affected the ability of both individuals and teams to build implementation science capacity. Without this capacity, teams could not participate in embedded implementation research collaborations. We report the response of the Alberta Strategy for Patient-Oriented Research SUPPORT Unit to these barriers to provide practical guidance on various program options to strengthen individual- and organization-level implementation science capacity.

Discussion

This study applied a whole-system approach to assess factors across Alberta's health-research ecosystem, which affect partnerships to advance implementation science. Our findings illustrated that partnership considerations go beyond interpersonal factors and include system-wide considerations. With the results, health organization leaders have (1) a method for assessing organizational capability to readily embed implementation research and (2) a catalog of potential responses to create conditions to readily engage with implementation science in their day-to-day implementation processes.

Emergency department clinicians' views on implementing psychosocial care following acute paediatric injury: a qualitative study

Introduction: The early post-trauma period is a key time to provide psychological support to acutely injured children. This is often when they present to emergency departments (EDs) with their families. However, there is limited understanding of the feasibility of implementing psychological support for children and their families in EDs. The aim of this study was to explore UK and Irish ED clinicians' perspectives on developing and implementing psychosocial care which educates families on their children's post-trauma psychological recovery.Methods: Semi-structured individual and group interviews were conducted with 24 UK and Irish ED clinicians recruited via a paediatric emergency research network.Results: Clinicians expressed that there is value in offering psychological support for injured children and their families; however, there are barriers which can prevent this from being effectively implemented. Namely, the prioritisation of physical health, time constraints, understaffing, and a lack of training. Therefore, a potential intervention would need to be brief and accessible, and all staff should be empowered to deliver it to all families.Conclusion: Overall, participants' views are consistent with trauma-informed approaches where a psychosocial intervention should be able to be implemented into the existing ED system and culture. These findings can inform implementation strategies and intervention development to facilitate the development and delivery of an accessible digital intervention for acutely injured children and their families.

Development of a method for Making Optimal Decisions for Intervention Flexibility during Implementation (MODIFI): A modified Delphi study

Background

Intervention adaptation is often necessary to improve the fit between evidence-based practices/programs and implementation contexts. Existing frameworks describe intervention adaptation processes but do not provide detailed steps for prospectively designing adaptations, are designed for researchers, and require substantial time and resources to complete. A pragmatic approach to guide implementers through developing and assessing adaptations in local contexts is needed. The goal of this project was to develop Making Optimal Decisions for Intervention Flexibility during Implementation (MODIFI), a method for intervention adaptation that leverages human centered design methods and is tailored to the needs of intervention implementers working in applied settings with limited time and resources.

Method

MODIFI was iteratively developed via a mixed-methods modified Delphi process. Feedback was collected from 43 implementation research and practice experts. Two rounds of data collection gathered quantitative ratings of acceptability (Round 1) and feasibility (Round 2), as well as qualitative feedback regarding MODIFI revisions analyzed using conventional content analysis.

Results

In Round 1, most participants rated all proposed components as essential but identified important avenues for revision which were incorporated into MODIFI prior to Round 2. Round 2 emphasized feasibility, where ratings were generally high and fewer substantive revisions were recommended. Round 2 changes largely surrounded operationalization of terms/processes and sequencing of content. Results include a detailed presentation of the final version of the three-step MODIFI method (Step 1: Learn about the users, local context, and intervention; Step 2: Adapt the intervention; Step 3: Evaluate the adaptation) along with a case example of its application.

Discussion

MODIFI is a pragmatic method that was developed to extend the contributions of other research-based adaptation theories, models, and frameworks while integrating methods that are tailored to the needs of intervention implementers. Guiding teams to tailor evidence-based interventions to their local context may extend for whom, where, and under what conditions an intervention can be effective.

Analysis, evaluation, and reformulation of social cognitive theory: Toward parent-child shared management in sleep health

THEORETICAL PRINCIPLES

Social Cognitive Theory (SCT) is a middle-range theory with triadic determinism between behavioral, environmental, and personal. SCT has been a guiding framework in health promotion research as it helps understand people's behaviors.

PHENOMENA ADDRESSED

Behavioral Insomnia of Childhood (BIC) is highly prevalent, affecting up to 45% of typically developing children and 80% of children with special healthcare needs. BIC leads to sleep deficiency, disrupted physical and psychological health, poor school performance, behavioral dysfunction, and negatively affects parental and family functioning. Using Fawcett's framework, we analyzed and evaluated SCT in a pediatric sleep context and propose a reformulation of SCT to better inform sleep research.

RESEARCH LINKAGES

SCT is individually focused and does not account for interdependence within relationships. Pediatric sleep interventions have limited long-term effects and sustainability without considering the parent-child dyadic interdependency. We advance the argument that the parent-child shared management (PCSM) perspective is beneficial for understanding pediatric sleep health. PCSM is a concept that reflects the shared responsibility and interdependence that parent and child have for managing child health. It assumes that with parents' ongoing support, children's responsibility for their health management increases over time, along with developmental progression and health-related experiences. We propose reformulating SCT by integrating PCSM in the pediatric sleep context: SCT with Shared Management (SCT-SM). The proposed SCT-SM accounts for parent-child interdependence and role transition. Shared management interventions that engage parents and children in active roles in managing sleep have potential sustainable effects in improving sleep and quality of life. (250).

Development of an Online Training Platform and Implementation Strategy for School-Based Mental Health Professionals in Rural Elementary Schools: A Mixed-Methods Study

Children in rural settings are less likely to receive mental health services than their urban and suburban counterparts and even less likely to receive evidence-based care. Rural schools could address the need for mental health interventions by using evidence-based practices within a tiered system of supports such as positive behavioral interventions and supports. However, very few school professionals, with or without mental health training, have received training on evidence-based practices. Rural schools need implementation strategies focused on training to prepare school personnel for the implementation of interventions with fidelity. Little is known about training strategies that are feasible and appropriate for the rural school context. User-centered design is an appropriate framework for the development of training strategies for professionals in rural schools because of its participatory approach and the development of products that fit the context where they are going to be used. The purpose of the study was to develop and assess components of an online training platform and implementation strategy based on the user-centered design. Quantitative and qualitative data from 25 participants from an equal number of schools in rural areas of Pennsylvania were used in the study. A mixed-methods design utilizing complementary descriptive statistics and theme analyses indicated that the training platform and implementation strategy were perceived as highly acceptable, appropriate, feasible and usable by school professionals. The resulting training platform and implementation strategy will fill a void in the training literature in rural schools.

Bridging HCI and Implementation Science for Innovation Adoption and Public Health Impact

Human computer interaction (HCI) and implementation science (IS) each have been applied to improve the adoption and delivery of innovative health interventions, and the two fields have complementary goals, foci, and methods. While the IS community increasingly draws on methods from HCI, there are many unrealized opportunities for HCI to draw from IS and to catalyze bidirectional collaborations. This workshop will explore similarities and differences between fields, with a goal of articulating a research agenda at their intersection.

Partnerships at the Interface of Education and Mental Health Services: The Utilisation and Acceptability of the Provision of Specialist Liaison and Teacher Skills Training

Partnerships between school staff and mental health professionals have the potential to improve access to mental health support for students, but uncertainty remains regarding whether and how they work in practice. We report on two pilot projects aimed at understanding the implementation drivers of tailored strategies for supporting and engaging front-line school staff in student mental health. The first project provided regular, accessible mental health professionals with whom school staff could meet and discuss individual or systemic mental health concerns (a school 'InReach' service), and the other offered a short skills training programme on commonly used psychotherapeutic techniques (the School Mental Health Toolbox; SMHT). The findings from the activity of 15 InReach workers over 3 years and 105 individuals who attended the SMHT training demonstrate that school staff made good use of these services. The InReach workers reported more than 1200 activities in schools (notably in providing specialist advice and support, especially for anxiety and emotional difficulties), whilst most SMHT training attendees reported the utilisation of the tools (in particular, supporting better sleep and relaxation techniques). The measures of acceptability and the possible impacts of the two services were also positive. These pilot studies suggest that investment into partnerships at the interface of education and mental health services can improve the availability of mental health support to students.

Precision Implementation: An Approach to Mechanism Testing in Implementation Research

Advancing mechanism-focused research in implementation science is a priority given its potential to improve tailoring and efficiency of implementation strategies. Experimental therapeutics, or experimental medicine, offers an approach for mechanism testing that has been promoted by the NIH Science of Behavior Change and endorsed by the National Institute for Mental Health. This approach has been applied across the translational spectrum - with initial applications to biological research and more recent applications to psychosocial treatment development research. We describe further advancement of experimental therapeutics along the translational spectrum and describe how it is ideally suited to inform precision experimental tests of implementation strategy mechanisms, which we term precision implementation. Such an approach to mechanism testing will allow for identification of causal dose-response relationships between implementation strategies, presumed mechanisms, and implementation outcomes. We discuss the tension between the scientific rigor required to conduct mechanism-focused research using experimental therapeutics and the "real world" conditions in which implementation research takes place. We provide a series of example studies that show "beginning to end" application of this framework in research focused on provider implementation of an evidence-based intervention in routine clinical care settings.

Advancing rapid adaptation for urgent public health crises: Using implementation science to facilitate effective and efficient responses

Responding rapidly to emerging public health crises is vital to reducing their escalation, spread, and impact on population health. These responses, however, are challenging and disparate processes for researchers and practitioners. Researchers often develop new interventions that take significant time and resources, with little exportability. In contrast, community-serving systems are often poorly equipped to properly adopt new interventions or adapt existing ones in a data-driven way during crises' onset and escalation. This results in significant delays in deploying evidence-based interventions (EBIs) with notable public health consequences. This prolonged timeline for EBI development and implementation results in significant morbidity and mortality that is costly and preventable. As public health emergencies have demonstrated (e.g., COVID-19 pandemic), the negative consequences often exacerbate existing health disparities. Implementation science has the potential to bridge the extant gap between research and practice, and enhance equity in rapid public health responses, but is underutilized. For the field to have a greater "real-world" impact, it needs to be more rapid, iterative, participatory, and work within the timeframes of community-serving systems. This paper focuses on rapid adaptation as a developing implementation science area to facilitate system responses during public health crises. We highlight frameworks to guide rapid adaptation for optimizing existing EBIs when responding to urgent public health issues. We also explore the economic implications of rapid adaptation. Resource limitations are frequently a central reason for implementation failure; thus, we consider the economic impacts of rapid adaptation. Finally, we provide examples and propose directions for future research and application.

To Utility and Beyond! Specifying and Advancing the Utility of Measurement-Based Care for Youth

Mental health organizations that serve youth are under pressure to adopt measurement-based care (MBC), defined as the continuous collection of client-report data used to support clinical decision-making as part of standard care. However, few frameworks exist to help leadership ascertain how to select an MBC approach for a clinical setting. This paper seeks to define how an MBC approach can display clinical utility to provide such a framework. Broadly, we define clinical utility as evidence that an MBC approach assists stakeholders in fulfilling clinical goals related to care quality (i.e., improve client-clinician alliance and clinical outcomes) at the client (i.e., youth and caregiver), clinician, supervisor, and administrator levels. More specifically, our definition of clinical utility is divided into two categories relevant to the usability and usefulness of an MBC approach for a specific setting: (a) implementability (i.e., evidence indicating ease of use in a clinical setting) and (b) usefulness in aiding clinical activities (i.e., evidence indicating the potential to improve communication and make clinical activities related to care quality easier or more effective). These categories provide valuable information about how easy an MBC approach is to use and the potential benefits that the MBC data will confer. To detail how we arrived at this definition, we review prior definitions of clinical utility, discuss how previous definitions inform our definition of clinical utility for MBC, and provide examples of how the concept of clinical utility can be applied to MBC. We finish with a discussion of future research directions.

Usability Issues in Evidence-Based Psychosocial Interventions and Implementation Strategies: Cross-project Analysis

BACKGROUND

People often prefer evidence-based psychosocial interventions (EBPIs) for mental health care; however, these interventions frequently remain unavailable to people in nonspecialty or integrated settings, such as primary care and schools. Previous research has suggested that usability, a concept from human-centered design, could support an understanding of the barriers to and facilitators of the successful adoption of EBPIs and support the redesign of EBPIs and implementation strategies.

OBJECTIVE

This study aimed to identify and categorize usability issues in EBPIs and their implementation strategies.

METHODS

We adapted a usability issue analysis and reporting format from a human-centered design. A total of 13 projects supported by the National Institute of Mental Health-funded Accelerating the Reach and Impact of Treatments for Youth and Adults with Mental Illness Center at the University of Washington used this format to describe usability issues for EBPIs and implementation strategies with which they were working. Center researchers used iterative affinity diagramming and coding processes to identify usability issue categories. On the basis of these categories and the underlying issues, we propose heuristics for the design or redesign of EBPIs and implementation strategies.

RESULTS

The 13 projects reported a total of 90 usability issues, which we categorized into 12 categories, including complex and/or cognitively overwhelming, required time exceeding available time, incompatibility with interventionist preference or practice, incompatibility with existing workflow, insufficient customization to clients/recipients, intervention buy-in (value), interventionist buy-in (trust), overreliance on technology, requires unavailable infrastructure, inadequate scaffolding for client/recipient, inadequate training and scaffolding for interventionists, and lack of support for necessary communication. These issues range from minor inconveniences that affect a few interventionists or recipients to severe issues that prevent all interventionists or recipients in a setting from completing part or all of the intervention. We propose 12 corresponding heuristics to guide EBPIs and implementation strategy designers in preventing and addressing these usability issues.

CONCLUSIONS

Usability issues were prevalent in the studied EBPIs and implementation strategies. We recommend using the lens of usability evaluation to understand and address barriers to the effective use and reach of EBPIs and implementation strategies.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/14990.

It's all in the name: why exposure therapy could benefit from a new one

Exposure therapy for anxiety and related disorders is the psychological intervention with the strongest support for its efficacy and effectiveness to date. Yet, it is the least used evidence-based intervention in routine clinical practice, with a long-acknowledged public relations problem. Despite a wealth of research aimed at improving uptake of exposure, exposure's marketing and branding remains an untapped target. We first introduce principles from the marketing literature to propose that the field take steps toward a rebranding and repackaging of exposure therapy to support efforts to implement it widely. Second, we present preliminary data on clinician preferences for the use of alternative terminology developed to be more palatable and marketable - "Supported Approach of Feared Experiences - Cognitive Behavioral Therapy (SAFE-CBT)" - compared to traditional terminology. This initial survey indicated that most clinicians preferred use of the SAFE-CBT term when talking to patients, whereas only a minority preferred it for use among training clinicians. We conclude by discussing implications of these results for future efforts to implement exposure therapy more widely and set an agenda for future research in this space.

Lessons learned from designing an asynchronous remote community approach for behavioral activation intervention for teens

Adolescent depression is common; however, over 60% of depressed adolescents do not receive mental health care. Digitally-delivered evidence-based psychosocial interventions (EBPIs) may provide an opportunity to improve access and engagement in mental health care. We present a case study that reviews lessons learned from using the Discover - Design - Build - Test (DDBT) model to create, develop, and evaluate a high-fidelity prototype of an app to deliver an EBPI for depression, behavioral activation (BA), on an Asynchronous Remote Communities (ARC) platform (referred to as ActivaTeen). We review work at each stage of the DDBT framework, including initial formative work, iterative design and development work, and an initial feasibility study. We engaged teens with depression, mental health clinicians, and expert evaluators through the process. We found that the DDBT model supported the research team in understanding the requirements for our prototype system, ActivaTeen, and conceiving of and developing specific ideas for implementation. Our work contributes a case study of how the DDBT framework can be applied to adapting an EBPI to a new, scalable and digital format. We provide lessons learned from engaging teens and clinicians with an asynchronous approach to EBPIs and human centered design considerations for teen mental health.

Clinician adoption of Parent–Child Interaction Therapy: A systematic review of implementation interventions

Background

Parent–Child Interaction Therapy (PCIT) is a parent training intervention for childhood conduct problems, distinctive in its use of live clinician coaching of the parent–child dyad via a one-way mirror and discrete earpiece. However, despite a compelling evidence base, uptake of evidence-based parent training programmes such as PCIT by clinicians in routine care settings remains poor. This systematic review aimed to identify and synthesise implementation interventions that have sought to increase clinician adoption of PCIT in usual care settings.

Methods

We searched MEDLINE (Ovid), Embase (Ovid), PsycInfo (Ovid), CINAHL (EBSCO), Science Citation Index and Social Sciences Citation Index, and Web of Science Core Collection from inception to October 2020. Articles were included if they tested (by way of randomised controlled trials, controlled clinical trials, interrupted time series and controlled before and after trials) implementation interventions across any and all of the patient, clinician, clinic, system or policy domains. Two independent reviewers screened and selected studies, assessed risk of bias and extracted data – summarising implementation intervention components according to items from the Template for Intervention Description and Replication (TIDieR) checklist ( Hoffmann et al., 2014 ).

Results

Of the 769 articles identified once duplicates were removed, 13 papers relating to three studies met the inclusion criteria – all were quantitative or mixed-methods examinations of the effectiveness of different PCIT clinician training or training-related consultation methods. A narrative description of interventions was provided, as quantitative synthesis was not possible.

Conclusions

Research attention has to date been focussed on the establishment of an evidence-base for PCIT's effectiveness, with relatively little attention to the dissemination, implementation and sustainment of this treatment. Those studies that do exist have focused on training methods and training-related expert consultation. Research attention could usefully turn to both adoption and sustainment of this effective treatment in usual care settings.

Plain language summary

In this review, we aimed to summarise what is already known about how to implement PCIT in community settings after clinicians have received training in the approach. While research relating to the implementation of other parent training programmes is interesting and informative, implementation efforts are most effective when tailored to a specific programme in a specific context. As such, it was important to review published studies relating to PCIT specifically. We identified three relevant studies, one of which is yet to publish its main implementation findings. The three studies have focused on how best to train clinicians in PCIT, including how best to provide post-training support from expert trainers. We concluded that a fruitful line for future research would be to focus on the post-training period, particularly how best to support clinicians to adopt and sustain PCIT in their practice.

Systematic review registration

The study was prospectively registered with the International Prospective Register of Systematic Reviews (PROSPERO) on 01/10/2020 (CRD42020207118).

An overview of and recommendations for more accessible digital mental health services

Mental health concerns are common, and various evidence-based interventions for mental health conditions have been developed. However, many people have difficulty accessing appropriate mental health care and this has been exacerbated by the COVID-19 pandemic. Digital mental health services, such as those delivered by mobile phone or web-based platforms, offer the possibility of expanding the reach and accessibility of mental health care. To achieve this goal, digital mental health interventions and plans for their implementation must be designed with the end users in mind. In this Review, we describe the evidence base for digital mental health interventions across various diagnoses and treatment targets. Then, we explain the different formats for digital mental health intervention delivery, and offer considerations for their use across key age groups. We discuss the role that the COVID-19 pandemic has played in emphasizing the value of these interventions, and offer considerations for ensuring equity in access to digital mental health interventions among diverse populations. As healthcare providers continue to embrace the role that technology can play in broadening access to care, the design and implementation of digital mental healthcare solutions must be carefully considered to maximize their effectiveness and accessibility.

Elements in Mental Health Interventions Associated with Effects on Emotion Regulation in Adolescents: A Meta-Analysis

PURPOSE

Adolescence is a sensitive period for developing mental health problems. Interventions targeting emotion regulation have shown promising transdiagnostic effects for this group, but optimization efforts are called for. In the current study, we used an element-based approach to identify potentially active ingredients in interventions measuring emotion regulation, to guide further optimization.

METHODS

We coded practice elements in 30 studies based on a systematic review of mental health interventions measuring emotion regulation in adolescents (N = 2,389 participants, mean age 13-17 years). Using a three-level modeling approach, we then investigated the difference in effect on emotion regulation between studies of interventions with and without these practice elements.

RESULTS

We identified 75 practice elements and 15 element categories used in the included interventions. Results showed significantly stronger effects on emotion regulation when interventions included the practice elements Setting goals for treatment (difference in d = 0.40, 95% CI [0.09, 0.70], p = .012) and Psychoeducation about acceptance (difference in d = 0.58, 95% CI [0.09, 1.07], p = .021). Furthermore, a total of 11 elements and four overall categories were identified as potentially active ingredients, based on an effect size difference of > 0.20 between interventions with and without the elements.

CONCLUSION

The results can direct experimental research into the selection of practices that are most likely key to mechanisms of change in interventions addressing emotion regulation for adolescents. The challenge of measuring emotion regulation is discussed.

Researchers' Perspectives on Digital Mental Health Intervention Co-Design With Marginalized Community Stakeholder Youth and Families

Co-design of digital mental health technology with youth and families is a relatively new but growing approach to intervention development. In this perspective article, researchers used collaborative reflexivity through duoethnography methodology to reflect and report on experiences and lessons learned conducting co-designed projects with marginalized youth and families. Researchers engaged in written reflective dialogue regarding projects designed to co-develop technology-based apps and computer programs to support mental health of youth and their families. Reflections described the barriers and challenges for sharing responsibilities with stakeholders who have extensive lived experience but limited exposure to research. Researchers shared insights about their own intersectionality and positionality from marginalized to privileged, relative to co-design participants, and what it means to share authority, authentic partnership, and responsibility in the research process. Cultural understanding may diverge, even between acculturated minority researchers and matched minority stakeholders. While there are a variety of approaches that researchers might refer to as co-design, it is important to be intentional in the implementation of these processes so that collaborations with stakeholder youth and families are neither disingenuous nor exploitative. Implications for equitable and meaningful engagement of marginalized communities in co-design projects for youth mental health are discussed.

Barriers to Clinician Implementation of Parent-Child Interaction Therapy (PCIT) in New Zealand and Australia: What Role for Time-Out?

BACKGROUND

Parent-Child Interaction Therapy (PCIT) is an effective parent training approach for a commonly occurring and disabling condition, namely conduct problems in young children. Yet, despite ongoing efforts to train clinicians in PCIT, the intervention is not widely available in New Zealand and Australia.

METHODS

We undertook a cross-sectional online survey of clinicians in New Zealand and Australia who had completed at least the 40-h initial PCIT training, to understand the barriers they encountered in their implementation efforts, and the extent to which attitudes toward time-out influenced implementation. The overall response rate was 47.5% (NZ: 60%; Australia: 31.4%).

RESULTS

Responses suggested that participants generally viewed PCIT as both acceptable and effective. Australian participants reported seeing significantly more clients for PCIT per week than those in NZ (Medians 0 and 2, respectively; χ2(1) = 14.08, p < 0.001) and tended to view PCIT as more effective in treating disruptive and oppositional behaviour (95% CI: -0.70, -0.13, p = 0.005). Participants currently seeing PCIT clients described it as more enjoyable to implement than those not using PCIT (95% CI: -0.85, -0.10, p = 0.01). Thirty-eight percent of participants indicated that they adapt or tailor the standardised protocol, primarily by adding in content relating to emotion regulation, and removing content relating to time-out. Participants generally felt that they had fewer skills, less knowledge, and less confidence relating to the Parent-Directed Interaction phase of PCIT (which involves time-out), compared with the Child-Directed Interaction phase.

CONCLUSION

While we had hypothesised that time-out represented an intra-intervention component that detracted from implementation success, results suggested that clinician concern over the use of time-out was present but not prominent. Rather, the lack of access to suitable equipment (i.e., one-way mirror and ear-piece) and difficulties associated with clients attending clinic-based sessions were barriers most commonly reported by clinicians. We suggest that future research might consider whether and how PCIT might be "re-implemented" by already-trained clinicians, moving beyond simply training more clinicians in the approach.

Editorial Perspective: Rethinking child and adolescent mental health care after COVID-19

While COVID-19 pandemic has allegedly passed its first peak in most western countries, health systems are progressively adapting to the 'new normality'. In child and adolescent mental health services (CAMHS), such organizational envisioning is needed to cope with the foreseeable psychological effects of prolonged social isolation induced by nation-wide public health measures such as school closure. CAMHS need to ensure flexible responses to the psychopathological consequences of evolving societal dynamics, as dramatically actualized by the unexpected COVID-19 pandemic. This would imply (a) shifting the focus of intervention from symptom reduction and containment of acute crises in a comparatively small number of severe cases to a broader preventive strategy, guided by a gradient of increasing intensity and specificity of treatment; (b) promoting smooth access pathways into services and encouraging participation of families; (c) adopting a transdiagnostic staging model to capture the developmental fluctuations from subsyndromal to syndromal states and back, with related changes in the intensity of the need of care; and (d) implementing digital tools to encourage help-seeking and compliance by digitally native youth.

Revisiting caregiver satisfaction with children's mental health services in the United States

Nearly four decades ago, Unclaimed Children documented the gaps in the United States between mental health programs and caregivers’ perspectives about those services for their children. This absence of attention to parent or caregiver perspectives, including their satisfaction with these services, was a key finding of the report, which detailed system failure in caring for youth with mental health needs. Since then, the focus on caregiver satisfaction with children’s mental health services has been largely overlooked in research, and when examined has been mostly included as an indicator of the feasibility of program implementation. In striking contrast, overall healthcare system reforms have highlighted the importance of improving consumer’s direct experience of care. However, caregiver satisfaction remains largely disconnected to these overall health system reforms, even as reforms focus increasingly on value-based, coordinated and integrated care. In this paper, we review literature from 2010 to 2020, revisit the measurement of caregiver satisfaction, identify how and when it is being measured, and delineate a research agenda to both realign it with health system improvements, refine its focus on expectancies and appropriateness, and root it more firmly in the principles of user experience (UX) and human-centered design (HCD).

Festschrift for Leonard Bickman: Introduction to The Future of Children's Mental Health Services Special Issue

This introductory article describes the genesis of the Festschrift for Leonard Bickman and of this Festschrift special issue entitled, The Future of Children’s Mental Health Services. The special issue includes a collection of 11 original children’s mental health services research articles, broadly organized in accordance with three themes (i.e., Improving Precision and Use of Service Data to Guide Policy and Practice, Implementation and Dissemination, and Preparing for Innovation), followed by an interview-style article with Bickman. Then follows a featured manuscript by Bickman himself, three invited commentaries, and a compilation of letters and notes in which colleagues reflect on his career and on their experiences of him. The introduction concludes with a few thoughts about the future of children’s mental health services portended by the extraordinary scholarly contributions of Bickman and those who have been inspired by him.

Study protocol of a randomised trial of Summer STRIPES: a peer-delivered high school preparatory intervention for students with ADHD

INTRODUCTION

High schoolers with attention-deficit/hyperactivity disorder (ADHD) experience substantial impairments, particularly in the school setting. However, very few high school students with ADHD receive evidence-based interventions for their difficulties. We aim to improve access to care by adapting evidence-based psychosocial intervention components to a low-resource and novel school-based intervention model, Summer STRIPES (Students Taking Responsibility and Initiative through Peer Enhanced Support). Summer STRIPES is a brief peer-delivered summer orientation to high school with continued peer-delivered sessions during ninth grade.

METHODS AND ANALYSIS

Participants will be 72 rising ninth grade students with ADHD who are randomised to receive either Summer STRIPES or school services as usual. Summer STRIPES will be delivered by 12 peer interventionists in a school setting. Outcomes will be measured at baseline, start of ninth grade, mid-ninth grade and end-of-ninth grade. At each assessment, self, parent and teacher measures will be obtained. We will test the effect of Summer STRIPES (compared with school services as usual) on ADHD symptoms and key mechanisms (intrinsic motivation, extrinsic motivation, executive functions) as well as key academic outcomes during the ninth-grade year (Grade Point Average (GPA), class attendance).

ETHICS AND DISSEMINATION

Findings will contribute to our understanding of how to improve access and utilisation of care for adolescents with ADHD. The protocol is approved by the institutional review board at Seattle Children's Research Institute. The study results will be disseminated through publications in peer-reviewed journals and presentations at scientific conferences.

TRIALS REGISTRATION NUMBER

NCT04571320; pre-results.

Translating economic evaluations into financing strategies for implementing evidence-based practices

BACKGROUND

Implementation researchers are increasingly using economic evaluation to explore the benefits produced by implementing evidence-based practices (EBPs) in healthcare settings. However, the findings of typical economic evaluations (e.g., based on clinical trials) are rarely sufficient to inform decisions about how health service organizations and policymakers should finance investments in EBPs. This paper describes how economic evaluations can be translated into policy and practice through complementary research on financing strategies that support EBP implementation and sustainment.

MAIN BODY

We provide an overview of EBP implementation financing, which outlines key financing and health service delivery system stakeholders and their points of decision-making. We then illustrate how economic evaluations have informed decisions about EBP implementation and sustainment with three case examples: (1) use of Pay-for-Success financing to implement multisystemic therapy in underserved areas of Colorado, USA, based in part on the strength of evidence from economic evaluations; (2) an alternative payment model to sustain evidence-based oncology care, developed by the US Centers for Medicare and Medicaid Services through simulations of economic impact; and (3) use of a recently developed fiscal mapping process to collaboratively match financing strategies and needs during a pragmatic clinical trial for a newly adapted family support intervention for opioid use disorder.

CONCLUSIONS

EBP financing strategies can help overcome cost-related barriers to implementing and sustaining EBPs by translating economic evaluation results into policy and practice. We present a research agenda to advance understanding of financing strategies in five key areas raised by our case examples: (1) maximize the relevance of economic evaluations for real-world EBP implementation; (2) study ongoing changes in financing systems as part of economic evaluations; (3) identify the conditions under which a given financing strategy is most beneficial; (4) explore the use and impacts of financing strategies across pre-implementation, active implementation, and sustainment phases; and (5) advance research efforts through strong partnerships with stakeholder groups while attending to issues of power imbalance and transparency. Attention to these research areas will develop a robust body of scholarship around EBP financing strategies and, ultimately, enable greater public health impacts of EBPs.

Generating Intervention Concepts for Reducing Adolescent Relationship Abuse Inequities Among Sexual and Gender Minority Youth: Protocol for a Web-Based, Longitudinal, Human-Centered Design Study

Background

Sexual and gender minority youth (SGMY; eg, lesbian, gay, bisexual, and transgender youth) are at greater risk than their cisgender heterosexual peers for adolescent relationship abuse (ARA; physical, sexual, or psychological abuse in a romantic relationship). However, there is a dearth of efficacious interventions for reducing ARA among SGMY. To address this intervention gap, we designed a novel web-based methodology leveraging the field of human-centered design to generate multiple ARA intervention concepts with SGMY.

Objective

This paper aims to describe study procedures for a pilot study to rigorously test the feasibility, acceptability, and appropriateness of using web-based human-centered design methods with SGMY to create novel, stakeholder-driven ARA intervention concepts.

Methods

We are conducting a longitudinal, web-based human-centered design study with 45-60 SGMY (aged between 14 and 18 years) recruited via social media from across the United States. Using MURAL (a collaborative, visual web-based workspace) and Zoom (a videoconferencing platform), the SGMY will participate in four group-based sessions (1.5 hours each). In session 1, the SGMY will use rose-thorn-bud to individually document their ideas about healthy and unhealthy relationship characteristics and then use affinity clustering as a group to categorize their self-reported ideas based on similarities and differences. In session 2, the SGMY will use rose-thorn-bud to individually critique a universal evidence-based intervention to reduce ARA and affinity clustering to aggregate their ideas as a group. In session 3, the SGMY will use a creative matrix to generate intervention ideas for reducing ARA among them and force-rank the intervention ideas based on their potential ease of implementation and potential impact using an importance-difficulty matrix. In session 4, the SGMY will generate and refine intervention concepts (from session 3 ideations) to reduce ARA using round robin (for rapid iteration) and concept poster (for fleshing out ideas more fully). We will use content analyses to document the intervention concepts. In a follow-up survey, the SGMY will complete validated measures about the feasibility, acceptability, and appropriateness of the web-based human-centered design methods (a priori benchmarks for success: means >3.75 on each 5-point scale).

Results

This study was funded in February 2020. Data collection began in August 2020 and will be completed by April 2021.

Conclusions

Through rigorous testing of the feasibility of our web-based human-centered design methodology, our study may help demonstrate the use of human-centered design methods to engage harder-to-reach stakeholders and actively involve them in the co-creation of relevant interventions. Successful completion of this project also has the potential to catalyze intervention research to address ARA inequities for SGMY. Finally, our approach may be transferable to other populations and health topics, thereby advancing prevention science and health equity.

International Registered Report Identifier (IRRID)

DERR1-10.2196/26554

Screen Time, Social Media Use, and Adolescent Development

Adolescents spend much of their daily lives online, and fears abound that digital technology use, and social media in particular, is harming their social and emotional development. Findings to date do not support causal or robust associations between social media use and adolescents’ development. Instead, prior studies have produced a mix of small positive, negative, and often null associations. The narrative around social media and adolescent development has been negative, but empirical support for the story of increasing deficits, disease, and disconnection is limited. This article reviews what is known about the association between social media use and adolescent social and emotional well-being, identifies key limitations in current research, and recommends ways to improve science while also minimizing risk and creating opportunities for positive development in an increasingly digital and uncertain age.