Establishing cross-systems collaborations for implementation: protocol for a longitudinal mixed methods study

Parenting attitudes and behaviors among parents involved with the child welfare system and affected by substance use disorders

BACKGROUND

Co-occurring parental substance use and child maltreatment is a serious concern in the U.S child welfare system.

OBJECTIVE

The aim of the study was to examine parenting attitudes and practices among parents who participated in Ohio START (Sobriety, Treatment, And Reducing Trauma), a statewide initiative that provides support to families affected by co-occurring parental substance use and child maltreatment.

PARTICIPANTS AND SETTING

Study 1 involved quantitative data collected from 73 enrolled parents through pre-test and post-test telephone surveys. Study 2 (parent interviews) involved qualitative data collected through in-depth interviews with 34 enrolled parents.

METHODS

The paired-sample t-test and the McNemar test were conducted in Study 1 and thematic analysis was conducted in Study 2.

RESULTS

Quantitative analysis indicated significant improvements in parental expectations of children (t = -3.42, p = .001, Cohen's d = -0.40), parent-child family roles (t = -5.74, p < .001, Cohen's d = -0.67), and children's power and independence (t = -3.42, p = .001, Cohen's d = -0.40). Qualitative analysis revealed six themes related to changes in parenting after participation in Ohio START: (1) Being present for children, (2) Engaging in activities with children, (3) Enjoyment in providing care to children, (4) Maintaining employment for financial stability, (5) Better emotion regulation and stress management, and (6) a sense of pride.

CONCLUSIONS

Our findings demonstrate positive changes in parenting attitudes and practices among parents who participated in Ohio START and provide further support for the potential merits of this model and its continued expansion throughout Ohio.

Specifying cross-system collaboration strategies for implementation: a multi-site qualitative study with child welfare and behavioral health organizations

BACKGROUND

Cross-system interventions that integrate health, behavioral health, and social services can improve client outcomes and expand community impact. Successful implementation of these interventions depends on the extent to which service partners can align frontline services and organizational operations. However, collaboration strategies linking multiple implementation contexts have received limited empirical attention. This study identifies, describes, and specifies multi-level collaboration strategies used during the implementation of Ohio Sobriety Treatment and Reducing Trauma (Ohio START), a cross-system intervention that integrates services across two systems (child welfare and evidence-based behavioral health services) for families that are affected by co-occurring child maltreatment and parental substance use disorders.

METHODS

In phase 1, we used a multi-site qualitative design with 17 counties that implemented Ohio START. Qualitative data were gathered from 104 staff from child welfare agencies, behavioral health treatment organizations, and regional behavioral health boards involved in implementation via 48 small group interviews about collaborative approaches to implementation. To examine cross-system collaboration strategies, qualitative data were analyzed using an iterative template approach and content analysis. In phase 2, a 16-member expert panel met to validate and specify the cross-system collaboration strategies identified in the interviews. The panel was comprised of key child welfare and behavioral health partners and scholars.

RESULTS

In phase 1, we identified seven cross-system collaboration strategies used for implementation. Three strategies were used to staff the program: (1) contract for expertise, (2) provide joint supervision, and (3) co-locate staff. Two strategies were used to promote service access: (4) referral protocols and (5) expedited access agreements. Two strategies were used to align case plans: (6) shared decision-making meetings, and (7) sharing data. In phase 2, expert panelists specified operational details of the cross-system collaboration strategies, and explained the processes by which strategies were perceived to improve implementation and service system outcomes.

CONCLUSIONS

We identified a range of cross-system collaboration strategies that show promise for improving staffing, service access, and case planning. Leaders, supervisors, and frontline staff used these strategies during all phases of implementation. These findings lay the foundation for future experimental and quasi-experimental studies that test the effectiveness of cross-system collaboration strategies.

Implementation and Mental Health Outcomes of a Service Cascade Linking Child Welfare and Children's Mental Health Systems: A Case Study of the Gateway CALL Demonstration

The mental health needs of children and youth involved in the child welfare system remain largely unmet. Service cascades are an emerging approach to systematizing mental health screening, assessment, and treatment referral processes. However, evidence is minimal and inconsistent regarding the effectiveness of such approaches for improving mental health service access and outcomes. In an effort to address this gap, this study presents a case-study of the implementation fidelity and treatment outcomes of the Gateway CALL service cascade. Study analyses involved longitudinal data collected as part of a larger evaluation of Gateway CALL. Specifically, descriptive and linear mixed model analyses were conducted to assess the implementation of service cascade components, and changes in mental health outcomes (behavior problems) among 175 children placed out-of-home during the study. Study analyses found that although fidelity was strong early in the service cascade, implementation began to break down once components involved more than one service system (child welfare, mental health). However, results also indicated that parent-reported child behavior problems decreased significantly over time, despite later cascade components being implemented with poor fidelity to the Gateway CALL service model. For children and youth involved in child welfare systems, service cascades like Gateway CALL have the potential to significantly improve both mental health service receipt and outcomes. To maximize the effectiveness of such approaches, later phases of implementation may require increased attention and support, particularly regarding processes and outcomes that cross child welfare and mental health service systems.

Benchmarking Trauma in Child Welfare: A Brief Report

Trauma exposure is common; however, considerably higher rates are reported in some vulnerable groups including adults and children involved in child welfare systems. In this context, early screening and service linkage may ameliorate its negative impact on the physical and mental well-being of adults and children alike. Using data from two Ohio-based child welfare interventions targeting co-occurring maltreatment and substance use (Ohio START¹ and EPIC2), the purpose of this brief report was to first describe the rate of trauma exposure among participating adults (Adverse Childhood Experiences or ACEs, N = 402), children 0-5 years (CTAC, N = 271) and youth 6-18 years (CTAC, N = 177), and second to benchmark observed rates against reported rates in other child welfare or similar populations across the United States. Results show that adults were exposed to 4.2 ACEs on average, a 24% increase over previous child welfare estimates. While mean CTAC scores were not significantly different among young children ages 0-5, older children reported on average 5.6 exposures which is 27% higher than previously reported estimates. Our findings highlight the difference in risk profiles between families involved child welfare due primarily to substance misuse and those without substance misuse concerns, or where substance misuse was not the primary cause of entry. We discuss implications for service provision and time-sensitive child welfare requirements.

Applying Theory to Explain the Influence of Factors External to an Organization on the Implementation of an Evidence-Based Intervention

Despite its widely acknowledged influence on implementation, limited research has been done on how the external environment (i.e., outer setting) determines when organizations adopt and implement new interventions. Determinant frameworks identify several outer setting-level factors such as funding streams, inter-organizational relationships, and peer pressure. However, these frameworks do not explain how or why outer-setting factors influence implementation. To advance research in this area, we argue for the importance of deriving theory-based propositions from organization theory to explain how outer setting factors influence organizations. Drawing on the work of the Organization Theory in Implementation Science (OTIS) project, we identified 20 propositions from five classic organization theories-Complexity Theory, Contingency Theory, Institutional Theory, Resource Dependence Theory, and Transaction Cost Economics. We then applied those propositions to hypothesize relationships among outer setting factors, implementation strategies, and implementation outcomes in five case studies of evidenced-based tobacco control interventions. The five case studies address the implementation of smoke-free policies, community health worker-led tobacco education and cessation programs, 5 A's (Ask, Advise, Assess, Assist, and Arrange), point-of-sale tobacco marketing policy interventions, and quitlines. The case studies illustrate how propositions may be used to guide the selection and testing of implementation strategies. Organization theories provide a menu of propositions that offer guidance for selecting and optimizing high-leverage implementation strategies that target factors at the level of outer setting. Furthermore, these propositions suggest testable hypotheses regarding the mechanisms underlying the influence of outer-setting factors on how and why organizations adopt and implement interventions.

Leveraging Technology to Increase Behavioral Health Services Access for Youth in the Juvenile Justice and Child Welfare Systems: a Cross-systems Collaboration Model

Behavioral health services access for justice- and child welfare-involved youth is limited despite significant need. Structural interventions to address limited access are nascent. Technology can advance access, but few interventions focus on system-impacted youth and their mental health needs and challenges. This article describes the development, process, and initial outcomes of the Youth Justice and Family Well-Being Technology Collaborative (JTC) that was formed to leverage technology within and across public health and justice-related systems to promote increased behavioral health services access. Cross-system considerations are identified for public health, court, and other key stakeholders to successfully integrate technology into practice to expand access to these critical services.

Enhancing Permanency in Children and Families (EPIC): a child welfare intervention for parental substance abuse

Background

Across Ohio, parental substance abuse has contributed to a marked increase in the number of children in foster care. Children exposed to parental substance use have a higher likelihood of physical abuse and neglect, and consequently a variety of physical, psychological and cognitive problems. The Enhancing Permanency in Children and Families (EPIC) program is a collaborative effort between the Ohio State University College of Social Work, two county offices of the Ohio Department of Job and Family Services, two juvenile courts and local behavioral health agencies. The goal of EPIC is to use three evidence-based and evidence-informed practices to reduce abusive and neglectful parenting, reduce addiction severity in parents, and improve permanency outcomes for families involved with the child welfare system due to substance abuse.

Methods

EPIC is a quasi-experimental study. Under the program, child welfare-involved adults who screen positive for substances are matched with a peer recovery supporter. Participants are also incentivized to participate in family treatment drug court, medications for opioid use disorders and home-based parenting supports. Participating adults (N = 250) are matched with comparison groups from counties participating in a separate intervention (Ohio START) and to those receiving treatment as usual, resulting in a final sample of 750 adults. Primary outcomes including addiction severity, child trauma symptoms, resilience, and attachment are assessed at baseline and at program completion. Additional outcomes include timely access to treatment services, length of placement in out-of-home care and recidivism into the child welfare system.

Discussion

This intervention formalizes cross-system collaboration between child welfare, behavioral health and juvenile courts to support families affected by addiction. The use of three evidence-based or evidence-informed strategies presents the opportunity to determine specific strategies that are most effective for reducing addiction severity. Lastly, the intervention combines several sources of funding to bolster sustainability beyond the life of the Regional Partnership Grant (RPG).

Trial registration

NCT04700696. Registered January 7, 2021-retrospectively registered.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-021-10668-1.

Coincidence analysis: a new method for causal inference in implementation science

BACKGROUND

Implementation of multifaceted interventions typically involves many diverse elements working together in interrelated ways, including intervention components, implementation strategies, and features of local context. Given this real-world complexity, implementation researchers may be interested in a new mathematical, cross-case method called Coincidence Analysis (CNA) that has been designed explicitly to support causal inference, answer research questions about combinations of conditions that are minimally necessary or sufficient for an outcome, and identify the possible presence of multiple causal paths to an outcome. CNA can be applied as a standalone method or in conjunction with other approaches and can reveal new empirical findings related to implementation that might otherwise have gone undetected.

METHODS

We applied CNA to a publicly available dataset from Sweden with county-level data on human papillomavirus (HPV) vaccination campaigns and vaccination uptake in 2012 and 2014 and then compared CNA results to the published regression findings.

RESULTS

The original regression analysis found vaccination uptake was positively associated only with the availability of vaccines in schools. CNA produced different findings and uncovered an additional solution path: high vaccination rates were achieved by either (1) offering the vaccine in all schools or (2) a combination of offering the vaccine in some schools and media coverage.

CONCLUSIONS

CNA offers a new comparative approach for researchers seeking to understand how implementation conditions work together and link to outcomes.