Longitudinal predictors of youth functional improvement in a public mental health system

Investigating the Trajectory and Associated Risk Factors of Clinical Outcomes for Early Childhood Disruptive Behavior Disorders Using Real World Data

Disruptive behavior disorders (DBDs) are common mental health problems among early childhood American youth that, if poorly managed, pose costly psychological and societal burdens. There is limited real world evidence on how parent management training (PMT) - the evidence-based treatment model of choice - implemented in common practice settings within the United States influences the behavioral progress of early childhood DBDs, and the risk factors associated with poor outcomes. This study used data from a measurement feedback system implemented within a U.S.-based private practice to study how behavioral outcomes change as a function of PMT treatment engagement and associated risk factors for 4-7 year-old children diagnosed with DBDs. Over 50% of patients reached optimal outcomes after 10 appointments. Attending 24-29 appointments provided maximum treatment effect - namely, 75% of patients reaching optimal outcomes by end of treatment. Outcomes attenuate after reaching the maximum effect. Patients also had higher odds of reaching optimal outcomes if they had consistent attendance throughout the treatment course. Notable risk factors associated with lower odds of reaching optimal outcomes included Medicaid insurance-type, greater clinical complexity, and having siblings concurrently in treatment. Increased implementation of systems that monitor and provide feedback on treatment outcomes in U.S.-based practice settings and similar investigations using its data can further enhance 'real world' management of early childhood DBDs among American youth.

Service Utilization for Parent Management of Early Childhood Behavior Problems in a Private Outpatient Behavioral Clinic: The Impact of Out-of-Pocket Cost, Travel Distance, and Initial Treatment Progress

Poorly-managed early childhood disruptive behavior disorders (DBDs) have costly psychological and societal burdens. While parent management training (PMT) is recommended to effectively manage DBDs, appointment adherence is poor. Past studies on influential factors of PMT appointment adherence focused on parental factors. Less well studied are social drivers relative to early treatment gains. This study investigated how financial and time cost relative to early gains influence PMT appointment adherence for early childhood DBDs in a clinic of a large behavioral health pediatric hospital from 2016 to 2018. Using information obtained from the clinic's data repository, claims records, public census and geospatial data, we assessed how owed unpaid charges, travel distance from home to clinic, and initial behavioral progress influences total and consistent attendance of appointments for commercially- and publicly-insured (Medicaid and Tricare) patients, controlling for demographic, service, and clinical differences. We further assessed how social deprivation interacted with unpaid charges to influence appointment adherence for commercially-insured patients. Commercially-insured patients had poorer appointment adherence with longer travel distances, or having unpaid charges and greater social deprivation; they also attended fewer total appointments with faster behavioral progress. Comparatively, publicly-insured patients were not affected by travel distance and had higher consistent attendance with faster behavioral progress. Longer travel distance and difficulty paying service costs while living in greater social deprivation are barriers to care for commercially-insured patients. Targeted intervention may be needed for this specific subgroup to attend and stay engaged in treatment.

Higher treatment focus diffusion in Multisystemic Therapy is associated with less functional improvement over the course of treatment

PURPOSE

Treatment focus diffusion (TFD), dividing focus across multiple concerns during treatment, is common in public mental health care and differs from the more narrowly focused empirically supported treatments for youth reported in the literature. The present study examined whether and to what extent TFD is associated with youth functional improvement over the course of therapy.

METHOD

This study utilized multi-level modeling techniques to analyze 12 consecutive years of standardized routine clinical service data from youth receiving treatment in one of two intensive in-home service settings: (a) Multisystemic Therapy (MST; n = 776 youths, 99 therapists), an implemented evidence-based treatment based on ecological theories of behavior in which therapists work with the multiple systems a youth interacts with (school, community, family), and (b) a standards-based service (n = 1854 youth, 413 therapists). Both service settings operate in the context of a publicly funded mental health care system which serves youth and families who are typically from underserved and low-income backgrounds. Majority of youth in this sample identified as multi-ethnic and male, and they, on average, were approximately 13 years old with three co-occurring diagnoses.

RESULTS

A significant TFD by service format interaction on youth functional improvement (alone and in the overall model) and follow up simple effects indicated that higher TFD was associated with significantly poorer outcomes in MST. The parameter estimate for TFD on functional improvement in the standards-based service format was in the same direction, but not statistically significant.

CONCLUSION

Our findings suggest that maintaining a narrower treatment focus might be beneficial to clients, particularly in implemented evidence-based treatments. Likewise, TFD could be a helpful case monitoring tool for clinicians, supervisors, and systems leaders when reviewing intensive-in-home cases.

Identifying Youth Problem Profiles and Predicting Remission Following Mental Health Treatment

This study utilized latent profile analysis to categorize youth served by a public mental health setting into homogenous classes. Then, associations between class membership and meeting clinical criteria by the latest assessment were examined. Caregiver responses to the Ohio Scales, Short Form, Problem Severity Scale for 1090 youth completed at entry into this public mental health system were subjected to latent profile analysis. This method classifies youth into categories based on mental health problem profiles, in order to determine the degree to which these groupings are related to later mental health outcomes. The classification of youth cases that emerged was then used to predict clinical remission at or nearest end of treatment, including final Ohio Scales Problem Severity scores and a measure of day-to-day functioning, the Child and Adolescent Functional Assessment Scale (CAFAS). A four-class model was identified as best representing the data, reflecting a relatively low-risk class (63.3% of the sample), an internalizing class (23.2%), a delinquency class (8.8%), and a high-risk class (4.7%). Individuals in the internalizing and high-risk classes had lower likelihoods of achieving problem remission than those in the low-risk and delinquency classes at the time of their last completed Ohio Scales. Additionally, youth assigned to the delinquency and high-risk classes had lower likelihoods of reaching functional impairment remission than those in the internalizing and low-risk classes. Youth membership in a class based on initial problem scores can be utilized to predict clinical remission over the course of treatment in public mental health care. Such class-based predictions support other methods of predicting outcomes and can be used by clinicians to develop more informed treatment plans and to adjust treatment based on such classifications.

Evidence-Based Treatments in Community Mental Health Settings: Use and Congruence With Children's Primary Diagnosis and Comorbidity

Many evidence-based treatments (EBTs) have been identified for specific child mental health disorders, but there is limited research on the use of EBTs in community-based settings. This study used administrative data from a statewide system of care to examine 1) the extent to which EBTs were provided congruent with the child's primary diagnosis, 2) whether there were differences in effectiveness of EBTs that were congruent or incongruent with the child's primary diagnosis, and 3) whether comorbidity moderated the effectiveness of EBTs for children based on congruence with their primary diagnosis. The sample consisted of 23,895 children ages 3-17 with at least one of the most common diagnoses (attention-deficit/hyperactivity disorder, conduct problems, depressive disorders, anxiety disorders, and post-traumatic stress disorder) who received outpatient psychotherapy. Data were collected as part of routine care, including child demographic characteristics, diagnosis, treatment type, and problem severity. Forty-two percent of children received an EBT congruent with their diagnosis, and these children showed greater improvement than the 35% of children who received no EBT (ES = 0.14-0.16) or the 23% who received an EBT incongruent with their diagnosis (ES = 0.06-0.15). For children with comorbid diagnoses, the use of EBTs congruent with the primary diagnosis was also associated with the greatest improvement, especially when compared to no EBT (ES = 0.22-0.24). Results of the current study support the use of EBTs in community-based settings, and suggest that clinicians should select EBTs that match the child's primary diagnosis to optimize treatment outcomes, especially for children with comorbidity.

Clinician-Identified Factors in Success of Parent-Directed Behavioral Therapy for Children's Tantrums

Disruptive behavior disorders (DBD) are the most common behavioral health problems in young American children. When not well-managed in early childhood, DBD can progress to lifetime mental health problems with personal, economic, as well as societal impacts. The evidence-based intervention of choice for DBD is outpatient parent-directed behavioral therapy (PDT). However, little is known about clinicians' perspectives on the factors influencing PDT's effectiveness in routine care. The current study directly assesses clinicians' perspectives on factors they believe impact PDT's success for disruptive behavior problems, in particular tantrums, at two outpatient behavioral therapy clinics specializing in PDT. In-depth interviews with 19 clinicians across three experience levels (doctoral intern, post-doctoral, licensed staff psychologist) were conducted and analyzed using qualitative methods. Two major themes were identified as enabling and limiting treatment success: (1) appointment attendance, (2) primary caregiver buy-in to treatment approach. Additional identified factors include caregiver's familial and social support, caregiver's physical and emotional capacities, complexity of the child's behavior problems, the extent to which the home environment can support positive changes, competing family/home demands, and care coordination among hospital programs. The primary factors identified by clinicians highlight the importance of fostering appointment attendance and parental psychoeducation that can be addressed by implementing multi-level administrative, training, and clinical initiatives to improve PDT's real-world effectiveness for DBD.

Practices Derived from the Evidence Base for Depression Predict Disruptive Behavior Progress in Adolescent Community Mental Health Care

Disruptive behavior problems develop along multiple causal pathways and are associated with a wide variety of co-occurring problems, including mood disorders. In usual care, effective treatment practices for youth disruptive behavior might differ from what the efficacy research suggests, given treatment setting and population demographic differences. The current study examined whether practices derived from the evidence base for disruptive behavior and/or depressed mood predicted progress on disruptive behavior problems in an adolescent usual care sample. Monthly clinical data, including therapeutic practices, treatment targets, and progress on selected treatment targets, for 1210 youth ages 13-17 who received intensive in-home services and were treated for disruptive behavior problems were examined utilizing multilevel modeling techniques. Practices derived from the evidence base for only depressed mood and practices derived from both disruptive behavior and depressed mood literatures predicted disruptive behavior progress, while practices derived from only the disruptive behavior evidence-based literature did not. All five practice elements exclusive to depressed mood treatment predicted positive disruptive behavior progress, while two of eleven disruptive behavior practices and four of seven practices derived from both problem areas predicted positive progress. Findings held when other predictors were included as covariates, including youth age and functional impairment. Although directionality remains unclear and further research is vital, usual care settings might present barriers to disruptive behavior treatment as prescribed by the evidence base, and youth-focused treatments based on depressed mood treatments merit further examination as a potentially promising route to effective treatment in such settings.

Predicting patterns of service utilization within children's mental health agencies

BACKGROUND

Some children with mental health (MH) problems have been found to receive ongoing care, either continuously or episodically. We sought to replicate patterns of MH service use over extended time periods, and test predictors of these patterns.

METHODS

Latent class analyses were applied to 4 years of visit data from five MH agencies and nearly 6000 children, 4- to 13-years-old at their first visit.

RESULTS

Five patterns of service use were identified, replicating previous findings. Overall, 14% of cases had two or more episodes of care and 23% were involved for more than 2 years. Most children (53%) were seen for just a few visits within a few months. Two patterns represented cases with two or more episodes of care spanning multiple years. In the two remaining patterns, children tended to have just one episode of care, but the number of sessions and length of involvement varied. Using discriminant function analyses, we were able to predict with just over 50% accuracy children's pattern of service use. Severe externalizing behaviors, high impairment, and high family burden predicted service use patterns with long durations of involvement and frequent visits.

CONCLUSIONS

Optimal treatment approaches for children seen for repeated episodes of care or for care lasting multiple years need to be developed. Children with the highest level of need (severe pathology, impairment, and burden) are probably best served by providing high intensity services at the start of care.

Disruptive Behavior Treatment Progress as a Function of Therapy Focus and Youth Diagnosis in a Community Mental Health Setting

Monthly disruptive behavior treatment progress for 613 youth ages 7-18 receiving intensive in-home services was examined. Multilevel modeling indicated carrying a depressive mood diagnosis predicted less disruptive behavior progress compared to youth with only externalizing diagnoses. Paradoxically, more monthly focus on disruptive behavior treatment targets predicted lower concurrent progress ratings, while greater focus on depressive mood targets predicted greater disruptive behavior progress for youth with a depressive mood diagnosis. Findings held when other predictors of disruptive behavior progress were included as covariates, including episode length, youth age, and functional impairment. Treatment and research implications are discussed.

Predicting Youth Improvement in Community-Based Residential Settings with Practices Derived from the Evidence-Base

The current investigation conducted descriptive analyses on key variables in community-based residential (CBR) settings and investigated the extent to which disruptive youth between the ages of 13 and 17 years improved based on therapists' reported alignment with using practices derived from the evidence-base (PDEBs). Results from both the descriptive analyses and multilevel modeling suggested that therapists are using practices that both do and do not align with the evidence-base for disruptive youth. In addition, both PDEBs and practices with minimal evidence-support predicted or marginally predicted final average progress rating for these youth. Findings are discussed as they relate to the importance of continued exploration of treatment outcomes for CBR youth.

Patterns of Child Mental Health Service Delivery in a Public System: Rural Children and the Role of Rural Residence

This study uses existing data from Hawaii's public mental health system for children and youth as an example of a state-level examination of service use patterns and health care disparities. The purpose of this study was to compare differences in mental health service utilization between rural and non-rural children, especially use of residential services. This study used a performance measure approach to conduct multi-level modeling on existing administrative data to examine the impact of community factors on service utilization. Rural children were found to have the most serious levels of mental health problems at intake, more likely to be placed in out-of-home care, more likely to receive only out-of-home care, more likely to in stay out-of-home longer, and less likely to receive follow-up care than their non-rural counterparts. Practice, policy, and research implications are discussed.

Factor Analysis of Therapist-Identified Treatment Targets in Community-Based Children's Mental Health

The present study used exploratory and confirmatory factor analyses to identify underlying latent factors affecting variation in community therapists' endorsement of treatment targets. As part of a statewide practice management program, therapist completed monthly reports of treatment targets (up to 10 per month) for a sample of youth (n = 790) receiving intensive in-home therapy. Nearly 75 % of youth were diagnosed with multiple co-occurring disorders. Five factors emerged: Disinhibition, Societal Rules Evasion, Social Engagement Deficits, Emotional Distress, and Management of Biodevelopmental Outcomes. Using logistic regression, primary diagnosis predicted therapist selection of Disinhibition and Emotional Distress targets. Client age predicted endorsement of Societal Rules Evasion targets. Practice-to-research implications are discussed.

A systematic review of mental health outcome measures for young people aged 12 to 25 years

BACKGROUND

Mental health outcome measures are used to monitor the quality and effectiveness of mental health services. There is also a growing expectation for implementation of routine measurement and measures being used by clinicians as a feedback monitoring system to improve client outcomes. The recent focus in Australia and elsewhere targeting mental health services to young people aged 12-25 years has meant that outcome measures relevant to this age range are now needed. This is a shift from the traditional divide of child and adolescent services versus adult services with a transitioning age at 18 years. This systematic review is the first to examine mental health outcome measures that are appropriate for the 12 to 25 year age range.

METHODS

MEDLINE and PsychINFO databases were systematically searched to identify studies using mental health outcome measures with young people aged 12 to 25 years. The search strategy complied with the relevant sections of the PRISMA statement.

RESULTS

A total of 184 published articles were identified, covering 29 different outcome measures. The measures were organised into domains that consisted of eight measures of cognition and emotion, nine functioning measures, six quality of life measures, and six multidimensional mental health measures. No measures were designed specifically for young people aged 12 to 25 years and only two had been used by clinicians as a feedback monitoring system. Five measures had been used across the whole 12 to 25 year age range, in a range of mental health settings and were deemed most appropriate for this age group.

CONCLUSIONS

With changes to mental health service systems that increasingly focus on early intervention in adolescence and young adulthood, there is a need for outcome measures designed specifically for those aged 12 to 25 years. In particular, multidimensional measures that are clinically meaningful need to be developed to ensure quality and effectiveness in youth mental health. Additionally, outcome measures can be clinically useful when designed to be used within routine feedback monitoring systems.

Community-based treatment for youth with co- and multimorbid disruptive behavior disorders

Little is known about the types of psychotherapeutic practices delivered to youth with comorbid and multimorbid diagnoses in community settings. The present study, based on therapists' self-reported practices with 569 youth diagnosed with a disruptive behavior disorder (ODD or CD), examined whether specific therapeutic practice applications varied as a function of the number and type of comorbid disorders. While type of comorbid disorder (AD/HD or internalizing) did not predict therapists' practices, youth with more than two diagnoses (multimorbid) received treatment characterized by a more diverse set and a higher dosage of practices.

Searching for elements of evidence-based practices in children's usual care and examining their impact

Most of the knowledge generated to bridge the research-practice gap has been derived from experimental studies implementing specific treatment models. Alternatively, this study uses observational methods to generate knowledge about community-based treatment processes and outcomes. Aims are to (a) describe outcome trajectories for children with disruptive behavior problems (DBPs), and (b) test how observed delivery of a benchmark set of practice elements common in evidence-based treatments may be associated with outcome change while accounting for potential confounding variables. Participants included 190 children ages 4 to 13 with DBPs and their caregivers, plus 85 psychotherapists, recruited from six clinics. All treatment sessions were videotaped and a random sample of 4 sessions in the first 4 months of treatment was reliably coded for intensity on 27 practice elements (benchmark set and others). Three outcomes (child symptom severity, parent discipline, and family functioning) were assessed by parent report at intake, 4, and 8 months. Data were collected on several potential covariates including child, parent, therapist, and service use characteristics. Multilevel modeling was used to assess relationships between observed practice and outcome slopes while accounting for covariates. Children and families demonstrated improvements in all 3 outcomes, but few significant associations between treatment processes and outcome change were identified. Families receiving greater intensity on the benchmark practice elements did demonstrate greater improvement in the parental discipline outcome. Observed changes in outcomes for families in community care were generally not strongly associated with the type or amount of treatment received.