Slipping Through the Cracks: Clinicians' Perspectives on the Gaps in New York City's Public Mental Health System

Most people who seek mental health treatment cannot access it. Certain groups (e.g., Medicaid enrollees and the uninsured) face particularly severe treatment access barriers along the care continuum. We interviewed 31 clinicians across two studies about their perspectives working in New York City's public mental health system. Because every clinician across both studies reported gaps in the system, we deployed an emergent, "serendipitous finding" approach and qualitatively analyzed the interviews together. Clinicians described three public mental health system gaps. First, many treatment-seekers must wait long periods of time to receive care and some never receive it at all. Second, patients with more serious challenges cannot access longer-term, higher-intensity, or specialized treatment. Third, some patients receiving high-intensity services may benefit from lower-intensity mental health support that is better integrated with medical and social service support. Coordinated and sustained financial investments at every step of the mental healthcare continuum are needed.

State Mental Health Authority Level of Involvement in Coordinated Specialty Care Clinics and Client Outcomes

OBJECTIVE

State mental health authorities (SMHAs) in all U.S. states and territories administer the Mental Health Block Grant (MHBG) set-aside funding for first-episode psychosis. Funds support implementation of coordinated specialty care (CSC) programs. The authors investigated the relationship between the level of SMHA involvement with CSC programs and clinical outcomes of clients in these programs.

METHODS

As part of a mixed-methods study of 34 CSC programs, SMHAs from 21 states and one U.S. territory associated with the 34 CSC programs participated in a 1-hour interview (between November 2018 and May 2019) focused on SMHA involvement in administration of MHBG set-aside funds and the SMHA's ongoing relationship with funded CSC programs. SMHA involvement was rated on a scale of 1 to 5, with 5 indicating the highest involvement. Client outcome data were collected at the 34 study sites over an 18-month period. Multilevel random-effect modeling was used, controlling for response propensity (propensity score), client demographic variables, and program-level covariates (i.e., fidelity score, staff turnover rates, service area urbanicity, and number of clients enrolled).

RESULTS

Clients in CSC programs with SMHAs that were the most involved (level 5) had significantly improved symptoms, social functioning, and role functioning, compared with clients in programs with which SMHAs were least involved (level 1).

CONCLUSIONS

The findings suggest that increased SMHA involvement in CSC programs is relevant for positive client outcomes. Levels of first-episode psychosis funding doubled in 2021 and 2022, and it is important to identify how SMHAs affect the success of CSC programs and the individuals served.

Improving Mental Health Services: A 50-Year Journey from Randomized Experiments to Artificial Intelligence and Precision Mental Health

This conceptual paper describes the current state of mental health services, identifies critical problems, and suggests how to solve them. I focus on the potential contributions of artificial intelligence and precision mental health to improving mental health services. Toward that end, I draw upon my own research, which has changed over the last half century, to highlight the need to transform the way we conduct mental health services research. I identify exemplars from the emerging literature on artificial intelligence and precision approaches to treatment in which there is an attempt to personalize or fit the treatment to the client in order to produce more effective interventions.

Traveling Without a Map: An Incomplete History of the Road to Implementation Science and Where We May Go from Here

This editorial provides a brief history of mental health services research over the last 30 years and how findings from large-scale studies shocked the field and led to the lines of inquiry culminating in current implementation science research. I review the manuscripts published in this special issue of Administration and Policy in Mental Health in light of that history and usethese studies as a way to assess the state of the field. Finally, I present five takeaways extracted from these articles that may be useful in considering future directions for implementation research.

The Children's Attention-Deficit Hyperactivity Disorder Telemental Health Treatment Study: Caregiver Outcomes

The Children's Attention-deficit Hyperactivity Disorder (ADHD) Telemental Health Treatment Study (CATTS) tested the hypotheses that children and caregivers who received guideline-based treatment delivered through a hybrid telehealth service delivery model would experience greater improvements in outcomes than children and caregivers receiving treatment via a comparison delivery model. Here, we present caregiver outcomes. 88 primary care providers (PCPs) in seven geographically underserved communities referred 223 children (ages 5.5 - 12.9 years) to the randomized controlled trial. Over 22 weeks, children randomized to the CATTS service delivery model received six sessions of telepsychiatry and six sessions of caregiver behavior management training provided in person by community therapists who were trained and supervised remotely. Children randomized to the comparison Augmented Primary Care (APC) service model received management in primary care augmented by a single telepsychiatry consultation. Caregiver outcomes included changes in distress, as measured by the Patient Health Questionnaire (PHQ-9), Parenting Stress Index (PSI), Caregiver Strain Questionnaire (CSQ) and Family Empowerment Scale (FES). Caregivers completed five assessments. Multilevel mixed effects regression modeling tested for differences between the two service delivery models in caregiver outcomes from baseline to 25 weeks. Compared to caregivers of children in the APC model, caregivers of children in the CATTS service model showed statistically significantly greater improvements on the PHQ-9 (β = -1.41, 95 % CI = [-2.74, -0.08], p < .05), PSI (β = -4.59, 95 % CI = [-7.87, - 1.31], p < .001), CSQ (β = -5.41, 95 % CI = [- 8.58, -2.24], p < .001) and FES (β = 6.69, 95 % CI = [2.32, 11.06], p < .01). Improvement in child ADHD symptoms mediated improved caregiver scores on the PSI and CSQ. Improvement in child ODD behaviors mediated caregiver CSQ scores. The CATTS trial supports the effectiveness of a hybrid telehealth service delivery model for reducing distress in caregivers of children with ADHD and suggests a mechanism through which the service model affected caregiver distress.

Measuring Use of Research Evidence: The Structured Interview for Evidence Use

OBJECTIVES

This article describes the Standard Interview for Evidence Use (SIEU), a measure to assess the level of engagement in acquiring, evaluating, and applying research evidence in health and social service settings.

METHOD

Three scales measuring input, process, and output of research evidence and eight subscales were identified using principal axis factor analysis and parallel analysis of data collected from 202 state and county child welfare, mental health, and juvenile justice systems leaders.

RESULTS

The SIEU scales and subscales demonstrate strong internal consistency as well as convergent and discriminant validity.

CONCLUSIONS

The SIEU is easy to use and can be administered as a complete scale or as three smaller scales to separately examine evidence in acquisition, evaluation, or application. The measure demonstrates potential in understanding the role of research evidence in service settings and in monitoring the process of evidence-based practice and application of scientific principles in social work practice.

Future Directions for the Implementation and Dissemination of Statewide Developmental-Behavioral Pediatric Integrated Health Care

The integration of mental health and pediatric health care services has long been a goal for both research and practice. With the advent of federal policies developed to mandate clinical efficiency across the health care spectrum, this issue is becoming more salient. Applied literature on this topic is only recently emerging, however, and there are limited contextual examples to guide program development, research, and refinement. This article presents background information relevant to the development of such a program (the Center for Advancement of Youth). The cultural and organizational contexts for the project are discussed, with particular emphasis on models for cooperation among several institutions of varying size and scope. The implications for the future of tangible research in this area are also discussed, with attention to extending lessons learned to diverse settings motivated to integrate various aspects of health care service provision.

Situated Motives of Lay Participants in Community Collaboratives for Children's Mental Health

Publicly funded programs in many industrialized countries increasingly require the participation of citizens. In this article, I explore the "situated motives" of family members who participated alongside professionals in implementing children's mental health programs in two communities in the United States. I conducted in-depth interviews with family members and observed monthly meetings of Community Collaboratives to assess how family members understood their participation. The inductive data analysis demonstrates that family members participated (a) as a therapeutic outlet, (b) to pay it forward, (c) to gain new skills, (d) to have a voice, and/or (e) to empower the community. I then use Giddens' concepts of "life politics" and "emancipatory politics" to explore how these accounts variously reflected lay members' orientations as consumers, empowered individuals, and/or citizen advocates. In the absence of articulated and specific objectives for family participation, these "situated motives" were salient and had implications for how policy was implemented.

Assessment Practices of Child Clinicians

Assessment is an integral component of treatment. However, prior surveys indicate clinicians may not use standardized assessment strategies. We surveyed 1,510 clinicians and used multivariate analysis of variance to explore group differences in specific measure use. Clinicians used unstandardized measures more frequently than standardized measures, although psychologists used standardized measures more frequently than nonpsychologists. We also used latent profile analysis to classify clinicians based on their overall approach to assessment and examined associations between clinician-level variables and assessment class or profile membership. A four-profile model best fit the data. The largest profile consisted of clinicians who primarily used unstandardized assessments (76.7%), followed by broad-spectrum assessors who regularly use both standardized and unstandardized assessment (11.9%), and two smaller profiles of minimal (6.0%) and selective assessors (5.5%). Compared with broad-spectrum assessors, unstandardized and minimal assessors were less likely to report having adequate standardized measures training. Implications for clinical practice and training are discussed.

Children and Young People's Improving Access to Psychological Therapies: inspiring innovation or more of the same?

In 2007 the UK Government announced a substantial expansion of funding for psychological therapies for those presenting with common mental health problems. This 'Improving Access to Psychological Therapies' (IAPT) project was widely welcomed, however, evidence backed, economic, and conceptual critiques were voiced from the start and the project remains controversial. In 2011, the UK government announced it was extending the IAPT project to encompass services for children and young people with the aim of 'transforming' the way mental health services are delivered to them. Here I critically reflect on the problems associated first with IAPT and then with CYP-IAPT and ponder whether CYP-IAPT is significantly different to the problematic adult IAPT project or more of the same.

Doing more with what we know: introduction to the special issue

This article introduces a special issue that provides an overarching conceptual model for advancing the impact of science on service delivery and includes some illustrations of these concepts in action from a variety of research teams in a diversity of contexts. Themes of the special issue include balancing considerations of efficacy, effectiveness, and extensiveness--for example, ensuring that treatments are not only reliable but also robust and widely relevant. It is argued that such a balance might be achieved through an increased focus on improving coordination of system resources (e.g., clients, providers, treatments, training programs) and through dynamic and developmental designs. The special issue is intended to raise the broader question of whether our current paradigms are satisfactory in moving us toward our shared vision, or whether we could do more with what we already know.

Family voice with informed choice: coordinating wraparound with research-based treatment for children and adolescents

The wraparound process is a type of individualized, team-based care coordination that has become central to many state and system efforts to reform children's mental health service delivery for youths with the most complex needs and their families. Although the emerging wraparound research base is generally positive regarding placements and costs, effect sizes are smaller for clinical and functional outcomes. This article presents a review of literature on care coordination and wraparound models, with a focus on theory and research that indicates the need to better connect wraparound-enrolled children and adolescents to evidence-based treatment (EBT). The article goes on to describe how recently developed applications of EBT that are based on quality improvement and flexible application of "common elements" of research-based care may provide a more individualized approach that better aligns with the philosophy and procedures of the wraparound process. Finally, this article presents preliminary studies that show the feasibility and potential effectiveness of coordinating wraparound with the Managing and Adapting Practice system, and discusses intervention development and research options that are currently under way.

Methodology for conducting the children's attention-deficit hyperactivity disorder telemental health treatment study in multiple underserved communities

BACKGROUND

Children living in nonmetropolitan communities are underserved by evidence-based mental health care and are underrepresented in clinical trials.

PURPOSE

In this article, we describe lessons learned in conducting the Children's Attention-Deficit Hyperactivity Disorder (ADHD) Telemental Health (TMH) Treatment Study (CATTS), a randomized controlled trial testing the effectiveness of TMH in improving outcomes of children with ADHD living in underserved communities.

METHODS

Children were referred by primary care providers (PCPs). The test intervention group received six telepsychiatry sessions with each session followed by an caregiver behavior training session delivered in-person by a local therapist. A secure website was used to support decision making by the telepsychiatrists and to facilitate real-time collaboration between the telepsychiatrists and community therapists. The control group received a single telepsychiatry consultation. Questionnaires tapping ADHD symptoms and other outcomes were administered to parents and teachers online through a secure portal from personal computers.

RESULTS

total of 88 PCPs in seven communities referred the 223 children who participated in the trial. Attrition in treatment sessions and research assessments was very low. Lessons learned TMH proved to be a viable means of providing evidence-based pharmacological services to children and training to local therapists. Recruitment was enhanced by offering the control group a telepsychiatry consultation. Site-specific strategies were needed to meet recruitment targets.

CONCLUSIONS

The CATTS trial used methods designed to optimize inclusion of children living in multiple dispersed and underserved areas. The study will serve as a model for other research projects aiming at reducing geographic disparities in access to quality mental health care.

Outcome Orientated Child and Adolescent Mental Health Services (OO-CAMHS): a whole service model

The international evidence base on factors that most influence outcomes in mental health care finds that matching therapeutic intervention to diagnosis has a clinically insignificant impact on outcomes. Decades of outcome research into treatment of psychiatric disorders shows that, despite the development of many new techniques, the outcomes being achieved in studies 30 years ago are similar to those being achieved now. In the last few years, new service models that incorporate systems of feedback on progress and alliance have emerged and show promise with regards improving overall outcomes for mental health service users. Growing familiarity with this outcome literature, together with a desire to be part of a service that can continue to improve patient outcomes, led a small community Child and Adolescent Mental Health Services team to develop a new whole service model - Outcome Orientated Child and Adolescent Mental Health Services (OO-CAMHS). OO-CAMHS incorporates key aspects of the evidence base on what could make a differential positive impact on outcomes and relinquishes those aspects that do not. In this paper, we outline the evidence base on which OO-CAMHS is built, describe the key features of the approach and present some of the early findings on its impact.

Children First

Although the importance of healthy mental development in children and youth is not disputed, the mental health needs of far too many Canadian children are being ignored. Within the context of recent federal and provincial calls for systemic reform of the mental health care systems for children and youth, we underscore the necessity for ongoing innovation, development, education, and evaluation. This article describes our aims to establish demonstration and research sites focused on promising frameworks that draw from systems of care, public health, and resiliency approaches.

12-month follow-up outcomes for youth departing and integrated residential continuum of care

This study examined the 12-month post-departure outcomes for youth who exited a residential treatment program at differing levels of restrictiveness. Study participants were 120 youth who entered an integrated residential continuum of care at its most restrictive level and then either departed the program at the same level or stepped down and departed at a lower level of restrictiveness. Results indicate that youth who stepped down and exited at the lowest level of restrictiveness were the most likely to be living at home or in a homelike setting and experienced fewer formal post-departure out-of-home placements. However, there were no differences in post-departure rates of substance use, arrests, or being in school or having graduated. These results suggest that youth who were served in the integrated continuum and departed at the lowest level of restrictiveness had more positive outcomes at 12-month post-discharge.

A meta-analysis of experimental studies of diversion programs for juvenile offenders

OBJECTIVE

Research to establish an evidence-base for the treatment of conduct problems and delinquency in adolescence is well established; however, an evidence-base for interventions with offenders who are diverted from the juvenile justice system has yet to be synthesized. The purpose of this study was to conduct a meta-analysis of experimental studies testing juvenile diversion programs and to examine the moderating effect of program type and implementation quality.

METHOD

A literature search using PsycINFO, Web of Science, and the National Criminal Justice Reference Service data-bases and research institute websites yielded 28 eligible studies involving 57 experimental comparisons and 19,301 youths.

RESULTS

Recidivism was the most common outcome reported across all studies. Overall, the effect of diversion programs on recidivism was non-significant (k=45, OR=0.83, 95%CI=0.43-1.58). Of the five program types identified, including case management (k=18, OR=0.78), individual treatment (k=11, OR=0.83), family treatment (k=4, OR=0.57), youth court (k=6, OR=0.93), and restorative justice (k=6, OR=0.87), only family treatment led to a statistically significant reduction in recidivism. Restorative justice studies that were implemented with active involvement of researchers led to statistically significant reductions in recidivism (k=3, OR=0.69). Other outcomes, including frequency of offending, truancy, and psycho-social problems were reported infrequently and were not subjected to meta-analysis.

CONCLUSIONS

High levels of heterogeneity characterize diversion research. Results of this study recommend against implementation of programs limited to case management and highlight the promise of family interventions and restorative justice.

Therapist training in empirically supported treatments: a review of evaluation methods for short- and long-term outcomes

Therapist training efforts have been assessed using several outcomes. A model for evaluating therapist training in empirically supported treatments is presented, adapted from Kirkpatrick's (in: Craig and Bittel (eds.) Training and development handbook, 1967) training evaluation model. The adapted framework includes short-term outcomes, such as reactions to training and changes in attitude, knowledge, or skills, and longer-term outcomes, such as changes in therapist behavior in practice or client outcomes. Evaluation methods for these outcomes are reviewed, with information on their validity, reliability, and feasibility. An agenda for further research to improve therapist training evaluation is presented, with discussion of how evaluation can inform other areas of the field.

Change what? Identifying quality improvement targets by investigating usual mental health care

Efforts to improve community-based children’s mental health care should be based on valid information about effective practices and current routine practices. Emerging research on routine care practices and outcomes has identified discrepancies between evidence-based practices and “usual care.” These discrepancies highlight potentially potent quality improvement interventions. This article reviews existing research on routine or “usual care” practice, identifies strengths and weaknesses in routine psychotherapeutic care, as well as gaps in knowledge, and proposes quality improvement recommendations based on existing data to improve the effectiveness of children’s mental health care. The two broad recommendations for bridging the research-practice gap are to implement valid, feasible measurement feedback systems and clinician training in common elements of evidence-based practice.

Defining Service Coordination: A Social Work Perspective

To address fragmentation, social workers are encouraged to "coordinate." This pilot study explores the meaning of, and factors that facilitate or prevent "coordination" and is intended as a first step toward future conceptual refinement, theory development, and system interventions. Using data from treatment guidelines archived by the National Guideline Clearinghouse (n=9) and semi-structured interviews with social workers (n=4), themes related to the definition, indicators, and perceptions of coordination were explored using a grounded theory approach. Data suggest the need for coordination is driven by complex client needs, but the quality of providers' personal relationships influence coordination. Future research might examine the impact of standardization of roles, referral procedures, and treatment philosophies.

A national study of the impact of outpatient mental health services for children in long-term foster care

Despite the tremendous mental health need evidenced by children in foster care and high rates of use of mental health services among children in foster care, little is known about the impact of outpatient mental health services on the behavioral health of this population. This study utilizes data from the National Survey of Child and Adolescent Well-being (NSCAW), the first nationally representative study of child welfare in the United States. A subsample of 439 children who have experienced long-term foster care were included in this study. These data were used to estimate the impact of outpatient mental health services on the externalizing and internalizing behavior problems of children in long-term foster care. A propensity score matching model was employed to produce a robust estimate of the treatment effect. Results indicate that children who have experienced long-term foster care do not benefit from the receipt of outpatient mental health services. Study results are discussed in the context of earlier research on the quality of mental health services for children in foster care.

Patterns of movement for youth within an integrated continuum of residential services

This study examined patterns of movement for youth receiving services within a continuum of intensive and restrictive residentially-based programs. Data were collected for 701 completed episodes of care within a three-program residential continuum of care over a 5 year period, and examined time within program, movement between programs, in-program disruptive behavior, and discharge status. Results showed that most youth either remained in a stable placement in the least restrictive of the programs, or followed a pattern of placements that systematically moved them from more restrictive to less restrictive settings. Of note, transitions from more restrictive to less restrictive programs correspond to deescalating levels of problem behavior; and over 80% of the youth were stepped down to either family-based or independent living situations at the time of departure. Findings support the notion that a continuum of intensive residential services can serve the needs of youth with significant emotional and behavioral needs.

Old wine in new skins: the sensitivity of established findings to new methods

Findings from an evaluation of a model system for delivering mental health services to youth were reassessed to determine the robustness of key findings to the use of methodologies unavailable to the original analysts. These analyses address a key concern about earlier findings-that the quasi-experimental design involved the comparison of two noncomparable groups. The authors employed propensity score methodology to reconsider between-group baseline differences in observed characteristics of participating families. The authors also considered the possible effect of unobserved between-group differences. The data support previous studies that show few differences in outcomes, but the findings are sensitive to unobserved heterogeneity.

Coordination between child welfare agencies and mental health service providers, children's service use, and outcomes

OBJECTIVE

Interorganizational relationships (IORs) between child welfare agencies and mental health service providers may facilitate mental health treatment access for vulnerable children. This study investigates whether IORs are associated with greater use of mental health services and improvement in mental health status for children served by the child welfare system.

METHODS

This was a longitudinal analysis of data from a 36-month period in the National Survey of Child and Adolescent Well-Being (NSCAW). The sample consisted of 1,613 children within 75 child welfare agencies who were 2 years or older and had mental health problems at baseline. IOR intensity was measured as the number of coordination approaches between each child welfare agency and mental health service providers. Separate weighted multilevel logistic regression models tested associations between IORs and service use and outcomes, respectively.

RESULTS

Agency-level factors accounted for 9% of the variance in the probability of service use and 12% of mental health improvement. Greater intensity of IORs was associated with higher likelihood of both service use and mental health improvement.

CONCLUSIONS

Having greater numbers of ties with mental health providers may help child welfare agencies improve children's mental health service access and outcomes.

PRACTICE IMPLICATIONS

Policymakers should develop policies and initiatives to encourage a combination of different types of organizational ties between child welfare and mental health systems. For instance, information sharing at the agency level in addition to coordination at the case level may improve the coordination necessary to serve these vulnerable children.

Developing a new system to measure outcomes in a service coordination program for youth with severe emotional disturbance

This paper presents information on re-developing an outcome evaluation for a state-funded program providing service coordination utilizing wraparound to youth with severe emotional disturbance (SED) and their families. Originally funded by the Robert Wood Johnson Foundation, the Kentucky IMPACT program has existed statewide since 1990. Changing data needs and limitations of the original evaluation required revamping the program's data collection system. The new evaluation uses the extant knowledge base to improve: (1) design, (2) measures, and (3) utility. A pre-post design with multiple follow-ups provides the framework for data collection. An ecological framework provides a conceptual structure for selecting measures focusing on both the service recipients and their environment. Data collection via a personal digital assistant (PDA) ensures utility of the data for both consumers and researchers. Issues ranging from conceptualization to implementation of the project as well as lessons learned are discussed.

The role of state mental health authorities in managing change for the implementation of evidence-based practices

The evidence-based practice demonstration for services to adults with serious mental illness has ended its pilot stage. This paper presents the approaches states employed to combine traditional policy levers with more strategic/institutional efforts (e.g., leadership) to facilitate implementation of these practices. Two rounds of site visits were completed and extensive interview data collected. The data were analyzed to find trends that were consistent across states and across practices. Two themes emerged for understanding implementation of evidence-based practices: the support and influence of the state mental health authority matters and so does the structure of the mental health systems.

Development and psychometric assessment of the collaborative care for attention-deficit disorders scale

OBJECTIVE

To describe the development and assess the validity and reliability of the Collaborative Care for Attention-Deficit Disorders Scale (CCADDS), a measure of collaborative care processes for children with attention-deficit/hyperactivity disorder who attend primary care practices.

METHODS

Collaborative care was conceptualized as a multidimensional construct. The 41-item CCADDS was developed from an existing instrument, review of the literature, focus groups, and an expert panel. The CCADDS was field tested in a national mail survey of 600 stratified and randomly selected practicing general pediatricians. Psychometric analysis included assessments of factor structure, construct validity, and internal consistency.

RESULTS

The overall response rate was 51%. Most respondents were male (56%), 46 years old or older (59%), and white (69%). Common factor analysis identified 3 subscales: beliefs, collaborative activities, and connectedness. Internal consistency reliability (coefficient alpha) for the overall scale was .91, and subscale scores ranged from .80 to .89. The CCADDS correlated with a validated measure of provider psychosocial orientation (r = -.36, P < .001) and with self-reported frequency of mental health referrals or consultations (r = -.24 to -.42, P < .001). CCADDS scores were similar among physicians by race/ethnicity, gender, age group, and practice location.

CONCLUSIONS

Scores on the CCADDS were reliable for measuring collaborative care processes in this sample of primary care clinicians who provide treatment for children with attention-deficit/hyperactivity disorder. Evidence for validity of scores was limited. Future research is needed to confirm its psychometric properties and factor structure and provide guidance on score interpretation.

Are CAFAS subscales and item weights valid? A preliminary investigation of the Child and Adolescent Functional Assessment Scale

Presents a psychometric analysis of the Child and Adolescent Functional Assessment Scale (CAFAS), one of the most commonly used measures of functional impairment in youths with emotional and behavioral disorders. Specific aims of the current investigation were to (a) examine the conceptual organization of the CAFAS items, (b) explore its scaling properties, and (c) investigate its construct validity. In Phase 1, a group of advanced graduate students and clinicians rated CAFAS items with respect to the degree that they reflect the originally assigned subscales. In Phase 2, additional raters assigned severity values to the subset of CAFAS items selected from Phase 1. Items were then scaled using simplified successive intervals scaling techniques. Results show differences between new empirically derived item weights and the original scoring method. This investigation highlights the benefits of continued examination and critique of level-of-functioning scaling for diagnosis, treatment, and prognosis in children and adolescents.

Pediatrician Coordination of Care for Children with Mental Illnesses

BACKGROUND

Children with mental illnesses are seen across various service sectors, including pediatric primary care. As such, care coordination, which has been shown to improve outcomes, is especially important. Little is known about organizational and state level factors that might affect pediatricians' efforts to coordinate care for children with mental illnesses.

OBJECTIVES

This study used data from a survey of primary care pediatricians to examine organizational and state level variables associated with increased care coordination for children with mental illnesses.

METHODS

We undertook a cross-sectional study using data from a survey of pediatricians. A total of 1337 pediatricians in 6 states were surveyed about their care coordination and about organizational characteristics. State level data were gathered from various sources. A 5-item scale was developed for the dependent variable of past month coordination contacts (Cronbach's alpha = 0.82).

RESULTS

No state level variables were associated with pediatrician coordination behaviors. Having a regular case conferencing mechanism, staff assigned to coordinate care, and a mental health specialist in the practice were associated with increased past month coordination contacts. Pediatricians in rural practices coordinated care more frequently than those in other locations. Pediatricians who screened more and those with more experience had higher rates of care coordination.

CONCLUSIONS

Having a regular case conferencing mechanism, staff assigned to coordinate care, and a mental health specialist in the practice were associated with increased mental health care coordination. This information should be useful in planning ways to increase care coordination for children with mental illnesses seen in pediatric primary care.

On blowing trumpets to the tulips: to prove or not to prove the null hypothesis--comment on Bösch, Steinkamp, and Boller (2006)

The H. Bösch, F. Steinkamp, and E. Boller meta-analysis reaches mixed and cautious conclusions about the possibility of psychokinesis. The authors argue that, for both methodological and philosophical reasons, it is nearly impossible to draw any conclusions from this body of research. The authors do not agree that any significant effect at all, no matter how small, is fundamentally important (Bösch et al., 2006, p. 517), and they suggest that psychokinesis researchers focus either on producing larger effects or on specifying the conditions under which they would be willing to accept the null hypothesis.

The premature demise of public child and adolescent inpatient psychiatric beds : Part II: challenges and implications

Psychiatric disorders are the leading reason for hospitalization among 5-19 year olds. Current data, however, suggest there are fewer than necessary available services for children and adolescents requiring intensive, inpatient psychiatric care. Children and adolescents with behavioral health problems, the majority of whom do not receive appropriate treatment, have increased risk of school failure, family disruption, out-of-home placements, poor employment opportunities, and poverty in adulthood. This paper will examine the challenges inherent in serving children and adolescents with serious emotional disturbances, avenues of financing for treatment and services, and various loci of intervention for high-risk children, including inpatient settings and systems of care. The goals of this paper are to illustrate the complexities of working with children and adolescents most in need of intensive psychiatric services, to explore how inpatient services "fit" into existing treatment approaches, and to discuss the efficacy of downsizing or closing inpatient psychiatric units for this population.

Family-based services in children's mental health: a research review and synthesis

A systematic review was undertaken of scientifically rigorous studies of family-based services in children's health and mental health. From a pool of over 4000 articles since 1980 in health and mental health that examined either specific family-based interventions for families of children or the processes of involvement, 41 studies were identified that met the methodological criteria for inclusion. These 41 studies encompassed 3 distinct categories: families as recipients of interventions (e.g., family education, support, engagement, empowerment); (b) families as co-therapists; and (c) studies of the processes of involvement (e.g., therapeutic alliance, engagement, empowerment, expectancies, and choice). Too few experimental studies exist to conclude decisively that family-based services improve youth clinical outcomes. However, those studies that have been rigorously examined demonstrate unequivocal improvements in other types of outcomes, such as retention in services, knowledge about mental health issues, self-efficacy, and improved family interactions - all outcomes that are essential ingredients of quality care. Four implications are drawn from this review. (1) Effective family education and support interventions from studies of adults with mental illnesses and from studies of families of high-risk infants exist and can be imported into the field of children's mental health. (2) The range of outcomes that are typically assessed in clinical treatment studies is too narrow to afford an adequate view of the impact of family-based interventions. A broader view of outcomes is needed. (3) The absence of a robust literature on process variables other than therapeutic alliance limits conclusions about how and why interventions are effective. Attention to the processes by which families become involved in services will require a more robust and nuanced range of studies that attend simultaneously to processes of change and to outcome improvement. (4) Linkage of effective family-based interventions to delivery of evidence-based services is likely to amplify the impact of those services and improve outcomes for youth and families.

An evaluation of collaborative interventions to improve chronic illness care. Framework and study design

The author's dual-purpose evaluation assesses the effectiveness of formal collaboratives in stimulating organizational changes to improve chronic illness care (the chronic care model or CCM). Intervention and comparison sites are compared before and after introduction of the CCM. Multiple data sources are used to measure the degree of implementation, patient-level processes and outcomes, and organizational and team factors associated with success. Despite challenges in timely recruitment of sites and patients, data collection on 37 participating organizations, 22 control sites, and more than 4,000 patients with diabetes, congestive heart failure, asthma, or depression is nearing completion. When analyzed, these data will shed new light on the effectiveness of collaborative improvement methods and the CCM.

One-year follow-up of multisystemic therapy as an alternative to the hospitalization of youths in psychiatric crisis

OBJECTIVE

This study presents findings from a 1-year follow-up to a randomized clinical trial comparing multisystemic therapy (MST), modified for use with youths presenting psychiatric emergencies, with inpatient psychiatric hospitalization.

METHOD

One hundred fifty-six children and adolescents approved for emergency psychiatric hospitalization were randomly assigned to home-based MST or inpatient hospitalization followed by usual services. Assessments examining mental health symptoms, out-of-home placement, school attendance, and family relations were conducted at five times: within 24 hours of recruitment, shortly after the hospitalized youth was released from the hospital (1-2 weeks after recruitment), at the completion of MST (average of 4 months postrecruitment), and 10 and 16 months postrecruitment.

RESULTS

Based on placement and youth-report measures, MST was initially more effective than emergency hospitalization and usual services at decreasing youths' symptoms and out-of-home placements and increasing school attendance and family structure, but these differences generally dissipated by 12 to 16 months postrecruitment. Hospitalization produced a rapid, but short-lived, decrease in externalizing symptoms based on caregiver reports.

CONCLUSION

Findings suggest that youths with serious emotional disturbance might benefit from continuous access to a continuum of evidence-based practices titrated to clinical need.

Evaluation of a Mental Health Service for Young Children: Development, Outcome and Satisfaction

BACKGROUND

Over a 10-year period (1984-1996) a child guidance clinic developed a service in the community for parents with young children with mental health problems. This included support for primary care staff and training courses. The clinical input to the young children developed from a clinic within the child guidance clinic (1984-87), to a specialist clinic for under fives (1990-91) to a service run by a nurse in the community (1994-95), with nurses referring to colleagues only the more complicated cases.

METHOD

The work in 1990-91 was compared with the work in 1994-95. The family and clinic scored the outcome of the work, by recording the severity of the problem, separately, on unanchored 5-point Likert scales before and after treatment. For the evaluation in 1994-95 a satisfaction questionnaire was also developed. The cost of running the two different clinics was calculated.

RESULTS

The results indicated that there was a slight fall in the effect size for the clinical work in 1994-95, but this method of working was two-thirds of the cost of the previous clinic. The parents were satisfied with both services. The post-contact parental satisfaction questionnaire had face validity, construct validity and internal consistency.

CONCLUSIONS

Nurses working on their own in the community can be a cost effective method for working with families with young children. Some families will need to be referred on to specialist teams and more work needs to be done to establish which families and when referral is appropriate. The questionnaire was shown to be a valid and reliable way of assessing family satisfaction.

Depression in primary care: linking clinical and systems strategies

Depression is a serious, often chronic disease that can be managed effectively with a chronic care model in primary care settings. Depressed persons are likely to be seen by a primary care physician, but their condition often goes unrecognized and untreated. There are effective treatment models that consist of efficacious psychotherapeutic and pharmacological interventions, use of evidence-based guidelines for primary care treatment of depression, development of explicit plans and protocols, reorganization of practice, longitudinal follow-up, patient self-management, decision-making support, access to community resources and leadership commitment. Moving these models into everyday practice requires overcoming both clinical and system barriers. Barriers consist of issues surrounding patients, providers, practices, plans, and purchasers. An understanding of these barriers at each level helps to provide a framework for the changes required to overcome them. The Robert Wood Johnson Foundation National Program on Depression in Primary Care will seek to apply simultaneously both clinical and system strategies in a new five-year initiative to overcome these barriers.

Measuring mental health outcomes with pre-post designs

The pre-post design has been the workhorse of outcome evaluations for many years. Using data from a study of 984 treated children (ages 5 to 17 years), this article argues that there are two structural problems with the pre-post evaluation of outcome: (1) excessively large intervals of uncertainty for individual outcomes and (2) paradoxical inconsistencies in the evaluation of groups. These problems can be solved by designs with three or more repeated measures analyzed with longitudinal multilevel analytic models.

Looking for the disorder in conduct disorder

Besides their well-known externalizing behavior, children with conduct disorder (CD) often have additional impairments outside the criteria for the CD diagnosis. In a 5-year study of 984 treated children (ages 5-17 years), those with CD had an average of 2.2 primary diagnoses. Children with CD showed the worst problem and impairment scores in comparison with 11 common diagnoses. Compared with other treated children, children with CD achieved worse scores on 14 of 15 syndromes, including internalizing problems such as withdrawal and major depression. The average child with CD had larger relapse scores in the 1.5- to 3-year period after admission to treatment. This pattern, pervasive at intake and chronic in course, resembles a global disability more than a circumscribed problem managed with a narrow range of treatments specific to it.