Horses for courses? A qualitative exploration of goals formulated in mental health settings by young people, parents, and clinicians

Outcomes that Matter to Youth and Families in Behavioral Health Services

Patient-centered outcomes research helps youth and families using behavioral health services make informed decisions about treatments to help them achieve the outcomes most important to them. However, there are few efforts to identify the outcomes valued by youth and families systematically. This project aimed to support the development of behavioral health services that deliver outcomes valued by families by identifying the outcomes that youth and young adults with behavioral health needs and caregivers say matter most to them. We engaged 34 youth and young adults (YYA) with behavioral health needs, alongside 42 caregivers from six U.S. regions, in two rounds of one-hour virtual focus groups. The initial round involved participants identifying what they hoped to gain from using behavioral health services for personal, familial, and parental or child well-being and the attributes of positive service experiences. We coded responses using qualitative analytical software, culminating in synthesized reports. Subsequently, the second round entailed participants' review and refinement of initial findings. Across sessions, each group reported the top three outcomes deemed most important for children, YYA, parents, families, and their service experiences. YYA identified being understood by others, improving their interpersonal relationships, and feeling heard as the highest priority behavioral health service outcomes. Caregivers of children and youth with behavioral health needs identified having accessible services that meet their needs, having providers that collaborate effectively with parents and other service systems, and experiencing consistent and continuous behavioral health care for their child as the most important behavioral health service outcomes. Both YYA with behavioral health needs and caregivers of children and youth prioritized gaining the necessary knowledge, resources, and tools to support their or their child's behavioral health. Additionally, both participant groups emphasized the importance of effective communication with providers, within their families, and with peers. Minimizing judgment and stigma from society, providers, and other professionals also emerged as a critical outcome for these groups. It is essential for research and policy development to focus on and cater to the outcomes that are important and valued by YYA and their families to maximize family engagement in care.

Ethnic differences in treatment outcome for children and young people accessing mental health support

Children and Young People (CYP) from minoritized ethnic backgrounds experience structural inequalities in Children and Young People's Mental Health Settings (CYPMHS). This mixed methods study explores whether CYP's ethnicity is associated with their treatment outcomes (operationalised as 'measurable change') from CYPMHS. A multilevel multi-nominal regression analysis, controlling for age, gender, referral source, presenting difficulty, case closure reason, suggests that CYP from Asian backgrounds (OR = 0.82, CI [0.70, 0.96]) and Mixed-race (odds ratio (OR) = 0.80; 95% CI [0.69, 0.92]) are less likely to report measurable improvement in mental health difficulties compared to White British CYP. Three themes from a thematic analysis of semi-structured interviews with 15 CYP from minoritized ethnic backgrounds focused on views and experiences of ending mental health support are also presented. CYP view personalised support and the right therapist as conducive to good endings and valued a range of outcomes pertaining to empowerment. Experiences of stigma and inequalities may begin to explain the less positive outcomes experienced by Asian and Mixed-race CYP found in the regression analysis. The implications of these findings and future areas of research are suggested.

Behavioral Health Services Outcomes That Matter Most to Caregivers of Children, Youth, and Young Adults with Mental Health Needs

This project documents the service outcomes that caregivers value most. A diverse group of caregivers, representing six regions of the United States, participated in two rounds of virtual one-hour focus groups. In round 1, participants identified what they hoped to gain from using behavioral health services for themselves, their families, and their child and discussed what made services a positive experience for them. They then reported their top-three most-hoped-for outcomes. In round 2, groups validated and refined summary findings from round 1. Caregivers prioritized service quality outcomes, primarily. They expressed a desire for an accessible, respectful, and supportive treatment environment, underpinned by well-trained and culturally responsive professionals. Caregivers also desire seamless cross-sector provider collaboration and care transitions, which integrate the insights and preferences of families and children themselves to craft a customized care plan. Priority outcomes not related to service quality included hoping to gain increased knowledge, resources, and tools and techniques to support the mental health needs of their children, to see their children improve their daily functioning and for their child develop more effective interpersonal communication skills. Caregivers also reported hoping to experience less stigma related to the mental health needs of their children and to achieve personal fulfillment for themselves and their children. Research, policies, and mental health services should prioritize and be designed to address the outcomes that matter to youth and families.

Notes from the youth mental health field: Using movement towards goals as a potential indicator of service change and quality improvement

The aim of this paper is to report our notes from the field on using movement toward goals at an aggregate level as an inference of service effectiveness. Analysis of routinely collected data from UK youth mental health services was conducted (N = 8,172, age M = 13.8, 67% female, 32% male) to explore the impact of including goal-based outcome data in combined calculations of standardized measures based on the principles of reliable change ("measurable change"). Due to the broad nature of standardized measures, inferred validity becomes diluted in any team or service level aggregate analysis. To make inferences that are closer to the person's interpretation of their difficulties, we argue that Idiographic Patient Reported Outcome Measures (I-PROMs) counterbalance these limitations. This is supported by our findings. The measurable change metric is the first step towards enabling national analysis of aggregated I-PROMs. I-PROMs, supplemented by standardized measures should be used to consider service evaluation.

Idiographic patient reported outcome measures (I-PROMs) for routine outcome monitoring in psychological therapies: Position paper

Idiographic patient-reported outcome measures (I-PROMs) are a growing set of individualized tools for use in routine outcome monitoring (ROM) in psychological therapies. This paper presents a position statement on their conceptualization, use, and analysis, based on contemporary evidence and clinical practice. Four problem-based, and seven goal-based, I-PROMs, with some evidence of psychometric evaluation and use in psychotherapy, were identified. I-PROMs may be particularly valuable to the evaluation of psychological therapies because of their clinical utility and their alignment with a patient-centered approach. However, there are several challenges for I-PROMs: how to generate items in a robust manner, their measurement model, methods for establishing their reliability and validity, and the meaning of an aggregated I-PROM score. Based on the current state of the literature, we recommend that I-PROMs are used to complement nomothetic measures. Research recommendations are also made regarding the most appropriate methods for analyzing I-PROM data.

What treatment outcomes matter most? A Q-study of outcome priority profiles among youth with lived experience of depression

Interest in youth perspectives on what constitutes an important outcome in the treatment of depression has been growing, but limited attention has been given to heterogeneity in outcome priorities, and minority viewpoints. These are important to consider for person-centred outcome tracking in clinical practice, or when conducting clinical trials targeting specific populations. This study used Q-methodology to identify outcome priority profiles among youth with lived experience of service use for depression. A purposive sample of 28 youth (aged 16-21 years) rank-ordered 35 outcome statements by importance and completed brief semi-structured interviews eliciting their sorting rationales. By-person principal component analysis was used to identify outcome priority profiles based on all Q-sort configurations. Priority profiles were described and interpreted with reference to the qualitative interview data. Four distinct outcome priority profiles were identified: "Relieving distress and experiencing a happier emotional state"; "Learning to cope with cyclical distressing emotional states"; "Understanding and processing distressing emotional states"; and "Reduced interference of ongoing distressing emotional states with daily life". All four profiles prioritised improvements in mood and the ability to feel pleasure but differed in the level of importance assigned to learning coping skills, processing experiences, and the reduced interference of depression with life and identity. As part of a person-centered approach to care delivery, care providers should routinely engage young people in conversation and shared decision-making about the types of change they would like to prioritise and track during treatment, beyond a common core of consensus outcomes.

Measuring goal progress using the goal-based outcome measure in Jigsaw - A primary care youth mental health service

BACKGROUND

Jigsaw is a primary care youth mental health service designed to increase access to and utilisation of mental health supports for 12- to 25-year-olds. Effectiveness in community youth mental health services is typically assessed using standardised instruments. The aim of this study was to examine the effectiveness of Jigsaw's brief intervention model of support using an idiographic tool, the goal-based outcome (GBO) measure. The study also aimed to explore the type of goals set by young people engaging with this service.

METHOD

The study sample consisted of a secondary dataset of 4839 young people aged 12-25 years (63.5% female, 36.5% male) who engaged with one of Jigsaw's 13 brief intervention services. Overall, 7366 goals set using the GBO were examined. Inductive thematic analysis was conducted to examine the type of goals set by young people, and inferential analyses were used to examine statistical and reliable changes in goal progress.

RESULTS

The goals young people set focused on developing coping mechanisms and personal growth and managing interpersonal difficulties. Mean scores for progress towards goals improved significantly from pre- to postintervention. The reliable change index (RCI) indicated that change greater than 2.82 points represents reliable change on the GBO, with 78.6% of young people showing reliable improvement. Demographic characteristics did not impact goal progress.

CONCLUSION

These findings suggest Jigsaw's brief intervention model of support is effective in assisting young people reach their goals and that the GBO is a suitable measure for young people attending a community-based youth mental health service.

A comprehensive mapping of outcomes following psychotherapy for adolescent depression: The perspectives of young people, their parents and therapists

As mental health systems move towards person-centred care, outcome measurement in clinical research and practice should track changes that matter to young people and their families. This study mapped the types of change described by three key stakeholder groups following psychotherapy for depression, and compared the salience of these outcomes with the frequency of their measurement in recent quantitative treatment effectiveness studies for adolescent depression.Using qualitative content analysis, this study identified and categorized outcomes across 102 semi-structured interviews that were conducted with depressed adolescents, their parents, and therapists, as part of a randomized superiority trial. Adolescents had been allocated to Cognitive-Behavioral Therapy, Short-Term Psychoanalytic Psychotherapy, or a Brief Psychosocial Intervention.The study mapped seven high-level outcome domains and 29 outcome categories. On average, participants discussed change in four domains and six outcome categories. The most frequently discussed outcome was an improvement in mood and affect (i.e., core depressive symptoms), but close to half of the participants also described changes in family functioning, coping and resilience, academic functioning, or social functioning. Coping had specific importance for adolescents, while parents and therapists showed particular interest in academic functioning. There was some variation in the outcomes discussed beyond these core themes, across stakeholder groups and treatment arms.Of the outcomes that were frequently discussed in stakeholder narratives, only symptomatic change has been commonly reported in recent treatment studies for adolescent depression. A shift towards considering multiple outcome domains and perspectives is needed to reflect stakeholder priorities and enable more nuanced insights into change processes.

The development of a parent–child activity based on the principles of perceptual control theory

Problems most frequently reported by young people in school counselling relate to family difficulties. During adolescence, conflict between parents and young people increases as young people move towards independence whilst still being reliant on parents. The quality of communication during this period has implications for young people’s well-being. The current study explored how the principles of perceptual control theory (PCT) could be used to develop a structured activity aimed at helping young people to talk to their parents about their goals and goal conflicts.

PCT proposes that individuals function well when they are able to control things that are important to them. Every individual has numerous goals/wants and if two or more are incompatible, conflict arises. The current study focused on supporting young people to explore conflict that might arise due to incompatible goals held by them and their parent. Six families (child and parent/carer) were recruited to try a goal-setting and monitoring activity. The activity was facilitated by a Method of Levels researcher over a 10-week period. There were two follow-up appointments at 2 and 4 months. Two families were retained for the entire study. On completion, four families provided qualitative feedback. On the basis of participants’ feedback, the activity was modified to incorporate discussions on incompatible goals. Two families piloted the modified activity and provided feedback. Both families completed the study. Results suggest that a parent–child activity using the principles of PCT is feasible and acceptable among parents and young people.

Key learning aims

(1)

Measuring psychological outcomes in paediatric settings: Making outcomes meaningful using client-defined perspectives

There is a growing drive to develop and implement patient-reported outcome measures within paediatric health services, particularly for young people living with chronic health conditions; however, there is little consensus on how best to do this in meaningful ways within psychological services working alongside medical teams. This reflective commentary considers some of the challenges of collecting psychological outcome measures in paediatric services and considers alternative approaches to making outcome measurement meaningful. All measures have their limitations; however, they become meaningless if they are not used in meaningful and considered ways with young people. Client-defined outcome measurement, such as goal-based outcome measures, alongside other types of measurement, can capture outcomes of meaning to young people living with chronic health conditions, and can enable them to feed into a shared decision-making process.

Goal setting improves retention in youth mental health: a cross-sectional analysis

BACKGROUND

This study explored if a youth-specific mental health service routinely set goals with young people during initial intake/assessment and if goal setting and goal quality in this service was associated with patient retention.

METHODS

Consecutive initial assessments (n = 283) and administrative service data from two youth-specific health services in Australia were audited for evidence of goal setting, content and quality of the goal and number of therapy services provided after the intake/assessment process. Logistic regression was used to determine if goal setting was associated with disengagement after the assessment session, controlling for drug use, unemployment, age, gender, mental health diagnosis and service site. A consecutive sub-sample of 166 goals (74 participants), was analysed for goal quality. Each goal was assessed against three components of the SMART (specific, measurable, acceptable/achievable, realistic and timed goals) criteria; specific, measurable and timed; and assigned a goal quality score 1-3. A multiple regression explored whether goal quality was predictive of the number of sessions attended, controlling for the same variables as the logistic regression.

RESULTS

Goal setting was evident in the records of 187 participants (66%). Although most goals were for emotional management, 24% addressed improvements in function. Of the 166 goals analysed in depth, 95 were specific, 23 measurable, but none were timed. Not setting goals during initial assessments correlated with service disengagement (OR 0.30, p > 0.001). Goal setting was positively associated with more therapy sessions attended, regardless of goal quality rating.

CONCLUSIONS

Engagement and retention of young people within mental health services can be challenging. Clinical tools such as goal setting may keep young people engaged in services longer, potentially improving clinical outcomes. Further research exploring the effectiveness of current youth service models on client-specific goal based outcomes is recommended.

Goal formulation and tracking in child mental health settings: when is it more likely and is it associated with satisfaction with care?

Goal formulation and tracking may support preference-based care. Little is known about the likelihood of goal formulation and tracking and associations with care satisfaction. Logistic and Poisson stepwise regressions were performed on clinical data for N = 3757 children from 32 services in the UK (M age = 11; SDage = 3.75; most common clinician-reported presenting problem was emotional problems = 55.6%). Regarding the likelihood of goal formulation, it was more likely for pre-schoolers, those with learning difficulties or those with both hyperactivity disorder and conduct disorder. Regarding the association between goal formulation and tracking and satisfaction with care, parents of children with goals information were more likely to report complete satisfaction by scoring at the maximum of the scale. Findings of the present research suggest that goal formulation and tracking may be an important part of patient satisfaction with care. Clinicians should be encouraged to consider goal formulation and tracking when it is clinically meaningful as a means of promoting collaborative practice.

Measuring what matters to patients: Using goal content to inform measure choice and development

INTRODUCTION

Personalised care requires personalised outcomes and ways of feeding back clinically useful information to clinicians and practitioners, but it is not clear how to best personalise outcome measurement and feedback using existing standardised outcome measures.

METHOD

The constant comparison method of grounded theory was used to compare goal themes derived from goals set at the outset of therapy for 180 children aged between 4 and 17 years, visiting eight child and adolescent mental health services, to existing standardised outcome measures used as part of common national datasets.

RESULTS

In all, 20 out of 27 goal themes corresponded to items on at least one commonly used outcome measure.

DISCUSSION

Consideration of goal themes helped to identify potential relevant outcome measures. However, there were several goal themes that were not captured by items on standardised outcome measures. These seemed to be related to existential factors such as understanding, thinking about oneself and future planning.

CONCLUSION

This presents a powerful framework for how clinicians can use goals to help select a standardised outcome measure (where this is helpful) in addition to the use of a goal-based outcome measure and personalise choices. There may be areas not captured by standardised outcome measures that may be important for children and young people and which may only be currently captured in goal measurement. There is an indication that we may not be measuring what is important to children and young people. We may need to develop or look for new measures that capture these areas.

Exploring the relationship between quality of life and mental health problems in children: implications for measurement and practice

Quality of life is typically reduced in children with mental health problems. Understanding the relationship between quality of life and mental health problems and the factors that moderate this association is a pressing priority. This was a cross-sectional study involving 45,398 children aged 8-13 years from 880 schools in England. Self-reported quality of life was assessed using nine items from the KIDSCREEN-10 and mental health was assessed using the Me and My School Questionnaire. Demographic information (gender, age, ethnicity, socio-economic status) was also recorded. Quality of life was highest in children with no problems and lowest in children with both internalising and externalising problems. There was indication that quality of life may be reduced in children with internalising problems compared with externalising problems. Approximately 12 % children with mental health problems reported high quality of life. The link between mental health and quality of life was moderated by gender and age but not by socio-economic status or ethnicity. This study supports previous work showing mental health and quality of life are related but not synonymous. The findings have implications for measuring quality of life in child mental health settings and the need for approaches to support children with mental health problems that are at particular risk of poor quality of life.