Notes from the youth mental health field: Using movement towards goals as a potential indicator of service change and quality improvement

Goals Form: Reliability, validity, and clinical utility of an idiographic goal-focused measure for routine outcome monitoring in psychotherapy

OBJECTIVE

This study aimed to assess the reliability, validity, and clinical utility of an idiographic, goal-focused patient-reported outcome measure: The Goals Form.

METHODS

Data were analyzed from 88 participants, across three samples, who had participated in collaborative-integrative psychotherapy at university-based clinics in the UK. The samples were approximately 70% female with mean age of 30 years old.

RESULTS

The psychometric properties of the Goals Form were generally good. Noncompletion of individual items was low, temporal stability tended to be at target levels, and mean change scores showed moderate to good convergent validity against measures of psychological distress. The measure appeared sensitive to change in psychotherapy and was experienced by most patients as helpful.

CONCLUSIONS

The Goals Form shows acceptable psychometric and clinical properties for routine outcome monitoring in psychotherapy.

Examining concurrent validity and item selection of the Session Wants and Needs Outcome Measure (SWAN-OM) in a children and young people web-based therapy service

BACKGROUND

Single-session mental health interventions are frequently attended by children and young people (CYP) in both web-based and face-to-face therapy settings. The Session "Wants" and "Needs" Outcome Measure (SWAN-OM) is an instrument developed in a web-based therapy service to overcome the challenges of collecting outcomes and experiences of single-session therapies (SSTs). It provides pre-defined goals for the session, selected by the young person prior to the intervention, on which progress toward achievement is scored at the end of the session.

OBJECTIVE

The objective of this study was to evaluate the instrument's psychometric properties, including concurrent validity against three other frequently used outcome and experience measures, at a web-based and text-based mental health service.

METHODS

The SWAN-OM was administered for a period of 6 months to 1,401 CYP (aged 10-32 years; 79.3% white; 77.59% female) accessing SST on a web-based service. Item correlations with comparator measures and hierarchical logistic regressions to predict item selection were calculated for concurrent validity and psychometric exploration.

RESULTS

The most frequently selected items were "Feel better" (N = 431; 11.61%) and "Find ways I can help myself" (N = 411; 11.07%); unpopular items were "Feel safe in my relationships" (N = 53; 1.43%) and "Learn the steps to achieve something I want" (N = 58; 1.56%). The SWAN-OM was significantly correlated with the Experience of Service Questionnaire, particularly the item "Feel better" [rs₍₁₀₉₎ = 0.48, p < 0.001], the Youth Counseling Impact Scale, particularly the item "Learn the steps to achieve something I want" [rs₍₂₂₎ = 0.76, p < 0.001], and the Positive and Negative Affect Schedule, particularly the items "Learn how to feel better" [rs₍₂₂₎ = 0.72, p < 0.001] and "Explore how I feel" [rs₍₇₀₎ = -0.44, p < 0.001].

CONCLUSION

The SWAN-OM demonstrates good concurrent validity with common measures of outcome and experience. Analysis suggests that lesser-endorsed items may be removed in future iterations of the measure to improve functionality. Future research is required to explore SWAN-OM's potential to measure meaningful change in a range of therapeutic settings.

Monitoring and Measurement in Child and Adolescent Mental Health: It's about More than Just Symptoms

Routine outcome monitoring (ROM) provides information to practitioners and others providing healthcare support to demonstrate the impact of interventions and for service evaluation [...].

The Session Wants and Need Outcome Measure: The Development of a Brief Outcome Measure for Single-Sessions of Web-Based Support

Single-session, brief interventions in therapy for young people make up a large proportion of service provision, including in digital mental health settings. Current nomothetic mental health measures are not specifically designed to capture the benefit or ‘change’ directly related to these brief interventions. As a consequence, we set out to design an outcome measure to concretely demonstrate the value of single-session interventions. The Session Wants and Needs Outcome Measure (SWAN-OM) aims to capture in-session goals and focuses on being user-centric, elements critical to the success of single-session and brief interventions which typically are asset-based and solution-focused. We describe the 4-stage process that was followed to develop this measure: (I) classical item generation and development, (II) content and (III) face validity pilot testing, and (IV) a user-experience approach with young people using framework analysis. This final stage was critical to ensure the integration of this outcome tool into a web-based digital therapy setting, a context which adds another layer of design complexity to item and measure development. This iterative methodology was used to overcome the challenges encountered and to place the needs of the young people and service practitioners at the centre of the design process, thus ensuring measure usability. To end, we highlight the main lessons learnt from engaging in this design process. Specifically, the needs of a measure for single-session interventions are considered, before outlining the learning associated with integrating the measure into a digital mental health platform. Both of these areas are emerging fields and, as such, this study contributes to our understanding of how an idiographic patient outcome theory driven measure can be created for use in a web-based digital mental health therapy service.