"It is not just about the alcohol": service users' views about individualised and standardised clinical assessment in a therapeutic community for alcohol dependence

Data-Informed Communication: How Measurement-Based Care Can Optimize Child Psychotherapy

Measurement-based care (MBC) research and practice, including clinical workflows and systems to support MBC, are grounded in adult-serving mental health systems. MBC research evidence is building in child and adolescent services, but MBC practice is inherently more complex due to identified client age, the family system and the need to involve multiple reporters. This paper seeks to address a gap in the literature by providing practical guidance for youth-serving clinicians implementing MBC with children and their families. We focus on MBC as a data-informed, client-centered communication process, and present three key strategies to enhance usual care child and adolescent psychotherapy via developmentally-appropriate MBC. These strategies include (1) go beyond standardized measures; (2) lean into discrepancies; and (3) get curious together. Case-based examples drawn from various child-serving settings illustrate these key strategies of MBC in child psychotherapy.

Therapists' and patients' experiences of using patients' self-reported data in ongoing psychotherapy processes-A systematic review and meta-analysis of qualitative studies

OBJECTIVE

Using patient-generated quantitative data in psychotherapy (feedback) appears to enhance treatment outcome, but there is variability in its effect. Different ways and reasons to implement routine outcome measurement might explain such variability. The goal of this review is to address the insufficient knowledge on how these data are used by therapists and patients.

METHODS

The present study is a systematic review and meta-analysis of qualitative reports of therapists' and patients' experiences using patient-generated quantitative data during ongoing psychotherapy.

RESULTS

Four main categories of use were identified: (1) uses of patients' self-reported data as nomothetic/objective markers for assessment, process monitoring, and treatment planning; (2) intrapersonal uses that enhance self-awareness, initiate reflection, and influence patients' mood or responses; (3) uses that prompt interactional processes by facilitating communication, supporting exploration, creating ownership in patients, changing treatment focus, enhancing therapeutic alliance, or disturbing the psychotherapy process; and (4) patients responding for specific purposes due to uncertainty and interpersonal motives, or strategic responding to achieve a desired result.

CONCLUSION

These results demonstrate that patient-reported data, when used in active psychotherapy, is very clearly not just an objective measurement of client functioning: the inclusion of patient-data has the potential to influence psychotherapy in numerous ways.

Effects and experiences of idiographic patient-reported outcome measures for feedback in psychotherapy: A systematic review and secondary analysis of the empirical literature

Objective: There is a growing interest in idiographic patient-reported outcome measures (I-PROMs) for routine outcome monitoring (ROM) and clinical feedback (CF) in psychotherapy, but to our knowledge, no systematic reviews of the empirical literature. Method: We conducted a systematic literature search for empirical papers investigating effects and experiences of I-PROMs for ROM/CF and found a total of 13 papers. There was only one experimental controlled effectiveness study. Results: We formulated a narrative summary of the data set as a whole. We conducted a secondary analysis of nine papers containing qualitative data on stakeholder experiences with I-PROMs and found three superordinate themes and eight subthemes, summarized as "I-PROMs can facilitate self-reflection for patients, assist in identifying and tracking therapeutic topics, and make patients more committed to therapy by giving them a greater sense of responsibility and empowerment. Formulating goals and problems can be difficult, and lack of progress can be demotivating. Time in therapy is precious and must be spent wisely. Effective use of I-PROMs is facilitated by flexibility and therapists' use of clinical skills." Conclusion: We discuss the limitations of the study and provide recommendations for future research and clinical practice.

Involving patients in the process: Development of a constipation patient-reported outcome measure for symptoms and quality of life

Objective

Patient-reported outcome measures (PROMs) are useful standardized tools to measure current patient health status and well-being. While there are existing constipation-related PROMs, the majority of PROMs were not developed with adequate patient involvement and few examined content validity. Accordingly, the current study aimed to develop a constipation PROM with multiple phases of patient and clinician involvement.

Methods

To generate PROM items, 15 patients with chronic constipation (age range =28-79 years, 10 females) underwent a qualitative interview exploring their experiences with chronic constipation. Following that, eight clinical experts completed the content validity index (CVI) ratings of all the items generated to assess content validity. Based on results of the content validity assessment, relevant items were maintained and 12 participants with chronic constipation were re-interviewed to obtain feedback about comprehensibility, comprehensiveness and relevance.

Results

Six themes and 25 sub-themes emerged from the qualitative interview, and an initial list of 33 symptom items and 18 quality of life (QoL) items were generated. Based on the CVIs calculated, 11 symptom items and nine QoL items were maintained with the scale-content validity index indicating excellent content validity. Overall, participants indicated the PROM to be relevant, comprehensive and easy to understand however, minor amendments were made to improve the three qualities of interest.

Conclusion

The current study developed a constipation PROM that measures both symptom severity and constipation-related QoL, with supporting evidence for relevance, comprehensiveness and comprehensibility. Further prioritization should be given to validating and exploring new digital modalities of PROM administration.

The psychometric properties of PSYCHLOPS, an individualized patient-reported outcome measure of personal distress

OBJECTIVE

Few studies report the psychometric properties of individualized patient-reported outcome measures (I-PROMs) combining traditional analysis and Item Response Theory (IRT).

METHODS

Pre- and posttreatment PSYCHLOPS data derived from six clinical samples (n = 939) were analyzed for validity, reliability, and responsiveness; caseness cutoffs and reliable change index were calculated. Exploratory and confirmatory factor analyses were used to determine whether items represented a unidimensional construct; IRT examined item properties of this construct.

RESULTS

Values for internal consistency, construct validity, convergent and discriminant validity, and structural validity were satisfactory. Responsiveness was high: Cohen's d, 1.48. Caseness cutoff and reliable clinical change scores were 6.41 and 4.63, respectively. IRT analysis confirmed that item scores possess strong properties in assessing the underlying trait measured by PSYCHLOPS.

CONCLUSION

PSYCHLOPS met the criteria for norm-referenced measurement of patient psychological distress. PSYCHLOPS functioned as a measure of a single latent trait, which we describe as "personal distress."

Idiographic patient reported outcome measures (I-PROMs) for routine outcome monitoring in psychological therapies: Position paper

Idiographic patient-reported outcome measures (I-PROMs) are a growing set of individualized tools for use in routine outcome monitoring (ROM) in psychological therapies. This paper presents a position statement on their conceptualization, use, and analysis, based on contemporary evidence and clinical practice. Four problem-based, and seven goal-based, I-PROMs, with some evidence of psychometric evaluation and use in psychotherapy, were identified. I-PROMs may be particularly valuable to the evaluation of psychological therapies because of their clinical utility and their alignment with a patient-centered approach. However, there are several challenges for I-PROMs: how to generate items in a robust manner, their measurement model, methods for establishing their reliability and validity, and the meaning of an aggregated I-PROM score. Based on the current state of the literature, we recommend that I-PROMs are used to complement nomothetic measures. Research recommendations are also made regarding the most appropriate methods for analyzing I-PROM data.

The structure of PTSD. Development of the Post Traumatic Symptom scale from a clinician-based perspective

BACKGROUND

Nations marked by a Marxist-Leninist ideology have suffered greatly due to a culture of abuse emphasized by the absolute absence of psychology, thus contributing to a diminished ability in recognizing the consequences of traumatic experiences.

OBJECTIVE

To improve the assessment of the presence and severity of posttraumatic stress disorder (PTSD) in such a cultural context, our paper aimed at developing an alternative self-report measure for PTSD - the Post Traumatic Symptom Scale (PTSs), developed by clinicians with wide relevant expertise, based on the natural language people use to describe its subjective experience. This research used multiple samples consistent with the corresponding objectives. Mokken Scale Analysis and the Classical Test Theory were both employed. The proposed scale was tested against five competing PTSD models, whilst also investigating the symptoms' clusters in two different samples by using, to our knowledge, a network analysis approach for the first time.

METHOD

The results indicated excellent psychometric properties regarding internal consistency and temporal reliability, as well as convergent and discriminant validity. The results of MSA showed that the scale fully conforms to the assumptions of the monotone homogeneity model, interpreted as positive evidence for its use in clinical purposes. The factor analyses pointed that the newer models outperformed the standard DSM-5 model, with bifactor models displaying better fit indexes than second-order models. Finally, a distinct pattern of symptom activation in the high-risk group (i.e. first-responders) was found, bringing support for symptoms overlapping between PTSD and affective disorders, thus reinforcing the idea of bridge symptoms which has significant clinical implications.

RESULTS

This study presents an alternative sound instrument for measuring PTSD symptomatology focused on how people naturally describe their subjective experiences. Theoretical and practical implications are discussed alongside limitations.

HIGHLIGHTS

The construction of PTSs encompasses cultural trauma and one's subjective experience.PTSs was tested against the five major competing models of PTSD.Network analyses suggest different patterns in a student sample vs. a first-responders one, with the accent on the negative alterations in cognitions and mood (NACM) model.

Improving quality of life assessments for high-need adult Medicaid service users with mental health conditions

PURPOSE

There is a lack of consensus on how to evaluate health and social service programs for people with mental health (MH) conditions. Having service users be the primary decision makers in selecting outcome measures can inform a meaningful evaluation strategy. We sought to identify the quality of life (QoL) survey preferences of high-need adult service users with MH conditions.

METHODS

A systematic review identified generic, self-reported QoL surveys with evidence of validity in MH populations of interest. An advisory panel selected the most promising surveys to assess the success of programs like Medicaid for MH service users. Three groups of high-need, adult service users with MH conditions and one group of direct care staff ranked the surveys from the advisory panel, and generated and ranked characteristics that were desirable or undesirable in a QoL survey.

RESULTS

Twenty-two surveys met the inclusion criteria. Of the six surveys selected by the advisory panel, groups of service users and direct care staff most preferred the Warwick-Edinburg Mental Well-being Scale (WEMWBS). The WEMWBS best embodied the features prioritized by the groups: to have a user-friendly format and positive focus, to be clearly worded and brief, and to avoid presumptive or unrealistic items. Service user groups appreciated survey topics most amenable to self-report, such as satisfaction with relationships.

CONCLUSION

Using QoL surveys that service users prefer can reduce the chance that deteriorating QoL is going unchecked, and increase the chance that decisions based on survey findings are meaningful to service users.

Personalising Outcome Measurement in Substance Misuse Treatment: the Feasibility and Psychometrics of Two Individualised Outcome Measures

Individualised information in substance misuse treatment complements standardised outcome measures. However, few studies investigate the use of individualised measures and their robustness in terms of quantifying outcomes. In this study, we analysed the psychometrics and feasibility of two individualised outcome measures (PQ and PSYCHLOPS). We followed a cross-sectional methodology, administering the individualised measures and three additional standardised measures (TOP, a measure of psychological health within addiction services; PHQ-9; CORE-OM) to a sample of 93 patients entering substance misuse treatment in four clinical services. The results showed high levels of patient acceptability of the two individualised measures (response rates > 95%). The internal reliability was good for both PQ and PSYCHLOPS (Cronbach’s alpha, .79 and .72, respectively). Convergent validity of PQ with standardised measures was weak: Pearson’s r values for TOP (psychological health), PHQ-9 and CORE-OM were .21, .22 and .27, respectively. In contrast, convergent validity of PSYCHLOPS was moderate: r = .40, .39 and .50, respectively. Convergence between PQ and PSYCHLOPS was weak (r = .28). Experience of previous treatment episodes was associated with higher PQ and PSYCHLOPS scores; PSYCHLOPS but not PQ scores were higher among those opting to complete the questionnaires in written rather than verbal format. Our findings demonstrated that PQ and PSYCHLOPS are reliable and feasible individualised outcome measures for use in substance misuse treatment units, although the lack of strong convergent validity indicates that they may be measuring different underlying constructs. Optimal outcome measurement may involve combining individualised and standardised measures.

How Routine Patient-Centered Monitoring Relates to Therapeutic Gains in Family Therapy: A Single-Case Study

As routine outcome monitoring systems develop, questions emerge about how therapists incorporate feedback into their practice, and how this relates to therapeutic gains. A case of covert grief was monitored in each session with the Personal Questionnaire and the Helpful Aspects of Therapy instruments. At 4 months follow-up, the Change Interview was administered. Individualized items facilitated access to the private views and needs of each member, which was useful for case formulation and ongoing personalization of the intervention. Qualitative feedback of treatment experiences helped therapists confirm the impacts of interventions, monitor therapeutic alliance, reformulate clinical hypothesis, and plan sessions. Therapists followed a critical triangulation process to decide the clinical meaning of feedback, according to his/her intervention model, expertise, and case-specific context.

How do patient reported outcome measures (PROMs) support clinician-patient communication and patient care? A realist synthesis

BACKGROUND

In this paper, we report the findings of a realist synthesis that aimed to understand how and in what circumstances patient reported outcome measures (PROMs) support patient-clinician communication and subsequent care processes and outcomes in clinical care. We tested two overarching programme theories: (1) PROMs completion prompts a process of self-reflection and supports patients to raise issues with clinicians and (2) PROMs scores raise clinicians' awareness of patients' problems and prompts discussion and action. We examined how the structure of the PROM and care context shaped the ways in which PROMs support clinician-patient communication and subsequent care processes.

RESULTS

PROMs completion prompts patients to reflect on their health and gives them permission to raise issues with clinicians. However, clinicians found standardised PROMs completion during patient assessments sometimes constrained rather than supported communication. In response, clinicians adapted their use of PROMs to render them compatible with the ongoing management of patient relationships. Individualised PROMs supported dialogue by enabling the patient to tell their story. In oncology, PROMs completion outside of the consultation enabled clinicians to identify problematic symptoms when the PROM acted as a substitute rather than addition to the clinical encounter and when the PROM focused on symptoms and side effects, rather than health related quality of life (HRQoL). Patients did not always feel it was appropriate to discuss emotional, functional or HRQoL issues with doctors and doctors did not perceive this was within their remit.

CONCLUSIONS

This paper makes two important contributions to the literature. First, our findings show that PROMs completion is not a neutral act of information retrieval but can change how patients think about their condition. Second, our findings reveal that the ways in which clinicians use PROMs is shaped by their relationships with patients and professional roles and boundaries. Future research should examine how PROMs completion and feedback shapes and is influenced by the process of building relationships with patients, rather than just their impact on information exchange and decision making.

Patients' experiences with routine outcome monitoring and clinical feedback systems: A systematic review and synthesis of qualitative empirical literature

Routine outcome monitoring (ROM) and clinical feedback (CF) systems have become important tools for psychological therapies, but there are challenges for their successful implementation.

OBJECTIVE

To overcome these challenges, a greater understanding is needed about how patients experience the use of ROM/CF.

METHOD

We conducted a systematic literature search of qualitative studies on patient experiences with the use of ROM/CF in mental health services.

RESULTS

The findings from 16 studies were synthesized, resulting in four meta-themes: (1) Suspicion towards service providers, (2) Flexibility and support to capture complexity, (3) Empowering patients, and (4) Developing collaborative practice.

CONCLUSIONS

We discuss the implications of these meta-themes for further development and implementation of ROM/CF into clinical practice, acknowledging the limitations of our review and suggesting avenues for further research. Clinical or methodological significance of this article: This article provides useful and actionable knowledge about the patient perspective on ROM/CF, an important discussion on the current state of research in this area, and useful and concrete suggestions for further avenues of research.