The clinical utility of the Personal Questionnaire (PQ): a mixed methods study

Psychotherapists' Experience with In-Session Use of Routine Outcome Monitoring: A Qualitative Meta-analysis

Routine outcome monitoring (ROM) has become an increasingly utilized tool in therapeutic practice that has the potential to improve therapy outcomes. This study aimed to synthesize the findings of existing qualitative studies investigating how clinicians use ROM in their work with clients. A systematic search of qualitative studies on clinicians' experience with the use of ROM in mental health services was conducted via PsycInfo, PsycArticles, Medline, Web of Science, and Scopus databases. Qualitative meta-analysis was used to synthesize the finding of the primary studies. Forty-seven studies met the inclusion criteria. The analysis resulted in 21 meta-categories organized into six clusters, namely (1) obtaining clinically relevant information, (2) adapting treatment, (3) facilitating communication, (4) enhancing the therapeutic relationship, (5) facilitating change in clients, and (6) personalized usage of ROM. The meta-analysis revealed that clinicians utilized ROM in diverse ways, including both informational and communicational functions. From the clinicians' perspective, ROM was an element that, on the one hand, introduced additional structure and standardization in treatment and, on the other hand, allowed for greater flexibility and tailoring of treatment.

Therapists' and patients' experiences of using patients' self-reported data in ongoing psychotherapy processes-A systematic review and meta-analysis of qualitative studies

OBJECTIVE

Using patient-generated quantitative data in psychotherapy (feedback) appears to enhance treatment outcome, but there is variability in its effect. Different ways and reasons to implement routine outcome measurement might explain such variability. The goal of this review is to address the insufficient knowledge on how these data are used by therapists and patients.

METHODS

The present study is a systematic review and meta-analysis of qualitative reports of therapists' and patients' experiences using patient-generated quantitative data during ongoing psychotherapy.

RESULTS

Four main categories of use were identified: (1) uses of patients' self-reported data as nomothetic/objective markers for assessment, process monitoring, and treatment planning; (2) intrapersonal uses that enhance self-awareness, initiate reflection, and influence patients' mood or responses; (3) uses that prompt interactional processes by facilitating communication, supporting exploration, creating ownership in patients, changing treatment focus, enhancing therapeutic alliance, or disturbing the psychotherapy process; and (4) patients responding for specific purposes due to uncertainty and interpersonal motives, or strategic responding to achieve a desired result.

CONCLUSION

These results demonstrate that patient-reported data, when used in active psychotherapy, is very clearly not just an objective measurement of client functioning: the inclusion of patient-data has the potential to influence psychotherapy in numerous ways.

Effects and experiences of idiographic patient-reported outcome measures for feedback in psychotherapy: A systematic review and secondary analysis of the empirical literature

Objective: There is a growing interest in idiographic patient-reported outcome measures (I-PROMs) for routine outcome monitoring (ROM) and clinical feedback (CF) in psychotherapy, but to our knowledge, no systematic reviews of the empirical literature. Method: We conducted a systematic literature search for empirical papers investigating effects and experiences of I-PROMs for ROM/CF and found a total of 13 papers. There was only one experimental controlled effectiveness study. Results: We formulated a narrative summary of the data set as a whole. We conducted a secondary analysis of nine papers containing qualitative data on stakeholder experiences with I-PROMs and found three superordinate themes and eight subthemes, summarized as "I-PROMs can facilitate self-reflection for patients, assist in identifying and tracking therapeutic topics, and make patients more committed to therapy by giving them a greater sense of responsibility and empowerment. Formulating goals and problems can be difficult, and lack of progress can be demotivating. Time in therapy is precious and must be spent wisely. Effective use of I-PROMs is facilitated by flexibility and therapists' use of clinical skills." Conclusion: We discuss the limitations of the study and provide recommendations for future research and clinical practice.

This is what I need a clinical feedback system to do for me: A qualitative inquiry into perspectives of adolescents and their therapists

OBJECTIVE

Routine outcome monitoring and clinical feedback systems might be beneficial for adolescent psychotherapy processes.

METHODS

Clinicians (n = 34) and adolescent clients (n = 22) aged 14-19 from seven different outpatient clinics located in Norway participated in the study. Adolescents were interviewed in individual in-depth interviews (n = 7) or in four adolescent-only focus groups (n = 15), clinicians participated in seven clinician-only focus groups.

RESULTS

We report two core domains, (1) feedback about the therapeutic relationship and (2) feedback about the therapeutic work. Seven subthemes specify the functionality that participants need in a feedback system.

CONCLUSION

Adolescents and therapists requested a feedback system that was relationally oriented, supported collaborative action, and was personalized to the needs of the individual adolescent. The research indicates that a clinical feedback system should have idiographic, as well as nomothetic, components. A clinical feedback system for adolescents should monitor experiences of personal autonomy and the quality of the therapeutic relationship.

The psychometric properties of PSYCHLOPS, an individualized patient-reported outcome measure of personal distress

OBJECTIVE

Few studies report the psychometric properties of individualized patient-reported outcome measures (I-PROMs) combining traditional analysis and Item Response Theory (IRT).

METHODS

Pre- and posttreatment PSYCHLOPS data derived from six clinical samples (n = 939) were analyzed for validity, reliability, and responsiveness; caseness cutoffs and reliable change index were calculated. Exploratory and confirmatory factor analyses were used to determine whether items represented a unidimensional construct; IRT examined item properties of this construct.

RESULTS

Values for internal consistency, construct validity, convergent and discriminant validity, and structural validity were satisfactory. Responsiveness was high: Cohen's d, 1.48. Caseness cutoff and reliable clinical change scores were 6.41 and 4.63, respectively. IRT analysis confirmed that item scores possess strong properties in assessing the underlying trait measured by PSYCHLOPS.

CONCLUSION

PSYCHLOPS met the criteria for norm-referenced measurement of patient psychological distress. PSYCHLOPS functioned as a measure of a single latent trait, which we describe as "personal distress."

Idiographic patient reported outcome measures (I-PROMs) for routine outcome monitoring in psychological therapies: Position paper

Idiographic patient-reported outcome measures (I-PROMs) are a growing set of individualized tools for use in routine outcome monitoring (ROM) in psychological therapies. This paper presents a position statement on their conceptualization, use, and analysis, based on contemporary evidence and clinical practice. Four problem-based, and seven goal-based, I-PROMs, with some evidence of psychometric evaluation and use in psychotherapy, were identified. I-PROMs may be particularly valuable to the evaluation of psychological therapies because of their clinical utility and their alignment with a patient-centered approach. However, there are several challenges for I-PROMs: how to generate items in a robust manner, their measurement model, methods for establishing their reliability and validity, and the meaning of an aggregated I-PROM score. Based on the current state of the literature, we recommend that I-PROMs are used to complement nomothetic measures. Research recommendations are also made regarding the most appropriate methods for analyzing I-PROM data.

Clinician perceptions of nomothetic and individualized patient-reported outcome measures in measurement-based care

Objective: Measurement-based care (MBC), which encompasses routine outcome monitoring (ROM) and measurement feedback systems (MFSs), is an evidence-based practice (EBP) supporting treatment personalization and clinical responsiveness. Despite MBC's effectiveness, clinicians report reservations regarding its utility, which may be a function of overreliance on nomothetic (i.e., standardized) measures. Although research suggests that individualized (i.e., idiographic) patient-reported outcome measures (I-PROMs) may have the potential to overcome these obstacles, little is known regarding clinicians' perceptions of different measurement approaches to MBC. Methods: This study examined clinicians' perceptions of the clinical utility, relevance to treatment planning, and practicality of nomothetic, individualized, and combined clinical feedback provided by a simulated MFS. Three hundred and twenty-nine clinicians were randomized to one of three conditions that presented a clinical vignette comprising: (a) nomothetic, (b) individualized, or (c) combined clinical feedback. Results: Participants' perceptions of the clinical feedback were not affected by the measurement approach. However, cognitive behavioral participants reported more positive perceptions of all aspects associated with the clinical feedback. Conclusion: These results were consistent with previous findings, suggesting that clinicians' theoretical orientation may have a significant impact on their perceptions of MBC, and should be considered when designing and implementing these systems.

How Routine Patient-Centered Monitoring Relates to Therapeutic Gains in Family Therapy: A Single-Case Study

As routine outcome monitoring systems develop, questions emerge about how therapists incorporate feedback into their practice, and how this relates to therapeutic gains. A case of covert grief was monitored in each session with the Personal Questionnaire and the Helpful Aspects of Therapy instruments. At 4 months follow-up, the Change Interview was administered. Individualized items facilitated access to the private views and needs of each member, which was useful for case formulation and ongoing personalization of the intervention. Qualitative feedback of treatment experiences helped therapists confirm the impacts of interventions, monitor therapeutic alliance, reformulate clinical hypothesis, and plan sessions. Therapists followed a critical triangulation process to decide the clinical meaning of feedback, according to his/her intervention model, expertise, and case-specific context.