What are "good outcomes" in public mental health settings? A qualitative exploration of clients' and therapists' experiences

The Connections Matter: Bi-Directional Learning in Program Evaluation and Practice-Oriented Research

Intended for researchers and clinical leaders, this article suggests that embedded program evaluation is a good fit with the desired features of practice-oriented research. The systematic nature of evaluation that is built into the operational workflow of a practice setting may increase the diversity of methods available to explore processes and outcomes of interest. We propose a novel conceptual framework that uses a human-centered systems lens to foster such embedded evaluation in clinical routine. This approach emphasizes the evaluator-practitioner partnership to build confidence in the bi-directional learning of practice-based evidence with evidence-based practice. The iterative cycles inherent to design thinking are aimed at developing better evaluation questions. The attention to structure and context inherent to systems thinking is intended to support meaningful perspectives in the naturally complex world of health care. Importantly, the combined human-centered systems lens can create greater awareness of the influence of individual and systemic biases that exist in any endeavor or institution that involves people. Recommended tools and strategies include systems mapping, program theory development, and visual facilitation using a logic model to represent the complexity of mental health treatment for communication, shared understanding, and connection to the broader evidence base. To illustrate elements of the proposed conceptual framework, two case examples are drawn from routine outcome monitoring (ROM) and progress feedback. We conclude with questions for future collaboration and research that may strengthen the partnership of evaluators and practitioners as a community of learners in service of local and system-level improvement.

Goals Form: Reliability, validity, and clinical utility of an idiographic goal-focused measure for routine outcome monitoring in psychotherapy

OBJECTIVE

This study aimed to assess the reliability, validity, and clinical utility of an idiographic, goal-focused patient-reported outcome measure: The Goals Form.

METHODS

Data were analyzed from 88 participants, across three samples, who had participated in collaborative-integrative psychotherapy at university-based clinics in the UK. The samples were approximately 70% female with mean age of 30 years old.

RESULTS

The psychometric properties of the Goals Form were generally good. Noncompletion of individual items was low, temporal stability tended to be at target levels, and mean change scores showed moderate to good convergent validity against measures of psychological distress. The measure appeared sensitive to change in psychotherapy and was experienced by most patients as helpful.

CONCLUSIONS

The Goals Form shows acceptable psychometric and clinical properties for routine outcome monitoring in psychotherapy.

The social health domain of people bereaved by a drug-related death and associations with professional help: A cross-sectional study

People bereaved by traumatic deaths are vulnerable to long-lasting impairments in social health, including the quality of social relationships and the capacity to manage their social lives. In this Norwegian study involving 255 participants bereaved by a drug-related death, we aimed to investigate their social health and associations with professional help. The results of a cross-sectional survey showed that participants on average rated their social health as poor, though with large variations within the group. Participants who reported high satisfaction with professional help reported significantly higher scores on most social health-related variables. More research is needed on professional help focusing on the social health of traumatically bereaved people.

Effective Nursing Recovery-Oriented Interventions for Individuals With Substance Use Disorder: A Literature Review

ABSTRACT

Nurses support the recovery of individuals with substance use disorder. How they support individuals, however, may impact the effectiveness of their work. For example, there are various paradigms of recovery that alter interventions. In addition, negative attitudes adopted by clinicians discourage individuals who use substances from accessing healthcare services, experiencing further health deterioration. Alternatively, nurses can enact interventions that promote positive experiences, further supporting the recovery of individuals. Hence, it is beneficial to increase nurses' awareness of effective interventions that promote recovery. The purpose of this literature review is to examine effective nursing interventions that promoted recovery of those with substance use disorders from the perspective of nurses and individuals who received nursing care. The review identified that effective interventions were based on three major themes: person-centered care, empowerment, and maintaining supports and capability enhancement. In addition, literature revealed that some interventions were perceived to be more effective; this depended on whose viewpoint was examined-nurses or individuals with substance use disorders. Finally, there are interventions based on spirituality, culture, advocacy, and self-disclosure that are often disregarded but may be effective. Nurses should utilize the more prominent interventions as they offer the most benefit and integrate interventions that are often overlooked.

Psychological recovery in a step 4 service: a qualitative study exploring the views of service users and clinicians

BACKGROUND

Psychological recovery is typically measured in improving access to psychological therapies (IAPT) services as the reduction of symptoms on routine outcome measures (ROMs). However, conceptualisations of psychological recovery vary, and there are concerns that ROMs may not be suitable for measuring recovery from complex mental health difficulties.

AIM

To gain insight into psychological recovery and measurement in clinical practice.

METHOD

A qualitative study at a step-4 IAPT service in the North of England. Eight clinicians contributed to focus groups, and 10 service users were later interviewed individually.

RESULTS

Factors that informed four congruent and interacting themes of recovery were identified among participants as an ongoing personal process, of intra-therapeutic and extra-therapeutic factors impacting on recovery in helpful and unhelpful ways, and the need for idiographic long-term recovery measures. The functional and long-term nature of recovery and the socio-economic context for recovery were considered particularly crucial.

CONCLUSIONS

The need for idiographic long-term recovery measures to support the ongoing process of recovery was reported in the majority of instances. Study findings mirrored existing recovery and outcome measurement literature, provided new evidence in relation to recovery from complex mental health difficulties, and made recommendations for future research and clinical practice.

How therapists and patients need to develop a clinical feedback system after 18 months of use in a practice-research network: a qualitative study

BACKGROUND

A personalized computer-adaptive system for clinical feedback and routine outcome monitoring in mental health, Norse Feedback aims to bridge the needs for standardized and idiographic measures in ordinary practice.

METHODS

Item response theory analyses of completed treatment processes (n = 800) informed a qualitative study comprising individual in-depth interviews and focus groups with patients (n = 9) and clinicians (n = 10). The research question was: How do clinicians and patients contribute to developing a clinical feedback system in a continuous process aimed at refining its clinical usefulness?

RESULTS

We conducted thematic analyses and found five themes: 1. Added clinical needs, 2. Needs for re-organizing the clinician report, 3.Needs for differentiation of clinical content, 4. User-interface needs, and 5. Item level suggestions.

CONCLUSION

In this article, we detail resulting needs for continuous adaptation to practice, and discuss implications of the concrete experiences with the Norse action research program for the larger field of ROM/CFS implementation.

Continuous quality improvement in measure development: Lessons from building a novel clinical feedback system

Purpose

While the use of clinical feedback systems has become commonplace in psychological treatment, many of the most common instruments used for this purpose have not changed in decades. This paper describes the first four cycles of a measure development method designed to embrace continuous quality improvement.

Methods

Using techniques and philosophies developed in business management and academia—lean continuous quality improvement, action research, and practice research networks—we iterated through multiple cycles of development with the goal of creating an optimal clinical feedback system. These cycles emphasize building capacity to receive and implement feedback from a variety of stakeholders, especially patients and providers of behavioral health services, while also being responsive to quantitative findings from measure development.

Results

Iterating measure development with stakeholder feedback over the course of 5 years has resulted in a novel measurement system with 19 subscales administered via branching logic, and a supporting practice research network to sustain development.

Conclusion

In developing a new clinical feedback system, the less-frequently-discussed practical aspects of measure development require close attention. Specifically, being willing to embrace change, planning for iteration, and systematically seeking stakeholder feedback are identified as central methods for improving clinical feedback systems.

Recovery From Severe Mental Health Problems: A Systematic Review of Service User and Informal Caregiver Perspectives

Introduction: The recovery approach aims to have users' perspectives at the heart of service development and research; it is a holistic perspective that considers social needs, personal growth and inclusion. In the last decade recovery-oriented research and practice has increased greatly, however, a comprehensive model of recovery considering exclusively the perspectives of people with lived experience has not been devised. Aims: This review aimed to develop a framework and contextualize service users' and informal caregivers' understanding of recovery from severe mental health problems. Methods: We systematically searched 6 databases including key terms related to knowledge, experience and narratives AND mental health AND personal recovery. The search was supplemented with reference sourcing through gray literature, reference tracking and expert consultation. Data analysis consisted of a qualitative meta-synthesis using constant comparative methods. Results: Sixty-two studies were analyzed. A pattern emerged regarding the recovery paradigms that the studies used to frame their findings. The resulting recovery framework included the domains Social recovery; Prosperity (Legal, political, and economic recovery); Individual Recovery; and Clinical Recovery Experience (SPICE). Service users' definitions of recovery tended to prioritize social aspects, particularly being accepted and connecting with others, while caregivers focused instead on clinical definitions of recovery such as symptom remission. Both groups emphasized individual aspects such as becoming self-sufficient and achieving personal goals, which was strongly linked with having economic means for independence. Conclusions: The recovery model provided by this review offers a template for further research in the field and a guide for policy and practice. Predominant definitions of recovery currently reflect understandings of mental health which focus on an individual perspective, while this review found an important emphasis on socio-political aspects. At the same time, only a small number of studies took place in low-income countries, focused on minoritized populations, or included caregivers' perspectives. These are important gaps in the literature that require further attention. Systematic Review Registration: The review protocol was registered on PROSPERO (CRD42017076450); https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=76450.

"It means so much for me to have a choice": a qualitative study providing first-person perspectives on medication-free treatment in mental health care

BACKGROUND

In 2016, the Western Norway Regional Health Authority started to integrate more evidence-based psychosocial interventions into the existing mental health care, emphasizing the right for persons with psychosis to choose medication-free treatment. This change emerged from the debate on the effectiveness and adverse effects of the use of antipsychotic medication. Aspects beyond symptom reduction, such as interpersonal relationships, increased understanding of one's own pattern of suffering, hope and motivation, are all considered important for the personal recovery process.

METHODS

This study explores whether these aspects were present in users' descriptions of their recovery processes within the medication-free treatment programme in Bergen, Western Norway. We interviewed ten patients diagnosed with psychosis who were eligible for medication-free services about their treatment experiences. Data were analysed using Attride-Stirling's thematic network approach.

RESULTS

The findings show a global theme relating to personal recovery processes facilitated by the provision of more psychosocial treatment options, with three organizing subthemes: interpersonal relationships between patients and therapists, the patient's understanding of personal patterns of suffering, and personal motivation for self-agency in the recovery process. Participants described an improved relationship with therapists compared to previous experiences. Integrating more evidence-based psychosocial interventions into existing mental health services facilitated learning experiences regarding the choice of treatment, particularly the discontinuation of medication, and appeared to support participants' increased self-agency and motivation in their personal recovery processes.

CONCLUSION

Health care in Norway is perhaps one step closer to optimizing care for people with psychosis, allowing for more patient choice and improving the dialogue and hence the interpersonal relationship between the patient and the therapist. Personal patterns of suffering can be explored within a system aiming to support and have a higher level of acceptance for the discontinuation of medication. Such a system requires personal agency in the treatment regimen, with more focus on personal coping strategies and more personal responsibility for the recovery process.

Moving Toward Connectedness - A Qualitative Study of Recovery Processes for People With Borderline Personality Disorder

Borderline personality disorder (BPD) is a mental health disorder estimated to affect 1–2% of the general population. As a group, people with BPD endure a high degree of suffering, often leading to suicide attempts, self-harm, and suicide. Comparatively few studies explore the first person perspective of the person suffering from any mental health disorder. This might be especially problematic for people diagnosed with BPD, as this particular diagnosis is followed by stigma potentially making help seeking harder and helping relationships more vulnerable. We interviewed 12 female participants recently diagnosed with BPD in-depth about their experiences with recovery and treatment, and used a stepwise reflective approach to rigorously analyze the data. Results show an overarching theme of working toward connectedness, with four constituent sub-themes. We discuss the findings with regard to empirical work, recovery and autonomy, and the risk of epistemic injustice that people with BPD risk facing.

Review: What Outcomes Count? A Review of Outcomes Measured for Adolescent Depression Between 2007 and 2017

OBJECTIVE

Measurement of treatment outcomes in childhood depression has traditionally focused on assessing symptoms from the clinician's perspective, without exploring other outcome domains or considering young people's perspectives. This systematic review explored the extent to which multidimensional and multi-informant outcome measurements have been used in clinical research for adolescent depression in the past decade and how patterns have evolved over time.

METHOD

Embase, Medline, and PsycINFO were searched, and studies that were published from 2007 through 2017 and assessed the effectiveness of treatments or service provision for adolescent depression were included. Of 7,483 studies screened, 95 met the inclusion criteria and were included for data extraction and analysis.

RESULTS

Ten outcomes domains were identified, 2 of which were assessed on average using 4 outcome measures. Most studies (94%) measured symptoms, followed by functioning (52%). Other domains such as personal growth, relationships, quality of life, and service satisfaction were each considered by less than 1 in 10 studies. Youth self-report was considered by 54% but tended to focus on secondary outcomes. Multidimensional and multi-informant measurements were more frequent in studies published since 2015.

CONCLUSION

Recent clinical research continues to prioritize symptoms measurement based on clinician report and has not yet fully embraced multidimensional and multi-informant approaches. In the context of significant policy shifts toward patient-centered and evidence-based care, measuring what matters most to patients has become a priority, but this is not yet widely reflected in clinical research.

What are "good outcomes" for adolescents in public mental health settings?

BACKGROUND

In line with the evidence-based paradigm, routine outcome monitoring and clinical feedback systems are now being recommended and implemented in youth mental health services. However, what constitutes a good outcome for young service users is not fully understood. In order to successfully monitor outcomes that are clinically and personally relevant for the service user that are to benefit from these systems, we need to gain more knowledge of what young service users value as meaningful outcomes of youth mental health services.

AIM

To contribute knowledge into what constitutes "good outcomes" from the experiences of adolescent service users in public mental health systems.

METHODS

A qualitative in-depth study of the experiences and reflections from 22 adolescents aged 14-19 years, currently or recently being in public mental health services. The data material was analyzed using a systematic step-wise consensual qualitative research framework for team-based analysis.

RESULTS

An overarching theme of outcome as having developed a stronger autonomy and safer identity emerged from the analysis, with the subsequent five constituent themes, named from the words of the adolescent clients: (1) I've discovered and given names to my emotions, (2) I've started to become the person that I truly am, (3) I've dared to open up and feel connected to others, (4) I've started saying yes where I used to say no, and, (5) I've learned how to cope with challenges in life.

CONCLUSION

"Good outcomes" in youth mental health services should be understood as recovery oriented, sensitive to developmental phases, and based on the personal goals and values of each adolescent client.

How Do People Experience Early Intervention Services for Psychosis? A Meta-Synthesis

We conducted a study to explore how people diagnosed with first-episode psychosis experienced their contact with early intervention services for psychosis and the way these experiences relate to their recovery processes. Our aim was to integrate and describe the service users' experiences in a rigorous and comprehensive way. A broad literature search was performed in June and July 2016. After screening, 17 qualitative studies were included. We analyzed the findings in two main steps: (a) translating studies into one another and (b) synthesizing the findings from the studies. Through these interpretative processes, we found five new and overarching themes: (a) something is wrong, (b) do for myself, (c) it's about people, (d) a price to pay, and (e) ongoing vulnerability. We describe these themes as a process that service users' maneuver through in their contact with the services. Our findings are discussed in light of relevant research.

"If there's no stability around them": experienced therapists' view on the role of patients' social world in recovery in bipolar disorder

BACKGROUND

Recovery in severe mental illness has traditionally been described as a deeply personal process. At the same time, researchers are increasingly attending to the social nature of such processes. In this article, we aim to supplement the growing knowledge base regarding these social aspects by exploring the perspectives of experienced therapists: how do they view the role of the social world in processes of healing and growth for people with bipolar disorder? And in what ways can the social world impede recovery?

METHODS

We conducted 12 semi-structured individual interviews and analyzed the resulting transcripts using a team-based thematic analysis method.

RESULTS

We identified three themes: (a) establishing a sense of belonging; (b) backing ongoing therapy; and (c) relational ripple effects.

CONCLUSIONS

We relate our findings to existing theory and research, discuss clinical implications, and highlight study limitations. We argue that our findings underscore the need to integrate an understanding of recovery as a personal and social process in the mental health care services that we provide.