1
|
Grindheim Ø, McAleavey A, Iversen V, Moltu C, Tømmervik K, Govasmark H, Brattland H. Response processes for patients providing quantitative self-report data: a qualitative study. Qual Life Res 2024:10.1007/s11136-024-03749-2. [PMID: 39143446 DOI: 10.1007/s11136-024-03749-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/24/2024] [Indexed: 08/16/2024]
Abstract
OBJECTIVE To identify factors that influence response processes for patients providing quantitative self-report data. Secondly, due to the lack of integrative and explanatory models in this area, to develop a model of patients' response processes that can guide what to look for when considering validity evidence and interpreting scores on individual items. METHODS Participants (n = 13) were recruited from a specialized substance use disorder treatment clinic and interviewed while responding to items from a clinical feedback system implemented for routine outcome monitoring in that setting. The interview approach was based on cognitive interviewing. Data collection and analysis were inspired by a grounded theory approach. RESULTS We identified several variables that influenced the participants' response processes. The variables were organized into five categories: context-related variables; item-related variables; response base variables; reasoning strategies; and response selection strategies. We also found that the participants' responses for many items were affected by different aspects of the response process in ways that are relevant to interpretation but not necessarily discernible from the numerical scores alone, and we developed response categories to capture this. CONCLUSION The findings suggest that patients providing quantitative self-report data encounter conditions in the response process that challenge and influence their ability to convey meaning and accuracy. This results in responses that for many of the items reflect messages important for interpretation and follow-up, even if it does not appear from the numerical scores alone. The proposed model may be a useful tool when developing items, assessing validity, and interpreting responses.
Collapse
Affiliation(s)
- Øyvind Grindheim
- Department of Mental Health, Norwegian University of Science and Technology, Trondheim, Norway.
| | - Andrew McAleavey
- District General Hospital of Førde, Førde, Norway
- Department of Health and Caring Sciences, Western Norway University of Applied Science, Førde, Norway
- Weill Cornell Medical College, New York, NY, USA
| | - Valentina Iversen
- Department of Mental Health, Norwegian University of Science and Technology, Trondheim, Norway
| | - Christian Moltu
- District General Hospital of Førde, Førde, Norway
- Department of Health and Caring Sciences, Western Norway University of Applied Science, Førde, Norway
| | - Kristin Tømmervik
- Clinic of Substance Use and Addiction Medicine, St. Olavs University Hospital, Trondheim, Norway
| | - Hege Govasmark
- Clinic of Substance Use and Addiction Medicine, St. Olavs University Hospital, Trondheim, Norway
| | - Heidi Brattland
- Department of Psychology, Norwegian University of Science and Technology, Trondheim, Norway
- Nidelv Mental Health Center, St. Olavs University Hospital, Trondheim, Norway
| |
Collapse
|
2
|
Haug IM, Neumer SP, Handegård BH, Lisøy C, Rasmussen LMP, Bania EV, Adolfsen F, Patras J. Dose-Response Effects of MittEcho, a Measurement Feedback System, in an Indicated Mental Health Intervention for Children in Municipal and School Services in Norway. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2024:10.1007/s10488-024-01389-9. [PMID: 38809322 DOI: 10.1007/s10488-024-01389-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/11/2024] [Indexed: 05/30/2024]
Abstract
Including routine client feedback can increase the effectiveness of mental health interventions for children, especially when implemented as intended. Rate of implementation, or dose, of such feedback interventions has been shown to moderate results in some studies. Variation in implementation and use of client feedback may also contribute to the mixed results observed within the feedback literature. This study evaluates dose-response associations of client feedback using a novel Measurement Feedback System (MFS) within an indicated group intervention. The primary aim was to determine whether the rate of MFS implementation predicts symptom reduction in anxiety and depression among school-aged children. The secondary aim was to assess whether the rate of MFS implementation influences children's satisfaction with the group intervention or their dropout rates. Data were collected via a randomized factorial study (clinicaltrials.gov NCT04263558) across 58 primary schools in Norway. Children aged 8 to 12 years (N = 701) participated in a group-based, transdiagnostic intervention targeting elevated symptoms of anxiety or depression. Half of the child groups also received the feedback intervention using the MittEcho MFS. Group leaders (N = 83), recruited locally, facilitated the interventions. The MFS dose was measured using the Implementation Index, which combines the use of MFS by both children and providers (group leaders) into a single dose variable. Results showed no significant additional effect of dose of MFS on change in depression or anxiety scores, on user satisfaction with the intervention or on intervention dropout. The discussion addresses potential reasons for these non-significant findings and implications for MFS implementation in preventive, group-based interventions in school settings.
Collapse
Affiliation(s)
- Ida Mari Haug
- Regional Centre for Child and Adolescent Mental Health and Child Welfare, Northern Norway, UiT The Arctic University of Norway, Sykehusvegen 44, Tromsø, 9019, Norway.
| | - Simon-Peter Neumer
- Regional Centre for Child and Adolescent Mental Health and Child Welfare, Northern Norway, UiT The Arctic University of Norway, Sykehusvegen 44, Tromsø, 9019, Norway
- Regional Centre for Child and Adolescent Mental Health, Eastern and Southern Norway, Oslo, Norway
| | - Bjørn Helge Handegård
- Regional Centre for Child and Adolescent Mental Health and Child Welfare, Northern Norway, UiT The Arctic University of Norway, Sykehusvegen 44, Tromsø, 9019, Norway
| | - Carina Lisøy
- Regional Centre for Child and Adolescent Mental Health, Eastern and Southern Norway, Oslo, Norway
| | - Lene-Mari P Rasmussen
- Regional Centre for Child and Adolescent Mental Health and Child Welfare, Northern Norway, UiT The Arctic University of Norway, Sykehusvegen 44, Tromsø, 9019, Norway
| | - Elisabeth Valmyr Bania
- Regional Centre for Child and Youth Mental Health and Child Welfare, Department of Mental Health, Central Norway, Norwegian University of Science and Technology, Trondheim, Norway
| | - Frode Adolfsen
- Regional Centre for Child and Adolescent Mental Health and Child Welfare, Northern Norway, UiT The Arctic University of Norway, Sykehusvegen 44, Tromsø, 9019, Norway
| | - Joshua Patras
- Regional Centre for Child and Adolescent Mental Health, Eastern and Southern Norway, Oslo, Norway
| |
Collapse
|
3
|
de Jong K, Douglas S, Wolpert M, Delgadillo J, Aas B, Bovendeerd B, Carlier I, Compare A, Edbrooke-Childs J, Janse P, Lutz W, Moltu C, Nordberg S, Poulsen S, Rubel JA, Schiepek G, Schilling VNLS, van Sonsbeek M, Barkham M. Using Progress Feedback to Enhance Treatment Outcomes: A Narrative Review. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2024:10.1007/s10488-024-01381-3. [PMID: 38733413 DOI: 10.1007/s10488-024-01381-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/17/2024] [Indexed: 05/13/2024]
Abstract
We face increasing demand for greater access to effective routine mental health services, including telehealth. However, treatment outcomes in routine clinical practice are only about half the size of those reported in controlled trials. Progress feedback, defined as the ongoing monitoring of patients' treatment response with standardized measures, is an evidence-based practice that continues to be under-utilized in routine care. The aim of the current review is to provide a summary of the current evidence base for the use of progress feedback, its mechanisms of action and considerations for successful implementation. We reviewed ten available meta-analyses, which report small to medium overall effect sizes. The results suggest that adding feedback to a wide range of psychological and psychiatric interventions (ranging from primary care to hospitalization and crisis care) tends to enhance the effectiveness of these interventions. The strongest evidence is for patients with common mental health problems compared to those with very severe disorders. Effect sizes for not-on-track cases, a subgroup of cases that are not progressing well, are found to be somewhat stronger, especially when clinical support tools are added to the feedback. Systematic reviews and recent studies suggest potential mechanisms of action for progress feedback include focusing the clinician's attention, altering clinician expectations, providing new information, and enhancing patient-centered communication. Promising approaches to strengthen progress feedback interventions include advanced systems with signaling technology, clinical problem-solving tools, and a broader spectrum of outcome and progress measures. An overview of methodological and implementation challenges is provided, as well as suggestions for addressing these issues in future studies. We conclude that while feedback has modest effects, it is a small and affordable intervention that can potentially improve outcomes in psychological interventions. Further research into mechanisms of action and effective implementation strategies is needed.
Collapse
Affiliation(s)
- Kim de Jong
- Clinical Psychology Unit, Institute of Psychology, Leiden University, Wassenaarseweg 52, Leiden, 2333 AK, The Netherlands.
| | - Susan Douglas
- Department of Leadership, Policy and Organizations, Vanderbilt University, Nashville, TN, USA
| | - Miranda Wolpert
- Division of Psychology and Language Sciences, Department of Clinical, Education and Health Psychology, University College London, United Kingdom, UK
| | - Jaime Delgadillo
- Clinical and Applied Psychology Unit, Department of Psychology, University of Sheffield, Sheffield, UK
| | - Benjamin Aas
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital, LMU Munich, Munich, Germany
- Faculty of Psychology and Educational Sciences, LMU Munich, Munich, Germany
| | - Bram Bovendeerd
- Department of Clinical Psychology and Experimental Psychopathology, Faculty of Behavioural and Social Sciences, University of Groningen, Groningen, The Netherlands
- Dimence, Center for mental health care, Deventer, The Netherlands
| | - Ingrid Carlier
- Department of Psychiatry, Leiden University Medical Centre, Leiden, The Netherlands
| | - Angelo Compare
- Department of Human and Social Sciences, University of Bergamo, Bergamo, Italy
| | - Julian Edbrooke-Childs
- Evidence Based Practice Unit, Anna Freud National Centre for Children and Families, University College London, London, UK
| | | | - Wolfgang Lutz
- Department of Psychology, University of Trier, Trier, Germany
| | - Christian Moltu
- District General Hospital of Førde, Førde, Norway
- Department of Health and Caring Science, Western Norway University of Applied Science, Førde, Norway
| | - Samuel Nordberg
- Department of Behavioral Health, Reliant Medical Group, Worcester, MA, USA
| | - Stig Poulsen
- Department of Psychology, University of Copenhagen, Copenhagen, Denmark
| | - Julian A Rubel
- Institute of Psychology, University of Osnabrück, Salzburg, Austria
| | - Günter Schiepek
- Institute of Synergetics and Psychotherapy Research, Paracelsus Medical University, Salzburg, Austria
| | | | | | - Michael Barkham
- Clinical and Applied Psychology Unit, Department of Psychology, University of Sheffield, Sheffield, UK
| |
Collapse
|
4
|
McAleavey AA, de Jong K, Nissen-Lie HA, Boswell JF, Moltu C, Lutz W. Routine Outcome Monitoring and Clinical Feedback in Psychotherapy: Recent Advances and Future Directions. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2024; 51:291-305. [PMID: 38329643 PMCID: PMC11076375 DOI: 10.1007/s10488-024-01351-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/24/2024] [Indexed: 02/09/2024]
Abstract
In the past decade, there has been an increase in research related to the routine collection and active use of standardized patient data in psychotherapy. Research has increasingly focused on personalization of care to patients, clinical skills and interventions that modulate treatment outcomes, and implementation strategies, all of which appear to enhance the beneficial effects of ROM and feedback. In this article, we summarize trends and recent advances in the research on this topic and identify several essential directions for the field in the short to medium term. We anticipate a broadening of research from the focus on average effects to greater specificity around what kinds of feedback, provided at what time, to which individuals, in what settings, are most beneficial. We also propose that the field needs to focus on issues of health equity, ensuring that ROM can be a vehicle for increased wellbeing for those who need it most. The complexity of mental healthcare systems means that there may be multiple viable measurement solutions with varying costs and benefits to diverse stakeholders in different treatment contexts, and research is needed to identify the most influential components in each of these contexts.
Collapse
Affiliation(s)
- Andrew A McAleavey
- Helse Førde Hospital Trust, Svanehaugvegen 2, Førde, 6812, Norway.
- Department of Health and Caring Science, Western Norway University of Applied Science, Førde, Norway.
- Department of Psychiatry, Weill Cornell Medical Center, New York, NY, USA.
| | - Kim de Jong
- Institute of Psychology, Clinical Psychology Unit, Leiden University, Leiden, The Netherlands
| | | | - James F Boswell
- Department of Psychology, University at Albany, State University of New York, Albany, NY, USA
| | - Christian Moltu
- Helse Førde Hospital Trust, Svanehaugvegen 2, Førde, 6812, Norway
- Department of Health and Caring Science, Western Norway University of Applied Science, Førde, Norway
| | - Wolfgang Lutz
- Department of Psychology, University of Trier, Trier, Germany
| |
Collapse
|
5
|
Douglas S, Page AC, Moltu C, Kyron M, Satterthwaite T. The Connections Matter: Bi-Directional Learning in Program Evaluation and Practice-Oriented Research. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2024; 51:318-335. [PMID: 37768486 DOI: 10.1007/s10488-023-01304-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/17/2023] [Indexed: 09/29/2023]
Abstract
Intended for researchers and clinical leaders, this article suggests that embedded program evaluation is a good fit with the desired features of practice-oriented research. The systematic nature of evaluation that is built into the operational workflow of a practice setting may increase the diversity of methods available to explore processes and outcomes of interest. We propose a novel conceptual framework that uses a human-centered systems lens to foster such embedded evaluation in clinical routine. This approach emphasizes the evaluator-practitioner partnership to build confidence in the bi-directional learning of practice-based evidence with evidence-based practice. The iterative cycles inherent to design thinking are aimed at developing better evaluation questions. The attention to structure and context inherent to systems thinking is intended to support meaningful perspectives in the naturally complex world of health care. Importantly, the combined human-centered systems lens can create greater awareness of the influence of individual and systemic biases that exist in any endeavor or institution that involves people. Recommended tools and strategies include systems mapping, program theory development, and visual facilitation using a logic model to represent the complexity of mental health treatment for communication, shared understanding, and connection to the broader evidence base. To illustrate elements of the proposed conceptual framework, two case examples are drawn from routine outcome monitoring (ROM) and progress feedback. We conclude with questions for future collaboration and research that may strengthen the partnership of evaluators and practitioners as a community of learners in service of local and system-level improvement.
Collapse
Affiliation(s)
- Susan Douglas
- Department of Leadership, Policy and Organizations, Vanderbilt University, Peabody College, 230 Appleton Place PMB #414, Nashville, TN, 37203-5721, USA.
| | - Andrew C Page
- School of Psychological Science and WA Mental Health Research Centre, University of Western Australia, Perth, Australia
| | - Christian Moltu
- District General Hospital of Førde, Førde, Norway
- Department of Health and Caring Science, Western Norway University of Applied Science, Førde, Norway
| | - Michael Kyron
- School of Psychological Science and WA Mental Health Research Centre, University of Western Australia, Perth, Australia
| | | |
Collapse
|
6
|
Connors EH, Childs AW, Douglas S, Jensen-Doss A. Data-Informed Communication: How Measurement-Based Care Can Optimize Child Psychotherapy. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2024:10.1007/s10488-024-01372-4. [PMID: 38662178 DOI: 10.1007/s10488-024-01372-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/13/2024] [Indexed: 04/26/2024]
Abstract
Measurement-based care (MBC) research and practice, including clinical workflows and systems to support MBC, are grounded in adult-serving mental health systems. MBC research evidence is building in child and adolescent services, but MBC practice is inherently more complex due to identified client age, the family system and the need to involve multiple reporters. This paper seeks to address a gap in the literature by providing practical guidance for youth-serving clinicians implementing MBC with children and their families. We focus on MBC as a data-informed, client-centered communication process, and present three key strategies to enhance usual care child and adolescent psychotherapy via developmentally-appropriate MBC. These strategies include (1) go beyond standardized measures; (2) lean into discrepancies; and (3) get curious together. Case-based examples drawn from various child-serving settings illustrate these key strategies of MBC in child psychotherapy.
Collapse
Affiliation(s)
| | - Amber W Childs
- Yale School of Medicine, Department of Psychiatry, New Haven, CT, USA
| | - Susan Douglas
- Department of Leadership, Policy, and Organizations, Vanderbilt University, Peabody College, Nashville, TN, USA
| | | |
Collapse
|
7
|
Azizian Kia S, Wittkampf L, van Lankeren J, Janse P. Motives of Therapists for Using Routine Outcome Monitoring (ROM) and How it is Used by Them in Clinical Practice: Two Qualitative Studies. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2024:10.1007/s10488-024-01374-2. [PMID: 38589737 DOI: 10.1007/s10488-024-01374-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/29/2024] [Indexed: 04/10/2024]
Abstract
Despite its demonstrated value, many mental health institutions struggle to implement progress feedback effectively. There is also insufficient information about how therapists utilize progress feedback. To gain more insight, two qualitative studies were conducted. The first study compared the attitudes and motives of therapists who used and those who did not use progress feedback. The second study examined how psychologists incorporated progress feedback into their practice. In total, 23 therapists were interviewed, and the data were analyzed using thematic analysis. The first study found that almost all the therapists had a positive attitude about progress feedback. Those who did not use it indicated reasons such as a heavy workload and patient-related factors, and they also lacked sufficient information about the potential benefits of progress feedback. The second study revealed four major ways in which the therapists utilized feedback, namely: supporting actions to discuss progress feedback, discussing progress feedback with patients, modifications in the ongoing treatment, and peer consultation. However, discussions during peer consultations about using progress feedback for patients who were not benefitting from treatment and how the treatment might be adjusted accordingly were often lacking. In conclusion, it is crucial that training and education be provided to therapists on how to use progress feedback effectively. Having regular discussions about progress feedback during peer consultations could also facilitate its integration into clinical practice.
Collapse
Affiliation(s)
| | | | | | - Pauline Janse
- Pro Persona Research, Wolfheze, The Netherlands.
- Behavioural Science Institute, Radboud University, Nijmegen, The Netherlands.
| |
Collapse
|
8
|
Jonášová K, Čevelíček M, Doležal P, Řiháček T. Psychotherapists' Experience with In-Session Use of Routine Outcome Monitoring: A Qualitative Meta-analysis. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2024:10.1007/s10488-024-01348-4. [PMID: 38507028 DOI: 10.1007/s10488-024-01348-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/23/2024] [Indexed: 03/22/2024]
Abstract
Routine outcome monitoring (ROM) has become an increasingly utilized tool in therapeutic practice that has the potential to improve therapy outcomes. This study aimed to synthesize the findings of existing qualitative studies investigating how clinicians use ROM in their work with clients. A systematic search of qualitative studies on clinicians' experience with the use of ROM in mental health services was conducted via PsycInfo, PsycArticles, Medline, Web of Science, and Scopus databases. Qualitative meta-analysis was used to synthesize the finding of the primary studies. Forty-seven studies met the inclusion criteria. The analysis resulted in 21 meta-categories organized into six clusters, namely (1) obtaining clinically relevant information, (2) adapting treatment, (3) facilitating communication, (4) enhancing the therapeutic relationship, (5) facilitating change in clients, and (6) personalized usage of ROM. The meta-analysis revealed that clinicians utilized ROM in diverse ways, including both informational and communicational functions. From the clinicians' perspective, ROM was an element that, on the one hand, introduced additional structure and standardization in treatment and, on the other hand, allowed for greater flexibility and tailoring of treatment.
Collapse
Affiliation(s)
- Klára Jonášová
- Department of Psychology, Faculty of Social Studies, Masaryk University, Joštova 10, 602 00, Brno, Czech Republic.
| | - Michal Čevelíček
- Department of Psychology, Faculty of Social Studies, Masaryk University, Joštova 10, 602 00, Brno, Czech Republic
| | - Petr Doležal
- Department of Psychology, Faculty of Social Studies, Masaryk University, Joštova 10, 602 00, Brno, Czech Republic
| | - Tomáš Řiháček
- Department of Psychology, Faculty of Social Studies, Masaryk University, Joštova 10, 602 00, Brno, Czech Republic
| |
Collapse
|
9
|
Solstad SM, Cooper M, Sundet R, Moltu C. Effects and experiences of idiographic patient-reported outcome measures for feedback in psychotherapy: A systematic review and secondary analysis of the empirical literature. Psychother Res 2023:1-14. [PMID: 37990817 DOI: 10.1080/10503307.2023.2283528] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Accepted: 11/07/2023] [Indexed: 11/23/2023] Open
Abstract
Objective: There is a growing interest in idiographic patient-reported outcome measures (I-PROMs) for routine outcome monitoring (ROM) and clinical feedback (CF) in psychotherapy, but to our knowledge, no systematic reviews of the empirical literature. Method: We conducted a systematic literature search for empirical papers investigating effects and experiences of I-PROMs for ROM/CF and found a total of 13 papers. There was only one experimental controlled effectiveness study. Results: We formulated a narrative summary of the data set as a whole. We conducted a secondary analysis of nine papers containing qualitative data on stakeholder experiences with I-PROMs and found three superordinate themes and eight subthemes, summarized as "I-PROMs can facilitate self-reflection for patients, assist in identifying and tracking therapeutic topics, and make patients more committed to therapy by giving them a greater sense of responsibility and empowerment. Formulating goals and problems can be difficult, and lack of progress can be demotivating. Time in therapy is precious and must be spent wisely. Effective use of I-PROMs is facilitated by flexibility and therapists' use of clinical skills." Conclusion: We discuss the limitations of the study and provide recommendations for future research and clinical practice.
Collapse
Affiliation(s)
| | - Mick Cooper
- School of Psychology, University of Roehampton, London, UK
| | - Rolf Sundet
- University of South-Eastern Norway, Borre, Norway
| | - Christian Moltu
- District General Hospital of Førde, Førde, Norway
- Western Norway University College of Applied Sciences, Førde, Norway
| |
Collapse
|
10
|
Douglas S, Bovendeerd B, van Sonsbeek M, Manns M, Milling XP, Tyler K, Bala N, Satterthwaite T, Hovland RT, Amble I, Atzil-Slonim D, Barkham M, de Jong K, Kendrick T, Nordberg SS, Lutz W, Rubel JA, Skjulsvik T, Moltu C. A Clinical Leadership Lens on Implementing Progress Feedback in Three Countries: Development of a Multidimensional Qualitative Coding Scheme. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2023:10.1007/s10488-023-01314-6. [PMID: 37917313 DOI: 10.1007/s10488-023-01314-6] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/12/2023] [Indexed: 11/04/2023]
Abstract
BACKGROUND Progress feedback, also known as measurement-based care (MBC), is the routine collection of patient-reported measures to monitor treatment progress and inform clinical decision-making. Although a key ingredient to improving mental health care, sustained use of progress feedback is poor. Integration into everyday workflow is challenging, impacted by a complex interrelated set of factors across patient, clinician, organizational, and health system levels. This study describes the development of a qualitative coding scheme for progress feedback implementation that accounts for the dynamic nature of barriers and facilitators across multiple levels of use in mental health settings. Such a coding scheme may help promote a common language for researchers and implementers to better identify barriers that need to be addressed, as well as facilitators that could be supported in different settings and contexts. METHODS Clinical staff, managers, and leaders from two Dutch, three Norwegian, and four mental health organizations in the USA participated in semi-structured interviews on how intra- and extra-organizational characteristics interact to influence the use of progress feedback in clinical practice, supervision, and program improvement. Interviews were conducted in the local language, then translated to English prior to qualitative coding. RESULTS A team-based consensus coding approach was used to refine an a priori expert-informed and literature-based qualitative scheme to incorporate new understandings and constructs as they emerged. First, this hermeneutic approach resulted in a multi-level coding scheme with nine superordinate categories and 30 subcategories. Second-order axial coding established contextually sensitive categories for barriers and facilitators. CONCLUSIONS The primary outcome is an empirically derived multi-level qualitative coding scheme that can be used in progress feedback implementation research and development. It can be applied across contexts and settings, with expectations for ongoing refinement. Suggestions for future research and application in practice settings are provided. Supplementary materials include the coding scheme and a detailed playbook.
Collapse
Affiliation(s)
- Susan Douglas
- Department of Leadership, Policy and Organizations, Vanderbilt University, Peabody College, 230 Appleton Place PMB #414, Nashville, TN, 37203-5721, USA.
| | - Bram Bovendeerd
- Department of Clinical Psychology and Experimental Psychopathology, Faculty of Behavioural and Social Sciences, University of Groningen, Groningen, the Netherlands
- Dimence, Center for Mental Health Care, Deventer, the Netherlands
| | | | - Mya Manns
- Department of Leadership, Policy and Organizations, Vanderbilt University, Peabody College, 230 Appleton Place PMB #414, Nashville, TN, 37203-5721, USA
| | - Xavier Patrick Milling
- Department of Leadership, Policy and Organizations, Vanderbilt University, Peabody College, 230 Appleton Place PMB #414, Nashville, TN, 37203-5721, USA
| | - Ke'Sean Tyler
- Department of Leadership, Policy and Organizations, Vanderbilt University, Peabody College, 230 Appleton Place PMB #414, Nashville, TN, 37203-5721, USA
| | | | - Tim Satterthwaite
- Department of Leadership, Policy and Organizations, Vanderbilt University, Peabody College, 230 Appleton Place PMB #414, Nashville, TN, 37203-5721, USA
| | - Runar Tengel Hovland
- Faculty of Health and Social Sciences, Western Norway University of Applied Sciences, Førde, Norway
- Department of Research and Innovation, Førde Hospital Trust, Førde, Norway
| | - Ingunn Amble
- Villa Sana - Centre for Work Health, Modum Bad, Norway
| | | | - Michael Barkham
- Clinical and Applied Psychology Unit, Department of Psychology, University of Sheffield, Sheffield, UK
| | - Kim de Jong
- Clinical Psychology Unit, Institute of Psychology, Leiden University, Leiden, the Netherlands
| | - Tony Kendrick
- Primary Care Research Centre, University of Southampton, Southampton, UK
| | - Samuel S Nordberg
- Department of Behavioral Health, Reliant Medical Group, Worcester, MA, USA
| | - Wolfgang Lutz
- Department of Psychology, University of Trier, Trier, Germany
| | - Julian A Rubel
- Department of Psychology, Psychotherapy Research Lab, Justus Liebig University Giessen, Giessen, Germany
| | | | - Christian Moltu
- District General Hospital of Førde, Førde, Norway
- Department of Health and Caring Science, Western Norway University of Applied Science, Førde, Norway
| |
Collapse
|