1
|
Ataman R, Ahmed S, Berta W, Thomas A. Sustainability of an outcome measure in outpatient stroke rehabilitation: A realist evaluation. J Eval Clin Pract 2024; 30:559-574. [PMID: 38361260 DOI: 10.1111/jep.13972] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Accepted: 12/31/2023] [Indexed: 02/17/2024]
Abstract
RATIONALE Only half of newly implemented evidence-based practices are sustained. Though poor sustainment can lead to negative consequences for clinical teams, organizations and patients, the causal explanations of sustainment are largely unknown. AIMS AND OBJECTIVES We aimed to ascertain how (mechanisms) and in what circumstances (context) a newly implemented outcome measure in rehabilitation was sustained or not (outcome). METHODOLOGY Informed by an integrated knowledge translation approach, we conducted a realist evaluation using a mixed method, embedded single case study design with data collection up to 18 months following the implementation of the Mayo-Portland Adaptability Inventory - version 4 (MPAI-4), a rehabilitation outcome measure. Quantitative data (survey and patient charts) was analysed using descriptive statistics, then integrated with qualitative data (interviews with 10 key informants) and analysed using inductive and deductive retroduction. We integrated the data to develop a case description and ultimately, to refine the programme theory to better understand the sustainability of the MPAI-4. RESULTS We linked context, mechanisms and outcomes, and also emphasized sustainability strategies in 18 explanations of how sustainability works. These explanations provide evidence for four overarching patterns: (1) implementation and sustainability phases are interconnected, (2) outcomes build on each other recursively, with patient benefits as the keystone outcome, (3) sustainment is achieved to varying levels across different sustainability outcomes [e.g., high level (e.g., rate of MPAI-4 scoring: 77.7%) to low level (e.g., rate of MPAI-4 application to clinical decision-making: 3.7%)] and (4) the work of sustaining the MPAI-4 is shared amongst different stakeholders. CONCLUSION Implementation teams can draw from this programme theory to improve the sustainment of outcomes measures while researchers could continue to refine the theory. Continued investigation of sustainability, including diverse and continuous sustainability outcomes, is needed to understand how to maintain improvements in quality of care and patient outcomes.
Collapse
Affiliation(s)
- Rebecca Ataman
- School of Physical and Occupational Therapy, McGill University, Montréal, Québec, Canada
- Centre for Interdisciplinary Research in Rehabilitation of Greater Montréal, Montréal, Québec, Canada
| | - Sara Ahmed
- School of Physical and Occupational Therapy, McGill University, Montréal, Québec, Canada
- Centre for Interdisciplinary Research in Rehabilitation of Greater Montréal, Montréal, Québec, Canada
- Constance Lethbridge Rehabilitation Center, CIUSSS Centre-Ouest de l'Îile de Montreal, Montreal, Quebec, Canada
- Clinical Epidemiology, Center for Outcome Research and Evaluation (CORE), McGill University Health Center Research Institute, Montreal, Quebec, Canada
| | - Whitney Berta
- Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada
| | - Aliki Thomas
- School of Physical and Occupational Therapy, McGill University, Montréal, Québec, Canada
- Centre for Interdisciplinary Research in Rehabilitation of Greater Montréal, Montréal, Québec, Canada
- Institute of Health Sciences Education, McGill University, Montréal, Québec, Canada
| |
Collapse
|
2
|
Ataman R, Ahmed S, Berta W, Thomas A. Collaborative sustainability planning for an outcome measure in outpatient stroke rehabilitation: A qualitative description study. J Eval Clin Pract 2024; 30:459-472. [PMID: 38254335 DOI: 10.1111/jep.13963] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Revised: 12/07/2023] [Accepted: 12/31/2023] [Indexed: 01/24/2024]
Abstract
RATIONALE Evidence suggests that sustainability planning and the use of a collaborative approach to planning result in better sustainability outcomes and more relevant knowledge. Yet, both approaches appear to be underutilized. A detailed description of collaborative sustainability planning may encourage the use of these two impactful strategies. AIMS AND OBJECTIVES To explore the collaborative sustainability planning process for a single outcome measure in three rehabilitation sites. METHODOLOGY Within the Mayo-Portland Adaptability Inventory-version 4 (MPAI-4) implementation project, we conducted a qualitative description study. We used data from 12 core sustainability planning meetings and 108 follow-up meetings that included a total of 31 clinical and research team participants. Sustainability planning was informed by an MPAI-4-specific implementation guide, and by the results from a realist review of the sustainability of rehabilitation practices and the Clinical Sustainability Assessment Tool. We analyzed qualitative data using thematic content analysis. RESULTS Three themes describe the collaborative sustainability planning process: (1) "collaboration as a driver for sustainability" which captures the active collaboration underpinning sustainability planning; (2) "co-creation of a sustainability plan to achieve shared objectives" which captures the identified barriers and facilitators, and selected sustainability strategies linked to one of six collaboratively identified shared objectives; and (3) "the iterative nature of sustainability planning" which captures the necessity of an agile and responsive sustainability planning process. CONCLUSION Identified strategies may be useful to support (collaborative) sustainment. Future research could investigate the effect of collaborative sustainability planning on sustainability objectives, and the relationship between these objectives.
Collapse
Affiliation(s)
- Rebecca Ataman
- School of Physical and Occupational Therapy, McGill University, Montréal, Québec, Canada
- Centre for Interdisciplinary Research in Rehabilitation of Greater Montréal, Montréal, Québec, Canada
| | - Sara Ahmed
- School of Physical and Occupational Therapy, McGill University, Montréal, Québec, Canada
- Centre for Interdisciplinary Research in Rehabilitation of Greater Montréal, Montréal, Québec, Canada
- Clinical Epidemiology, Center for Outcome Research and Evaluation (CORE), McGill University Health Center Research Institute, Montreal, Quebec, Canada
| | - Whitney Berta
- Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada
| | - Aliki Thomas
- School of Physical and Occupational Therapy, McGill University, Montréal, Québec, Canada
- Centre for Interdisciplinary Research in Rehabilitation of Greater Montréal, Montréal, Québec, Canada
- Institute of Health Sciences Education, McGill University, Montréal, Québec, Canada
| |
Collapse
|
3
|
Malec JF. Letter regarding Ataman R, Thomas A, Roberge-Dao J, McKerral M, Auger C, Wittich W et al. Measurement Properties of the Mayo-Portland Adaptability Inventory (MPAI-4) and Related Measures: A Systematic Review. Arch Phys Med Rehabil 2023. Arch Phys Med Rehabil 2023; 104:2169-2170. [PMID: 37716518 DOI: 10.1016/j.apmr.2023.06.025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2023] [Accepted: 06/05/2023] [Indexed: 09/18/2023]
Affiliation(s)
- James F Malec
- Physical Medicine and Rehabilitation, Indiana University School of Medicine, Indianapolis, IN.
| |
Collapse
|
4
|
Kengne Talla P, Thomas A, Ataman R, Auger C, McKerral M, Wittich W, Poncet F, Ahmed S. Evaluating the implementation of the Mayo-Portland Adaptability Inventory-4 (MPAI-4) in three rehabilitation settings in Quebec: a mixed-methods study protocol. BMJ Open 2023; 13:e068866. [PMID: 37221032 DOI: 10.1136/bmjopen-2022-068866] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 05/25/2023] Open
Abstract
INTRODUCTION Stroke is a leading cause of morbidity and mortality worldwide, placing an immense burden on patients and the health system. Timely access to rehabilitation services can improve stroke survivors' quality of life. The use of standardised outcome measures is endorsed for optimising patient rehabilitation outcomes and improving clinical decision-making. This project results from a provincially mandated recommendation to use the fourth version of the Mayo-Portland Adaptability Inventory (MPAI-4) to measure changes in social participation of stroke survivors and to maintain commitment to evidence-informed practices in stroke care. This protocol outlines the implementation process of the MPAI-4 for three rehabilitation centres. The objectives are to: (a) describe the context of MPAI-4 implementation; (b) determine clinical teams' readiness for change; (c) identify barriers and enablers to implementing the MPAI-4 and match the implementation strategies; (d) evaluate the MPAI-4 implementation outcomes including the degree of integration of the MPAI-4 into clinical practice and (e) explore participants' experiences using the MPAI-4. METHODS AND ANALYSIS We will use a multiple case study design within an integrated knowledge translation (iKT) approach with active engagement from key informants. Each case is a rehabilitation centre implementing MPAI-4. We will collect data from clinicians and programme managers using mixed methods guided by several theoretical frameworks. Data sources include surveys, focus groups and patient charts. We will conduct descriptive, correlational and content analyses. Ultimately, we will analyse, integrate data from qualitative and quantitative components and report them within and across participating sites. Results will provide insights about iKT within stroke rehabilitation settings that could be applied to future research projects. ETHICS AND DISSEMINATION The project received Institutional Review Board approval from the Centre for Interdisciplinary Research in Rehabilitation of Greater Montreal. We will disseminate results in peer-reviewed publications and at local, national and international scientific conferences.
Collapse
Affiliation(s)
- Pascaline Kengne Talla
- Faculty of Dental Medicine and Oral Health Sciences, McGill University, Montreal, Quebec, Canada
- Centre de recherche interdisciplinaire en readaptation du Montreal metropolitain, Montreal, Quebec, Canada
- Lethbridge-Layton-Mackay Rehabilitation Centre, Centre Intégré Universitaire de Santé et de Services Sociaux (CIUSSS) du Centre Ouest-de-l'Ile-de-Montréal, Montreal, Quebec, Canada
| | - Aliki Thomas
- Centre de recherche interdisciplinaire en readaptation du Montreal metropolitain, Montreal, Quebec, Canada
- School of Physical and Occupational Therapy, McGill University, Montreal, Quebec, Canada
- Faculty of Education, McGill University, Montreal, Quebec, Canada
- Integrated Health and Social Services Centre of Laval (CISSS de Laval), Laval, Quebec, Canada
| | - Rebecca Ataman
- Centre de recherche interdisciplinaire en readaptation du Montreal metropolitain, Montreal, Quebec, Canada
- Lethbridge-Layton-Mackay Rehabilitation Centre, Centre Intégré Universitaire de Santé et de Services Sociaux (CIUSSS) du Centre Ouest-de-l'Ile-de-Montréal, Montreal, Quebec, Canada
- School of Physical and Occupational Therapy, McGill University, Montreal, Quebec, Canada
| | - Claudine Auger
- Centre de recherche interdisciplinaire en readaptation du Montreal metropolitain, Montreal, Quebec, Canada
- École de la réadaptation, Faculte de Medecine, Université de Montreal, Montreal, Quebec, Canada
- Integrated University Health and Social Services Centre for South-Central Montreal (Institut Universitaire sur la Réadaptation en Déficience Physique de Montréal, CIUSSS du Centre-Sud-de-l'Île-de-Montréal), Montreal, Quebec, Canada
| | - Michelle McKerral
- Centre de recherche interdisciplinaire en readaptation du Montreal metropolitain, Montreal, Quebec, Canada
- Integrated University Health and Social Services Centre for South-Central Montreal (Institut Universitaire sur la Réadaptation en Déficience Physique de Montréal, CIUSSS du Centre-Sud-de-l'Île-de-Montréal), Montreal, Quebec, Canada
- Department of Psychology, Université de Montréal, Montreal, Quebec, Canada
| | - Walter Wittich
- Centre de recherche interdisciplinaire en readaptation du Montreal metropolitain, Montreal, Quebec, Canada
- School of Optometry, Université de Montreal, Montreal, Quebec, Canada
- Institut Nazareth et Louis-Braille, Integrated Health and Social Services Centre of Montérégie-Centre (CISSS de la Montérégie-Centre), Montérégie, Quebec, Canada
| | - Frédérique Poncet
- Centre de recherche interdisciplinaire en readaptation du Montreal metropolitain, Montreal, Quebec, Canada
- Lethbridge-Layton-Mackay Rehabilitation Centre, Centre Intégré Universitaire de Santé et de Services Sociaux (CIUSSS) du Centre Ouest-de-l'Ile-de-Montréal, Montreal, Quebec, Canada
- School of Optometry, Université de Montreal, Montreal, Quebec, Canada
| | - Sara Ahmed
- Centre de recherche interdisciplinaire en readaptation du Montreal metropolitain, Montreal, Quebec, Canada
- Lethbridge-Layton-Mackay Rehabilitation Centre, Centre Intégré Universitaire de Santé et de Services Sociaux (CIUSSS) du Centre Ouest-de-l'Ile-de-Montréal, Montreal, Quebec, Canada
| |
Collapse
|