1
|
Ramanathan S, Lynch E, Bernhardt J, Nilsson M, Cadilhac DA, Carey L, Middleton S, Chamberlain J, Walker FR, Reeves P, Searles A. Impact assessment of the Centre for Research Excellence in Stroke Rehabilitation and Brain Recovery. Health Res Policy Syst 2023; 21:30. [PMID: 37127659 PMCID: PMC10152619 DOI: 10.1186/s12961-023-00974-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2022] [Accepted: 03/08/2023] [Indexed: 05/03/2023] Open
Abstract
BACKGROUND Research impact is an emerging measure of research achievement alongside traditional academic outputs such as publications. We present the results of applying the Framework to Assess the Impact from Translational health research (FAIT) to the Centre for Research Excellence (CRE) in Stroke Rehabilitation and Brain Recovery (CRE-Stroke, 2014-2019) and report on the feasibility and lessons from the application of FAIT to a CRE rather than a discrete research project. METHODS Data were gathered via online surveys, in-depth interviews, document analysis and review of relevant websites/databases to report on the three major FAIT methods: the modified Payback Framework, an assessment of costs against monetized consequences, and a narrative account of the impact generated from CRE-Stroke activities. FAIT was applied during the last 4 years of CRE-Stroke operation. RESULTS With an economic investment of AU$ 3.9 million over 5 years, CRE-Stroke delivered a return on investment that included AU$ 18.8 million in leveraged grants, fellowships and consultancies. Collectively, CRE-Stroke members produced 354 publications that were accessed 470,000 times and cited over 7220 times. CRE-Stroke supported 26 PhDs, 39 postdocs and seven novice clinician researchers. There were 59 capacity-building events benefiting 744 individuals including policy-makers and consumers. CRE-Stroke created research infrastructure (including a research register of stroke survivors and a brain biobank), and its global leadership produced international consensus recommendations to influence the stroke research landscape worldwide. Members contributed to the Australian Living Stroke Guidelines: four researchers' outputs were directly referenced. Based only on the consequences that could be monetized, CRE-Stroke returned AU$ 4.82 for every dollar invested in the CRE. CONCLUSION This case example in the developing field of impact assessment illustrates how researchers can use evidence to demonstrate and report the impact of and returns on research investment. The prospective application of FAIT by a dedicated research impact team demonstrated impact in broad categories of knowledge-gain, capacity-building, new infrastructure, input to policy and economic benefits. The methods can be used by other research teams to provide comprehensive evidence to governments and other research funders about what has been generated from their research investment but requires dedicated resources to complete.
Collapse
Affiliation(s)
- Shanthi Ramanathan
- Health Research Economics, Hunter Medical Research Institute, Locked Bag 100, New Lambton Heights, NSW, 2305, Australia.
- School of Medicine and Public Health, College of Health, Medicine and Wellbeing, University of Newcastle, Callaghan, NSW, Australia.
| | - Elizabeth Lynch
- The Florey Institute of Neuroscience and Mental Health, Melbourne University, Parkville, VIC, Australia
- NHMRC Centre of Research Excellence in Stroke Rehabilitation and Brain Recovery, Heidelberg, VIC, Australia
- College of Nursing and Health Sciences, Flinders University, Bedford Park, SA, Australia
| | - Julie Bernhardt
- The Florey Institute of Neuroscience and Mental Health, Melbourne University, Parkville, VIC, Australia
- NHMRC Centre of Research Excellence in Stroke Rehabilitation and Brain Recovery, Heidelberg, VIC, Australia
| | - Michael Nilsson
- Health Research Economics, Hunter Medical Research Institute, Locked Bag 100, New Lambton Heights, NSW, 2305, Australia
- School of Medicine and Public Health, College of Health, Medicine and Wellbeing, University of Newcastle, Callaghan, NSW, Australia
- NHMRC Centre of Research Excellence in Stroke Rehabilitation and Brain Recovery, Heidelberg, VIC, Australia
| | - Dominique A Cadilhac
- The Florey Institute of Neuroscience and Mental Health, Melbourne University, Parkville, VIC, Australia
- NHMRC Centre of Research Excellence in Stroke Rehabilitation and Brain Recovery, Heidelberg, VIC, Australia
- Stroke and Ageing Research, School of Clinical Sciences at Monash Health, Monash University, Clayton, VIC, Australia
| | - Leeanne Carey
- The Florey Institute of Neuroscience and Mental Health, Melbourne University, Parkville, VIC, Australia
- NHMRC Centre of Research Excellence in Stroke Rehabilitation and Brain Recovery, Heidelberg, VIC, Australia
- Occupational Therapy, School of Allied Health, Human Services and Sport, LaTrobe University, Bundoora, VIC, Australia
| | - Sandy Middleton
- NHMRC Centre of Research Excellence in Stroke Rehabilitation and Brain Recovery, Heidelberg, VIC, Australia
- Nursing Research Institute, St Vincent's Health Australia (Sydney) and Australian Catholic University, Darlinghurst, Sydney, Australia
| | - Jan Chamberlain
- The Florey Institute of Neuroscience and Mental Health, Melbourne University, Parkville, VIC, Australia
- NHMRC Centre of Research Excellence in Stroke Rehabilitation and Brain Recovery, Heidelberg, VIC, Australia
| | - Frederick Rohan Walker
- School of Medicine and Public Health, College of Health, Medicine and Wellbeing, University of Newcastle, Callaghan, NSW, Australia
- NHMRC Centre of Research Excellence in Stroke Rehabilitation and Brain Recovery, Heidelberg, VIC, Australia
| | - Penny Reeves
- Health Research Economics, Hunter Medical Research Institute, Locked Bag 100, New Lambton Heights, NSW, 2305, Australia
- School of Medicine and Public Health, College of Health, Medicine and Wellbeing, University of Newcastle, Callaghan, NSW, Australia
| | - Andrew Searles
- Health Research Economics, Hunter Medical Research Institute, Locked Bag 100, New Lambton Heights, NSW, 2305, Australia
- School of Medicine and Public Health, College of Health, Medicine and Wellbeing, University of Newcastle, Callaghan, NSW, Australia
| |
Collapse
|
2
|
Sarkies M, Jones LK, Pang J, Sullivan D, Watts GF. How Can Implementation Science Improve the Care of Familial Hypercholesterolaemia? Curr Atheroscler Rep 2023; 25:133-143. [PMID: 36806760 PMCID: PMC10027803 DOI: 10.1007/s11883-023-01090-6] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/03/2023] [Indexed: 02/23/2023]
Abstract
PURPOSE OF REVIEW Describe the application of implementation science to improve the detection and management of familial hypercholesterolaemia. RECENT FINDINGS Gaps between evidence and practice, such as underutilization of genetic testing, family cascade testing, failure to achieve LDL-cholesterol goals and low levels of knowledge and awareness, have been identified through clinical registry analyses and clinician surveys. Implementation science theories, models and frameworks have been applied to assess barriers and enablers in the literature specific to local contextual factors (e.g. stages of life). The effect of implementation strategies to overcome these factors has been evaluated; for example, automated identification of individuals with FH or training and education to improve statin adherence. Clinical registries were identified as a key infrastructure to monitor, evaluate and sustain improvements in care. The expansion in evidence supporting the care of familial hypercholesterolaemia requires a similar expansion of efforts to translate new knowledge into clinical practice.
Collapse
Affiliation(s)
- Mitchell Sarkies
- School of Health Sciences, Faculty of Medicine and Health, University of Sydney, Sydney, NSW, 2006, Australia.
- Centre for Healthcare Resilience and Implementation Science, Australian Institute of Health Innovation, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, NSW, Australia.
| | - Laney K Jones
- Department of Genomic Health, Research Institute, Geisinger, Danville, PA, USA
- Heart and Vascular Institute, Geisinger, Danville, PA, USA
| | - Jing Pang
- School of Medicine, University of Western Australia, Perth, WA, Australia
| | - David Sullivan
- Department of Chemical Pathology, Royal Prince Alfred Hospital, Sydney, NSW, Australia
| | - Gerald F Watts
- School of Medicine, University of Western Australia, Perth, WA, Australia
- Lipid Disorders Clinic, Department of Cardiology, Royal Perth Hospital, Perth, WA, Australia
| |
Collapse
|
3
|
Kork AA, Antonini C, García-Torea N, Luque-Vílchez M, Costa E, Senn J, Larrinaga C, Bertorello D, Brichetto G, Zaratin P, Andreaus M. Collective health research assessment: developing a tool to measure the impact of multistakeholder research initiatives. Health Res Policy Syst 2022; 20:49. [PMID: 35501895 PMCID: PMC9063051 DOI: 10.1186/s12961-022-00856-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2021] [Accepted: 04/12/2022] [Indexed: 11/27/2022] Open
Abstract
Background The need to more collaboratively measure the impact of health research and to do so from multidimensional perspectives has been acknowledged. A scorecard was developed as part of the Collective Research Impact Framework (CRIF), to engage stakeholders in the assessment of the impacts of health research and innovations. The purpose of this study was to describe the developmental process of the MULTI-ACT Master Scorecard (MSC) and how it can be used as a workable tool for collectively assessing future responsible research and innovation measures. Methods An extensive review of the health research impact literature and of multistakeholder initiatives resulted in a database of 1556 impact indicators. The MSC was then cocreated by engaging key stakeholders and conducting semi-structured interviews of experts in the field. Results The MSC consists of five accountability dimensions: excellence, efficacy, economic, social and patient-reported outcomes. The tool contains 125 potential indicators, classified into 53 impact measurement aspects that are considered the most relevant topics for multistakeholder research and innovation initiatives when assessing their impact on the basis of their mission and their stakeholders’ interests. The scorecard allows the strategic management of multistakeholder research initiatives to demonstrate their impact on people and society. The value of the tool is that it is comprehensive, customizable and easy to use. Conclusions The MSC is an example of how the views of society can be taken into account when research impacts are assessed in a more sustainable and balanced way. The engagement of patients and other stakeholders is an integral part of the CRIF, facilitating collaborative decision-making in the design of policies and research agendas. In policy making, the collective approach allows the evaluation perspective to be extended to the needs of society and towards responsible research and innovation. Multidimensionality makes research and innovations more responsive to systemic challenges, and developing more equitable and sustainable health services. Supplementary Information The online version contains supplementary material available at 10.1186/s12961-022-00856-9.
Collapse
Affiliation(s)
- Anna-Aurora Kork
- Faculty of Social Sciences, Tampere University, Tampere, Finland.
| | - Carla Antonini
- Department of Accounting, Universidad Autónoma de Madrid, Madrid, Spain
| | - Nicolás García-Torea
- Department of Economy and Business Administration, Universidad de Burgos, Burgos, Spain
| | - Mercedes Luque-Vílchez
- Department of Agriculture Economy, Finance and Accounting, Universidad de Córdoba, Córdoba, Spain.,European Financial Reporting Advisory Group (EFRAG), Brussels, Belgium
| | - Ericka Costa
- Department of Economic and Management, University of Trento, Trento, Italy
| | | | - Carlos Larrinaga
- Department of Economy and Business Administration, Universidad de Burgos, Burgos, Spain
| | | | | | - Paola Zaratin
- FISM-Italian Multiple Sclerosis Society Foundation, Genoa, Italy
| | - Michele Andreaus
- Department of Economic and Management, University of Trento, Trento, Italy
| |
Collapse
|