1
|
Norman G, Mason T, Dumville JC, Bower P, Wilson P, Cullum N. Approaches to enabling rapid evaluation of innovations in health and social care: a scoping review of evidence from high-income countries. BMJ Open 2022; 12:e064345. [PMID: 36600433 PMCID: PMC10580278 DOI: 10.1136/bmjopen-2022-064345] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/03/2022] [Accepted: 12/01/2022] [Indexed: 12/24/2022] Open
Abstract
OBJECTIVE The COVID-19 pandemic increased the demand for rapid evaluation of innovation in health and social care. Assessment of rapid methodologies is lacking although challenges in ensuring rigour and effective use of resources are known. We mapped reports of rapid evaluations of health and social care innovations, categorised different approaches to rapid evaluation, explored comparative benefits of rapid evaluation, and identified knowledge gaps. DESIGN Scoping review. DATA SOURCES MEDLINE, EMBASE and Health Management Information Consortium (HMIC) databases were searched through 13 September 2022. ELIGIBILITY CRITERIA FOR SELECTING STUDIES We included publications reporting primary research or methods for rapid evaluation of interventions or services in health and social care in high-income countries. DATA EXTRACTION AND SYNTHESIS Two reviewers developed and piloted a data extraction form. One reviewer extracted data, a second reviewer checked 10% of the studies; disagreements and uncertainty were resolved through consensus. We used narrative synthesis to map different approaches to conducting rapid evaluation. RESULTS We identified 16 759 records and included 162 which met inclusion criteria.We identified four main approaches for rapid evaluation: (1) Using methodology designed specifically for rapid evaluation; (2) Increasing rapidity by doing less or using less time-intensive methodology; (3) Using alternative technologies and/or data to increase speed of existing evaluation method; (4) Adapting part of non-rapid evaluation.The COVID-19 pandemic resulted in an increase in publications and some limited changes in identified methods. We found little research comparing rapid and non-rapid evaluation. CONCLUSIONS We found a lack of clarity about what 'rapid evaluation' means but identified some useful preliminary categories. There is a need for clarity and consistency about what constitutes rapid evaluation; consistent terminology in reporting evaluations as rapid; development of specific methodologies for making evaluation more rapid; and assessment of advantages and disadvantages of rapid methodology in terms of rigour, cost and impact.
Collapse
Affiliation(s)
- Gill Norman
- Division of Nursing, Midwifery & Social Work; School of Health Sciences; Faculty of Biology Medicine and Health, The University of Manchester, Manchester, UK
- Manchester Academic Health Science Centre, Research and Innovation Division, Manchester University Foundation NHS Trust, Manchester, UK
| | - Thomas Mason
- Centre for Primary Care and Health Services Research; School of Health Sciences; Faculty of Biology, Medicine & Health, University of Manchester, Manchester, UK
- Division of Health Research, Lancaster University, Lancaster, UK
| | - Jo C Dumville
- Division of Nursing, Midwifery & Social Work; School of Health Sciences; Faculty of Biology Medicine and Health, The University of Manchester, Manchester, UK
- Manchester Academic Health Science Centre, Research and Innovation Division, Manchester University Foundation NHS Trust, Manchester, UK
| | - Peter Bower
- Manchester Academic Health Science Centre, Research and Innovation Division, Manchester University Foundation NHS Trust, Manchester, UK
- Centre for Primary Care and Health Services Research; School of Health Sciences; Faculty of Biology, Medicine & Health, University of Manchester, Manchester, UK
| | - Paul Wilson
- Manchester Academic Health Science Centre, Research and Innovation Division, Manchester University Foundation NHS Trust, Manchester, UK
- Centre for Primary Care and Health Services Research; School of Health Sciences; Faculty of Biology, Medicine & Health, University of Manchester, Manchester, UK
| | - Nicky Cullum
- Division of Nursing, Midwifery & Social Work; School of Health Sciences; Faculty of Biology Medicine and Health, The University of Manchester, Manchester, UK
- Manchester Academic Health Science Centre, Research and Innovation Division, Manchester University Foundation NHS Trust, Manchester, UK
| |
Collapse
|
2
|
Deane AM, Little L, Bellomo R, Chapman MJ, Davies AR, Ferrie S, Horowitz M, Hurford S, Lange K, Litton E, Mackle D, O'Connor S, Parker J, Peake SL, Presneill JJ, Ridley EJ, Singh V, van Haren F, Williams P, Young P, Iwashyna TJ. Outcomes Six Months after Delivering 100% or 70% of Enteral Calorie Requirements during Critical Illness (TARGET). A Randomized Controlled Trial. Am J Respir Crit Care Med 2020; 201:814-822. [PMID: 31904995 DOI: 10.1164/rccm.201909-1810oc] [Citation(s) in RCA: 42] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023] Open
Abstract
Rationale: The long-term effects of delivering approximately 100% of recommended calorie intake via the enteral route during critical illness compared with a lesser amount of calories are unknown.Objectives: Our hypotheses were that achieving approximately 100% of recommended calorie intake during critical illness would increase quality-of-life scores, return to work, and key life activities and reduce death and disability 6 months later.Methods: We conducted a multicenter, blinded, parallel group, randomized clinical trial, with 3,957 mechanically ventilated critically ill adults allocated to energy-dense (1.5 kcal/ml) or routine (1.0 kcal/ml) enteral nutrition.Measurements and Main Results: Participants assigned energy-dense nutrition received more calories (percent recommended energy intake, mean [SD]; energy-dense: 103% [28] vs. usual: 69% [18]). Mortality at Day 180 was similar (560/1,895 [29.6%] vs. 539/1,920 [28.1%]; relative risk 1.05 [95% confidence interval, 0.95-1.16]). At a median (interquartile range) of 185 (182-193) days after randomization, 2,492 survivors were surveyed and reported similar quality of life (EuroQol five dimensions five-level quality-of-life questionnaire visual analog scale, median [interquartile range]: 75 [60-85]; group difference: 0 [95% confidence interval, 0-0]). Similar numbers of participants returned to work with no difference in hours worked or effectiveness at work (n = 818). There was no observed difference in disability (n = 1,208) or participation in key life activities (n = 705).Conclusions: The delivery of approximately 100% compared with 70% of recommended calorie intake during critical illness does not improve quality of life or functional outcomes or increase the number of survivors 6 months later.
Collapse
Affiliation(s)
- Adam M Deane
- Department of Medicine and Radiology, Melbourne Medical School, Royal Melbourne Hospital and
| | - Lorraine Little
- Australian and New Zealand Intensive Care Research Centre, School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia
| | - Rinaldo Bellomo
- Centre for Integrated Critical Care, Melbourne Medical School, The University of Melbourne, Parkville, Australia
| | | | - Andrew R Davies
- Australian and New Zealand Intensive Care Research Centre, School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia
| | - Suzie Ferrie
- Department of Nutrition and Dietetics, Royal Prince Alfred Hospital, Camperdown, Australia
| | - Michael Horowitz
- Centre of Research Excellence in Translating Nutritional Science to Good Health, Adelaide Medical School, University of Adelaide, Adelaide, Australia
| | - Sally Hurford
- Medical Research Institute of New Zealand, Wellington, New Zealand
| | - Kylie Lange
- Centre of Research Excellence in Translating Nutritional Science to Good Health, Adelaide Medical School, University of Adelaide, Adelaide, Australia
| | | | - Diane Mackle
- Medical Research Institute of New Zealand, Wellington, New Zealand
| | | | - Jane Parker
- Australian and New Zealand Intensive Care Research Centre, School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia
| | | | - Jeffrey J Presneill
- Department of Medicine and Radiology, Melbourne Medical School, Royal Melbourne Hospital and
| | - Emma J Ridley
- Australian and New Zealand Intensive Care Research Centre, School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia
| | - Vanessa Singh
- Australian and New Zealand Intensive Care Research Centre, School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia
| | - Frank van Haren
- Medical School, Australian National University, Canberra, Australia; and
| | | | - Paul Young
- Medical Research Institute of New Zealand, Wellington, New Zealand
| | - Theodore J Iwashyna
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, University of Michigan, Ann Arbor, Michigan
| |
Collapse
|