1
|
Richards HS, Cousins S, Scroggie DL, Elliott D, Macefield R, Hudson E, Mutanga IR, Shah M, Alford N, Blencowe NS, Blazeby J. Examining the application of the IDEAL framework in the reporting and evaluation of innovative invasive procedures: secondary qualitative analysis of a systematic review. BMJ Open 2024; 14:e079654. [PMID: 38803251 PMCID: PMC11129025 DOI: 10.1136/bmjopen-2023-079654] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Accepted: 05/01/2024] [Indexed: 05/29/2024] Open
Abstract
OBJECTIVES The development of new surgical procedures is fundamental to advancing patient care. The Idea, Developments, Exploration, Assessment and Long-term (IDEAL) framework describes study designs for stages of innovation. It can be difficult to apply due to challenges in defining and identifying innovative procedures. This study examined how the IDEAL framework is operationalised in real-world settings; specifically, the types of innovations evaluated using the framework and how authors justify their choice of IDEAL study design. DESIGN Secondary qualitative analysis of a systematic review. DATA SOURCES Citation searches (Web of Science and Scopus) identified studies following the IDEAL framework and citing any of the ten key IDEAL/IDEAL_D papers. ELIGIBILITY CRITERIA Studies of invasive procedures/devices of any design citing any of the ten key IDEAL/IDEAL_D papers. DATA EXTRACTION AND SYNTHESIS All relevant text was extracted. Three frameworks were developed, namely: (1) type of innovation under evaluation; (2) terminology used to describe stage of innovation and (3) reported rationale for IDEAL stage. RESULTS 48 articles were included. 19/48 described entirely new procedures, including those used for the first time in a different clinical context (n=15/48), reported as IDEAL stage 2a (n=8, 53%). Terminology describing stage of innovation was varied, inconsistent and ambiguous and was not defined. Authors justified their choice of IDEAL study design based on limitations in published evidence (n=36) and unknown feasibility and safety (n=32) outcomes. CONCLUSION Identifying stage of innovation is crucial to inform appropriate study design and governance decisions. Authors' rationale for choice of IDEAL stage related to the existing evidence base or lack of sufficient outcome data for procedures. Stage of innovation was poorly defined with inconsistent descriptions. Further work is needed to develop methods to identify innovation to inform practical application of the IDEAL framework. Defining the concept of innovation in terms of uncertainty, risk and degree of evidence may help to inform decision-making.
Collapse
Affiliation(s)
- Hollie Sarah Richards
- National Institute for Health Research Bristol Biomedical Research Centre Surgical and Orthopaedic Innovation Theme, Bristol Centre for Surgical Research, Bristol Medical School, University of Bristol Medical School, Bristol, UK
| | - Sian Cousins
- National Institute for Health Research Bristol Biomedical Research Centre Surgical and Orthopaedic Innovation Theme, Bristol Centre for Surgical Research, Bristol Medical School, University of Bristol Medical School, Bristol, UK
| | - Darren L Scroggie
- National Institute for Health Research Bristol Biomedical Research Centre Surgical and Orthopaedic Innovation Theme, Bristol Centre for Surgical Research, Bristol Medical School, University of Bristol Medical School, Bristol, UK
| | - Daisy Elliott
- National Institute for Health Research Bristol Biomedical Research Centre Surgical and Orthopaedic Innovation Theme, Bristol Centre for Surgical Research, Bristol Medical School, University of Bristol Medical School, Bristol, UK
| | - Rhiannon Macefield
- National Institute for Health Research Bristol Biomedical Research Centre Surgical and Orthopaedic Innovation Theme, Bristol Centre for Surgical Research, Bristol Medical School, University of Bristol Medical School, Bristol, UK
| | - Elizabeth Hudson
- National Institute for Health Research Bristol Biomedical Research Centre Surgical and Orthopaedic Innovation Theme, Bristol Centre for Surgical Research, Bristol Medical School, University of Bristol Medical School, Bristol, UK
| | - Ian Rodney Mutanga
- National Institute for Health Research Bristol Biomedical Research Centre Surgical and Orthopaedic Innovation Theme, Bristol Centre for Surgical Research, Bristol Medical School, University of Bristol Medical School, Bristol, UK
| | - Maximilian Shah
- National Institute for Health Research Bristol Biomedical Research Centre Surgical and Orthopaedic Innovation Theme, Bristol Centre for Surgical Research, Bristol Medical School, University of Bristol Medical School, Bristol, UK
| | - Natasha Alford
- National Institute for Health Research Bristol Biomedical Research Centre Surgical and Orthopaedic Innovation Theme, Bristol Centre for Surgical Research, Bristol Medical School, University of Bristol Medical School, Bristol, UK
| | - Natalie S Blencowe
- National Institute for Health Research Bristol Biomedical Research Centre Surgical and Orthopaedic Innovation Theme, Bristol Centre for Surgical Research, Bristol Medical School, University of Bristol Medical School, Bristol, UK
| | - Jane Blazeby
- National Institute for Health Research Bristol Biomedical Research Centre Surgical and Orthopaedic Innovation Theme, Bristol Centre for Surgical Research, Bristol Medical School, University of Bristol Medical School, Bristol, UK
| |
Collapse
|
2
|
Macefield RC, Wilson N, Hoffmann C, Blazeby JM, McNair AGK, Avery KNL, Potter S. Outcome selection, measurement and reporting for new surgical procedures and devices: a systematic review of IDEAL/IDEAL-D studies to inform development of a core outcome set. BJS Open 2020; 4:1072-1083. [PMID: 33016009 PMCID: PMC8444278 DOI: 10.1002/bjs5.50358] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2020] [Accepted: 08/20/2020] [Indexed: 11/24/2022] Open
Abstract
BACKGROUND Outcome selection, measurement and reporting for the evaluation of new surgical procedures and devices is inconsistent and lacks standardization. A core outcome set may promote the safe and transparent evaluation of surgical innovations. This systematic review examined outcome selection, measurement and reporting in studies conducted within the IDEAL (Idea, Development, Exploration, Assessment and Long-term monitoring) framework to examine current practice and inform the development of a core outcome set for early-phase studies of surgical procedures/devices. METHODS Web of Science and Scopus citation searches were performed to identify author-reported IDEAL/IDEAL-D studies for any surgical procedure/device. Outcomes were extracted verbatim, including contextual information regarding outcome selection and measurement. Outcomes were categorized to inform a conceptual framework of outcome domains relevant to evaluating innovation. RESULTS Some 48 studies were identified. Outcome selection, measurement and reporting varied widely across studies in different IDEAL stages. From 1737 outcomes extracted, 22 domains specific to evaluating innovation were conceptualized under seven broad categories: procedure completion success/failure; modifications; unanticipated events; surgeons' experiences; patients' experiences; resource use specific to the innovative procedure/device; and other innovation-specific outcomes. Most innovation-specific outcomes were measured and reported in only a small number of studies. CONCLUSION This review highlighted the need for guidance and standardization in outcome selection and reporting in the evaluation of new surgical procedures/devices. Novel outcome domains specific to innovation have been identified to establish a core outcome set for future evaluations of surgical innovations.
Collapse
Affiliation(s)
- R. C. Macefield
- National Institute for Health Research Bristol Biomedical Research Centre, Bristol Centre for Surgical Research, Bristol Medical SchoolUniversity of BristolBristolUK
| | - N. Wilson
- National Institute for Health Research Bristol Biomedical Research Centre, Bristol Centre for Surgical Research, Bristol Medical SchoolUniversity of BristolBristolUK
| | - C. Hoffmann
- National Institute for Health Research Bristol Biomedical Research Centre, Bristol Centre for Surgical Research, Bristol Medical SchoolUniversity of BristolBristolUK
| | - J. M. Blazeby
- National Institute for Health Research Bristol Biomedical Research Centre, Bristol Centre for Surgical Research, Bristol Medical SchoolUniversity of BristolBristolUK
| | - A. G. K. McNair
- National Institute for Health Research Bristol Biomedical Research Centre, Bristol Centre for Surgical Research, Bristol Medical SchoolUniversity of BristolBristolUK
- Department of Gastrointestinal SurgeryBristolUK
| | - K. N. L. Avery
- National Institute for Health Research Bristol Biomedical Research Centre, Bristol Centre for Surgical Research, Bristol Medical SchoolUniversity of BristolBristolUK
| | - S. Potter
- National Institute for Health Research Bristol Biomedical Research Centre, Bristol Centre for Surgical Research, Bristol Medical SchoolUniversity of BristolBristolUK
- Bristol Breast Care CentreNorth Bristol NHS TrustBristolUK
| |
Collapse
|
3
|
Li B, Li D, Liang T, Li X. The effect of perirenal puncture and drainage with urokinase treatment of perirenal hematoma complicated by infection: Two cases' report. Int J Immunopathol Pharmacol 2019; 33:2058738419859696. [PMID: 31238742 PMCID: PMC6595634 DOI: 10.1177/2058738419859696] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
The aim of this study was to discuss the clinical significance of perirenal puncture and drainage with urokinase treatment of perirenal hematoma complicated by infection following surgery for upper urinary tract calculi. Two cases of perirenal hematoma complicated by infection following surgery for upper urinary tract calculi in 2017, and later received perirenal puncture and drainage of perirenal hematoma with urokinase treatment were selected. Puncture and drainage of perirenal hematoma with urokinase treatment were performed without the occurrence of severe complications such as sepsis, septic shock, or secondary bleeding. Both the renal morphology and functions were well restored. Puncture and drainage with urokinase treatment had definite efficacy in the treatment of perirenal hematoma complicated by infection.
Collapse
Affiliation(s)
- Bengen Li
- Department of Urology, Affiliated Hospital of Zunyi Medical University, Zunyi, China
| | - Daobing Li
- Department of Urology, Affiliated Hospital of Zunyi Medical University, Zunyi, China
| | - Tiancai Liang
- Department of Urology, Affiliated Hospital of Zunyi Medical University, Zunyi, China
| | - Xiaoguang Li
- Department of Urology, Affiliated Hospital of Zunyi Medical University, Zunyi, China
| |
Collapse
|
4
|
Tradewell MB, Albersheim J, Dahm P. Use of the IDEAL framework in the urological literature: where are we in 2018? BJU Int 2019; 123:1078-1085. [PMID: 30653798 DOI: 10.1111/bju.14676] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
OBJECTIVES To assess uptake and application of the IDEAL principles in original surgical procedure- or device-related clinical research studies, as well as its reported relevance as characterized by secondary publications, editorials and reviews. MATERIALS AND METHODS IDEAL (Idea, Development, Exploration, Assessment, Long-term study) is a framework that provides stage-specific guidance for surgical innovation and represented a major advance towards raising evidential standards. We performed a comprehensive literature search of all urology-related publications citing one or more of seven key publications on IDEAL in The Lancet and BMJ using multiple databases up to 31 December 2017. RESULTS We identified a total of 150 urology-related manuscripts citing IDEAL, of which 83 (55.3%) were original research and 67 (44.7%) were secondary publications. Among the original research articles, 40 (48.2%) did not explicitly apply IDEAL principles or were not surgical innovation studies. The IDEAL phases of the 43 (51.8%) remaining original research studies were IDEAL, in nine (20.9%), 27 (62.8%), four (9.3%), 0 (0%), and three publications (7.0%), respectively. Across IDEAL stages, 30 (75.0%) studies were prospective, 29 (85.3%) reported ethical oversight, and 39 (90.7%) captured treatment-related harms. None of the studies collected information on physician experience. CONCLUSIONS The IDEAL framework has found widespread adoption in the urology literature as witnessed by a large number of original manuscripts and secondary publications citing IDEAL; however, its application is largely limited to the early stages of surgical innovation, frequently with inappropriate and incomplete implementation. Further efforts are needed to guide investigators in the optimal use of the IDEAL framework as it relates to surgical innovation in urology.
Collapse
Affiliation(s)
| | - Jacob Albersheim
- Department of Urology, University of Minnesota, Minneapolis, MN, USA
| | - Philipp Dahm
- Department of Urology, University of Minnesota, Minneapolis, MN, USA.,Urology Section, Minneapolis Veterans Administration Health Care System, Minneapolis, MN, USA
| |
Collapse
|
5
|
Perinephric Hematoma with Active Arterial Hemorrhage following Extracorporeal Shockwave Lithotripsy. Case Rep Urol 2019; 2019:1547437. [PMID: 30723569 PMCID: PMC6339706 DOI: 10.1155/2019/1547437] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2018] [Accepted: 12/27/2018] [Indexed: 11/27/2022] Open
Abstract
Subcapsular hematoma is an exceedingly rare complication of extracorporeal shockwave lithotripsy (ESWL) for renal stones with cases demonstrating evidence of active arterial bleeding even more so. A 49-year-old male presented with acute onset right flank pain two hours following ESWL. CT scan with contrast revealed active contrast extravasation consistent with arterial bleeding. The patient was managed with arterial embolization and recovered uneventfully following a 4-day hospitalization.
Collapse
|
6
|
Page kidney as a complication after a shock wave lithotripsy: a case report. CEN Case Rep 2018; 7:330-331. [PMID: 30159710 DOI: 10.1007/s13730-018-0361-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2018] [Accepted: 08/19/2018] [Indexed: 10/28/2022] Open
|
7
|
Khachane A, Philippou Y, Hirst A, McCulloch P. Appraising the uptake and use of the IDEAL Framework and Recommendations: A review of the literature. Int J Surg 2018; 57:84-90. [PMID: 30098412 DOI: 10.1016/j.ijsu.2018.07.008] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2018] [Revised: 07/18/2018] [Accepted: 07/24/2018] [Indexed: 11/28/2022]
Abstract
INTRODUCTION Evaluation of new surgical innovations is complex and variably regulated, and historically the quality of surgical studies has been criticized. The IDEAL (Idea, Development, Exploration, Assessment, Long-term monitoring) Framework was established to provide a pathway for evaluating surgical innovations at each stage of their development in order to produce high quality surgical research. Since the inception of IDEAL in 2009, there has been no assessment of its use. In this review, we look at the uptake and usage of IDEAL by examining the published literature. METHODS We conducted a literature search to identify all of the publications that cited IDEAL and included only those papers that intentionally used IDEAL as part of the study methodology. We then characterized these publications by year of publication, specialty, and geographical location. We performed a critical appraisal of Stage 1, 2a, and 2b studies in order to assess the degree to which authors have correctly followed the Framework and Recommendations. RESULTS We found 790 citations of IDEAL publications, and after abstract and full-text screening, 38 prospective studies for a surgical innovation that used IDEAL remained. We saw an overall increase in the uptake of IDEAL, with a predominance in urology and origin in the United Kingdom. The critical appraisal showed that although authors identified their project as using IDEAL, they often failed to include key IDEAL characteristics; this was especially true for the features unique to IDEAL Stages 2a and 2b. CONCLUSION It is evident from the large number of studies citing IDEAL that the importance and challenges of reporting surgical research is well recognized among researchers. There is growing enthusiasm for using IDEAL but the current level of understanding of the Recommendations is low. Clearer and more comprehensive explanation of the application of the IDEAL Framework and Recommendations is needed to guide surgical researchers undertaking IDEAL based studies of surgical innovations.
Collapse
Affiliation(s)
- Asha Khachane
- IDEAL Collaboration, Oxford, UK, Maimonides Medical Center, Brooklyn, NY, USA.
| | | | | | | |
Collapse
|