1
|
Bečulić H, Begagić E, Džidić-Krivić A, Pugonja R, Softić N, Bašić B, Balogun S, Nuhović A, Softić E, Ljevaković A, Sefo H, Šegalo S, Skomorac R, Pojskić M. Sensitivity and specificity of machine learning and deep learning algorithms in the diagnosis of thoracolumbar injuries resulting in vertebral fractures: A systematic review and meta-analysis. BRAIN & SPINE 2024; 4:102809. [PMID: 38681175 PMCID: PMC11052896 DOI: 10.1016/j.bas.2024.102809] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/01/2024] [Revised: 03/13/2024] [Accepted: 04/04/2024] [Indexed: 05/01/2024]
Abstract
Introduction Clinicians encounter challenges in promptly diagnosing thoracolumbar injuries (TLIs) and fractures (VFs), motivating the exploration of Artificial Intelligence (AI) and Machine Learning (ML) and Deep Learning (DL) technologies to enhance diagnostic capabilities. Despite varying evidence, the noteworthy transformative potential of AI in healthcare, leveraging insights from daily healthcare data, persists. Research question This review investigates the utilization of ML and DL in TLIs causing VFs. Materials and methods Employing Preferred Reporting Items for Systematic Reviews and Meta-Analyzes (PRISMA) methodology, a systematic review was conducted in PubMed and Scopus databases, identifying 793 studies. Seventeen were included in the systematic review, and 11 in the meta-analysis. Variables considered encompassed publication years, geographical location, study design, total participants (14,524), gender distribution, ML or DL methods, specific pathology, diagnostic modality, test analysis variables, validation details, and key study conclusions. Meta-analysis assessed specificity, sensitivity, and conducted hierarchical summary receiver operating characteristic curve (HSROC) analysis. Results Predominantly conducted in China (29.41%), the studies involved 14,524 participants. In the analysis, 11.76% (N = 2) focused on ML, while 88.24% (N = 15) were dedicated to deep DL. Meta-analysis revealed a sensitivity of 0.91 (95% CI = 0.86-0.95), consistent specificity of 0.90 (95% CI = 0.86-0.93), with a false positive rate of 0.097 (95% CI = 0.068-0.137). Conclusion The study underscores consistent specificity and sensitivity estimates, affirming the diagnostic test's robustness. However, the broader context of ML applications in TLIs emphasizes the critical need for standardization in methodologies to enhance clinical utility.
Collapse
Affiliation(s)
- Hakija Bečulić
- Department of Neurosurgery, Cantonal Hospital Zenica, Crkvice 67, 72000, Zenica, Bosnia and Herzegovina
- Department of Anatomy, School of Medicine, University of Zenica, Travnička 1, 72000, Zenica, Bosnia and Herzegovina
| | - Emir Begagić
- Department of General Medicine, School of Medicine, University of Zenica, Travnička 1, 72000, Zenica, Bosnia and Herzegovina
| | - Amina Džidić-Krivić
- Department of Neurology, Cantonal Hospital Zenica, Crkvice 67, 72000, Zenica, Bosnia and Herzegovina
| | - Ragib Pugonja
- Department of Anatomy, School of Medicine, University of Zenica, Travnička 1, 72000, Zenica, Bosnia and Herzegovina
| | - Namira Softić
- Department of Neurosurgery, Cantonal Hospital Zenica, Crkvice 67, 72000, Zenica, Bosnia and Herzegovina
| | - Binasa Bašić
- Department of Neurology, General Hospital Travnik, Kalibunar Bb, 72270, Travnik, Bosnia and Herzegovina
| | - Simon Balogun
- Division of Neurosurgery, Department of Surgery, Obafemi Awolowo University Teaching Hospitals Complex, Ilesa Road PMB 5538, 220282, Ile-Ife, Nigeria
| | - Adem Nuhović
- Department of General Medicine, School of Medicine, University of Sarajevo, Univerzitetska 1, 71000, Sarajevo, Bosnia and Herzegovina
| | - Emir Softić
- Department of Patophysiology, School of Medicine, University of Zenica, Travnička 1, 72000, Zenica, Bosnia and Herzegovina
| | - Adnana Ljevaković
- Department of Neurology, General Hospital Travnik, Kalibunar Bb, 72270, Travnik, Bosnia and Herzegovina
| | - Haso Sefo
- Neurosurgery Clinic, University Clinical Center Sarajevo, Bolnička 25, 71000, Sarajevo, Bosnia and Herzegovina
| | - Sabina Šegalo
- Department of Laboratory Technologies, Faculty of Health Siences, University of Sarajevo, Stjepana Tomića 1, 71000, Sarajevo, Bosnia and Herzegovina
| | - Rasim Skomorac
- Department of Anatomy, School of Medicine, University of Zenica, Travnička 1, 72000, Zenica, Bosnia and Herzegovina
- Department of Surgery, School of Medicine, University of Zenica, Travnička 1, 72000, Zenica, Bosnia and Herzegovina
| | - Mirza Pojskić
- Department of Neurosurgery, University Hospital Marburg, Baldingerstr., 35033, Marburg, Germany
| |
Collapse
|
2
|
Buyck F, Vandemeulebroucke J, Ceranka J, Van Gestel F, Cornelius JF, Duerinck J, Bruneau M. Computer-vision based analysis of the neurosurgical scene - A systematic review. BRAIN & SPINE 2023; 3:102706. [PMID: 38020988 PMCID: PMC10668095 DOI: 10.1016/j.bas.2023.102706] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Revised: 10/23/2023] [Accepted: 10/29/2023] [Indexed: 12/01/2023]
Abstract
Introduction With increasing use of robotic surgical adjuncts, artificial intelligence and augmented reality in neurosurgery, the automated analysis of digital images and videos acquired over various procedures becomes a subject of increased interest. While several computer vision (CV) methods have been developed and implemented for analyzing surgical scenes, few studies have been dedicated to neurosurgery. Research question In this work, we present a systematic literature review focusing on CV methodologies specifically applied to the analysis of neurosurgical procedures based on intra-operative images and videos. Additionally, we provide recommendations for the future developments of CV models in neurosurgery. Material and methods We conducted a systematic literature search in multiple databases until January 17, 2023, including Web of Science, PubMed, IEEE Xplore, Embase, and SpringerLink. Results We identified 17 studies employing CV algorithms on neurosurgical videos/images. The most common applications of CV were tool and neuroanatomical structure detection or characterization, and to a lesser extent, surgical workflow analysis. Convolutional neural networks (CNN) were the most frequently utilized architecture for CV models (65%), demonstrating superior performances in tool detection and segmentation. In particular, mask recurrent-CNN manifested most robust performance outcomes across different modalities. Discussion and conclusion Our systematic review demonstrates that CV models have been reported that can effectively detect and differentiate tools, surgical phases, neuroanatomical structures, as well as critical events in complex neurosurgical scenes with accuracies above 95%. Automated tool recognition contributes to objective characterization and assessment of surgical performance, with potential applications in neurosurgical training and intra-operative safety management.
Collapse
Affiliation(s)
- Félix Buyck
- Department of Neurosurgery, Universitair Ziekenhuis Brussel (UZ Brussel), 1090, Brussels, Belgium
- Vrije Universiteit Brussel (VUB), Research group Center For Neurosciences (C4N-NEUR), 1090, Brussels, Belgium
| | - Jef Vandemeulebroucke
- Vrije Universiteit Brussel (VUB), Department of Electronics and Informatics (ETRO), 1050, Brussels, Belgium
- Department of Radiology, Universitair Ziekenhuis Brussel (UZ Brussel), 1090, Brussels, Belgium
- imec, 3001, Leuven, Belgium
| | - Jakub Ceranka
- Vrije Universiteit Brussel (VUB), Department of Electronics and Informatics (ETRO), 1050, Brussels, Belgium
- imec, 3001, Leuven, Belgium
| | - Frederick Van Gestel
- Department of Neurosurgery, Universitair Ziekenhuis Brussel (UZ Brussel), 1090, Brussels, Belgium
- Vrije Universiteit Brussel (VUB), Research group Center For Neurosciences (C4N-NEUR), 1090, Brussels, Belgium
| | - Jan Frederick Cornelius
- Department of Neurosurgery, Medical Faculty, Heinrich-Heine-University, 40225, Düsseldorf, Germany
| | - Johnny Duerinck
- Department of Neurosurgery, Universitair Ziekenhuis Brussel (UZ Brussel), 1090, Brussels, Belgium
- Vrije Universiteit Brussel (VUB), Research group Center For Neurosciences (C4N-NEUR), 1090, Brussels, Belgium
| | - Michaël Bruneau
- Department of Neurosurgery, Universitair Ziekenhuis Brussel (UZ Brussel), 1090, Brussels, Belgium
- Vrije Universiteit Brussel (VUB), Research group Center For Neurosciences (C4N-NEUR), 1090, Brussels, Belgium
| |
Collapse
|
3
|
Ortiz AV, Feldman MJ, Yengo-Kahn AM, Roth SG, Dambrino RJ, Chitale RV, Chambless LB. Words matter: using natural language processing to predict neurosurgical residency match outcomes. J Neurosurg 2023; 138:559-566. [PMID: 35901704 DOI: 10.3171/2022.5.jns22558] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2022] [Accepted: 05/10/2022] [Indexed: 02/04/2023]
Abstract
OBJECTIVE Narrative letters of recommendation (NLORs) are considered by neurosurgical program directors to be among the most important parts of the residency application. However, the utility of these NLORs in predicting match outcomes compared to objective measures has not been determined. In this study, the authors compare the performance of machine learning models trained on applicant NLORs and demographic data to predict match outcomes and investigate whether narrative language is predictive of standardized letter of recommendation (SLOR) rankings. METHODS This study analyzed 1498 NLORs from 391 applications submitted to a single neurosurgery residency program over the 2020-2021 cycle. Applicant demographics and match outcomes were extracted from Electronic Residency Application Service applications and training program websites. Logistic regression models using least absolute shrinkage and selection operator were trained to predict match outcomes using applicant NLOR text and demographics. Another model was trained on NLOR text to predict SLOR rankings. Model performance was estimated using area under the curve (AUC). RESULTS Both the NLOR and demographics models were able to discriminate similarly between match outcomes (AUCs 0.75 and 0.80; p = 0.13). Words including "outstanding," "seamlessly," and "AOA" (Alpha Omega Alpha) were predictive of match success. This model was able to predict SLORs ranked in the top 5%. Words including "highest," "outstanding," and "best" were predictive of the top 5% SLORs. CONCLUSIONS NLORs and demographic data similarly discriminate whether applicants will or will not match into a neurosurgical residency program. However, NLORs potentially provide further insight regarding applicant fit. Because words used in NLORs are predictive of both match outcomes and SLOR rankings, continuing to include narrative evaluations may be invaluable to the match process.
Collapse
Affiliation(s)
| | - Michael J Feldman
- 2Department of Neurological Surgery, Vanderbilt University Medical Center, Nashville, Tennessee
| | - Aaron M Yengo-Kahn
- 2Department of Neurological Surgery, Vanderbilt University Medical Center, Nashville, Tennessee
| | - Steven G Roth
- 2Department of Neurological Surgery, Vanderbilt University Medical Center, Nashville, Tennessee
| | - Robert J Dambrino
- 2Department of Neurological Surgery, Vanderbilt University Medical Center, Nashville, Tennessee
| | - Rohan V Chitale
- 2Department of Neurological Surgery, Vanderbilt University Medical Center, Nashville, Tennessee
| | - Lola B Chambless
- 2Department of Neurological Surgery, Vanderbilt University Medical Center, Nashville, Tennessee
| |
Collapse
|
4
|
Iqbal J, Jahangir K, Mashkoor Y, Sultana N, Mehmood D, Ashraf M, Iqbal A, Hafeez MH. The future of artificial intelligence in neurosurgery: A narrative review. Surg Neurol Int 2022; 13:536. [DOI: 10.25259/sni_877_2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2022] [Accepted: 10/27/2022] [Indexed: 11/19/2022] Open
Abstract
Background:
Artificial intelligence (AI) and machine learning (ML) algorithms are on the tremendous rise for being incorporated into the field of neurosurgery. AI and ML algorithms are different from other technological advances as giving the capability for the computer to learn, reason, and problem-solving skills that a human inherits. This review summarizes the current use of AI in neurosurgery, the challenges that need to be addressed, and what the future holds.
Methods:
A literature review was carried out with a focus on the use of AI in the field of neurosurgery and its future implication in neurosurgical research.
Results:
The online literature on the use of AI in the field of neurosurgery shows the diversity of topics in terms of its current and future implications. The main areas that are being studied are diagnostic, outcomes, and treatment models.
Conclusion:
Wonders of AI in the field of medicine and neurosurgery hold true, yet there are a lot of challenges that need to be addressed before its implications can be seen in the field of neurosurgery from patient privacy, to access to high-quality data and overreliance on surgeons on AI. The future of AI in neurosurgery is pointed toward a patient-centric approach, managing clinical tasks, and helping in diagnosing and preoperative assessment of the patients.
Collapse
Affiliation(s)
- Javed Iqbal
- School of Medicine, King Edward Medical University Lahore, Punjab, Pakistan,
| | - Kainat Jahangir
- School of Medicine, Dow University of Health Sciences, Karachi, Sindh, Pakistan,
| | - Yusra Mashkoor
- Department of Internal Medicine, Dow University of Health Sciences, Karachi, Sindh, Pakistan,
| | - Nazia Sultana
- School of Medicine, Government Medical College, Siddipet, Telangana, India,
| | - Dalia Mehmood
- Department of Community Medicine, Fatima Jinnah Medical University, Lahore, Punjab, Pakistan,
| | - Mohammad Ashraf
- Wolfson School of Medicine, University of Glasgow, Scotland, United Kingdom,
| | - Ather Iqbal
- House Officer, Holy Family Hospital Rawalpindi, Punjab, Pakistan,
| | | |
Collapse
|
5
|
Danilov GV, Ishankulov TA, Kotik KV, Shifrin MA, Potapov AA. [Artificial intelligence technologies in clinical neurooncology]. ZHURNAL VOPROSY NEIROKHIRURGII IMENI N. N. BURDENKO 2022; 86:127-133. [PMID: 36534634 DOI: 10.17116/neiro202286061127] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
Neurooncology in the 21st century is a complex discipline integrating achievements of fundamental and applied neurosciences. Complex processes and data in clinical neurooncology determine the necessity for advanced methods of mathematical modeling and predictive analytics to obtain new scientific knowledge. Such methods are currently being developed in computer science (artificial intelligence). This review is devoted to potential and range of possible applications of artificial intelligence technologies in neurooncology with a special emphasis on glial tumors. Our conclusions may be valid for other areas of clinical medicine.
Collapse
Affiliation(s)
- G V Danilov
- Burdenko Neurosurgical Center, Moscow, Russia
| | | | - K V Kotik
- Burdenko Neurosurgical Center, Moscow, Russia
| | - M A Shifrin
- Burdenko Neurosurgical Center, Moscow, Russia
| | - A A Potapov
- Burdenko Neurosurgical Center, Moscow, Russia
| |
Collapse
|