1
|
Artha Wiguna IGLNA, Kristian Y, Deslivia MF, Limantara R, Cahyadi D, Liando IA, Hamzah HA, Kusuman K, Dimitri D, Anastasia M, Suyasa IK. A deep learning approach for cervical cord injury severity determination through axial and sagittal magnetic resonance imaging segmentation and classification. EUROPEAN SPINE JOURNAL : OFFICIAL PUBLICATION OF THE EUROPEAN SPINE SOCIETY, THE EUROPEAN SPINAL DEFORMITY SOCIETY, AND THE EUROPEAN SECTION OF THE CERVICAL SPINE RESEARCH SOCIETY 2024:10.1007/s00586-024-08464-7. [PMID: 39198286 DOI: 10.1007/s00586-024-08464-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/14/2023] [Revised: 07/30/2024] [Accepted: 08/20/2024] [Indexed: 09/01/2024]
Abstract
STUDY DESIGN Cross-sectional Database Study. OBJECTIVE While the American Spinal Injury Association (ASIA) Impairment Scale is the standard for assessing spinal cord injuries (SCI), it has limitations due to subjectivity and impracticality. Advances in machine learning (ML) and image recognition have spurred research into their use for outcome prediction. This study aims to analyze deep learning techniques for identifying and classifying cervical SCI severity from MRI scans. METHODS The study included patients with traumatic and nontraumatic cervical SCI admitted from 2019 to 2022. MRI images were labeled by two senior resident physicians. A deep convolutional neural network was trained using axial and sagittal cervical MRI images from the dataset. Model performance was assessed using Dice Score and IoU to measure segmentation accuracy by comparing predicted and ground truth masks. Classification accuracy was evaluated with the F1 Score, balancing false positives and negatives. RESULT In the axial spinal cord segmentation, we achieved a Dice score of 0.94 for and IoU score of 0.89. In the sagittal spinal cord segmentation, we obtained Dice score up to 0.9201 and IoU scores up to 0.8541. The model for axial image score classification gave a satisfactory result with an F1 score of 0.72 and AUC of 0.79. CONCLUSION Our models successfully identified cervical SCI on T2-weighted MR images with satisfactory performance. Further research is needed to develop more advanced models for predicting patient outcomes in SCI cases.
Collapse
Affiliation(s)
| | - Yosi Kristian
- Institut Sains dan Teknologi Terpadu Surabaya, Surabaya, East Java, Indonesia
| | | | - Rudi Limantara
- Institut Sains dan Teknologi Terpadu Surabaya, Surabaya, East Java, Indonesia
| | - David Cahyadi
- Institut Sains dan Teknologi Terpadu Surabaya, Surabaya, East Java, Indonesia
| | - Ivan Alexander Liando
- Department of Orthopaedic Surgery, Udayana University, Prof I G N G Ngoerah Hospital Jl. Diponegoro, Dauh Puri Klod, Denpasar, Bali, 80113, Indonesia
| | - Hendra Aryudi Hamzah
- Department of Orthopaedic Surgery, Udayana University, Prof I G N G Ngoerah Hospital Jl. Diponegoro, Dauh Puri Klod, Denpasar, Bali, 80113, Indonesia
| | - Kevin Kusuman
- Department of Orthopaedic Surgery, Udayana University, Prof I G N G Ngoerah Hospital Jl. Diponegoro, Dauh Puri Klod, Denpasar, Bali, 80113, Indonesia
| | - Dominicus Dimitri
- Department of Orthopaedic Surgery, Udayana University, Prof I G N G Ngoerah Hospital Jl. Diponegoro, Dauh Puri Klod, Denpasar, Bali, 80113, Indonesia
| | - Maria Anastasia
- Department of Orthopaedic Surgery, Udayana University, Prof I G N G Ngoerah Hospital Jl. Diponegoro, Dauh Puri Klod, Denpasar, Bali, 80113, Indonesia
| | - I Ketut Suyasa
- Department of Orthopaedic Surgery, Udayana University, Prof I G N G Ngoerah Hospital Jl. Diponegoro, Dauh Puri Klod, Denpasar, Bali, 80113, Indonesia
| |
Collapse
|
2
|
Sastry RA, Setty A, Liu DD, Zheng B, Ali R, Weil RJ, Roye GD, Doberstein CE, Oyelese AA, Niu T, Gokaslan ZL, Telfeian AE. Natural language processing augments comorbidity documentation in neurosurgical inpatient admissions. PLoS One 2024; 19:e0303519. [PMID: 38723044 PMCID: PMC11081267 DOI: 10.1371/journal.pone.0303519] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2022] [Accepted: 04/04/2024] [Indexed: 05/13/2024] Open
Abstract
OBJECTIVE To establish whether or not a natural language processing technique could identify two common inpatient neurosurgical comorbidities using only text reports of inpatient head imaging. MATERIALS AND METHODS A training and testing dataset of reports of 979 CT or MRI scans of the brain for patients admitted to the neurosurgery service of a single hospital in June 2021 or to the Emergency Department between July 1-8, 2021, was identified. A variety of machine learning and deep learning algorithms utilizing natural language processing were trained on the training set (84% of the total cohort) and tested on the remaining images. A subset comparison cohort (n = 76) was then assessed to compare output of the best algorithm against real-life inpatient documentation. RESULTS For "brain compression", a random forest classifier outperformed other candidate algorithms with an accuracy of 0.81 and area under the curve of 0.90 in the testing dataset. For "brain edema", a random forest classifier again outperformed other candidate algorithms with an accuracy of 0.92 and AUC of 0.94 in the testing dataset. In the provider comparison dataset, for "brain compression," the random forest algorithm demonstrated better accuracy (0.76 vs 0.70) and sensitivity (0.73 vs 0.43) than provider documentation. For "brain edema," the algorithm again demonstrated better accuracy (0.92 vs 0.84) and AUC (0.45 vs 0.09) than provider documentation. DISCUSSION A natural language processing-based machine learning algorithm can reliably and reproducibly identify selected common neurosurgical comorbidities from radiology reports. CONCLUSION This result may justify the use of machine learning-based decision support to augment provider documentation.
Collapse
Affiliation(s)
- Rahul A. Sastry
- Department of Neurosurgery, Warren Alpert Medical School, Rhode Island Hospital, Brown University, Providence, RI, United States of America
| | - Aayush Setty
- Department of Neurosurgery, Warren Alpert Medical School, Rhode Island Hospital, Brown University, Providence, RI, United States of America
- Department of Computer Science, Brown University, Providence, RI, United States of America
| | - David D. Liu
- Department of Neurosurgery, Warren Alpert Medical School, Rhode Island Hospital, Brown University, Providence, RI, United States of America
| | - Bryan Zheng
- Department of Neurosurgery, Warren Alpert Medical School, Rhode Island Hospital, Brown University, Providence, RI, United States of America
| | - Rohaid Ali
- Department of Neurosurgery, Warren Alpert Medical School, Rhode Island Hospital, Brown University, Providence, RI, United States of America
| | - Robert J. Weil
- Department of Neurosurgery, Brain & Spine, Southcoast Health, Dartmouth, MA, United States of America
| | - G. Dean Roye
- Department of Surgery, Warren Alpert Medical School, Rhode Island Hospital, Brown University, Providence, RI, United States of America
| | - Curtis E. Doberstein
- Department of Neurosurgery, Warren Alpert Medical School, Rhode Island Hospital, Brown University, Providence, RI, United States of America
| | - Adetokunbo A. Oyelese
- Department of Neurosurgery, Warren Alpert Medical School, Rhode Island Hospital, Brown University, Providence, RI, United States of America
| | - Tianyi Niu
- Department of Neurosurgery, Warren Alpert Medical School, Rhode Island Hospital, Brown University, Providence, RI, United States of America
| | - Ziya L. Gokaslan
- Department of Neurosurgery, Warren Alpert Medical School, Rhode Island Hospital, Brown University, Providence, RI, United States of America
| | - Albert E. Telfeian
- Department of Neurosurgery, Warren Alpert Medical School, Rhode Island Hospital, Brown University, Providence, RI, United States of America
| |
Collapse
|
3
|
Toh ZA, Berg B, Han QYC, Hey HWD, Pikkarainen M, Grotle M, He HG. Clinical Decision Support System Used in Spinal Disorders: Scoping Review. J Med Internet Res 2024; 26:e53951. [PMID: 38502157 PMCID: PMC10988379 DOI: 10.2196/53951] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2023] [Revised: 01/29/2024] [Accepted: 02/10/2024] [Indexed: 03/20/2024] Open
Abstract
BACKGROUND Spinal disorders are highly prevalent worldwide with high socioeconomic costs. This cost is associated with the demand for treatment and productivity loss, prompting the exploration of technologies to improve patient outcomes. Clinical decision support systems (CDSSs) are computerized systems that are increasingly used to facilitate safe and efficient health care. Their applications range in depth and can be found across health care specialties. OBJECTIVE This scoping review aims to explore the use of CDSSs in patients with spinal disorders. METHODS We used the Joanna Briggs Institute methodological guidance for this scoping review and reported according to the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) statement. Databases, including PubMed, Embase, Cochrane, CINAHL, Web of Science, Scopus, ProQuest, and PsycINFO, were searched from inception until October 11, 2022. The included studies examined the use of digitalized CDSSs in patients with spinal disorders. RESULTS A total of 4 major CDSS functions were identified from 31 studies: preventing unnecessary imaging (n=8, 26%), aiding diagnosis (n=6, 19%), aiding prognosis (n=11, 35%), and recommending treatment options (n=6, 20%). Most studies used the knowledge-based system. Logistic regression was the most commonly used method, followed by decision tree algorithms. The use of CDSSs to aid in the management of spinal disorders was generally accepted over the threat to physicians' clinical decision-making autonomy. CONCLUSIONS Although the effectiveness was frequently evaluated by examining the agreement between the decisions made by the CDSSs and the health care providers, comparing the CDSS recommendations with actual clinical outcomes would be preferable. In addition, future studies on CDSS development should focus on system integration, considering end user's needs and preferences, and external validation and impact studies to assess effectiveness and generalizability. TRIAL REGISTRATION OSF Registries osf.io/dyz3f; https://osf.io/dyz3f.
Collapse
Affiliation(s)
- Zheng An Toh
- National University Hospital, National University Health System, Singapore, Singapore
| | - Bjørnar Berg
- Centre for Intelligent Musculoskeletal Health, Faculty of Health Sciences, Oslo Metropolitan University, Oslo, Norway
| | | | - Hwee Weng Dennis Hey
- Division of Orthopaedic Surgery, National University Hospital, National University Health System, Singapore, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Minna Pikkarainen
- Department of Rehabilitation and Health Technology, Oslo Metropolitan University, Oslo, Norway
- Martti Ahtisaari Institute, Oulu Business School, Oulu University, Oulu, Finland
- Department of Product Design, Oslo Metropolitan University, Oslo, Norway
| | - Margreth Grotle
- Centre for Intelligent Musculoskeletal Health, Faculty of Health Sciences, Oslo Metropolitan University, Oslo, Norway
- Department of Research and Innovation, Division of Clinical Neuroscience, Oslo University Hospital, Oslo, Norway
| | - Hong-Gu He
- Alice Lee Centre for Nursing Studies, Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| |
Collapse
|
4
|
Bharadwaj UU, Chin CT, Majumdar S. Practical Applications of Artificial Intelligence in Spine Imaging: A Review. Radiol Clin North Am 2024; 62:355-370. [PMID: 38272627 DOI: 10.1016/j.rcl.2023.10.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2024]
Abstract
Artificial intelligence (AI), a transformative technology with unprecedented potential in medical imaging, can be applied to various spinal pathologies. AI-based approaches may improve imaging efficiency, diagnostic accuracy, and interpretation, which is essential for positive patient outcomes. This review explores AI algorithms, techniques, and applications in spine imaging, highlighting diagnostic impact and challenges with future directions for integrating AI into spine imaging workflow.
Collapse
Affiliation(s)
- Upasana Upadhyay Bharadwaj
- Department of Radiology and Biomedical Imaging, University of California San Francisco, 1700 4th Street, Byers Hall, Suite 203, Room 203D, San Francisco, CA 94158, USA
| | - Cynthia T Chin
- Department of Radiology and Biomedical Imaging, University of California San Francisco, 505 Parnassus Avenue, Box 0628, San Francisco, CA 94143, USA.
| | - Sharmila Majumdar
- Department of Radiology and Biomedical Imaging, University of California San Francisco, 1700 4th Street, Byers Hall, Suite 203, Room 203D, San Francisco, CA 94158, USA
| |
Collapse
|
5
|
Yi W, Zhao J, Tang W, Yin H, Yu L, Wang Y, Tian W. Deep learning-based high-accuracy detection for lumbar and cervical degenerative disease on T2-weighted MR images. EUROPEAN SPINE JOURNAL : OFFICIAL PUBLICATION OF THE EUROPEAN SPINE SOCIETY, THE EUROPEAN SPINAL DEFORMITY SOCIETY, AND THE EUROPEAN SECTION OF THE CERVICAL SPINE RESEARCH SOCIETY 2023; 32:3807-3814. [PMID: 36943484 DOI: 10.1007/s00586-023-07641-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/24/2022] [Revised: 01/31/2023] [Accepted: 03/05/2023] [Indexed: 03/23/2023]
Abstract
PURPOSE To develop and validate a deep learning (DL) model for detecting lumbar degenerative disease in both sagittal and axial views of T2-weighted MRI and evaluate its generalized performance in detecting cervical degenerative disease. METHODS T2-weighted MRI scans of 804 patients with symptoms of lumbar degenerative disease were retrospectively collected from three hospitals. The training dataset (n = 456) and internal validation dataset (n = 134) were randomly selected from the center I. Two external validation datasets comprising 100 and 114 patients were from center II and center III, respectively. A DL model based on 3D ResNet18 and transformer architecture was proposed to detect lumbar degenerative disease. In addition, a cervical MR image dataset comprising 200 patients from an independent hospital was used to evaluate the generalized performance of the DL model. The diagnostic performance was assessed by the free-response receiver operating characteristic (fROC) curve and precision-recall (PR) curve. Precision, recall, and F1-score were used to measure the DL model. RESULTS A total of 2497 three-dimension retrogression annotations were labeled for training (n = 1157) and multicenter validation (n = 1340). The DL model showed excellent detection efficiency in the internal validation dataset, with F1-score achieving 0.971 and 0.903 on the sagittal and axial MR images, respectively. Good performance was also observed in the external validation dataset I (F1-score, 0.768 on sagittal MR images and 0.837 on axial MR images) and external validation dataset II (F1-score, 0.787 on sagittal MR images and 0.770 on axial MR images). Furthermore, the robustness of the DL model was demonstrated via transfer learning and generalized performance evaluation on the external cervical dataset, with the F1-score yielding 0.931 and 0.919 on the sagittal and axial MR images, respectively. CONCLUSION The proposed DL model can automatically detect lumbar and cervical degenerative disease on T2-weighted MR images with good performance, robustness, and feasibility in clinical practice.
Collapse
Affiliation(s)
- Wei Yi
- Department of Spine Surgery, Beijing Jishuitan Hospital, Beijing, 100035, China.
| | - Jingwei Zhao
- Beijing Jishuitan Hospital, Research Unit of Intelligent Orthopedics, Chinese Academy of Medical Sciences, Beijing, China.
| | - Wen Tang
- Institute of Advanced Research, Infervision Medical Technology Co., Ltd, Beijing, Beijing, China
| | - Hongkun Yin
- Institute of Advanced Research, Infervision Medical Technology Co., Ltd, Beijing, Beijing, China
| | - Lifeng Yu
- The Second Hospital of Zhangjiakou City, Zhangjiakou, Hebei Province, China
| | - Yaohui Wang
- Department of Trauma, Beijing Water Conservancy Hospital, Beijing, 10036, China
| | - Wei Tian
- Beijing Jishuitan Hospital, Research Unit of Intelligent Orthopedics, Chinese Academy of Medical Sciences, Beijing, China
| |
Collapse
|
6
|
Alsoof D, McDonald CL, Kuris EO, Daniels AH. Machine Learning for the Orthopaedic Surgeon: Uses and Limitations. J Bone Joint Surg Am 2022; 104:1586-1594. [PMID: 35383655 DOI: 10.2106/jbjs.21.01305] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
➤ Machine learning is a subset of artificial intelligence in which computer algorithms are trained to make classifications and predictions based on patterns in data. The utilization of these techniques is rapidly expanding in the field of orthopaedic research. ➤ There are several domains in which machine learning has application to orthopaedics, including radiographic diagnosis, gait analysis, implant identification, and patient outcome prediction. ➤ Several limitations prevent the widespread use of machine learning in the daily clinical environment. However, future work can overcome these issues and enable machine learning tools to be a useful adjunct for orthopaedic surgeons in their clinical decision-making.
Collapse
Affiliation(s)
- Daniel Alsoof
- Department of Orthopedic Surgery, Warren Alpert Medical School of Brown University, Providence, Rhode Island
| | | | | | | |
Collapse
|
7
|
Ong W, Zhu L, Zhang W, Kuah T, Lim DSW, Low XZ, Thian YL, Teo EC, Tan JH, Kumar N, Vellayappan BA, Ooi BC, Quek ST, Makmur A, Hallinan JTPD. Application of Artificial Intelligence Methods for Imaging of Spinal Metastasis. Cancers (Basel) 2022; 14:4025. [PMID: 36011018 PMCID: PMC9406500 DOI: 10.3390/cancers14164025] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2022] [Revised: 08/10/2022] [Accepted: 08/15/2022] [Indexed: 11/16/2022] Open
Abstract
Spinal metastasis is the most common malignant disease of the spine. Recently, major advances in machine learning and artificial intelligence technology have led to their increased use in oncological imaging. The purpose of this study is to review and summarise the present evidence for artificial intelligence applications in the detection, classification and management of spinal metastasis, along with their potential integration into clinical practice. A systematic, detailed search of the main electronic medical databases was undertaken in concordance with the PRISMA guidelines. A total of 30 articles were retrieved from the database and reviewed. Key findings of current AI applications were compiled and summarised. The main clinical applications of AI techniques include image processing, diagnosis, decision support, treatment assistance and prognostic outcomes. In the realm of spinal oncology, artificial intelligence technologies have achieved relatively good performance and hold immense potential to aid clinicians, including enhancing work efficiency and reducing adverse events. Further research is required to validate the clinical performance of the AI tools and facilitate their integration into routine clinical practice.
Collapse
Affiliation(s)
- Wilson Ong
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd., Singapore 119074, Singapore
| | - Lei Zhu
- Department of Computer Science, School of Computing, National University of Singapore, 13 Computing Drive, Singapore 117417, Singapore
| | - Wenqiao Zhang
- Department of Computer Science, School of Computing, National University of Singapore, 13 Computing Drive, Singapore 117417, Singapore
| | - Tricia Kuah
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd., Singapore 119074, Singapore
| | - Desmond Shi Wei Lim
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd., Singapore 119074, Singapore
| | - Xi Zhen Low
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd., Singapore 119074, Singapore
| | - Yee Liang Thian
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd., Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - Ee Chin Teo
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd., Singapore 119074, Singapore
| | - Jiong Hao Tan
- University Spine Centre, Department of Orthopaedic Surgery, National University Health System, 1E, Lower Kent Ridge Road, Singapore 119228, Singapore
| | - Naresh Kumar
- University Spine Centre, Department of Orthopaedic Surgery, National University Health System, 1E, Lower Kent Ridge Road, Singapore 119228, Singapore
| | - Balamurugan A. Vellayappan
- Department of Radiation Oncology, National University Cancer Institute Singapore, National University Hospital, Singapore 119074, Singapore
| | - Beng Chin Ooi
- Department of Computer Science, School of Computing, National University of Singapore, 13 Computing Drive, Singapore 117417, Singapore
| | - Swee Tian Quek
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd., Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - Andrew Makmur
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd., Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - James Thomas Patrick Decourcy Hallinan
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd., Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| |
Collapse
|
8
|
Hallinan JTPD, Zhu L, Zhang W, Lim DSW, Baskar S, Low XZ, Yeong KY, Teo EC, Kumarakulasinghe NB, Yap QV, Chan YH, Lin S, Tan JH, Kumar N, Vellayappan BA, Ooi BC, Quek ST, Makmur A. Deep Learning Model for Classifying Metastatic Epidural Spinal Cord Compression on MRI. Front Oncol 2022; 12:849447. [PMID: 35600347 PMCID: PMC9114468 DOI: 10.3389/fonc.2022.849447] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2022] [Accepted: 03/18/2022] [Indexed: 11/13/2022] Open
Abstract
Background Metastatic epidural spinal cord compression (MESCC) is a devastating complication of advanced cancer. A deep learning (DL) model for automated MESCC classification on MRI could aid earlier diagnosis and referral. Purpose To develop a DL model for automated classification of MESCC on MRI. Materials and Methods Patients with known MESCC diagnosed on MRI between September 2007 and September 2017 were eligible. MRI studies with instrumentation, suboptimal image quality, and non-thoracic regions were excluded. Axial T2-weighted images were utilized. The internal dataset split was 82% and 18% for training/validation and test sets, respectively. External testing was also performed. Internal training/validation data were labeled using the Bilsky MESCC classification by a musculoskeletal radiologist (10-year experience) and a neuroradiologist (5-year experience). These labels were used to train a DL model utilizing a prototypical convolutional neural network. Internal and external test sets were labeled by the musculoskeletal radiologist as the reference standard. For assessment of DL model performance and interobserver variability, test sets were labeled independently by the neuroradiologist (5-year experience), a spine surgeon (5-year experience), and a radiation oncologist (11-year experience). Inter-rater agreement (Gwet’s kappa) and sensitivity/specificity were calculated. Results Overall, 215 MRI spine studies were analyzed [164 patients, mean age = 62 ± 12(SD)] with 177 (82%) for training/validation and 38 (18%) for internal testing. For internal testing, the DL model and specialists all showed almost perfect agreement (kappas = 0.92–0.98, p < 0.001) for dichotomous Bilsky classification (low versus high grade) compared to the reference standard. Similar performance was seen for external testing on a set of 32 MRI spines with the DL model and specialists all showing almost perfect agreement (kappas = 0.94–0.95, p < 0.001) compared to the reference standard. Conclusion A DL model showed comparable agreement to a subspecialist radiologist and clinical specialists for the classification of malignant epidural spinal cord compression and could optimize earlier diagnosis and surgical referral.
Collapse
Affiliation(s)
- James Thomas Patrick Decourcy Hallinan
- Department of Diagnostic Imaging, National University Hospital, Singapore, Singapore.,Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Lei Zhu
- NUS Graduate School, Integrative Sciences and Engineering Programme, National University of Singapore, Singapore, Singapore
| | - Wenqiao Zhang
- Department of Computer Science, School of Computing, National University of Singapore, Singapore, Singapore
| | - Desmond Shi Wei Lim
- Department of Diagnostic Imaging, National University Hospital, Singapore, Singapore.,Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Sangeetha Baskar
- Department of Diagnostic Imaging, National University Hospital, Singapore, Singapore
| | - Xi Zhen Low
- Department of Diagnostic Imaging, National University Hospital, Singapore, Singapore.,Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Kuan Yuen Yeong
- Department of Radiology, Ng Teng Fong General Hospital, Singapore, Singapore
| | - Ee Chin Teo
- Department of Diagnostic Imaging, National University Hospital, Singapore, Singapore
| | | | - Qai Ven Yap
- Biostatistics Unit, Yong Loo Lin School of Medicine, Singapore, Singapore
| | - Yiong Huak Chan
- Biostatistics Unit, Yong Loo Lin School of Medicine, Singapore, Singapore
| | - Shuxun Lin
- Division of Spine Surgery, Department of Orthopaedic Surgery, Ng Teng Fong General Hospital, Singapore, Singapore
| | - Jiong Hao Tan
- University Spine Centre, Department of Orthopaedic Surgery, National University Health System, Singapore, Singapore
| | - Naresh Kumar
- University Spine Centre, Department of Orthopaedic Surgery, National University Health System, Singapore, Singapore
| | - Balamurugan A Vellayappan
- Department of Radiation Oncology, National University Cancer Institute Singapore, National University Hospital, Singapore, Singapore
| | - Beng Chin Ooi
- Department of Computer Science, School of Computing, National University of Singapore, Singapore, Singapore
| | - Swee Tian Quek
- Department of Diagnostic Imaging, National University Hospital, Singapore, Singapore.,Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Andrew Makmur
- Department of Diagnostic Imaging, National University Hospital, Singapore, Singapore.,Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| |
Collapse
|
9
|
Pokorny G, Amaral R, Pratali R, Acácio R, Romeiro C, Magno MV, Daher M, Herrero CFPS. PRESENTATION OF THE MULTICENTRIC COLLECTION SPINE SURGERY DATABASE. COLUNA/COLUMNA 2022. [DOI: 10.1590/s1808-185120222104261485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022] Open
Abstract
ABSTRACT Objectives: To present the Spine Surgery Database developed by the Brazilian Spine Study Group and the methodology involved in its creation, in addition to presenting initial informationabout the use of the database. Methods: Description of the steps for selecting the questionnaires and variables to be included in the database, initial expansion of the use of the database tophysicians close to the BSSG, a brief exploration of quality control and methods for the inclusion ofnew centers, and training on the database, in addition to a brief descriptionof some of the data included in the database. Results: Currently, the database includes 428 patients who already underwent spine surgery and 9 collection centers with at least one patient collected. Conclusion: The Brazilian Spine Study Group’s Multicentric Collection Database is a viable tool that allows patients from different sourcesto be included within a common flow. Level of Evidence V; Expert opinion.
Collapse
Affiliation(s)
| | | | | | - Ricardo Acácio
- Instituto de Ortopedia e Traumatologia de Joinville, Brazil
| | | | | | - Murilo Daher
- Centro de Reabilitação e Readaptação Dr. Henrique Santillo, Brazil
| | | |
Collapse
|