1
|
Song K, Zhu W, Zhang Z, Liu B, Zhang M, Tang T, Liang J, Wu W. Synthetic lumbar MRI can aid in diagnosis and treatment strategies based on self-pix networks. Sci Rep 2024; 14:20382. [PMID: 39223186 PMCID: PMC11368963 DOI: 10.1038/s41598-024-71288-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2024] [Accepted: 08/27/2024] [Indexed: 09/04/2024] Open
Abstract
CT and MR tools are commonly used to diagnose lumbar fractures (LF). However, numerous limitations have been found in practice. The aims of this study were to innovate and develop a spinal disease-specific neural network and to evaluate whether synthetic MRI of the LF affected clinical diagnosis and treatment strategies. A total of 675 LF patients who met the inclusion and exclusion criteria were included in the study. For each participant, two mid-sagittal CT and T2-weighted MR images were selected; 1350 pairs of LF images were also included. A new Self-pix based on Pix2pix and Self-Attention was constructed. A total of 1350 pairs of CT and MR images, which were randomly divided into a training group (1147 pairs) and a test group (203 pairs), were fed into Pix2pix and Self-pix. The quantitative evaluation included PSNR and SSIM (PSNR1 and SSIM1: real MR images and Pix2pix-generated MR images; PSNR2 and SSIM2: real MR images and Self-pix-generated MR images). The qualitative evaluation, including accurate diagnosis of acute fractures and accurate selection of treatment strategies based on Self-pix-generated MRI, was performed by three spine surgeons. In the LF group, PSNR1 and PSNR2 were 10.884 and 11.021 (p < 0.001), and SSIM1 and SSIM2 were 0.766 and 0.771 (p < 0.001), respectively. In the ROI group, PSNR1 and PSNR2 were 12.350 and 12.670 (p = 0.004), and SSIM1 and SSIM2 were 0.816 and 0.832 (p = 0.005), respectively. According to the qualitative evaluation, Self-pix-generated MRI showed no significant difference from real MRI in identifying acute fractures (p = 0.689), with a good sensitivity of 84.36% and specificity of 96.65%. No difference in treatment strategy was found between the Self-pix-generated MRI group and the real MRI group (p = 0.135). In this study, a disease-specific GAN named Self-pix was developed, which demonstrated better image generation performance compared to traditional GAN. The spine surgeon could accurately diagnose LF and select treatment strategies based on Self-pix-generated T2 MR images.
Collapse
Affiliation(s)
- Ke Song
- The First College of Clinical Medical Science, China Three Gorges University, Yichang, 443000, China
- Yichang Central People's Hospital, Yichang, 443000, China
| | - Wendong Zhu
- College of Computer and Information Technology, China Three Gorges University, Yichang, 430002, China
| | - Zhenxi Zhang
- School of Biomedical Engineering, Sun Yat-Sen University, Shenzhen, 518107, China
| | - Bin Liu
- Wendeng Orthopaedic and Traumatologic Hospital of Shandong Province, Weihai, 264400, China
| | - Meiling Zhang
- The First College of Clinical Medical Science, China Three Gorges University, Yichang, 443000, China
- Yichang Central People's Hospital, Yichang, 443000, China
| | - Tinglong Tang
- College of Computer and Information Technology, China Three Gorges University, Yichang, 430002, China
| | - Jie Liang
- The First College of Clinical Medical Science, China Three Gorges University, Yichang, 443000, China
- Yichang Central People's Hospital, Yichang, 443000, China
| | - Weifei Wu
- The First College of Clinical Medical Science, China Three Gorges University, Yichang, 443000, China.
- Yichang Central People's Hospital, Yichang, 443000, China.
| |
Collapse
|
2
|
Ruitenbeek HC, Oei EHG, Visser JJ, Kijowski R. Artificial intelligence in musculoskeletal imaging: realistic clinical applications in the next decade. Skeletal Radiol 2024; 53:1849-1868. [PMID: 38902420 DOI: 10.1007/s00256-024-04684-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/01/2024] [Revised: 04/06/2024] [Accepted: 04/15/2024] [Indexed: 06/22/2024]
Abstract
This article will provide a perspective review of the most extensively investigated deep learning (DL) applications for musculoskeletal disease detection that have the best potential to translate into routine clinical practice over the next decade. Deep learning methods for detecting fractures, estimating pediatric bone age, calculating bone measurements such as lower extremity alignment and Cobb angle, and grading osteoarthritis on radiographs have been shown to have high diagnostic performance with many of these applications now commercially available for use in clinical practice. Many studies have also documented the feasibility of using DL methods for detecting joint pathology and characterizing bone tumors on magnetic resonance imaging (MRI). However, musculoskeletal disease detection on MRI is difficult as it requires multi-task, multi-class detection of complex abnormalities on multiple image slices with different tissue contrasts. The generalizability of DL methods for musculoskeletal disease detection on MRI is also challenging due to fluctuations in image quality caused by the wide variety of scanners and pulse sequences used in routine MRI protocols. The diagnostic performance of current DL methods for musculoskeletal disease detection must be further evaluated in well-designed prospective studies using large image datasets acquired at different institutions with different imaging parameters and imaging hardware before they can be fully implemented in clinical practice. Future studies must also investigate the true clinical benefits of current DL methods and determine whether they could enhance quality, reduce error rates, improve workflow, and decrease radiologist fatigue and burnout with all of this weighed against the costs.
Collapse
Affiliation(s)
- Huibert C Ruitenbeek
- Department of Radiology and Nuclear Medicine, Erasmus MC, University Medical Center, P.O. Box 2040, 3000 CA, Rotterdam, The Netherlands
| | - Edwin H G Oei
- Department of Radiology and Nuclear Medicine, Erasmus MC, University Medical Center, P.O. Box 2040, 3000 CA, Rotterdam, The Netherlands
| | - Jacob J Visser
- Department of Radiology and Nuclear Medicine, Erasmus MC, University Medical Center, P.O. Box 2040, 3000 CA, Rotterdam, The Netherlands
| | - Richard Kijowski
- Department of Radiology, New York University Grossman School of Medicine, 660 First Avenue, 3rd Floor, New York, NY, 10016, USA.
| |
Collapse
|
3
|
Li Y, Liang Z, Li Y, Cao Y, Zhang H, Dong B. Machine learning value in the diagnosis of vertebral fractures: A systematic review and meta-analysis. Eur J Radiol 2024; 181:111714. [PMID: 39241305 DOI: 10.1016/j.ejrad.2024.111714] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2024] [Revised: 07/28/2024] [Accepted: 08/30/2024] [Indexed: 09/09/2024]
Abstract
PURPOSE To evaluate the diagnostic accuracy of machine learning (ML) in detecting vertebral fractures, considering varying fracture classifications, patient populations, and imaging approaches. METHOD A systematic review and meta-analysis were conducted by searching PubMed, Embase, Cochrane Library, and Web of Science up to December 31, 2023, for studies using ML for vertebral fracture diagnosis. Bias risk was assessed using QUADAS-2. A bivariate mixed-effects model was used for the meta-analysis. Meta-analyses were performed according to five task types (vertebral fractures, osteoporotic vertebral fractures, differentiation of benign and malignant vertebral fractures, differentiation of acute and chronic vertebral fractures, and prediction of vertebral fractures). Subgroup analyses were conducted by different ML models (including ML and DL) and modeling methods (including CT, X-ray, MRI, and clinical features). RESULTS Eighty-one studies were included. ML demonstrated a diagnostic sensitivity of 0.91 and specificity of 0.95 for vertebral fractures. Subgroup analysis showed that DL (SROC 0.98) and CT (SROC 0.98) performed best overall. For osteoporotic fractures, ML showed a sensitivity of 0.93 and specificity of 0.96, with DL (SROC 0.99) and X-ray (SROC 0.99) performing better. For differentiating benign from malignant fractures, ML achieved a sensitivity of 0.92 and specificity of 0.93, with DL (SROC 0.96) and MRI (SROC 0.97) performing best. For differentiating acute from chronic vertebral fractures, ML showed a sensitivity of 0.92 and specificity of 0.93, with ML (SROC 0.96) and CT (SROC 0.97) performing best. For predicting vertebral fractures, ML had a sensitivity of 0.76 and specificity of 0.87, with ML (SROC 0.80) and clinical features (SROC 0.86) performing better. CONCLUSIONS ML, especially DL models applied to CT, MRI, and X-ray, shows high diagnostic accuracy for vertebral fractures. ML also effectively predicts osteoporotic vertebral fractures, aiding in tailored prevention strategies. Further research and validation are required to confirm ML's clinical efficacy.
Collapse
Affiliation(s)
- Yue Li
- Pain Ward of Rehabilitation Department, Honghui Hospital, Xi'an Jiaotong University, Xi'an, Shaanxi Province 710054, PR China
| | - Zhuang Liang
- Pain Ward of Rehabilitation Department, Honghui Hospital, Xi'an Jiaotong University, Xi'an, Shaanxi Province 710054, PR China
| | - Yingchun Li
- Pain Ward of Rehabilitation Department, Honghui Hospital, Xi'an Jiaotong University, Xi'an, Shaanxi Province 710054, PR China
| | - Yang Cao
- Pain Ward of Rehabilitation Department, Honghui Hospital, Xi'an Jiaotong University, Xi'an, Shaanxi Province 710054, PR China
| | - Hui Zhang
- Pain Ward of Rehabilitation Department, Honghui Hospital, Xi'an Jiaotong University, Xi'an, Shaanxi Province 710054, PR China
| | - Bo Dong
- Pain Ward of Rehabilitation Department, Honghui Hospital, Xi'an Jiaotong University, Xi'an, Shaanxi Province 710054, PR China.
| |
Collapse
|
4
|
Lee S, Jung JY, Mahatthanatrakul A, Kim JS. Artificial Intelligence in Spinal Imaging and Patient Care: A Review of Recent Advances. Neurospine 2024; 21:474-486. [PMID: 38955525 PMCID: PMC11224760 DOI: 10.14245/ns.2448388.194] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2024] [Revised: 05/14/2024] [Accepted: 05/23/2024] [Indexed: 07/04/2024] Open
Abstract
Artificial intelligence (AI) is transforming spinal imaging and patient care through automated analysis and enhanced decision-making. This review presents a clinical task-based evaluation, highlighting the specific impact of AI techniques on different aspects of spinal imaging and patient care. We first discuss how AI can potentially improve image quality through techniques like denoising or artifact reduction. We then explore how AI enables efficient quantification of anatomical measurements, spinal curvature parameters, vertebral segmentation, and disc grading. This facilitates objective, accurate interpretation and diagnosis. AI models now reliably detect key spinal pathologies, achieving expert-level performance in tasks like identifying fractures, stenosis, infections, and tumors. Beyond diagnosis, AI also assists surgical planning via synthetic computed tomography generation, augmented reality systems, and robotic guidance. Furthermore, AI image analysis combined with clinical data enables personalized predictions to guide treatment decisions, such as forecasting spine surgery outcomes. However, challenges still need to be addressed in implementing AI clinically, including model interpretability, generalizability, and data limitations. Multicenter collaboration using large, diverse datasets is critical to advance the field further. While adoption barriers persist, AI presents a transformative opportunity to revolutionize spinal imaging workflows, empowering clinicians to translate data into actionable insights for improved patient care.
Collapse
Affiliation(s)
- Sungwon Lee
- Department of Radiology, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea
- Visual Analysis and Learning for Improved Diagnostics (VALID) Lab, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea
| | - Joon-Yong Jung
- Department of Radiology, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea
- Visual Analysis and Learning for Improved Diagnostics (VALID) Lab, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea
| | - Akaworn Mahatthanatrakul
- Department of Orthopaedics, Faculty of Medicine, Naresuan University Hospital, Phitsanulok, Thailand
| | - Jin-Sung Kim
- Spine Center, Department of Neurosurgery, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea
| |
Collapse
|
5
|
Zhang J, Xia L, Tang J, Xia J, Liu Y, Zhang W, Liu J, Liang Z, Zhang X, Zhang L, Tang G. Constructing a Deep Learning Radiomics Model Based on X-ray Images and Clinical Data for Predicting and Distinguishing Acute and Chronic Osteoporotic Vertebral Fractures: A Multicenter Study. Acad Radiol 2024; 31:2011-2026. [PMID: 38016821 DOI: 10.1016/j.acra.2023.10.061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Revised: 09/13/2023] [Accepted: 10/31/2023] [Indexed: 11/30/2023]
Abstract
RATIONALE AND OBJECTIVES To construct and validate a deep learning radiomics (DLR) model based on X-ray images for predicting and distinguishing acute and chronic osteoporotic vertebral fractures (OVFs). METHODS A total of 942 cases (1076 vertebral bodies) with both vertebral X-ray examination and MRI scans were included in this study from three hospitals. They were divided into a training cohort (n = 712), an internal validation cohort (n = 178), an external validation cohort (n = 111), and a prospective validation cohort (n = 75). The ResNet-50 model architecture was used for deep transfer learning (DTL), with pre-training performed on RadImageNet and ImageNet datasets. DTL features and radiomics features were extracted from lateral X-ray images of OVFs patients and fused together. A logistic regression model with the least absolute shrinkage and selection operator was established, with MRI showing bone marrow edema as the gold standard for acute OVFs. The performance of the model was evaluated using receiver operating characteristic curves. Eight machine learning classification models were evaluated for their ability to distinguish between acute and chronic OVFs. The Nomogram was constructed by combining clinical baseline data to achieve visualized classification assessment. The predictive performance of the best RadImageNet model and ImageNet model was compared using the Delong test. The clinical value of the Nomogram was evaluated using decision curve analysis (DCA). RESULTS Pre-training resulted in 34 and 39 fused features after feature selection and fusion. The most effective machine learning algorithm in both DLR models was Light Gradient Boosting Machine. Using the Delong test, the area under the curve (AUC) for distinguishing between acute and chronic OVFs in the training cohort was 0.979 and 0.972 for the RadImageNet and ImageNet models, respectively, with no statistically significant difference between them (P = 0.235). In the internal validation cohort, external validation cohort, and prospective validation cohort, the AUCs for the two models were 0.967 vs 0.629, 0.886 vs 0.817, and 0.933 vs 0.661, respectively, with statistically significant differences in all comparisons (P < 0.05). The deep learning radiomics nomogram (DLRN) was constructed by combining the predictive model of RadImageNet with clinical baseline features, resulting in AUCs of 0.981, 0.974, 0.895, and 0.902 in the training cohort, internal validation cohort, external validation cohort, and prospective validation cohort, respectively. Using the Delong test, the AUCs for the fused feature model and the DLRN in the training cohort were 0.979 and 0.981, respectively, with no statistically significant difference between them (P = 0.169). In the internal validation cohort, external validation cohort, and prospective validation cohort, the AUCs for the two models were 0.967 vs 0.974, 0.886 vs 0.895, and 0.933 vs 0.902, respectively, with statistically significant differences in all comparisons (P < 0.05). The Nomogram showed a slight improvement in predictive performance in the internal and external validation cohort, but a slight decrease in the prospective validation cohort (0.933 vs 0.902). DCA showed that the Nomogram provided more benefits to patients compared to the DLR models. CONCLUSION Compared to the ImageNet model, the RadImageNet model has higher diagnostic value in distinguishing between acute and chronic OVFs. Furthermore, the diagnostic performance of the model is further improved when combined with clinical baseline features to construct the Nomogram.
Collapse
Affiliation(s)
- Jun Zhang
- Department of Radiology, Shanghai Tenth People's Hospital, Clinical Medical College of Nanjing Medical University, 301 Middle Yanchang Road, Shanghai, 200072, PR China (J.Z., G.T.); Department of Radiology, Sir RunRun Hospital affiliated to Nanjing Medical University, 109 Longmian Road, Nanjing, Jiangsu, 211002, PR China (J.Z., L.X., W.Z., J.L., Z.L.)
| | - Liang Xia
- Department of Radiology, Sir RunRun Hospital affiliated to Nanjing Medical University, 109 Longmian Road, Nanjing, Jiangsu, 211002, PR China (J.Z., L.X., W.Z., J.L., Z.L.)
| | - Jun Tang
- Department of Radiology, The Affiliated Taizhou People's Hospital of Nanjing Medical University, 366 Taihu Road, Taizhou, Jiangsu, 225300, PR China (J.T., J.X.)
| | - Jianguo Xia
- Department of Radiology, The Affiliated Taizhou People's Hospital of Nanjing Medical University, 366 Taihu Road, Taizhou, Jiangsu, 225300, PR China (J.T., J.X.)
| | - Yongkang Liu
- Department of Radiology, The Affiliated Hospital of Nanjing University of Chinese Medicine, 155 Hanzhong Road, Nanjing, Jiangsu, 210004, PR China (Y.L.)
| | - Weixiao Zhang
- Department of Radiology, Sir RunRun Hospital affiliated to Nanjing Medical University, 109 Longmian Road, Nanjing, Jiangsu, 211002, PR China (J.Z., L.X., W.Z., J.L., Z.L.)
| | - Jiayi Liu
- Department of Radiology, Sir RunRun Hospital affiliated to Nanjing Medical University, 109 Longmian Road, Nanjing, Jiangsu, 211002, PR China (J.Z., L.X., W.Z., J.L., Z.L.)
| | - Zhipeng Liang
- Department of Radiology, Sir RunRun Hospital affiliated to Nanjing Medical University, 109 Longmian Road, Nanjing, Jiangsu, 211002, PR China (J.Z., L.X., W.Z., J.L., Z.L.)
| | - Xueli Zhang
- Department of Radiology, Shanghai Tenth People's Hospital, Tongji University School of Medicine, 301 Middle Yanchang Road, Shanghai, 200072, PR China (X.Z., L.Z., G.T.)
| | - Lin Zhang
- Department of Radiology, Shanghai Tenth People's Hospital, Tongji University School of Medicine, 301 Middle Yanchang Road, Shanghai, 200072, PR China (X.Z., L.Z., G.T.).
| | - Guangyu Tang
- Department of Radiology, Shanghai Tenth People's Hospital, Clinical Medical College of Nanjing Medical University, 301 Middle Yanchang Road, Shanghai, 200072, PR China (J.Z., G.T.); Department of Radiology, Shanghai Tenth People's Hospital, Tongji University School of Medicine, 301 Middle Yanchang Road, Shanghai, 200072, PR China (X.Z., L.Z., G.T.)
| |
Collapse
|
6
|
Bečulić H, Begagić E, Džidić-Krivić A, Pugonja R, Softić N, Bašić B, Balogun S, Nuhović A, Softić E, Ljevaković A, Sefo H, Šegalo S, Skomorac R, Pojskić M. Sensitivity and specificity of machine learning and deep learning algorithms in the diagnosis of thoracolumbar injuries resulting in vertebral fractures: A systematic review and meta-analysis. BRAIN & SPINE 2024; 4:102809. [PMID: 38681175 PMCID: PMC11052896 DOI: 10.1016/j.bas.2024.102809] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/01/2024] [Revised: 03/13/2024] [Accepted: 04/04/2024] [Indexed: 05/01/2024]
Abstract
Introduction Clinicians encounter challenges in promptly diagnosing thoracolumbar injuries (TLIs) and fractures (VFs), motivating the exploration of Artificial Intelligence (AI) and Machine Learning (ML) and Deep Learning (DL) technologies to enhance diagnostic capabilities. Despite varying evidence, the noteworthy transformative potential of AI in healthcare, leveraging insights from daily healthcare data, persists. Research question This review investigates the utilization of ML and DL in TLIs causing VFs. Materials and methods Employing Preferred Reporting Items for Systematic Reviews and Meta-Analyzes (PRISMA) methodology, a systematic review was conducted in PubMed and Scopus databases, identifying 793 studies. Seventeen were included in the systematic review, and 11 in the meta-analysis. Variables considered encompassed publication years, geographical location, study design, total participants (14,524), gender distribution, ML or DL methods, specific pathology, diagnostic modality, test analysis variables, validation details, and key study conclusions. Meta-analysis assessed specificity, sensitivity, and conducted hierarchical summary receiver operating characteristic curve (HSROC) analysis. Results Predominantly conducted in China (29.41%), the studies involved 14,524 participants. In the analysis, 11.76% (N = 2) focused on ML, while 88.24% (N = 15) were dedicated to deep DL. Meta-analysis revealed a sensitivity of 0.91 (95% CI = 0.86-0.95), consistent specificity of 0.90 (95% CI = 0.86-0.93), with a false positive rate of 0.097 (95% CI = 0.068-0.137). Conclusion The study underscores consistent specificity and sensitivity estimates, affirming the diagnostic test's robustness. However, the broader context of ML applications in TLIs emphasizes the critical need for standardization in methodologies to enhance clinical utility.
Collapse
Affiliation(s)
- Hakija Bečulić
- Department of Neurosurgery, Cantonal Hospital Zenica, Crkvice 67, 72000, Zenica, Bosnia and Herzegovina
- Department of Anatomy, School of Medicine, University of Zenica, Travnička 1, 72000, Zenica, Bosnia and Herzegovina
| | - Emir Begagić
- Department of General Medicine, School of Medicine, University of Zenica, Travnička 1, 72000, Zenica, Bosnia and Herzegovina
| | - Amina Džidić-Krivić
- Department of Neurology, Cantonal Hospital Zenica, Crkvice 67, 72000, Zenica, Bosnia and Herzegovina
| | - Ragib Pugonja
- Department of Anatomy, School of Medicine, University of Zenica, Travnička 1, 72000, Zenica, Bosnia and Herzegovina
| | - Namira Softić
- Department of Neurosurgery, Cantonal Hospital Zenica, Crkvice 67, 72000, Zenica, Bosnia and Herzegovina
| | - Binasa Bašić
- Department of Neurology, General Hospital Travnik, Kalibunar Bb, 72270, Travnik, Bosnia and Herzegovina
| | - Simon Balogun
- Division of Neurosurgery, Department of Surgery, Obafemi Awolowo University Teaching Hospitals Complex, Ilesa Road PMB 5538, 220282, Ile-Ife, Nigeria
| | - Adem Nuhović
- Department of General Medicine, School of Medicine, University of Sarajevo, Univerzitetska 1, 71000, Sarajevo, Bosnia and Herzegovina
| | - Emir Softić
- Department of Patophysiology, School of Medicine, University of Zenica, Travnička 1, 72000, Zenica, Bosnia and Herzegovina
| | - Adnana Ljevaković
- Department of Neurology, General Hospital Travnik, Kalibunar Bb, 72270, Travnik, Bosnia and Herzegovina
| | - Haso Sefo
- Neurosurgery Clinic, University Clinical Center Sarajevo, Bolnička 25, 71000, Sarajevo, Bosnia and Herzegovina
| | - Sabina Šegalo
- Department of Laboratory Technologies, Faculty of Health Siences, University of Sarajevo, Stjepana Tomića 1, 71000, Sarajevo, Bosnia and Herzegovina
| | - Rasim Skomorac
- Department of Anatomy, School of Medicine, University of Zenica, Travnička 1, 72000, Zenica, Bosnia and Herzegovina
- Department of Surgery, School of Medicine, University of Zenica, Travnička 1, 72000, Zenica, Bosnia and Herzegovina
| | - Mirza Pojskić
- Department of Neurosurgery, University Hospital Marburg, Baldingerstr., 35033, Marburg, Germany
| |
Collapse
|
7
|
Zhang J, Xia L, Liu J, Niu X, Tang J, Xia J, Liu Y, Zhang W, Liang Z, Zhang X, Tang G, Zhang L. Exploring deep learning radiomics for classifying osteoporotic vertebral fractures in X-ray images. Front Endocrinol (Lausanne) 2024; 15:1370838. [PMID: 38606087 PMCID: PMC11007145 DOI: 10.3389/fendo.2024.1370838] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/15/2024] [Accepted: 03/15/2024] [Indexed: 04/13/2024] Open
Abstract
Purpose To develop and validate a deep learning radiomics (DLR) model that uses X-ray images to predict the classification of osteoporotic vertebral fractures (OVFs). Material and methods The study encompassed a cohort of 942 patients, involving examinations of 1076 vertebrae through X-ray, CT, and MRI across three distinct hospitals. The OVFs were categorized as class 0, 1, or 2 based on the Assessment System of Thoracolumbar Osteoporotic Fracture. The dataset was divided randomly into four distinct subsets: a training set comprising 712 samples, an internal validation set with 178 samples, an external validation set containing 111 samples, and a prospective validation set consisting of 75 samples. The ResNet-50 architectural model was used to implement deep transfer learning (DTL), undergoing -pre-training separately on the RadImageNet and ImageNet datasets. Features from DTL and radiomics were extracted and integrated using X-ray images. The optimal fusion feature model was identified through least absolute shrinkage and selection operator logistic regression. Evaluation of the predictive capabilities for OVFs classification involved eight machine learning models, assessed through receiver operating characteristic curves employing the "One-vs-Rest" strategy. The Delong test was applied to compare the predictive performance of the superior RadImageNet model against the ImageNet model. Results Following pre-training separately on RadImageNet and ImageNet datasets, feature selection and fusion yielded 17 and 12 fusion features, respectively. Logistic regression emerged as the optimal machine learning algorithm for both DLR models. Across the training set, internal validation set, external validation set, and prospective validation set, the macro-average Area Under the Curve (AUC) based on the RadImageNet dataset surpassed those based on the ImageNet dataset, with statistically significant differences observed (P<0.05). Utilizing the binary "One-vs-Rest" strategy, the model based on the RadImageNet dataset demonstrated superior efficacy in predicting Class 0, achieving an AUC of 0.969 and accuracy of 0.863. Predicting Class 1 yielded an AUC of 0.945 and accuracy of 0.875, while for Class 2, the AUC and accuracy were 0.809 and 0.692, respectively. Conclusion The DLR model, based on the RadImageNet dataset, outperformed the ImageNet model in predicting the classification of OVFs, with generalizability confirmed in the prospective validation set.
Collapse
Affiliation(s)
- Jun Zhang
- Department of Radiology, Shanghai Tenth People’s Hospital, Clinical Medical College of Nanjing Medical University, Shanghai, China
- Department of Radiology, Sir RunRun Hospital, Nanjing Medical University, Nanjing, China
| | - Liang Xia
- Department of Radiology, Sir RunRun Hospital, Nanjing Medical University, Nanjing, China
| | - Jiayi Liu
- Department of Radiology, Sir RunRun Hospital, Nanjing Medical University, Nanjing, China
| | - Xiaoying Niu
- Department of Neonates, Dongfeng General Hospital of National Medicine, Hubei University of Medicine, Shiyan, China
| | - Jun Tang
- Department of Radiology, The Affiliated Taizhou People’s Hospital of Nanjing Medical University, Taizhou, China
| | - Jianguo Xia
- Department of Radiology, The Affiliated Taizhou People’s Hospital of Nanjing Medical University, Taizhou, China
| | - Yongkang Liu
- Department of Radiology, Jiangsu Provincial Hospital of Traditional Chinese Medicine, Nanjing University of Chinese Medicine, Nanjing, China
| | - Weixiao Zhang
- Department of Radiology, Sir RunRun Hospital, Nanjing Medical University, Nanjing, China
| | - Zhipeng Liang
- Department of Radiology, Sir RunRun Hospital, Nanjing Medical University, Nanjing, China
| | - Xueli Zhang
- Department of Radiology, Shanghai Tenth People’s Hospital, Tongji University School of Medicine, Shanghai, China
| | - Guangyu Tang
- Department of Radiology, Shanghai Tenth People’s Hospital, Clinical Medical College of Nanjing Medical University, Shanghai, China
- Department of Radiology, Shanghai Tenth People’s Hospital, Tongji University School of Medicine, Shanghai, China
| | - Lin Zhang
- Department of Radiology, Shanghai Tenth People’s Hospital, Tongji University School of Medicine, Shanghai, China
| |
Collapse
|
8
|
Wang YN, Liu G, Wang L, Chen C, Wang Z, Zhu S, Wan WT, Weng YZ, Lu WW, Li ZY, Wang Z, Ma XL, Yang Q. A Deep-Learning Model for Diagnosing Fresh Vertebral Fractures on Magnetic Resonance Images. World Neurosurg 2024; 183:e818-e824. [PMID: 38218442 DOI: 10.1016/j.wneu.2024.01.035] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2023] [Accepted: 01/07/2024] [Indexed: 01/15/2024]
Abstract
BACKGROUND The accurate diagnosis of fresh vertebral fractures (VFs) was critical to optimizing treatment outcomes. Existing studies, however, demonstrated insufficient accuracy, sensitivity, and specificity in detecting fresh fractures using magnetic resonance imaging (MRI), and fall short in localizing the fracture sites. METHODS This prospective study comprised 716 patients with fresh VFs. We obtained 849 Short TI Inversion Recovery (STIR) image slices for training and validation of the AI model. The AI models employed were yolov7 and resnet50, to detect fresh VFs. RESULTS The AI model demonstrated a diagnostic accuracy of 97.6% for fresh VFs, with a sensitivity of 98% and a specificity of 97%. The performance of the model displayed a high degree of consistency when compared to the evaluations by spine surgeons. In the external testing dataset, the model exhibited a classification accuracy of 92.4%, a sensitivity of 93%, and a specificity of 92%. CONCLUSIONS Our findings highlighted the potential of AI in diagnosing fresh VFs, offering an accurate and efficient way to aid physicians with diagnosis and treatment decisions.
Collapse
Affiliation(s)
- Yan-Ni Wang
- Department of Spine Surgery, Tianjin Hospital, Tianjin University, Tianjin, China
| | - Gang Liu
- Department of Spine Surgery, Tianjin Hospital, Tianjin University, Tianjin, China
| | - Lei Wang
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, School of Health Sciences & Biomedical Engineering, Hebei University of Technology, Tianjin, China
| | - Chao Chen
- Department of Spine Surgery, Tianjin Hospital, Tianjin University, Tianjin, China
| | - Zhi Wang
- Department of Spine Surgery, Tianjin Hospital, Tianjin University, Tianjin, China
| | - Shan Zhu
- Department of Spine Surgery, Tianjin Hospital, Tianjin University, Tianjin, China
| | - Wen-Tao Wan
- Department of Spine Surgery, Tianjin Hospital, Tianjin University, Tianjin, China
| | - Yuan-Zhi Weng
- Department of Orthopaedics and Traumatology, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong, Hong Kong SAR, China; Department of Orthopaedics and Traumatology, The University of Hong Kong-Shenzhen Hospital, Shenzhen, China; Research Center for Human Tissue and Organs Degeneration, Institute of Biomedicine and Biotechnology, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences (CAS), Shenzhen, China
| | - Weijia William Lu
- Department of Orthopaedics and Traumatology, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong, Hong Kong SAR, China; Department of Orthopaedics and Traumatology, The University of Hong Kong-Shenzhen Hospital, Shenzhen, China; Research Center for Human Tissue and Organs Degeneration, Institute of Biomedicine and Biotechnology, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences (CAS), Shenzhen, China
| | - Zhao-Yang Li
- Tianjin Key Laboratory of Composite and Functional Materials, School of Materials Science and Engineering, Tianjin University, Tianjin, China
| | - Zheng Wang
- Department of Orthopaedics, Chinese People's Liberation Army General Hospital, Beijing, China
| | - Xin-Long Ma
- Department of Spine Surgery, Tianjin Hospital, Tianjin University, Tianjin, China
| | - Qiang Yang
- Department of Spine Surgery, Tianjin Hospital, Tianjin University, Tianjin, China.
| |
Collapse
|
9
|
Yuh WT, Khil EK, Yoon YS, Kim B, Yoon H, Lim J, Lee KY, Yoo YS, An KD. Deep Learning-Assisted Quantitative Measurement of Thoracolumbar Fracture Features on Lateral Radiographs. Neurospine 2024; 21:30-43. [PMID: 38569629 PMCID: PMC10992637 DOI: 10.14245/ns.2347366.683] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2023] [Revised: 01/24/2024] [Accepted: 02/02/2024] [Indexed: 04/05/2024] Open
Abstract
OBJECTIVE This study aimed to develop and validate a deep learning (DL) algorithm for the quantitative measurement of thoracolumbar (TL) fracture features, and to evaluate its efficacy across varying levels of clinical expertise. METHODS Using the pretrained Mask Region-Based Convolutional Neural Networks model, originally developed for vertebral body segmentation and fracture detection, we fine-tuned the model and added a new module for measuring fracture metrics-compression rate (CR), Cobb angle (CA), Gardner angle (GA), and sagittal index (SI)-from lumbar spine lateral radiographs. These metrics were derived from six-point labeling by 3 radiologists, forming the ground truth (GT). Training utilized 1,000 nonfractured and 318 fractured radiographs, while validations employed 213 internal and 200 external fractured radiographs. The accuracy of the DL algorithm in quantifying fracture features was evaluated against GT using the intraclass correlation coefficient. Additionally, 4 readers with varying expertise levels, including trainees and an attending spine surgeon, performed measurements with and without DL assistance, and their results were compared to GT and the DL model. RESULTS The DL algorithm demonstrated good to excellent agreement with GT for CR, CA, GA, and SI in both internal (0.860, 0.944, 0.932, and 0.779, respectively) and external (0.836, 0.940, 0.916, and 0.815, respectively) validations. DL-assisted measurements significantly improved most measurement values, particularly for trainees. CONCLUSION The DL algorithm was validated as an accurate tool for quantifying TL fracture features using radiographs. DL-assisted measurement is expected to expedite the diagnostic process and enhance reliability, particularly benefiting less experienced clinicians.
Collapse
Affiliation(s)
- Woon Tak Yuh
- Department of Neurosurgery, Hallym University Dongtan Sacred Heart Hospital, Hwaseong, Korea
| | - Eun Kyung Khil
- Department of Radiology, Hallym University Dongtan Sacred Heart Hospital, Hwaseong, Korea
- Department of Radiology, Fastbone Orthopedic Hospital, Hwaseong, Korea
| | - Yu Sung Yoon
- Department of Radiology, Kyungpook National University Hospital, School of Medicine, Kyungpook National University, Daegu, Korea
| | | | | | - Jihe Lim
- Department of Radiology, Hallym University Dongtan Sacred Heart Hospital, Hwaseong, Korea
| | - Kyoung Yeon Lee
- Department of Radiology, Hallym University Dongtan Sacred Heart Hospital, Hwaseong, Korea
| | - Yeong Seo Yoo
- Department of Radiology, Hallym University Dongtan Sacred Heart Hospital, Hwaseong, Korea
| | - Kyeong Deuk An
- Department of Neurosurgery, Hallym University Dongtan Sacred Heart Hospital, Hwaseong, Korea
| |
Collapse
|
10
|
Gitto S, Serpi F, Albano D, Risoleo G, Fusco S, Messina C, Sconfienza LM. AI applications in musculoskeletal imaging: a narrative review. Eur Radiol Exp 2024; 8:22. [PMID: 38355767 PMCID: PMC10866817 DOI: 10.1186/s41747-024-00422-8] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2023] [Accepted: 12/29/2023] [Indexed: 02/16/2024] Open
Abstract
This narrative review focuses on clinical applications of artificial intelligence (AI) in musculoskeletal imaging. A range of musculoskeletal disorders are discussed using a clinical-based approach, including trauma, bone age estimation, osteoarthritis, bone and soft-tissue tumors, and orthopedic implant-related pathology. Several AI algorithms have been applied to fracture detection and classification, which are potentially helpful tools for radiologists and clinicians. In bone age assessment, AI methods have been applied to assist radiologists by automatizing workflow, thus reducing workload and inter-observer variability. AI may potentially aid radiologists in identifying and grading abnormal findings of osteoarthritis as well as predicting the onset or progression of this disease. Either alone or combined with radiomics, AI algorithms may potentially improve diagnosis and outcome prediction of bone and soft-tissue tumors. Finally, information regarding appropriate positioning of orthopedic implants and related complications may be obtained using AI algorithms. In conclusion, rather than replacing radiologists, the use of AI should instead help them to optimize workflow, augment diagnostic performance, and keep up with ever-increasing workload.Relevance statement This narrative review provides an overview of AI applications in musculoskeletal imaging. As the number of AI technologies continues to increase, it will be crucial for radiologists to play a role in their selection and application as well as to fully understand their potential value in clinical practice. Key points • AI may potentially assist musculoskeletal radiologists in several interpretative tasks.• AI applications to trauma, age estimation, osteoarthritis, tumors, and orthopedic implants are discussed.• AI should help radiologists to optimize workflow and augment diagnostic performance.
Collapse
Affiliation(s)
- Salvatore Gitto
- Department of Biomedical Sciences for Health, Università degli Studi di Milano, Via Cristina Belgioioso 173, Milan, 20157, Italy
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
| | - Francesca Serpi
- Department of Biomedical Sciences for Health, Università degli Studi di Milano, Via Cristina Belgioioso 173, Milan, 20157, Italy
| | - Domenico Albano
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
- Dipartimento di Scienze Biomediche, Chirurgiche ed Odontoiatriche, Università degli Studi di Milano, Milan, Italy
| | - Giovanni Risoleo
- Scuola di Specializzazione in Radiodiagnostica, Università degli Studi di Milano, Milan, Italy
| | - Stefano Fusco
- Department of Biomedical Sciences for Health, Università degli Studi di Milano, Via Cristina Belgioioso 173, Milan, 20157, Italy
| | - Carmelo Messina
- Department of Biomedical Sciences for Health, Università degli Studi di Milano, Via Cristina Belgioioso 173, Milan, 20157, Italy
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
| | - Luca Maria Sconfienza
- Department of Biomedical Sciences for Health, Università degli Studi di Milano, Via Cristina Belgioioso 173, Milan, 20157, Italy.
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy.
| |
Collapse
|
11
|
Maki S, Furuya T, Inoue M, Shiga Y, Inage K, Eguchi Y, Orita S, Ohtori S. Machine Learning and Deep Learning in Spinal Injury: A Narrative Review of Algorithms in Diagnosis and Prognosis. J Clin Med 2024; 13:705. [PMID: 38337399 PMCID: PMC10856760 DOI: 10.3390/jcm13030705] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Revised: 01/14/2024] [Accepted: 01/18/2024] [Indexed: 02/12/2024] Open
Abstract
Spinal injuries, including cervical and thoracolumbar fractures, continue to be a major public health concern. Recent advancements in machine learning and deep learning technologies offer exciting prospects for improving both diagnostic and prognostic approaches in spinal injury care. This narrative review systematically explores the practical utility of these computational methods, with a focus on their application in imaging techniques such as computed tomography (CT) and magnetic resonance imaging (MRI), as well as in structured clinical data. Of the 39 studies included, 34 were focused on diagnostic applications, chiefly using deep learning to carry out tasks like vertebral fracture identification, differentiation between benign and malignant fractures, and AO fracture classification. The remaining five were prognostic, using machine learning to analyze parameters for predicting outcomes such as vertebral collapse and future fracture risk. This review highlights the potential benefit of machine learning and deep learning in spinal injury care, especially their roles in enhancing diagnostic capabilities, detailed fracture characterization, risk assessments, and individualized treatment planning.
Collapse
Affiliation(s)
- Satoshi Maki
- Department of Orthopaedic Surgery, Graduate School of Medicine, Chiba University, Chiba 260-8670, Japan
- Center for Frontier Medical Engineering, Chiba University, Chiba 263-8522, Japan
| | - Takeo Furuya
- Department of Orthopaedic Surgery, Graduate School of Medicine, Chiba University, Chiba 260-8670, Japan
| | - Masahiro Inoue
- Department of Orthopaedic Surgery, Graduate School of Medicine, Chiba University, Chiba 260-8670, Japan
| | - Yasuhiro Shiga
- Department of Orthopaedic Surgery, Graduate School of Medicine, Chiba University, Chiba 260-8670, Japan
| | - Kazuhide Inage
- Department of Orthopaedic Surgery, Graduate School of Medicine, Chiba University, Chiba 260-8670, Japan
| | - Yawara Eguchi
- Department of Orthopaedic Surgery, Graduate School of Medicine, Chiba University, Chiba 260-8670, Japan
| | - Sumihisa Orita
- Department of Orthopaedic Surgery, Graduate School of Medicine, Chiba University, Chiba 260-8670, Japan
- Center for Frontier Medical Engineering, Chiba University, Chiba 263-8522, Japan
| | - Seiji Ohtori
- Department of Orthopaedic Surgery, Graduate School of Medicine, Chiba University, Chiba 260-8670, Japan
| |
Collapse
|
12
|
Wang Y, Su F, Lu Q, Zhang W, Liu T, Tao Y, Fu S, Cui L, Lu SB, Chen X, Shi Z. Deep learning-driven diagnosis of multi-type vertebra diseases based on computed tomography images. Quant Imaging Med Surg 2024; 14:800-813. [PMID: 38223021 PMCID: PMC10784083 DOI: 10.21037/qims-23-685] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2023] [Accepted: 11/24/2023] [Indexed: 01/16/2024]
Abstract
Background Osteoporotic vertebral compression fractures (OVCFs) are the most common type of fragility fracture. Distinguishing between OVCFs and other types of vertebra diseases, such as old fractures (OFs), Schmorl's node (SN), Kummell's disease (KD), and previous surgery (PS), is critical for subsequent surgery and treatment. Combining with advanced deep learning (DL) technologies, this study plans to develop a DL-driven diagnostic system for diagnosing multi-type vertebra diseases. Methods We established a large-scale dataset based on the computed tomography (CT) images of 1,051 patients with OVCFs from Luhe Hospital and used data of 46 patients from Xuanwu Hospital as alternative hospital validation dataset. Each patient underwent one examination. The dataset contained 11,417 CT slices and 19,718 manually annotated vertebrae with diseases. A two-stage DL-based system was developed to diagnose five vertebra diseases. The proposed system consisted of a vertebra detection module (VDModule) and a vertebra classification module (VCModule). Results The training and testing dataset for the VDModule consisted of 9,135 and 3,212 vertebrae, respectively. The VDModule using the ResNet18-based Faster region-based convolutional neural network (R-CNN) model achieved an area under the curve (AUC), false-positive (FP) rate, and false-negative (FN) rate of 0.982, 1.52%, and 1.33%, respectively, in the testing dataset. The training dataset for VCModule consisted of 14,584 and 47,604 diseased and normal vertebrae, respectively. The testing dataset consisted of 4,489 and 15,122 diseased and normal vertebrae, respectively. The ResNet50-based VCModule achieved an average sensitivity and specificity of 0.919 and 0.995, respectively, in diagnosing four kinds of vertebra diseases except for SN in the testing dataset. In the alternative hospital validation dataset, the ResNet50-based VCModule achieved an average sensitivity and specificity of 0.891 and 0.989, respectively, in diagnosing four kinds of vertebra diseases except for SN. Conclusions Our proposed DL system can accurately diagnose four vertebra diseases and has strong potential to facilitate the accurate and rapid diagnosis of vertebral diseases.
Collapse
Affiliation(s)
- Yongjie Wang
- Department of Orthopedics, Beijing Luhe Hospital, Capital Medical University, Beijing, China
| | - Feng Su
- School of Mechanical Engineering and Automation, Beihang University, Beijing, China
- Peking-Tsinghua Center for Life Sciences, Academy for Advanced Interdisciplinary Studies, Peking University, Beijing, China
| | - Qian Lu
- Department of Orthopedics, Beijing Luhe Hospital, Capital Medical University, Beijing, China
| | - Wenkai Zhang
- Department of Orthopedics, Beijing Luhe Hospital, Capital Medical University, Beijing, China
| | - Tao Liu
- Department of Orthopedics, Beijing Luhe Hospital, Capital Medical University, Beijing, China
| | - Yining Tao
- School of Mechanical Engineering and Automation, Beihang University, Beijing, China
| | - Shuai Fu
- School of Mechanical Engineering and Automation, Beihang University, Beijing, China
| | - Libin Cui
- Department of Orthopedics, Beijing Luhe Hospital, Capital Medical University, Beijing, China
| | - Shi-Bao Lu
- Department of Orthopedics, Xuanwu Hospital, Capital Medical University, Beijing, China
| | - Xueming Chen
- Department of Orthopedics, Beijing Luhe Hospital, Capital Medical University, Beijing, China
| | - Zhenyun Shi
- School of Mechanical Engineering and Automation, Beihang University, Beijing, China
| |
Collapse
|
13
|
Jung J, Dai J, Liu B, Wu Q. Artificial intelligence in fracture detection with different image modalities and data types: A systematic review and meta-analysis. PLOS DIGITAL HEALTH 2024; 3:e0000438. [PMID: 38289965 PMCID: PMC10826962 DOI: 10.1371/journal.pdig.0000438] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Accepted: 12/25/2023] [Indexed: 02/01/2024]
Abstract
Artificial Intelligence (AI), encompassing Machine Learning and Deep Learning, has increasingly been applied to fracture detection using diverse imaging modalities and data types. This systematic review and meta-analysis aimed to assess the efficacy of AI in detecting fractures through various imaging modalities and data types (image, tabular, or both) and to synthesize the existing evidence related to AI-based fracture detection. Peer-reviewed studies developing and validating AI for fracture detection were identified through searches in multiple electronic databases without time limitations. A hierarchical meta-analysis model was used to calculate pooled sensitivity and specificity. A diagnostic accuracy quality assessment was performed to evaluate bias and applicability. Of the 66 eligible studies, 54 identified fractures using imaging-related data, nine using tabular data, and three using both. Vertebral fractures were the most common outcome (n = 20), followed by hip fractures (n = 18). Hip fractures exhibited the highest pooled sensitivity (92%; 95% CI: 87-96, p< 0.01) and specificity (90%; 95% CI: 85-93, p< 0.01). Pooled sensitivity and specificity using image data (92%; 95% CI: 90-94, p< 0.01; and 91%; 95% CI: 88-93, p < 0.01) were higher than those using tabular data (81%; 95% CI: 77-85, p< 0.01; and 83%; 95% CI: 76-88, p < 0.01), respectively. Radiographs demonstrated the highest pooled sensitivity (94%; 95% CI: 90-96, p < 0.01) and specificity (92%; 95% CI: 89-94, p< 0.01). Patient selection and reference standards were major concerns in assessing diagnostic accuracy for bias and applicability. AI displays high diagnostic accuracy for various fracture outcomes, indicating potential utility in healthcare systems for fracture diagnosis. However, enhanced transparency in reporting and adherence to standardized guidelines are necessary to improve the clinical applicability of AI. Review Registration: PROSPERO (CRD42021240359).
Collapse
Affiliation(s)
- Jongyun Jung
- Department of Biomedical Informatics (Dr. Qing Wu, Jongyun Jung, and Jingyuan Dai), College of Medicine, The Ohio State University, Columbus, Ohio, United States of America
| | - Jingyuan Dai
- Department of Biomedical Informatics (Dr. Qing Wu, Jongyun Jung, and Jingyuan Dai), College of Medicine, The Ohio State University, Columbus, Ohio, United States of America
| | - Bowen Liu
- Department of Mathematics and Statistics, Division of Computing, Analytics, and Mathematics, School of Science and Engineering (Bowen Liu), University of Missouri-Kansas City, Kansas City, Missouri, United States of America
| | - Qing Wu
- Department of Biomedical Informatics (Dr. Qing Wu, Jongyun Jung, and Jingyuan Dai), College of Medicine, The Ohio State University, Columbus, Ohio, United States of America
| |
Collapse
|
14
|
Silberstein J, Wee C, Gupta A, Seymour H, Ghotra SS, Sá dos Reis C, Zhang G, Sun Z. Artificial Intelligence-Assisted Detection of Osteoporotic Vertebral Fractures on Lateral Chest Radiographs in Post-Menopausal Women. J Clin Med 2023; 12:7730. [PMID: 38137799 PMCID: PMC10743975 DOI: 10.3390/jcm12247730] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Revised: 12/06/2023] [Accepted: 12/15/2023] [Indexed: 12/24/2023] Open
Abstract
Osteoporotic vertebral fractures (OVFs) are often not reported by radiologists on routine chest radiographs. This study aims to investigate the clinical value of a newly developed artificial intelligence (AI) tool, Ofeye 1.0, for automated detection of OVFs on lateral chest radiographs in post-menopausal women (>60 years) who were referred to undergo chest x-rays for other reasons. A total of 510 de-identified lateral chest radiographs from three clinical sites were retrieved and analysed using the Ofeye 1.0 tool. These images were then reviewed by a consultant radiologist with findings serving as the reference standard for determining the diagnostic performance of the AI tool for the detection of OVFs. Of all the original radiologist reports, missed OVFs were found in 28.8% of images but were detected using the AI tool. The AI tool demonstrated high specificity of 92.8% (95% CI: 89.6, 95.2%), moderate accuracy of 80.3% (95% CI: 76.3, 80.4%), positive predictive value (PPV) of 73.7% (95% CI: 65.2, 80.8%), and negative predictive value (NPV) of 81.5% (95% CI: 79, 83.8%), but low sensitivity of 49% (95% CI: 40.7, 57.3%). The AI tool showed improved sensitivity compared with the original radiologist reports, which was 20.8% (95% CI: 14.5, 28.4). The new AI tool can be used as a complementary tool in routine diagnostic reports for the reduction in missed OVFs in elderly women.
Collapse
Affiliation(s)
- Jenna Silberstein
- Discipline of Medical Radiation Science, Curtin Medical School, Curtin University, Perth, WA 6102, Australia;
| | - Cleo Wee
- Curtin Medical School, Curtin University, Perth, WA 6102, Australia; (C.W.); (A.G.)
| | - Ashu Gupta
- Curtin Medical School, Curtin University, Perth, WA 6102, Australia; (C.W.); (A.G.)
- Radiology Department, Fiona Stanley Hospital, Murdoch, WA 6105, Australia
| | - Hannah Seymour
- Department of Geriatrics and Aged Care, Fiona Stanley Hospital, Murdoch, WA 6150, Australia;
| | - Switinder Singh Ghotra
- Department of Radiology, Hospital of Yverdon-les-Bains (eHnv), 1400 Yverdon-les-Bains, Switzerland;
- School of Health Sciences (HESAV), University of Applied Sciences and Arts Western Switzerland (HES-SO), 1011 Lausanne, Switzerland;
| | - Cláudia Sá dos Reis
- School of Health Sciences (HESAV), University of Applied Sciences and Arts Western Switzerland (HES-SO), 1011 Lausanne, Switzerland;
| | - Guicheng Zhang
- School of Population Health, Curtin University, Perth, WA 6102, Australia;
| | - Zhonghua Sun
- Discipline of Medical Radiation Science, Curtin Medical School, Curtin University, Perth, WA 6102, Australia;
- Curtin Health Research Innovation Institute (CHIRI), Curtin University, Perth, WA 6102, Australia
| |
Collapse
|
15
|
Howlett DC, Drinkwater KJ, Mahmood N, Salman L, Griffin J, Javaid MK, Retnasingam G, Marzoug A, Greenhalgh R. Radiology reporting of incidental osteoporotic vertebral fragility fractures present on CT studies: results of UK national re-audit. Clin Radiol 2023; 78:e1041-e1047. [PMID: 37838545 DOI: 10.1016/j.crad.2023.09.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2023] [Revised: 09/13/2023] [Accepted: 09/17/2023] [Indexed: 10/16/2023]
Abstract
AIM To describe a UK-wide re-audit of the 2019 Royal College of Radiologists (RCR) audit evaluating patient-related data and organisational infrastructure in the radiological reporting of vertebral fragility fractures (VFFs) on computed tomography (CT) studies and to assess the impact of a series of RCR interventions, initiated to raise VFF awareness, on reporting practice and outcomes. MATERIALS AND METHODS Patient specific and organisational questionnaires largely replicated those utilised in 2019. The patient questionnaire involved retrospective analysis of between 50 and 100 consecutive, non-traumatic CT studies which included the thoracolumbar spine. All RCR radiology audit leads were invited to participate. Data collection commenced from 1 April 2022. RESULTS Data were supplied by 129/194 (67%) departments. One thousand five hundred and eighty-six of 7,316 patients (21.7%) had a VFF on auditor review. Overall improvements were demonstrated in key initial/provisional reporting results; comment on spine/bone (93.2%, 14.4% improvement, p<0.0002); fracture severity assessment (34.7%, 8.5% improvement, p=0.0007); use of recommended terminology (67.8%, 7.5% improvement, p=0.0034); recommendations for further management (11.7%, 9.1% improvement, p<0.0002). CONCLUSIONS The 2022 national re-audit confirms improvements in diagnostic performance and practice in VFF reporting. Continuing work is required to build on this improvement and to further embed best practice.
Collapse
Affiliation(s)
- D C Howlett
- Department of Radiology, East Sussex Healthcare NHS Trust, Eastbourne, UK
| | - K J Drinkwater
- Directorate of Education and Professional Practice, Royal College of Radiologists, London, UK.
| | - N Mahmood
- Department of Radiology, University Hospitals Sussex NHS Foundation Trust, Brighton, UK
| | - L Salman
- Department of Radiology, East Sussex Healthcare NHS Trust, Eastbourne, UK
| | - J Griffin
- The Royal Osteoporosis Society, Bath, UK
| | - M K Javaid
- The Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, Oxford, UK
| | - G Retnasingam
- Department of Radiology St Helens and Knowsley Teaching Hospitals NHS Trust, Prescot, UK
| | - A Marzoug
- Department of Radiology, Ninewells Hospital, Dundee, UK
| | - R Greenhalgh
- Department of Radiology, London North West University Healthcare NHS Trust, Harrow, UK
| |
Collapse
|
16
|
Dong Q, Luo G, Lane NE, Lui LY, Marshall LM, Johnston SK, Dabbous H, O'Reilly M, Linnau KF, Perry J, Chang BC, Renslo J, Haynor D, Jarvik JG, Cross NM. Generalizability of Deep Learning Classification of Spinal Osteoporotic Compression Fractures on Radiographs Using an Adaptation of the Modified-2 Algorithm-Based Qualitative Criteria. Acad Radiol 2023; 30:2973-2987. [PMID: 37438161 PMCID: PMC10776803 DOI: 10.1016/j.acra.2023.04.023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2023] [Revised: 04/13/2023] [Accepted: 04/20/2023] [Indexed: 07/14/2023]
Abstract
RATIONALE AND OBJECTIVES Spinal osteoporotic compression fractures (OCFs) can be an early biomarker for osteoporosis but are often subtle, incidental, and underreported. To ensure early diagnosis and treatment of osteoporosis, we aimed to build a deep learning vertebral body classifier for OCFs as a critical component of our future automated opportunistic screening tool. MATERIALS AND METHODS We retrospectively assembled a local dataset, including 1790 subjects and 15,050 vertebral bodies (thoracic and lumbar). Each vertebral body was annotated using an adaption of the modified-2 algorithm-based qualitative criteria. The Osteoporotic Fractures in Men (MrOS) Study dataset provided thoracic and lumbar spine radiographs of 5994 men from six clinical centers. Using both datasets, five deep learning algorithms were trained to classify each individual vertebral body of the spine radiographs. Classification performance was compared for these models using multiple metrics, including the area under the receiver operating characteristic curve (AUC-ROC), sensitivity, specificity, and positive predictive value (PPV). RESULTS Our best model, built with ensemble averaging, achieved an AUC-ROC of 0.948 and 0.936 on the local dataset's test set and the MrOS dataset's test set, respectively. After setting the cutoff threshold to prioritize PPV, this model achieved a sensitivity of 54.5% and 47.8%, a specificity of 99.7% and 99.6%, and a PPV of 89.8% and 94.8%. CONCLUSION Our model achieved an AUC-ROC>0.90 on both datasets. This testing shows some generalizability to real-world clinical datasets and a suitable performance for a future opportunistic osteoporosis screening tool.
Collapse
Affiliation(s)
- Qifei Dong
- Department of Biomedical Informatics and Medical Education, University of Washington, Seattle, Washington (Q.D., G.L., B.C.C.)
| | - Gang Luo
- Department of Biomedical Informatics and Medical Education, University of Washington, Seattle, Washington (Q.D., G.L., B.C.C.)
| | - Nancy E Lane
- Department of Medicine, University of California - Davis, Sacramento, California (N.E.L.)
| | - Li-Yung Lui
- Research Institute, California Pacific Medical Center, San Francisco, California (L.-Y.L.)
| | - Lynn M Marshall
- Epidemiology Programs, Oregon Health and Science University-Portland State University School of Public Health, Portland, Oregon (L.M.M.)
| | - Sandra K Johnston
- Department of Radiology, University of Washington, Seattle, Washington (S.K.J., K.F.L., D.H., N.M.C)
| | - Howard Dabbous
- Department of Radiology and Imaging Sciences, Emory University, Atlanta, Georgia (H.D.)
| | - Michael O'Reilly
- Department of Radiology, University of Limerick Hospital Group, Limerick, Ireland (M.O.)
| | - Ken F Linnau
- Department of Radiology, University of Washington, Seattle, Washington (S.K.J., K.F.L., D.H., N.M.C)
| | - Jessica Perry
- Department of Biostatistics, University of Washington, Seattle, Washington (J.P.)
| | - Brian C Chang
- Department of Biomedical Informatics and Medical Education, University of Washington, Seattle, Washington (Q.D., G.L., B.C.C.)
| | - Jonathan Renslo
- Keck School of Medicine, University of Southern California, Los Angeles, California (J.R.)
| | - David Haynor
- Department of Radiology, University of Washington, Seattle, Washington (S.K.J., K.F.L., D.H., N.M.C)
| | - Jeffrey G Jarvik
- Departments of Radiology and Neurological Surgery, University of Washington, Seattle, Washington (J.G.J)
| | - Nathan M Cross
- Department of Radiology, University of Washington, Seattle, Washington (S.K.J., K.F.L., D.H., N.M.C).
| |
Collapse
|
17
|
Jo SW, Khil EK, Lee KY, Choi I, Yoon YS, Cha JG, Lee JH, Kim H, Lee SY. Deep learning system for automated detection of posterior ligamentous complex injury in patients with thoracolumbar fracture on MRI. Sci Rep 2023; 13:19017. [PMID: 37923853 PMCID: PMC10624679 DOI: 10.1038/s41598-023-46208-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2023] [Accepted: 10/29/2023] [Indexed: 11/06/2023] Open
Abstract
This study aimed to develop a deep learning (DL) algorithm for automated detection and localization of posterior ligamentous complex (PLC) injury in patients with acute thoracolumbar (TL) fracture on magnetic resonance imaging (MRI) and evaluate its diagnostic performance. In this retrospective multicenter study, using midline sagittal T2-weighted image with fracture (± PLC injury), a training dataset and internal and external validation sets of 300, 100, and 100 patients, were constructed with equal numbers of injured and normal PLCs. The DL algorithm was developed through two steps (Attention U-net and Inception-ResNet-V2). We evaluate the diagnostic performance for PLC injury between the DL algorithm and radiologists with different levels of experience. The area under the curves (AUCs) generated by the DL algorithm were 0.928, 0.916 for internal and external validations, and by two radiologists for observer performance test were 0.930, 0.830, respectively. Although no significant difference was found in diagnosing PLC injury between the DL algorithm and radiologists, the DL algorithm exhibited a trend of higher AUC than the radiology trainee. Notably, the radiology trainee's diagnostic performance significantly improved with DL algorithm assistance. Therefore, the DL algorithm exhibited high diagnostic performance in detecting PLC injuries in acute TL fractures.
Collapse
Affiliation(s)
- Sang Won Jo
- Department of Radiology, Hallym University Dongtan Sacred Heart Hospital, 7, Keunjaebong-gil, Hwaseong-si, Republic of Korea
| | - Eun Kyung Khil
- Department of Radiology, Hallym University Dongtan Sacred Heart Hospital, 7, Keunjaebong-gil, Hwaseong-si, Republic of Korea.
- Department of Radiology, Fastbone Orthopedic Hospital, Hwaseong-si, Republic of Korea.
| | - Kyoung Yeon Lee
- Department of Radiology, Hallym University Dongtan Sacred Heart Hospital, 7, Keunjaebong-gil, Hwaseong-si, Republic of Korea
| | - Il Choi
- Department of Neurologic Surgery, Hallym University Dongtan Sacred Heart Hospital, Hwaseong-si, Republic of Korea
| | - Yu Sung Yoon
- Department of Radiology, Soonchunhyang University Bucheon Hospital, Bucheon, Republic of Korea
- Department of Radiology, Kyungpook National University Hospital, Daegu, Republic of Korea
| | - Jang Gyu Cha
- Department of Radiology, Soonchunhyang University Bucheon Hospital, Bucheon, Republic of Korea
| | | | | | | |
Collapse
|
18
|
Ono Y, Suzuki N, Sakano R, Kikuchi Y, Kimura T, Sutherland K, Kamishima T. A Deep Learning-Based Model for Classifying Osteoporotic Lumbar Vertebral Fractures on Radiographs: A Retrospective Model Development and Validation Study. J Imaging 2023; 9:187. [PMID: 37754951 PMCID: PMC10532676 DOI: 10.3390/jimaging9090187] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Revised: 09/08/2023] [Accepted: 09/12/2023] [Indexed: 09/28/2023] Open
Abstract
Early diagnosis and initiation of treatment for fresh osteoporotic lumbar vertebral fractures (OLVF) are crucial. Magnetic resonance imaging (MRI) is generally performed to differentiate between fresh and old OLVF. However, MRIs can be intolerable for patients with severe back pain. Furthermore, it is difficult to perform in an emergency. MRI should therefore only be performed in appropriately selected patients with a high suspicion of fresh fractures. As radiography is the first-choice imaging examination for the diagnosis of OLVF, improving screening accuracy with radiographs will optimize the decision of whether an MRI is necessary. This study aimed to develop a method to automatically classify lumbar vertebrae (LV) conditions such as normal, old, or fresh OLVF using deep learning methods with radiography. A total of 3481 LV images for training, validation, and testing and 662 LV images for external validation were collected. Visual evaluation by two radiologists determined the ground truth of LV diagnoses. Three convolutional neural networks were ensembled. The accuracy, sensitivity, and specificity were 0.89, 0.83, and 0.92 in the test and 0.84, 0.76, and 0.89 in the external validation, respectively. The results suggest that the proposed method can contribute to the accurate automatic classification of LV conditions on radiography.
Collapse
Affiliation(s)
- Yohei Ono
- Department of Radiology, NTT East Medical Center Sapporo, South-1 West-15, Chuo-Ku, Sapporo 060-0061, Japan; (Y.O.); (N.S.)
- Graduate School of Health Sciences, Hokkaido University, North-12 West-5, Kita-Ku, Sapporo 060-0812, Japan
| | - Nobuaki Suzuki
- Department of Radiology, NTT East Medical Center Sapporo, South-1 West-15, Chuo-Ku, Sapporo 060-0061, Japan; (Y.O.); (N.S.)
| | - Ryosuke Sakano
- Department of Radiological Technology, Hokkaido University Hospital, Kita-14 Nishi-5, Kita-Ku, Sapporo 060-8648, Japan;
| | - Yasuka Kikuchi
- Department of Radiology, NTT East Medical Center Sapporo, South-1 West-15, Chuo-Ku, Sapporo 060-0061, Japan; (Y.O.); (N.S.)
- Department of Diagnostic Imaging, Faculty of Medicine, Hokkaido University, Kita-15 Nishi-7, Kita-Ku, Sapporo 060-8638, Japan
- Department of Diagnostic and Interventional Radiology, Tonan Hospital, Kita 4 Nishi 7, Chuo-Ku, Sapporo 060-0004, Japan;
| | - Tasuku Kimura
- Department of Radiology, NTT East Medical Center Sapporo, South-1 West-15, Chuo-Ku, Sapporo 060-0061, Japan; (Y.O.); (N.S.)
- Department of Radiology, Hokkaido Medical Center, Yamanote5-7, Nishi-Ku, Sapporo 063-0005, Japan;
| | - Kenneth Sutherland
- Global Center for Biomedical Science and Engineering, Hokkaido University, North-15 West-7, Kita-Ku, Sapporo 060-8638, Japan;
| | - Tamotsu Kamishima
- Faculty of Health Sciences, Hokkaido University, North-12 West-5, Kita-Ku, Sapporo 060-0812, Japan
| |
Collapse
|
19
|
Constant C, Aubin CE, Kremers HM, Garcia DVV, Wyles CC, Rouzrokh P, Larson AN. The use of deep learning in medical imaging to improve spine care: A scoping review of current literature and clinical applications. NORTH AMERICAN SPINE SOCIETY JOURNAL 2023; 15:100236. [PMID: 37599816 PMCID: PMC10432249 DOI: 10.1016/j.xnsj.2023.100236] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/20/2023] [Accepted: 06/14/2023] [Indexed: 08/22/2023]
Abstract
Background Artificial intelligence is a revolutionary technology that promises to assist clinicians in improving patient care. In radiology, deep learning (DL) is widely used in clinical decision aids due to its ability to analyze complex patterns and images. It allows for rapid, enhanced data, and imaging analysis, from diagnosis to outcome prediction. The purpose of this study was to evaluate the current literature and clinical utilization of DL in spine imaging. Methods This study is a scoping review and utilized the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) methodology to review the scientific literature from 2012 to 2021. A search in PubMed, Web of Science, Embased, and IEEE Xplore databases with syntax specific for DL and medical imaging in spine care applications was conducted to collect all original publications on the subject. Specific data was extracted from the available literature, including algorithm application, algorithms tested, database type and size, algorithm training method, and outcome of interest. Results A total of 365 studies (total sample of 232,394 patients) were included and grouped into 4 general applications: diagnostic tools, clinical decision support tools, automated clinical/instrumentation assessment, and clinical outcome prediction. Notable disparities exist in the selected algorithms and the training across multiple disparate databases. The most frequently used algorithms were U-Net and ResNet. A DL model was developed and validated in 92% of included studies, while a pre-existing DL model was investigated in 8%. Of all developed models, only 15% of them have been externally validated. Conclusions Based on this scoping review, DL in spine imaging is used in a broad range of clinical applications, particularly for diagnosing spinal conditions. There is a wide variety of DL algorithms, database characteristics, and training methods. Future studies should focus on external validation of existing models before bringing them into clinical use.
Collapse
Affiliation(s)
- Caroline Constant
- Orthopedic Surgery AI Laboratory, Mayo Clinic, 200 1st St Southwest, Rochester, MN, 55902, United States
- Polytechnique Montreal, 2500 Chem. de Polytechnique, Montréal, QC H3T 1J4, Canada
- AO Research Institute Davos, Clavadelerstrasse 8, CH 7270, Davos, Switzerland
| | - Carl-Eric Aubin
- Polytechnique Montreal, 2500 Chem. de Polytechnique, Montréal, QC H3T 1J4, Canada
| | - Hilal Maradit Kremers
- Orthopedic Surgery AI Laboratory, Mayo Clinic, 200 1st St Southwest, Rochester, MN, 55902, United States
| | - Diana V. Vera Garcia
- Orthopedic Surgery AI Laboratory, Mayo Clinic, 200 1st St Southwest, Rochester, MN, 55902, United States
| | - Cody C. Wyles
- Orthopedic Surgery AI Laboratory, Mayo Clinic, 200 1st St Southwest, Rochester, MN, 55902, United States
- Department of Orthopedic Surgery, Mayo Clinic, 200, 1st St Southwest, Rochester, MN, 55902, United States
| | - Pouria Rouzrokh
- Orthopedic Surgery AI Laboratory, Mayo Clinic, 200 1st St Southwest, Rochester, MN, 55902, United States
- Radiology Informatics Laboratory, Mayo Clinic, 200, 1st St Southwest, Rochester, MN, 55902, United States
| | - Annalise Noelle Larson
- Orthopedic Surgery AI Laboratory, Mayo Clinic, 200 1st St Southwest, Rochester, MN, 55902, United States
- Department of Orthopedic Surgery, Mayo Clinic, 200, 1st St Southwest, Rochester, MN, 55902, United States
| |
Collapse
|
20
|
Shen L, Gao C, Hu S, Kang D, Zhang Z, Xia D, Xu Y, Xiang S, Zhu Q, Xu G, Tang F, Yue H, Yu W, Zhang Z. Using Artificial Intelligence to Diagnose Osteoporotic Vertebral Fractures on Plain Radiographs. J Bone Miner Res 2023; 38:1278-1287. [PMID: 37449775 DOI: 10.1002/jbmr.4879] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/17/2023] [Revised: 06/18/2023] [Accepted: 07/06/2023] [Indexed: 07/18/2023]
Abstract
Osteoporotic vertebral fracture (OVF) is a risk factor for morbidity and mortality in elderly population, and accurate diagnosis is important for improving treatment outcomes. OVF diagnosis suffers from high misdiagnosis and underdiagnosis rates, as well as high workload. Deep learning methods applied to plain radiographs, a simple, fast, and inexpensive examination, might solve this problem. We developed and validated a deep-learning-based vertebral fracture diagnostic system using area loss ratio, which assisted a multitasking network to perform skeletal position detection and segmentation and identify and grade vertebral fractures. As the training set and internal validation set, we used 11,397 plain radiographs from six community centers in Shanghai. For the external validation set, 1276 participants were recruited from the outpatient clinic of the Shanghai Sixth People's Hospital (1276 plain radiographs). Radiologists performed all X-ray images and used the Genant semiquantitative tool for fracture diagnosis and grading as the ground truth data. Accuracy, sensitivity, specificity, positive predictive value, and negative predictive value were used to evaluate diagnostic performance. The AI_OVF_SH system demonstrated high accuracy and computational speed in skeletal position detection and segmentation. In the internal validation set, the accuracy, sensitivity, and specificity with the AI_OVF_SH model were 97.41%, 84.08%, and 97.25%, respectively, for all fractures. The sensitivity and specificity for moderate fractures were 88.55% and 99.74%, respectively, and for severe fractures, they were 92.30% and 99.92%. In the external validation set, the accuracy, sensitivity, and specificity for all fractures were 96.85%, 83.35%, and 94.70%, respectively. For moderate fractures, the sensitivity and specificity were 85.61% and 99.85%, respectively, and 93.46% and 99.92% for severe fractures. Therefore, the AI_OVF_SH system is an efficient tool to assist radiologists and clinicians to improve the diagnosing of vertebral fractures. © 2023 The Authors. Journal of Bone and Mineral Research published by Wiley Periodicals LLC on behalf of American Society for Bone and Mineral Research (ASBMR).
Collapse
Affiliation(s)
- Li Shen
- Department of Osteoporosis and Bone Disease, Shanghai Clinical Research Center of Bone Disease, Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
- Clinical Research Center, Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Chao Gao
- Department of Osteoporosis and Bone Disease, Shanghai Clinical Research Center of Bone Disease, Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Shundong Hu
- Department of Radiology, Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Dan Kang
- Shanghai Jiyinghui Intelligent Technology Co, Shanghai, China
| | - Zhaogang Zhang
- Shanghai Jiyinghui Intelligent Technology Co, Shanghai, China
| | - Dongdong Xia
- Department of Orthopaedics, Ning Bo First Hospital, Zhejiang, China
| | - Yiren Xu
- Department of Radiology, Ning Bo First Hospital, Zhejiang, China
| | - Shoukui Xiang
- Department of Endocrinology and Metabolism, The First People's Hospital of Changzhou, Changzhou, China
| | - Qiong Zhu
- Kangjian Community Health Service Center, Shanghai, China
| | - GeWen Xu
- Kangjian Community Health Service Center, Shanghai, China
| | - Feng Tang
- Jinhui Community Health Service Center, Shanghai, China
| | - Hua Yue
- Department of Osteoporosis and Bone Disease, Shanghai Clinical Research Center of Bone Disease, Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Wei Yu
- Department of Radiology, Peking Union Medical College Hospital, Beijing, China
| | - Zhenlin Zhang
- Department of Osteoporosis and Bone Disease, Shanghai Clinical Research Center of Bone Disease, Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
- Clinical Research Center, Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| |
Collapse
|
21
|
Skuban-Eiseler T, Orzechowski M, Denkinger M, Kocar TD, Leinert C, Steger F. Artificial Intelligence-Based Clinical Decision Support Systems in Geriatrics: An Ethical Analysis. J Am Med Dir Assoc 2023; 24:1271-1276.e4. [PMID: 37453451 DOI: 10.1016/j.jamda.2023.06.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2023] [Revised: 06/08/2023] [Accepted: 06/08/2023] [Indexed: 07/18/2023]
Abstract
OBJECTIVES To provide an ethical analysis of the implications of the usage of artificial intelligence-supported clinical decision support systems (AI-CDSS) in geriatrics. DESIGN Ethical analysis based on the normative arguments regarding the use of AI-CDSS in geriatrics using a principle-based ethical framework. SETTING AND PARTICIPANTS Normative arguments identified in 29 articles on AI-CDSS in geriatrics. METHODS Our analysis is based on a literature search that was done to determine ethical arguments that are currently discussed regarding AI-CDSS. The relevant articles were subjected to a detailed qualitative analysis regarding the ethical considerations Supplementary Datamentioned therein. We then discussed the identified arguments within the frame of the 4 principles of medical ethics according to Beauchamp and Childress and with respect to the needs of frail older adults. RESULTS We found a total of 5089 articles; 29 articles met the inclusion criteria and were subsequently subjected to a detailed qualitative analysis. We could not identify any systematic analysis of the ethical implications of AI-CDSS in geriatrics. The ethical considerations are very unsystematic and scattered, and the existing literature has a predominantly technical focus emphasizing the technology's utility. In an extensive ethical analysis, we systematically discuss the ethical implications of the usage of AI-CDSS in geriatrics. CONCLUSIONS AND IMPLICATIONS AI-CDSS in geriatrics can be a great asset, especially when dealing with patients with cognitive disorders; however, from an ethical perspective, we see the need for further research. By using AI-CDSS, older patients' values and beliefs might be overlooked, and the quality of the doctor-patient relationship might be altered, endangering compliance to the 4 ethical principles of Beauchamp and Childress.
Collapse
Affiliation(s)
- Tobias Skuban-Eiseler
- Institute of the History, Philosophy and Ethics of Medicine, Faculty of Medicine, Ulm University, Ulm, Germany; kbo-Isar-Amper-Klinikum Region München, München-Haar, Germany.
| | - Marcin Orzechowski
- Institute of the History, Philosophy and Ethics of Medicine, Faculty of Medicine, Ulm University, Ulm, Germany
| | - Michael Denkinger
- Institute of Geriatric Research, Ulm University Medical Center, Ulm, Germany; AGAPLESION Bethesda Clinic Ulm, Ulm, Germany
| | - Thomas Derya Kocar
- Institute of Geriatric Research, Ulm University Medical Center, Ulm, Germany; AGAPLESION Bethesda Clinic Ulm, Ulm, Germany
| | - Christoph Leinert
- Institute of Geriatric Research, Ulm University Medical Center, Ulm, Germany; AGAPLESION Bethesda Clinic Ulm, Ulm, Germany
| | - Florian Steger
- Institute of the History, Philosophy and Ethics of Medicine, Faculty of Medicine, Ulm University, Ulm, Germany
| |
Collapse
|
22
|
Wilson NA. CORR Insights®: Can a Deep Learning Algorithm Improve Detection of Occult Scaphoid Fractures in Plain Radiographs? A Clinical Validation Study. Clin Orthop Relat Res 2023; 481:1836-1838. [PMID: 37039785 PMCID: PMC10427042 DOI: 10.1097/corr.0000000000002663] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/07/2023] [Accepted: 03/21/2023] [Indexed: 04/12/2023]
Affiliation(s)
- Nicole A Wilson
- Assistant Professor of Surgery, Pediatrics, and Biomedical Engineering, Division of Pediatric Surgery, University of Rochester, Rochester, NY, USA
| |
Collapse
|
23
|
Zhang J, Li Z, Lin H, Xue M, Wang H, Fang Y, Liu S, Huo T, Zhou H, Yang J, Xie Y, Xie M, Lu L, Liu P, Ye Z. Deep learning assisted diagnosis system: improving the diagnostic accuracy of distal radius fractures. Front Med (Lausanne) 2023; 10:1224489. [PMID: 37663656 PMCID: PMC10471443 DOI: 10.3389/fmed.2023.1224489] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Accepted: 08/04/2023] [Indexed: 09/05/2023] Open
Abstract
Objectives To explore an intelligent detection technology based on deep learning algorithms to assist the clinical diagnosis of distal radius fractures (DRFs), and further compare it with human performance to verify the feasibility of this method. Methods A total of 3,240 patients (fracture: n = 1,620, normal: n = 1,620) were included in this study, with a total of 3,276 wrist joint anteroposterior (AP) X-ray films (1,639 fractured, 1,637 normal) and 3,260 wrist joint lateral X-ray films (1,623 fractured, 1,637 normal). We divided the patients into training set, validation set and test set in a ratio of 7:1.5:1.5. The deep learning models were developed using the data from the training and validation sets, and then their effectiveness were evaluated using the data from the test set. Evaluate the diagnostic performance of deep learning models using receiver operating characteristic (ROC) curves and area under the curve (AUC), accuracy, sensitivity, and specificity, and compare them with medical professionals. Results The deep learning ensemble model had excellent accuracy (97.03%), sensitivity (95.70%), and specificity (98.37%) in detecting DRFs. Among them, the accuracy of the AP view was 97.75%, the sensitivity 97.13%, and the specificity 98.37%; the accuracy of the lateral view was 96.32%, the sensitivity 94.26%, and the specificity 98.37%. When the wrist joint is counted, the accuracy was 97.55%, the sensitivity 98.36%, and the specificity 96.73%. In terms of these variables, the performance of the ensemble model is superior to that of both the orthopedic attending physician group and the radiology attending physician group. Conclusion This deep learning ensemble model has excellent performance in detecting DRFs on plain X-ray films. Using this artificial intelligence model as a second expert to assist clinical diagnosis is expected to improve the accuracy of diagnosing DRFs and enhance clinical work efficiency.
Collapse
Affiliation(s)
- Jiayao Zhang
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Zhimin Li
- School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan, China
| | - Heng Lin
- Department of Orthopedics, Nanzhang People’s Hospital, Nanzhang, China
| | - Mingdi Xue
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Honglin Wang
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Ying Fang
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Songxiang Liu
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Tongtong Huo
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan, China
| | - Hong Zhou
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Jiaming Yang
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Yi Xie
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Mao Xie
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Lin Lu
- Department of Orthopedics, Renmin Hospital of Wuhan University, Wuhan, China
| | - Pengran Liu
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Zhewei Ye
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| |
Collapse
|
24
|
Karnuta JM. CORR Insights®: Can Artificial Intelligence Pass the American Board of Orthopaedic Surgery Examination? Orthopaedic Residents Versus ChatGPT. Clin Orthop Relat Res 2023; 481:1631-1633. [PMID: 37335233 PMCID: PMC10344508 DOI: 10.1097/corr.0000000000002741] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/12/2023] [Accepted: 05/23/2023] [Indexed: 06/21/2023]
Affiliation(s)
- Jaret McGraw Karnuta
- Resident Physician, Hospital of the University of Pennsylvania, Philadelphia, PA, USA
| |
Collapse
|
25
|
Zhang J, Lin H, Wang H, Xue M, Fang Y, Liu S, Huo T, Zhou H, Yang J, Xie Y, Xie M, Cheng L, Lu L, Liu P, Ye Z. Deep learning system assisted detection and localization of lumbar spondylolisthesis. Front Bioeng Biotechnol 2023; 11:1194009. [PMID: 37539438 PMCID: PMC10394621 DOI: 10.3389/fbioe.2023.1194009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2023] [Accepted: 07/10/2023] [Indexed: 08/05/2023] Open
Abstract
Objective: Explore a new deep learning (DL) object detection algorithm for clinical auxiliary diagnosis of lumbar spondylolisthesis and compare it with doctors' evaluation to verify the effectiveness and feasibility of the DL algorithm in the diagnosis of lumbar spondylolisthesis. Methods: Lumbar lateral radiographs of 1,596 patients with lumbar spondylolisthesis from three medical institutions were collected, and senior orthopedic surgeons and radiologists jointly diagnosed and marked them to establish a database. These radiographs were randomly divided into a training set (n = 1,117), a validation set (n = 240), and a test set (n = 239) in a ratio of 0.7 : 0.15: 0.15. We trained two DL models for automatic detection of spondylolisthesis and evaluated their diagnostic performance by PR curves, areas under the curve, precision, recall, F1-score. Then we chose the model with better performance and compared its results with professionals' evaluation. Results: A total of 1,780 annotations were marked for training (1,242), validation (263), and test (275). The Faster Region-based Convolutional Neural Network (R-CNN) showed better precision (0.935), recall (0.935), and F1-score (0.935) in the detection of spondylolisthesis, which outperformed the doctor group with precision (0.927), recall (0.892), f1-score (0.910). In addition, with the assistance of the DL model, the precision of the doctor group increased by 4.8%, the recall by 8.2%, the F1-score by 6.4%, and the average diagnosis time per plain X-ray was shortened by 7.139 s. Conclusion: The DL detection algorithm is an effective method for clinical diagnosis of lumbar spondylolisthesis. It can be used as an assistant expert to improve the accuracy of lumbar spondylolisthesis diagnosis and reduce the clinical workloads.
Collapse
Affiliation(s)
- Jiayao Zhang
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Heng Lin
- Department of Orthopedics, Nanzhang People’s Hospital, Nanzhang, China
| | - Honglin Wang
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Mingdi Xue
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Ying Fang
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Songxiang Liu
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Tongtong Huo
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Hong Zhou
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Jiaming Yang
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Yi Xie
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Mao Xie
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Liangli Cheng
- Department of Orthopedics, Daye People’s Hospital, Daye, China
| | - Lin Lu
- Department of Orthopedics, Renmin Hospital of Wuhan University, Wuhan, China
| | - Pengran Liu
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Zhewei Ye
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| |
Collapse
|
26
|
Ryu SM, Lee S, Jang M, Koh JM, Bae SJ, Jegal SG, Shin K, Kim N. Diagnosis of osteoporotic vertebral compression fractures and fracture level detection using multitask learning with U-Net in lumbar spine lateral radiographs. Comput Struct Biotechnol J 2023; 21:3452-3458. [PMID: 37457807 PMCID: PMC10345217 DOI: 10.1016/j.csbj.2023.06.017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2023] [Revised: 06/18/2023] [Accepted: 06/24/2023] [Indexed: 07/18/2023] Open
Abstract
Recent studies of automatic diagnosis of vertebral compression fractures (VCFs) using deep learning mainly focus on segmentation and vertebral level detection in lumbar spine lateral radiographs (LSLRs). Herein, we developed a model for simultaneous VCF diagnosis and vertebral level detection without using adjacent vertebral bodies. In total, 1102 patients with VCF, 1171 controls were enrolled. The 1865, 208, and 198 LSLRS were divided into training, validation, and test dataset. A ground truth label with a 4-point trapezoidal shape was made based on radiological reports showing normal or VCF at some vertebral level. We applied a modified U-Net architecture, in which decoders were trained to detect VCF and vertebral levels, sharing the same encoder. The multi-task model was significantly better than the single-task model in sensitivity and area under the receiver operating characteristic curve. In the internal dataset, the accuracy, sensitivity, and specificity of fracture detection per patient or vertebral body were 0.929, 0.944, and 0.917 or 0.947, 0.628, and 0.977, respectively. In external validation, those of fracture detection per patient or vertebral body were 0.713, 0.979, and 0.447 or 0.828, 0.936, and 0.820, respectively. The success rates were 96 % and 94 % for vertebral level detection in internal and external validation, respectively. The multi-task-shared encoder was significantly better than the single-task encoder. Furthermore, both fracture and vertebral level detection was good in internal and external validation. Our deep learning model may help radiologists perform real-life medical examinations.
Collapse
Affiliation(s)
- Seung Min Ryu
- Department of Orthopedic Surgery, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
- Department of Biomedical Engineering, Asan Medical Institute of Convergence Science and Technology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Soyoung Lee
- Department of Biomedical Engineering, Asan Medical Institute of Convergence Science and Technology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Miso Jang
- Department of Convergence Medicine, Asan Medical Institute of Convergence Science and Technology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Jung-Min Koh
- Division of Endocrinology and Metabolism, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Sung Jin Bae
- Department of Health Screening and Promotion Center, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Seong Gyu Jegal
- Department of Biomedical Engineering, Asan Medical Institute of Convergence Science and Technology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Keewon Shin
- Department of Biomedical Engineering, Asan Medical Institute of Convergence Science and Technology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Namkug Kim
- Department of Biomedical Engineering, Asan Medical Institute of Convergence Science and Technology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
- Department of Convergence Medicine, Asan Medical Institute of Convergence Science and Technology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| |
Collapse
|
27
|
Gupta P, Kingston KA, O’Malley M, Williams RJ, Ramkumar PN. Advancements in Artificial Intelligence for Foot and Ankle Surgery: A Systematic Review. FOOT & ANKLE ORTHOPAEDICS 2023; 8:24730114221151079. [PMID: 36817020 PMCID: PMC9929923 DOI: 10.1177/24730114221151079] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/16/2023] Open
Abstract
Background There has been a rapid increase in research applying artificial intelligence (AI) to various subspecialties of orthopaedic surgery, including foot and ankle surgery. The purpose of this systematic review is to (1) characterize the topics and objectives of studies using AI in foot and ankle surgery, (2) evaluate the performance of their models, and (3) evaluate their validity (internal or external validation). Methods A systematic literature review was conducted using PubMed/MEDLINE and Embase databases in December 2022. All studies that used AI or its subsets machine learning (ML) and deep learning (DL) in the setting of foot and ankle surgery relevant to orthopaedic surgeons were included. Studies were evaluated for their demographics, subject area, outcomes of interest, model(s) tested, model(s)' performance, and validity (internal or external). Results A total of 31 studies met inclusion criteria: 14 studies investigated AI for image interpretation, 13 studies investigated AI for clinical predictions, and 4 studies were grouped as "other." Studies commonly explored AI for ankle fractures, calcaneus fractures, hallux valgus, Achilles tendon pathologies, plantar fasciitis, and sports injuries. For studies reporting the area under the receiver operating characteristic curve (AUC), AUCs ranged from 0.64 (poor) to 0.99 (excellent). Two studies (6.45%) reported external validation. Conclusion Applications of AI in the field of foot and ankle surgery are expanding, particularly for image interpretation and clinical predictions. Current model performances range from poor to excellent, and most studies lack external validation, demonstrating a need for further research prior to deploying AI-based clinical applications. Level of Evidence Level III, retrospective cohort study.
Collapse
Affiliation(s)
- Puneet Gupta
- Department of Orthopaedic Surgery, George Washington University School of Medicine and Health Sciences, Washington, DC, USA
| | | | - Martin O’Malley
- Hospital for Special Surgery, New York, NY, USA,Brooklyn Nets, National Basketball Association (NBA), Brooklyn, NY, USA
| | - Riley J. Williams
- Hospital for Special Surgery, New York, NY, USA,Brooklyn Nets, National Basketball Association (NBA), Brooklyn, NY, USA
| | - Prem N. Ramkumar
- Hospital for Special Surgery, New York, NY, USA,Brooklyn Nets, National Basketball Association (NBA), Brooklyn, NY, USA,Prem N. Ramkumar, MD, MBA, Hospital for Special Surgery, 535 E 70th St, New York, NY 10021-4898, USA.
| |
Collapse
|
28
|
A practical guide to the development and deployment of deep learning models for the orthopedic surgeon: part II. Knee Surg Sports Traumatol Arthrosc 2023; 31:1635-1643. [PMID: 36773057 DOI: 10.1007/s00167-023-07338-7] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/20/2022] [Accepted: 01/30/2023] [Indexed: 02/12/2023]
Abstract
Deep learning has the potential to be one of the most transformative technologies to impact orthopedic surgery. Substantial innovation in this area has occurred over the past 5 years, but clinically meaningful advancements remain limited by a disconnect between clinical and technical experts. That is, it is likely that few orthopedic surgeons possess both the clinical knowledge necessary to identify orthopedic problems, and the technical knowledge needed to implement deep learning-based solutions. To maximize the utilization of rapidly advancing technologies derived from deep learning models, orthopedic surgeons should understand the steps needed to design, organize, implement, and evaluate a deep learning project and its workflow. Equipping surgeons with this knowledge is the objective of this three-part editorial review. Part I described the processes involved in defining the problem, team building, data acquisition, curation, labeling, and establishing the ground truth. Building on that, this review (Part II) provides guidance on pre-processing and augmenting the data, making use of open-source libraries/toolkits, and selecting the required hardware to implement the pipeline. Special considerations regarding model training and evaluation unique to deep learning models relative to "shallow" machine learning models are also reviewed. Finally, guidance pertaining to the clinical deployment of deep learning models in the real world is provided. As in Part I, the focus is on applications of deep learning for computer vision and imaging.
Collapse
|
29
|
Performance of a deep convolutional neural network for MRI-based vertebral body measurements and insufficiency fracture detection. Eur Radiol 2022; 33:3188-3199. [PMID: 36576545 PMCID: PMC10121505 DOI: 10.1007/s00330-022-09354-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2022] [Revised: 09/23/2022] [Accepted: 11/29/2022] [Indexed: 12/29/2022]
Abstract
OBJECTIVES The aim is to validate the performance of a deep convolutional neural network (DCNN) for vertebral body measurements and insufficiency fracture detection on lumbar spine MRI. METHODS This retrospective analysis included 1000 vertebral bodies in 200 patients (age 75.2 ± 9.8 years) who underwent lumbar spine MRI at multiple institutions. 160/200 patients had ≥ one vertebral body insufficiency fracture, 40/200 had no fracture. The performance of the DCNN and that of two fellowship-trained musculoskeletal radiologists in vertebral body measurements (anterior/posterior height, extent of endplate concavity, vertebral angle) and evaluation for insufficiency fractures were compared. Statistics included (a) interobserver reliability metrics using intraclass correlation coefficient (ICC), kappa statistics, and Bland-Altman analysis, and (b) diagnostic performance metrics (sensitivity, specificity, accuracy). A statistically significant difference was accepted if the 95% confidence intervals did not overlap. RESULTS The inter-reader agreement between radiologists and the DCNN was excellent for vertebral body measurements, with ICC values of > 0.94 for anterior and posterior vertebral height and vertebral angle, and good to excellent for superior and inferior endplate concavity with ICC values of 0.79-0.85. The performance of the DCNN in fracture detection yielded a sensitivity of 0.941 (0.903-0.968), specificity of 0.969 (0.954-0.980), and accuracy of 0.962 (0.948-0.973). The diagnostic performance of the DCNN was independent of the radiological institution (accuracy 0.964 vs. 0.960), type of MRI scanner (accuracy 0.957 vs. 0.964), and magnetic field strength (accuracy 0.966 vs. 0.957). CONCLUSIONS A DCNN can achieve high diagnostic performance in vertebral body measurements and insufficiency fracture detection on heterogeneous lumbar spine MRI. KEY POINTS • A DCNN has the potential for high diagnostic performance in measuring vertebral bodies and detecting insufficiency fractures of the lumbar spine.
Collapse
|
30
|
Park S, Kim JK, Chang MC, Park JJ, Yang JJ, Lee GW. Assessment of Fusion After Anterior Cervical Discectomy and Fusion Using Convolutional Neural Network Algorithm. Spine (Phila Pa 1976) 2022; 47:1645-1650. [PMID: 35905310 DOI: 10.1097/brs.0000000000004439] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/03/2022] [Accepted: 06/28/2022] [Indexed: 02/01/2023]
Abstract
BACKGROUND A convolutional neural network (CNN) is a deep learning (DL) model specialized for image processing, analysis, and classification. OBJECTIVE In this study, we evaluated whether a CNN model using lateral cervical spine radiographs as input data can help assess fusion after anterior cervical discectomy and fusion (ACDF). STUDY DESIGN Diagnostic imaging study using DL. PATIENT SAMPLE We included 187 patients who underwent ACDF and fusion assessment with postoperative one-year computed tomography and neutral and dynamic lateral cervical spine radiographs. OUTCOME MEASURES The performance of the CNN-based DL algorithm was evaluated in terms of accuracy and area under the curve. MATERIALS AND METHODS Fusion or nonunion was confirmed by cervical spine computed tomography. Among the 187 patients, 69.5% (130 patients) were randomly selected as the training set, and the remaining 30.5% (57 patients) were assigned to the validation set to evaluate model performance. Radiographs of the cervical spine were used as input images to develop a CNN-based DL algorithm. The CNN algorithm used three radiographs (neutral, flexion, and extension) per patient and showed the diagnostic results as fusion (0) or nonunion (1) for each radiograph. By combining the results of the three radiographs, the final decision for a patient was determined to be fusion (fusion ≥2) or nonunion (fusion ≤1). By combining the results of the three radiographs, the final decision for a patient was determined as fusion (fusion ≥2) or nonunion (nonunion ≤1). RESULTS The CNN-based DL model demonstrated an accuracy of 89.5% and an area under the curve of 0.889 (95% confidence interval, 0.793-0.984). CONCLUSION The CNN algorithm for fusion assessment after ACDF trained using lateral cervical radiographs showed a relatively high diagnostic accuracy of 89.5% and is expected to be a useful aid in detecting pseudarthrosis.
Collapse
Affiliation(s)
- Sehan Park
- Department of Orthopedic Surgery, Dongguk University Ilsan Hospital, Goyang-si, Gyeonggi-do Province, Republic of Korea
| | - Jeoung Kun Kim
- Department of Business Administration, School of Business, Yeungnam University, Gyeongsan-si, Gyeonggi-do Province, Republic of Korea
| | - Min Cheol Chang
- Department of Physical Medicine and Rehabilitation, Yeungnam University Medical Center, Yeungnam University College of Medicine, Daegu, Gyeongsang Province, Republic of Korea
| | - Jeong Jin Park
- Department of Orthopedic Surgery, Yeungnam University Medical Center, Yeungnam University College of Medicine, Daegu, Gyeongsang Province, Republic of Korea
| | - Jae Jun Yang
- Department of Orthopedic Surgery, Dongguk University Ilsan Hospital, Goyang-si, Gyeonggi-do Province, Republic of Korea
| | - Gun Woo Lee
- Department of Physical Medicine and Rehabilitation, Yeungnam University Medical Center, Yeungnam University College of Medicine, Daegu, Gyeongsang Province, Republic of Korea
| |
Collapse
|
31
|
Kumar V, Patel S, Baburaj V, Vardhan A, Singh PK, Vaishya R. Current understanding on artificial intelligence and machine learning in orthopaedics - A scoping review. J Orthop 2022; 34:201-206. [PMID: 36104993 PMCID: PMC9465367 DOI: 10.1016/j.jor.2022.08.020] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/20/2022] [Revised: 08/16/2022] [Accepted: 08/17/2022] [Indexed: 11/25/2022] Open
Abstract
Background Artificial Intelligence (AI) has improved the way of looking at technological challenges. Today, we can afford to see many of the problems as just an input-output system rather than solving from the first principles. The field of Orthopaedics is not spared from this rapidly expanding technology. The recent surge in the use of AI can be attributed mainly to advancements in deep learning methodologies and computing resources. This review was conducted to draw an outline on the role of AI in orthopaedics. Methods We developed a search strategy and looked for articles on PubMed, Scopus, and EMBASE. A total of 40 articles were selected for this study, from tools for medical aid like imaging solutions, implant management, and robotic surgery to understanding scientific questions. Results A total of 40 studies have been included in this review. The role of AI in the various subspecialties such as arthroplasty, trauma, orthopaedic oncology, foot and ankle etc. have been discussed in detail. Conclusion AI has touched most of the aspects of Orthopaedics. The increase in technological literacy, data management plans, and hardware systems, amalgamated with the access to hand-held devices like mobiles, and electronic pads, augur well for the exciting times ahead in this field. We have discussed various technological breakthroughs in AI that have been able to perform in Orthopaedics, and also the limitations and the problem with the black-box approach of modern AI algorithms. We advocate for better interpretable algorithms which can help both the patients and surgeons alike.
Collapse
Affiliation(s)
- Vishal Kumar
- Department of Orthopaedics, Postgraduate Institute of Medical Education and Research, Chandigarh, 160012, India
| | - Sandeep Patel
- Department of Orthopaedics, Postgraduate Institute of Medical Education and Research, Chandigarh, 160012, India
| | - Vishnu Baburaj
- Department of Orthopaedics, Postgraduate Institute of Medical Education and Research, Chandigarh, 160012, India
| | - Aditya Vardhan
- Department of Orthopaedics, Postgraduate Institute of Medical Education and Research, Chandigarh, 160012, India
| | - Prasoon Kumar Singh
- Department of Orthopaedics, Postgraduate Institute of Medical Education and Research, Chandigarh, 160012, India
| | | |
Collapse
|
32
|
Impact of Artificial Intelligence Assistance on Chest CT Interpretation Times: A Prospective Randomized Study. AJR Am J Roentgenol 2022; 219:743-751. [PMID: 35703413 DOI: 10.2214/ajr.22.27598] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
BACKGROUND. Deep learning-based convolutional neural networks have enabled major advances in development of artificial intelligence (AI) software applications. Modern AI applications offer comprehensive multiorgan evaluation. OBJECTIVE. The purpose of this article was to evaluate the impact of an automated AI platform integrated into clinical workflow for chest CT interpretation on radiologists' interpretation times when evaluated in a real-world clinical setting. METHODS. In this prospective single-center study, a commercial AI software solution was integrated into clinical workflow for chest CT interpretation. The software provided automated analysis of cardiac, pulmonary, and musculoskeletal findings, including labeling, segmenting, and measuring normal structures as well as detecting, labeling, and measuring abnormalities. AI-annotated images and autogenerated summary results were stored in the PACS and available to interpreting radiologists. A total of 390 patients (204 women, 186 men; mean age, 62.8 ± 13.3 [SD] years) who underwent out-patient chest CT between January 19, 2021, and January 28, 2021, were included. Scans were randomized using 1:1 allocation between AI-assisted and non-AI-assisted arms and were clinically interpreted by one of three cardiothoracic radiologists (65 scans per arm per radiologist; total of 195 scans per arm) who recorded interpretation times using a stopwatch. Findings were categorized according to review of report impressions. Interpretation times were compared between arms. RESULTS. Mean interpretation times were significantly shorter in the AI-assisted than in the non-AI-assisted arm for all three readers (289 ± 89 vs 344 ± 129 seconds, p < .001; 449 ± 110 vs 649 ± 82 seconds, p < .001; 281 ± 114 vs 348 ± 93 seconds, p = .01) and for readers combined (328 ± 122 vs 421 ± 175 seconds, p < .001). For readers combined, the mean difference was 93 seconds (95% CI, 63-123 seconds), corresponding with a 22.1% reduction in the AI-assisted arm. Mean interpretation time was also shorter in the AI-assisted arm compared with the non-AI-assisted arm for contrast-enhanced scans (83 seconds), noncontrast scans (104 seconds), negative scans (84 seconds), positive scans without significant new findings (117 seconds), and positive scans with significant new findings (92 seconds). CONCLUSION. Cardiothoracic radiologists exhibited a 22.1% reduction in chest CT interpretations times when they had access to results from an automated AI support platform during real-world clinical practice. CLINICAL IMPACT. Integration of the AI support platform into clinical workflow improved radiologist efficiency.
Collapse
|
33
|
A Classification Method for Thoracolumbar Vertebral Fractures due to Basketball Sports Injury Based on Deep Learning. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2022; 2022:8747487. [PMID: 36245837 PMCID: PMC9556197 DOI: 10.1155/2022/8747487] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/06/2022] [Revised: 08/30/2022] [Accepted: 09/15/2022] [Indexed: 11/17/2022]
Abstract
Objective There are more and more basketball competitions, to propose a classification method of thoracolumbar fractures to assist in the diagnosis of basketball injuries, to analyze the feasibility of its clinical application, and to improve the recovery rate. Methods From February 2015 to May 2022, 1130 CT images of thoracolumbar fractures admitted to our hospital and affiliated hospital units due to basketball injuries were collected, and the image labeling system uniformly labeled them. All CT images were classified according to the AO spine classification of thoracolumbar injuries. In the ABC-type classification, 935 CT images were used for training and validation to optimize the deep learning system, including 815 training sets and 120 validation sets; the remaining 198 CT images were used as test sets for comparing the deep learning system and clinician's diagnosis. In the classification of subtype A, a total of 523 CT scans can be performed for training and validation to optimize the deep learning system, including 500 training sets and 23 validation sets; the remaining 94 CT images are used as test sets for comparing depth learning systems and clinicians' diagnostic results. Results The deep learning system had a correct rate of ABC classification of fractures in 86.4%, with a kappa coefficient of 0.850 (P < 0.001); the correct rate of subtype A was 85.3%, with a kappa coefficient of 0.815 (P < 0.001). Conclusion The classification accuracy of thoracolumbar fractures based on deep learning is high. The method can assist in diagnosing CT images of thoracolumbar fractures and improve the current manual and complex diagnosis process.
Collapse
|
34
|
Xiao BH, Zhu MSY, Du EZ, Liu WH, Ma JB, Huang H, Gong JS, Diacinti D, Zhang K, Gao B, Liu H, Jiang RF, Ji ZY, Xiong XB, He LC, Wu L, Xu CJ, Du MM, Wang XR, Chen LM, Wu KY, Yang L, Xu MS, Diacinti D, Dou Q, Kwok TYC, Wáng YXJ. A software program for automated compressive vertebral fracture detection on elderly women's lateral chest radiograph: Ofeye 1.0. Quant Imaging Med Surg 2022; 12:4259-4271. [PMID: 35919046 PMCID: PMC9338385 DOI: 10.21037/qims-22-433] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2022] [Accepted: 05/25/2022] [Indexed: 11/17/2022]
Abstract
Background Because osteoporotic vertebral fracture (OVF) on chest radiographs is commonly missed in radiological reports, we aimed to develop a software program which offers automated detection of compressive vertebral fracture (CVF) on lateral chest radiographs, and which emphasizes CVF detection specificity with a low false positivity rate. Methods For model training, we retrieved 3,991 spine radiograph cases and 1,979 chest radiograph cases from 16 sources, with among them in total 1,404 cases had OVF. For model testing, we retrieved 542 chest radiograph cases and 162 spine radiograph cases from four independent clinics, with among them 215 cases had OVF. All cases were female subjects, and except for 31 training data cases which were spine trauma cases, all the remaining cases were post-menopausal women. Image data included DICOM (Digital Imaging and Communications in Medicine) format, hard film scanned PNG (Portable Network Graphics) format, DICOM exported PNG format, and PACS (Picture Archiving and Communication System) downloaded resolution reduced DICOM format. OVF classification included: minimal and mild grades with <20% or ≥20-25% vertebral height loss respectively, moderate grade with ≥25-40% vertebral height loss, severe grade with ≥40%-2/3 vertebral height loss, and collapsed grade with ≥2/3 vertebral height loss. The CVF detection base model was mainly composed of convolution layers that include convolution kernels of different sizes, pooling layers, up-sampling layers, feature merging layers, and residual modules. When the model loss function could not be further decreased with additional training, the model was considered to be optimal and termed 'base-model 1.0'. A user-friendly interface was also developed, with the synthesized software termed 'Ofeye 1.0'. Results Counting cases and with minimal and mild OVFs included, base-model 1.0 demonstrated a specificity of 97.1%, a sensitivity of 86%, and an accuracy of 93.9% for the 704 testing cases. In total, 33 OVFs in 30 cases had a false negative reading, which constituted a false negative rate of 14.0% (30/215) by counting all OVF cases. Eighteen OVFs in 15 cases had OVFs of ≥ moderate grades missed, which constituted a false negative rate of 7.0% (15/215, i.e., sensitivity 93%) if only counting cases with ≥ moderate grade OVFs missed. False positive reading was recorded in 13 vertebrae in 13 cases (one vertebra in each case), which constituted a false positivity rate of 2.7% (13/489). These vertebrae with false positivity labeling could be readily differentiated from a true OVF by a human reader. The software Ofeye 1.0 allows 'batch processing', for example, 100 radiographs can be processed in a single operation. This software can be integrated into hospital PACS, or installed in a standalone personal computer. Conclusions A user-friendly software program was developed for CVF detection on elderly women's lateral chest radiographs. It has an overall low false positivity rate, and for moderate and severe CVFs an acceptably low false negativity rate. The integration of this software into radiological practice is expected to improve osteoporosis management for elderly women.
Collapse
Affiliation(s)
- Ben-Heng Xiao
- Department of Imaging and Interventional Radiology, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR, China
| | | | - Er-Zhu Du
- Department of Radiology, Dongguan Traditional Chinese Medicine Hospital, Dongguan, China
| | - Wei-Hong Liu
- Department of Radiology, General Hospital of China Resources & Wuhan Iron and Steel Corporation, Wuhan, China
| | - Jian-Bing Ma
- Department of Radiology, the First Hospital of Jiaxing, The Affiliated Hospital of Jiaxing University, Jiaxing, China
| | - Hua Huang
- Department of Radiology, The Third People’s Hospital of Shenzhen, The Second Affiliated Hospital of Southern University of Science and Technology, National Clinical Research Center for Infectious Diseases, Shenzhen, China
| | - Jing-Shan Gong
- Department of Radiology, Shenzhen People’s Hospital (The Second Clinical Medical College, Jinan University; The First Affiliated Hospital, Southern University of Science and Technology), Shenzhen, China
| | - Davide Diacinti
- Department of Radiological Sciences, Oncology and Pathology, Sapienza University of Rome, Sapienza University of Rome, Rome, Italy
- Department of Diagnostic and Molecular Imaging, Radiology and Radiotherapy, University Foundation Hospital Tor Vergata, Rome, Italy
| | - Kun Zhang
- Department of Radiology, First Affiliated Hospital of Hunan University of Chinese Medicine, Changsha, China
| | - Bo Gao
- Department of Radiology, The Affiliated Hospital of Guizhou Medical University, Guiyang, China
| | - Heng Liu
- Department of Radiology, the Affiliated Hospital of Zunyi Medical University, Zunyi, China
| | - Ri-Feng Jiang
- Department of Radiology, Fujian Medical University Union Hospital, Fuzhou, China
| | - Zhong-You Ji
- PET-CT Center, Fujian Medical University Union Hospital, Fuzhou, China
| | - Xiao-Bao Xiong
- Department of Radiology, Zhejiang Provincial Tongde Hospital, Hangzhou, China
| | - Lai-Chang He
- Department of Radiology, the First Affiliated Hospital of Nanchang University, Nanchang, China
| | - Lei Wu
- Department of Radiology, the First Affiliated Hospital of Zhejiang Chinese Medical University, Hangzhou, China
| | - Chuan-Jun Xu
- Department of Radiology, The Second Hospital of Nanjing, Nanjing University of Chinese Medicine, Nanjing, China
| | - Mei-Mei Du
- Department of Radiology, The Second Affiliated Hospital and Yuying Children's Hospital, Wenzhou Medical University, Wenzhou, China
| | - Xiao-Rong Wang
- Department of Radiology, Ningbo First Hospital, Ningbo, China
| | - Li-Mei Chen
- Department of Imaging and Interventional Radiology, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Kong-Yang Wu
- Department of Imaging and Interventional Radiology, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR, China
- College of Electrical and Information Engineering, Jinan University, Guangzhou, China
| | - Liu Yang
- Department of Imaging and Interventional Radiology, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Mao-Sheng Xu
- Department of Radiology, the First Affiliated Hospital of Zhejiang Chinese Medical University, Hangzhou, China
| | - Daniele Diacinti
- Department of Radiological Sciences, Oncology and Pathology, Sapienza University of Rome, Sapienza University of Rome, Rome, Italy
| | - Qi Dou
- Department of Computer Science and Engineering, Faculty of Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Timothy Y. C. Kwok
- JC Centre for Osteoporosis Care and Control, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Yì Xiáng J. Wáng
- Department of Imaging and Interventional Radiology, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR, China
| |
Collapse
|
35
|
Zhang X, Yang Y, Shen YW, Zhang KR, Jiang ZK, Ma LT, Ding C, Wang BY, Meng Y, Liu H. Diagnostic accuracy and potential covariates of artificial intelligence for diagnosing orthopedic fractures: a systematic literature review and meta-analysis. Eur Radiol 2022; 32:7196-7216. [PMID: 35754091 DOI: 10.1007/s00330-022-08956-4] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2022] [Revised: 05/07/2022] [Accepted: 06/08/2022] [Indexed: 02/05/2023]
Abstract
OBJECTIVES To systematically quantify the diagnostic accuracy and identify potential covariates affecting the performance of artificial intelligence (AI) in diagnosing orthopedic fractures. METHODS PubMed, Embase, Web of Science, and Cochrane Library were systematically searched for studies on AI applications in diagnosing orthopedic fractures from inception to September 29, 2021. Pooled sensitivity and specificity and the area under the receiver operating characteristic curves (AUC) were obtained. This study was registered in the PROSPERO database prior to initiation (CRD 42021254618). RESULTS Thirty-nine were eligible for quantitative analysis. The overall pooled AUC, sensitivity, and specificity were 0.96 (95% CI 0.94-0.98), 90% (95% CI 87-92%), and 92% (95% CI 90-94%), respectively. In subgroup analyses, multicenter designed studies yielded higher sensitivity (92% vs. 88%) and specificity (94% vs. 91%) than single-center studies. AI demonstrated higher sensitivity with transfer learning (with vs. without: 92% vs. 87%) or data augmentation (with vs. without: 92% vs. 87%), compared to those without. Utilizing plain X-rays as input images for AI achieved results comparable to CT (AUC 0.96 vs. 0.96). Moreover, AI achieved comparable results to humans (AUC 0.97 vs. 0.97) and better results than non-expert human readers (AUC 0.98 vs. 0.96; sensitivity 95% vs. 88%). CONCLUSIONS AI demonstrated high accuracy in diagnosing orthopedic fractures from medical images. Larger-scale studies with higher design quality are needed to validate our findings. KEY POINTS • Multicenter study design, application of transfer learning, and data augmentation are closely related to improving the performance of artificial intelligence models in diagnosing orthopedic fractures. • Utilizing plain X-rays as input images for AI to diagnose fractures achieved results comparable to CT (AUC 0.96 vs. 0.96). • AI achieved comparable results to humans (AUC 0.97 vs. 0.97) but was superior to non-expert human readers (AUC 0.98 vs. 0.96, sensitivity 95% vs. 88%) in diagnosing fractures.
Collapse
Affiliation(s)
- Xiang Zhang
- Department of Orthopedics, Orthopedic Research Institute, West China Hospital, Sichuan University, No. 37 Guo Xue Rd, Chengdu, 610041, China
| | - Yi Yang
- Department of Orthopedics, Orthopedic Research Institute, West China Hospital, Sichuan University, No. 37 Guo Xue Rd, Chengdu, 610041, China
| | - Yi-Wei Shen
- Department of Orthopedics, Orthopedic Research Institute, West China Hospital, Sichuan University, No. 37 Guo Xue Rd, Chengdu, 610041, China
| | - Ke-Rui Zhang
- Department of Orthopedics, Orthopedic Research Institute, West China Hospital, Sichuan University, No. 37 Guo Xue Rd, Chengdu, 610041, China
| | - Ze-Kun Jiang
- West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, 610000, China
| | - Li-Tai Ma
- Department of Orthopedics, Orthopedic Research Institute, West China Hospital, Sichuan University, No. 37 Guo Xue Rd, Chengdu, 610041, China
| | - Chen Ding
- Department of Orthopedics, Orthopedic Research Institute, West China Hospital, Sichuan University, No. 37 Guo Xue Rd, Chengdu, 610041, China
| | - Bei-Yu Wang
- Department of Orthopedics, Orthopedic Research Institute, West China Hospital, Sichuan University, No. 37 Guo Xue Rd, Chengdu, 610041, China
| | - Yang Meng
- Department of Orthopedics, Orthopedic Research Institute, West China Hospital, Sichuan University, No. 37 Guo Xue Rd, Chengdu, 610041, China
| | - Hao Liu
- Department of Orthopedics, Orthopedic Research Institute, West China Hospital, Sichuan University, No. 37 Guo Xue Rd, Chengdu, 610041, China.
| |
Collapse
|
36
|
Qu B, Cao J, Qian C, Wu J, Lin J, Wang L, Ou-Yang L, Chen Y, Yan L, Hong Q, Zheng G, Qu X. Current development and prospects of deep learning in spine image analysis: a literature review. Quant Imaging Med Surg 2022; 12:3454-3479. [PMID: 35655825 PMCID: PMC9131328 DOI: 10.21037/qims-21-939] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Accepted: 03/04/2022] [Indexed: 10/07/2023]
Abstract
BACKGROUND AND OBJECTIVE As the spine is pivotal in the support and protection of human bodies, much attention is given to the understanding of spinal diseases. Quick, accurate, and automatic analysis of a spine image greatly enhances the efficiency with which spine conditions can be diagnosed. Deep learning (DL) is a representative artificial intelligence technology that has made encouraging progress in the last 6 years. However, it is still difficult for clinicians and technicians to fully understand this rapidly evolving field due to the diversity of applications, network structures, and evaluation criteria. This study aimed to provide clinicians and technicians with a comprehensive understanding of the development and prospects of DL spine image analysis by reviewing published literature. METHODS A systematic literature search was conducted in the PubMed and Web of Science databases using the keywords "deep learning" and "spine". Date ranges used to conduct the search were from 1 January, 2015 to 20 March, 2021. A total of 79 English articles were reviewed. KEY CONTENT AND FINDINGS The DL technology has been applied extensively to the segmentation, detection, diagnosis, and quantitative evaluation of spine images. It uses static or dynamic image information, as well as local or non-local information. The high accuracy of analysis is comparable to that achieved manually by doctors. However, further exploration is needed in terms of data sharing, functional information, and network interpretability. CONCLUSIONS The DL technique is a powerful method for spine image analysis. We believe that, with the joint efforts of researchers and clinicians, intelligent, interpretable, and reliable DL spine analysis methods will be widely applied in clinical practice in the future.
Collapse
Affiliation(s)
- Biao Qu
- Department of Instrumental and Electrical Engineering, Xiamen University, Xiamen, China
| | - Jianpeng Cao
- Department of Electronic Science, Biomedical Intelligent Cloud R&D Center, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, National Institute for Data Science in Health and Medicine, Xiamen University, Xiamen, China
| | - Chen Qian
- Department of Electronic Science, Biomedical Intelligent Cloud R&D Center, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, National Institute for Data Science in Health and Medicine, Xiamen University, Xiamen, China
| | - Jinyu Wu
- Department of Electronic Science, Biomedical Intelligent Cloud R&D Center, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, National Institute for Data Science in Health and Medicine, Xiamen University, Xiamen, China
| | - Jianzhong Lin
- Department of Radiology, Zhongshan Hospital of Xiamen University, Xiamen, China
| | - Liansheng Wang
- Department of Computer Science, School of Informatics, Xiamen University, Xiamen, China
| | - Lin Ou-Yang
- Department of Medical Imaging of Southeast Hospital, Medical College of Xiamen University, Zhangzhou, China
| | - Yongfa Chen
- Department of Pediatric Orthopedic Surgery, The First Affiliated Hospital of Xiamen University, Xiamen, China
| | - Liyue Yan
- Department of Information & Computational Mathematics, Xiamen University, Xiamen, China
| | - Qing Hong
- Biomedical Intelligent Cloud R&D Center, China Mobile Group, Xiamen, China
| | - Gaofeng Zheng
- Department of Instrumental and Electrical Engineering, Xiamen University, Xiamen, China
| | - Xiaobo Qu
- Department of Electronic Science, Biomedical Intelligent Cloud R&D Center, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, National Institute for Data Science in Health and Medicine, Xiamen University, Xiamen, China
| |
Collapse
|
37
|
Ground truth generalizability affects performance of the artificial intelligence model in automated vertebral fracture detection on plain lateral radiographs of the spine. Spine J 2022; 22:511-523. [PMID: 34737066 DOI: 10.1016/j.spinee.2021.10.020] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/07/2021] [Revised: 09/23/2021] [Accepted: 10/25/2021] [Indexed: 02/03/2023]
Abstract
BACKGROUND CONTEXT Computer-aided diagnosis with artificial intelligence (AI) has been used clinically, and ground truth generalizability is important for AI performance in medical image analyses. The AI model was trained on one specific group of older adults (aged≧60) has not yet been shown to work equally well in a younger adult group (aged 18-59). PURPOSE To compare the performance of the developed AI model with ensemble method trained with the ground truth for those aged 60 years or older in identifying vertebral fractures (VFs) on plain lateral radiographs of spine (PLRS) between younger and older adult populations. STUDY DESIGN/SETTING Retrospective analysis of PLRS in a single medical institution. OUTCOME MEASURES Accuracy, sensitivity, specificity, and interobserver reliability (kappa value) were used to compare diagnostic performance of the AI model and subspecialists' consensus between the two groups. METHODS Between January 2016 and December 2018, the ground truth of 941 patients (one PLRS per person) aged 60 years and older with 1101 VFs and 6358 normal vertebrae was used to set up the AI model. The framework of the developed AI model includes: object detection with You Only Look Once Version 3 (YOLOv3) at T0-L5 levels in the PLRS, data pre-preprocessing with image-size and quality processing, and AI ensemble model (ResNet34, DenseNet121, and DenseNet201) for identifying or grading VFs. The reported overall accuracy, sensitivity and specificity were 92%, 91% and 93%, respectively, and external validation was also performed. Thereafter, patients diagnosed as VFs and treated in our institution during October 2019 to August 2020 were the study group regardless of age. In total, 258 patients (339 VFs and 1725 normal vertebrae) in the older adult population (mean age 78±10.4; range, 60-106) were enrolled. In the younger adult population (mean age 36±9.43; range, 20-49), 106 patients (120 VFs and 728 normal vertebrae) were enrolled. After identification and grading of VFs based on the Genant method with consensus between two subspecialists', VFs in each PLRS with human labels were defined as the testing dataset. The corresponding CT or MRI scan was used for labeling in the PLRS. The bootstrap method was applied to the testing dataset. RESULTS The model for clinical application, Digital Imaging and Communications in Medicine (DICOM) format, is uploaded directly (available at: http://140.113.114.104/vght_demo/svf-model (grading) and http://140.113.114.104/vght demo/svf-model2 (labeling). Overall accuracy, sensitivity and specificity in the older adult population were 93.36% (95% CI 93.34%-93.38%), 88.97% (95% CI 88.59%-88.99%) and 94.26% (95% CI 94.23%-94.29%), respectively. Overall accuracy, sensitivity and specificity in the younger adult population were 93.75% (95% CI 93.7%-93.8%), 65.00% (95% CI 64.33%-65.67%) and 98.49% (95% CI 98.45%-98.52%), respectively. Accuracy reached 100% in VFs grading once the VFs were labeled accurately. The unique pattern of limbus-like VFs, 43 (35.8%) were investigated only in the younger adult population. If limbus-like VFs from the dataset were not included, the accuracy increased from 93.75% (95% CI 93.70%-93.80%) to 95.78% (95% CI 95.73%-95.82%), sensitivity increased from 65.00% (95% CI 64.33%-65.67%) to 70.13% (95% CI 68.98%-71.27%) and specificity remained unchanged at 98.49% (95% CI 98.45%-98.52%), respectively. The main causes of false negative results in older adults were patients' lung markings, diaphragm or bowel airs (37%, n=14) followed by type I fracture (29%, n=11). The main causes of false negatives in younger adults were limbus-like VFs (45%, n=19), followed by type I fracture (26%, n=11). The overall kappa between AI discrimination and subspecialists' consensus in the older and younger adult populations were 0.77 (95% CI, 0.733-0.805) and 0.72 (95% CI, 0.6524-0.80), respectively. CONCLUSIONS The developed VF-identifying AI ensemble model based on ground truth of older adults achieved better performance in identifying VFs in older adults and non-fractured thoracic and lumbar vertebrae in the younger adults. Different age distribution may have potential disease diversity and implicate the effect of ground truth generalizability on the AI model performance.
Collapse
|
38
|
Ajmera P, Kharat A, Botchu R, Gupta H, Kulkarni V. Real-world analysis of artificial intelligence in musculoskeletal trauma. J Clin Orthop Trauma 2021; 22:101573. [PMID: 34527511 PMCID: PMC8427222 DOI: 10.1016/j.jcot.2021.101573] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/06/2021] [Revised: 08/20/2021] [Accepted: 08/20/2021] [Indexed: 11/30/2022] Open
Abstract
Musculoskeletal trauma accounts for a large percentage of emergency room visits and is amongst the top causes of unscheduled patient visits to the emergency room. Musculoskeletal trauma results in expenditure of billions of dollars and protracted losses of quality-adjusted life years. New and innovative methods are needed to minimise the impact by ensuring quick and accurate assessment. However, each of the currently utilised radiological procedures, such as radiography, ultrasonography, computed tomography, and magnetic resonance imaging, has resulted in implosion of medical imaging data. Deep learning, a recent advancement in artificial intelligence, has demonstrated the potential to analyse medical images with sensitivity and specificity at par with experts. In this review article, we intend to summarise and showcase the various developments which have occurred in the dynamic field of artificial intelligence and machine learning and how their applicability to different aspects of imaging in trauma can be explored to improvise our existing reporting systems and improvise on patient outcomes.
Collapse
Affiliation(s)
- Pranav Ajmera
- Department of Radiology, Dr D.Y. Patil Medical College, Hospital and Research Center, DPU, Pune, India
| | - Amit Kharat
- Department of Radiology, Dr D.Y. Patil Medical College, Hospital and Research Center, DPU, Pune, India
| | - Rajesh Botchu
- Department of Musculoskeletal Radiology, Royal Orthopedic Hospital, Birmingham, UK
| | - Harun Gupta
- Department of Musculoskeletal Radiology, Leeds Teaching Hospitals, Leeds, UK
| | | |
Collapse
|