1
|
Dai M, Tiu BC, Schlossman J, Ayobi A, Castineira C, Kiewsky J, Avare C, Chaibi Y, Chang P, Chow D, Soun JE. Validation of a Deep Learning Tool for Detection of Incidental Vertebral Compression Fractures. J Comput Assist Tomogr 2025:00004728-990000000-00417. [PMID: 39876529 DOI: 10.1097/rct.0000000000001726] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2024] [Accepted: 12/07/2024] [Indexed: 01/30/2025]
Abstract
OBJECTIVE This study evaluated the performance of a deep learning-based vertebral compression fracture (VCF) detection tool in patients with incidental VCF. The purpose of this study was to validate this tool across multiple sites and multiple vendors. METHODS This was a retrospective, multicenter, multinational blinded study using anonymized chest and abdominal CT scans performed for indications other than VCF in patients ≥50 years old. Images were obtained from 2 teleradiology companies in France and United States and were processed by CINA-VCF v1.0, a deep learning algorithm designed for VCF detection. Ground truth was established by majority consensus across 3 board-certified radiologists. Overall performance of CINA-VCF was evaluated, as well as subset analyses based on imaging acquisition parameters, baseline patient characteristics, and VCF severity. A subgroup was also analyzed and compared with available clinical radiology reports. RESULTS Four hundred seventy-four CT scans were included in this study, comprising 166 (35.0%) positive and 308 (65.0%) negative VCF cases. CINA-VCF demonstrated an area under the curve (AUC) of 0.97 (95% CI: 0.96-0.99), accuracy of 93.7% (95% CI: 91.1%-95.7%), sensitivity of 95.2% (95% CI: 90.7%-97.9%), and specificity of 92.9% (95% CI: 89.4%-96.5%). Subset analysis based on VCF severity resulted in a specificity of 94.2% (95% CI: 90.9%-96.6%) for grade 0 negative cases and a specificity of 64.3% (95% CI: 35.1%-87.2%) for grade 1 negative cases. For grades 2 and 3 positive cases, sensitivity was 89.7% (95% CI: 79.9%-95.8%) and 99.0% (95% CI: 94.4%-100.0%), respectively. CONCLUSIONS CINA-VCF successfully detected incidental VCF and even outperformed clinical reports. The performance was consistent among all subgroups analyzed. Limitations of the tool included various confounding pathologies such as Schmorl's nodes and borderline cases. Despite these limitations, this study validates the applicability and generalizability of the tool in the clinical setting.
Collapse
Affiliation(s)
- Michelle Dai
- Irvine School of Medicine, University of California, Irvine, CA
- Touro University Nevada, College of Osteopathic Medicine, Henderson, NV
| | | | | | | | | | | | | | | | - Peter Chang
- Department of Radiological Sciences
- Center for Artificial Intelligence in Diagnostic Medicine, University of California Irvine, Irvine, CA
| | - Daniel Chow
- Department of Radiological Sciences
- Center for Artificial Intelligence in Diagnostic Medicine, University of California Irvine, Irvine, CA
| | | |
Collapse
|
2
|
Li Y, Liang Z, Li Y, Cao Y, Zhang H, Dong B. Machine learning value in the diagnosis of vertebral fractures: A systematic review and meta-analysis. Eur J Radiol 2024; 181:111714. [PMID: 39241305 DOI: 10.1016/j.ejrad.2024.111714] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2024] [Revised: 07/28/2024] [Accepted: 08/30/2024] [Indexed: 09/09/2024]
Abstract
PURPOSE To evaluate the diagnostic accuracy of machine learning (ML) in detecting vertebral fractures, considering varying fracture classifications, patient populations, and imaging approaches. METHOD A systematic review and meta-analysis were conducted by searching PubMed, Embase, Cochrane Library, and Web of Science up to December 31, 2023, for studies using ML for vertebral fracture diagnosis. Bias risk was assessed using QUADAS-2. A bivariate mixed-effects model was used for the meta-analysis. Meta-analyses were performed according to five task types (vertebral fractures, osteoporotic vertebral fractures, differentiation of benign and malignant vertebral fractures, differentiation of acute and chronic vertebral fractures, and prediction of vertebral fractures). Subgroup analyses were conducted by different ML models (including ML and DL) and modeling methods (including CT, X-ray, MRI, and clinical features). RESULTS Eighty-one studies were included. ML demonstrated a diagnostic sensitivity of 0.91 and specificity of 0.95 for vertebral fractures. Subgroup analysis showed that DL (SROC 0.98) and CT (SROC 0.98) performed best overall. For osteoporotic fractures, ML showed a sensitivity of 0.93 and specificity of 0.96, with DL (SROC 0.99) and X-ray (SROC 0.99) performing better. For differentiating benign from malignant fractures, ML achieved a sensitivity of 0.92 and specificity of 0.93, with DL (SROC 0.96) and MRI (SROC 0.97) performing best. For differentiating acute from chronic vertebral fractures, ML showed a sensitivity of 0.92 and specificity of 0.93, with ML (SROC 0.96) and CT (SROC 0.97) performing best. For predicting vertebral fractures, ML had a sensitivity of 0.76 and specificity of 0.87, with ML (SROC 0.80) and clinical features (SROC 0.86) performing better. CONCLUSIONS ML, especially DL models applied to CT, MRI, and X-ray, shows high diagnostic accuracy for vertebral fractures. ML also effectively predicts osteoporotic vertebral fractures, aiding in tailored prevention strategies. Further research and validation are required to confirm ML's clinical efficacy.
Collapse
Affiliation(s)
- Yue Li
- Pain Ward of Rehabilitation Department, Honghui Hospital, Xi'an Jiaotong University, Xi'an, Shaanxi Province 710054, PR China
| | - Zhuang Liang
- Pain Ward of Rehabilitation Department, Honghui Hospital, Xi'an Jiaotong University, Xi'an, Shaanxi Province 710054, PR China
| | - Yingchun Li
- Pain Ward of Rehabilitation Department, Honghui Hospital, Xi'an Jiaotong University, Xi'an, Shaanxi Province 710054, PR China
| | - Yang Cao
- Pain Ward of Rehabilitation Department, Honghui Hospital, Xi'an Jiaotong University, Xi'an, Shaanxi Province 710054, PR China
| | - Hui Zhang
- Pain Ward of Rehabilitation Department, Honghui Hospital, Xi'an Jiaotong University, Xi'an, Shaanxi Province 710054, PR China
| | - Bo Dong
- Pain Ward of Rehabilitation Department, Honghui Hospital, Xi'an Jiaotong University, Xi'an, Shaanxi Province 710054, PR China.
| |
Collapse
|
3
|
Yıldız Potter İ, Rodriguez EK, Wu J, Nazarian A, Vaziri A. An Automated Vertebrae Localization, Segmentation, and Osteoporotic Compression Fracture Detection Pipeline for Computed Tomographic Imaging. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024; 37:2428-2443. [PMID: 38717516 PMCID: PMC11522205 DOI: 10.1007/s10278-024-01135-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/23/2024] [Revised: 04/30/2024] [Accepted: 05/01/2024] [Indexed: 06/29/2024]
Abstract
Osteoporosis is the most common chronic metabolic bone disease worldwide. Vertebral compression fracture (VCF) is the most common type of osteoporotic fracture. Approximately 700,000 osteoporotic VCFs are diagnosed annually in the USA alone, resulting in an annual economic burden of ~$13.8B. With an aging population, the rate of osteoporotic VCFs and their associated burdens are expected to rise. Those burdens include pain, functional impairment, and increased medical expenditure. Therefore, it is of utmost importance to develop an analytical tool to aid in the identification of VCFs. Computed Tomography (CT) imaging is commonly used to detect occult injuries. Unlike the existing VCF detection approaches based on CT, the standard clinical criteria for determining VCF relies on the shape of vertebrae, such as loss of vertebral body height. We developed a novel automated vertebrae localization, segmentation, and osteoporotic VCF detection pipeline for CT scans using state-of-the-art deep learning models to bridge this gap. To do so, we employed a publicly available dataset of spine CT scans with 325 scans annotated for segmentation, 126 of which also graded for VCF (81 with VCFs and 45 without VCFs). Our approach attained 96% sensitivity and 81% specificity in detecting VCF at the vertebral-level, and 100% accuracy at the subject-level, outperforming deep learning counterparts tested for VCF detection without segmentation. Crucially, we showed that adding predicted vertebrae segments as inputs significantly improved VCF detection at both vertebral and subject levels by up to 14% Sensitivity and 20% Specificity (p-value = 0.028).
Collapse
Affiliation(s)
| | - Edward K Rodriguez
- Carl J. Shapiro Department of Orthopedic Surgery, Beth Israel Deaconess Medical Center (BIDMC), Harvard Medical School, 330 Brookline Avenue, Stoneman 10, Boston, MA, 02215, USA
- Musculoskeletal Translational Innovation Initiative, Beth Israel Deaconess Medical Center, Harvard Medical School, 330 Brookline Avenue, RN123, Boston, MA, 02215, USA
| | - Jim Wu
- Department of Radiology, Beth Israel Deaconess Medical Center (BIDMC), Harvard Medical School, 330 Brookline Avenue, Shapiro 4, Boston, MA, 02215, USA
| | - Ara Nazarian
- Carl J. Shapiro Department of Orthopedic Surgery, Beth Israel Deaconess Medical Center (BIDMC), Harvard Medical School, 330 Brookline Avenue, Stoneman 10, Boston, MA, 02215, USA
- Musculoskeletal Translational Innovation Initiative, Beth Israel Deaconess Medical Center, Harvard Medical School, 330 Brookline Avenue, RN123, Boston, MA, 02215, USA
- Department of Orthopaedics Surgery, Yerevan State University, Yerevan, Armenia
| | - Ashkan Vaziri
- BioSensics, LLC, 57 Chapel Street, Newton, MA, 02458, USA
| |
Collapse
|
4
|
Milch HS, Haramati LB. The science and practice of imaging-based screening: What the radiologist needs to know. Clin Imaging 2024; 114:110266. [PMID: 39216274 DOI: 10.1016/j.clinimag.2024.110266] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2024] [Revised: 08/12/2024] [Accepted: 08/13/2024] [Indexed: 09/04/2024]
Abstract
Imaging-based screening is an important public health focus and a fundamental part of Diagnostic Radiology. Hence, radiologists should be familiar with the concepts that drive imaging-based screening practice including goals, risks, biases and clinical trials. This review article discusses an array of imaging-based screening exams including the key epidemiology and evidence that drive screening guidelines for abdominal aortic aneurysm, breast cancer, carotid artery disease, colorectal cancer, coronary artery disease, lung cancer, osteoporosis, and thyroid cancer. We will provide an overview on societal interests in screening, screening-related inequities, and opportunities to address them. Emerging evidence for opportunistic screening and the role of AI in imaging-based screening will be explored. In-depth knowledge and formalized training in imaging-based screening strengthens radiologists as clinician scientists and has the potential to broaden our public health leadership opportunities. SUMMARY SENTENCE: An overview of key screening concepts, the evidence that drives today's imaging-based screening practices, and the need for radiologist leadership in screening policies and evidence development.
Collapse
Affiliation(s)
- Hannah S Milch
- Department of Radiology, David Geffen School of Medicine at UCLA, Los Angeles, CA, United States of America.
| | - Linda B Haramati
- Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, United States of America
| |
Collapse
|
5
|
Wiklund P, Buchebner D, Geijer M. Vertebral compression fractures at abdominal CT: underdiagnosis, undertreatment, and evaluation of an AI algorithm. J Bone Miner Res 2024; 39:1113-1119. [PMID: 38900913 DOI: 10.1093/jbmr/zjae096] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/18/2023] [Revised: 06/05/2024] [Accepted: 06/12/2024] [Indexed: 06/22/2024]
Abstract
Vertebral compression fractures (VCFs) are common and indicate a high future risk of additional osteoporotic fractures. However, many VCFs are unreported by radiologists, and even if reported, many patients do not receive treatment. The purpose of the study was to evaluate a new artificial intelligence (AI) algorithm for the detection of VCFs and to assess the prevalence of reported and unreported VCFs. This retrospective cohort study included patients over age 60 yr with an abdominal CT between January 18, 2019 and January 18, 2020. Images and radiology reports were reviewed to identify reported and unreported VCFs, and the images were processed by an AI algorithm. For reported VCFs, the electronic health records were reviewed regarding subsequent osteoporosis screening and treatment. Totally, 1112 patients were included. Of these, 187 patients (16.8%) had a VCF, of which 62 had an incident VCF and 49 had a previously unknown prevalent VCF. The radiologist reporting rate of these VCFs was 30% (33/111). For moderate and severe (grade 2-3) VCF, the AI algorithm had 85.2% sensitivity, 92.3% specificity, 57.8% positive predictive value, and 98.1% negative predictive value. Three of 30 patients with reported VCFs started osteoporosis treatment within a year. The AI algorithm had high accuracy for the detection of VCFs and could be very useful in increasing the detection rate of VCFs, as there was a substantial underdiagnosis of VCFs. However, as undertreatment in reported cases was substantial, to fully realize the potential of AI, changes to the management pathway outside of the radiology department are imperative.
Collapse
Affiliation(s)
- Peder Wiklund
- Department of Radiology, Region Halland, 30185 Halmstad, Sweden
| | - David Buchebner
- Department of Internal Medicine, Halland Hospital Halmstad, 30185 Halmstad, Sweden
| | - Mats Geijer
- Department of Radiology, Institute of Clinical Sciences, Sahlgrenska Academy, University of Gothenburg, 41345 Gothenburg, Sweden
- Department of Radiology, Sahlgrenska University Hospital, 41345 Gothenburg, Sweden
- Department of Clinical Sciences, Lund University, Lund, Sweden
| |
Collapse
|
6
|
Bendtsen MG, Hitz MF. Opportunistic Identification of Vertebral Compression Fractures on CT Scans of the Chest and Abdomen, Using an AI Algorithm, in a Real-Life Setting. Calcif Tissue Int 2024; 114:468-479. [PMID: 38530406 PMCID: PMC11061033 DOI: 10.1007/s00223-024-01196-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Accepted: 02/13/2024] [Indexed: 03/28/2024]
Abstract
This study evaluated the performance of a vertebral fracture detection algorithm (HealthVCF) in a real-life setting and assessed the impact on treatment and diagnostic workflow. HealthVCF was used to identify moderate and severe vertebral compression fractures (VCF) at a Danish hospital. Around 10,000 CT scans were processed by the HealthVCF and CT scans positive for VCF formed both the baseline and 6-months follow-up cohort. To determine performance of the algorithm 1000 CT scans were evaluated by specialized radiographers to determine performance of the algorithm. Sensitivity was 0.68 (CI 0.581-0.776) and specificity 0.91 (CI 0.89-0.928). At 6-months follow-up, 18% of the 538 patients in the retrospective cohort were dead, 78 patients had been referred for a DXA scan, while 25 patients had been diagnosed with osteoporosis. A higher mortality rate was seen in patients not known with osteoporosis at baseline compared to patients known with osteoporosis at baseline, 12.8% versus 22.6% (p = 0.003). Patients receiving bisphosphonates had a lower mortality rate (9.6%) compared to the rest of the population (20.9%) (p = 0.003). HealthVCF demonstrated a poorer performance than expected, and the tested version is not generalizable to the Danish population. Based on its specificity, the HealthVCF can be used as a tool to prioritize resources in opportunistic identification of VCF's. Implementing such a tool on its own only resulted in a small number of new diagnoses of osteoporosis and referrals to DXA scans during a 6-month follow-up period. To increase efficiency, the HealthVCF should be integrated with Fracture Liaison Services (FLS).
Collapse
Affiliation(s)
| | - Mette Friberg Hitz
- Research Unit, Medical Department, Zealand University Hospital, Koege, Denmark
- Institute of Clinical Medicine, University of Copenhagen, Koege, Denmark
| |
Collapse
|
7
|
Whittier DE, Bevers MSAM, Geusens PPMM, van den Bergh JP, Gabel L. Characterizing Bone Phenotypes Related to Skeletal Fragility Using Advanced Medical Imaging. Curr Osteoporos Rep 2023; 21:685-697. [PMID: 37884821 PMCID: PMC10724303 DOI: 10.1007/s11914-023-00830-6] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 10/11/2023] [Indexed: 10/28/2023]
Abstract
PURPOSE OF REVIEW Summarize the recent literature that investigates how advanced medical imaging has contributed to our understanding of skeletal phenotypes and fracture risk across the lifespan. RECENT FINDINGS Characterization of bone phenotypes on the macro-scale using advanced imaging has shown that while wide bones are generally stronger than narrow bones, they may be more susceptible to age-related declines in bone strength. On the micro-scale, HR-pQCT has been used to identify bone microarchitecture phenotypes that improve stratification of fracture risk based on phenotype-specific risk factors. Adolescence is a key phase for bone development, with distinct sex-specific growth patterns and significant within-sex bone property variability. However, longitudinal studies are needed to evaluate how early skeletal growth impacts adult bone phenotypes and fracture risk. Metabolic and rare bone diseases amplify fracture risk, but the interplay between bone phenotypes and disease remains unclear. Although bone phenotyping is a promising approach to improve fracture risk assessment, the clinical availability of advanced imaging is still limited. Consequently, alternative strategies for assessing and managing fracture risk include vertebral fracture assessment from clinically available medical imaging modalities/techniques or from fracture risk assessment tools based on clinical risk factors. Bone fragility is not solely determined by its density but by a combination of bone geometry, distribution of bone mass, microarchitecture, and the intrinsic material properties of bone tissue. As such, different individuals can exhibit distinct bone phenotypes, which may predispose them to be more vulnerable or resilient to certain perturbations that influence bone strength.
Collapse
Affiliation(s)
- Danielle E Whittier
- McCaig Institute for Bone and Joint Health and Alberta Children's Hospital Research Institute, University of Calgary, Calgary, Canada.
- Department of Cell Biology and Anatomy, University of Calgary, Calgary, Canada.
| | - Melissa S A M Bevers
- Department of Internal Medicine, VieCuri Medical Center, Venlo, The Netherlands
- NUTRIM School for Nutrition and Translational Research In Metabolism, Maastricht University Medical Center, Maastricht, The Netherlands
- Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands
| | - Piet P M M Geusens
- Subdivision of Rheumatology, Department of Internal Medicine, Maastricht University Medical Center, Maastricht, The Netherlands
- Department of Medicine and Life Sciences, Hasselt University, Hasselt, Belgium
| | - Joop P van den Bergh
- Department of Internal Medicine, VieCuri Medical Center, Venlo, The Netherlands
- NUTRIM School for Nutrition and Translational Research In Metabolism, Maastricht University Medical Center, Maastricht, The Netherlands
- Subdivision of Rheumatology, Department of Internal Medicine, Maastricht University Medical Center, Maastricht, The Netherlands
| | - Leigh Gabel
- McCaig Institute for Bone and Joint Health and Alberta Children's Hospital Research Institute, University of Calgary, Calgary, Canada
- Human Performance Laboratory, Faculty of Kinesiology, University of Calgary, Calgary, Canada
| |
Collapse
|