1
|
Zhou L, Ji Q, Peng H, Chen F, Zheng Y, Jiao Z, Gong J, Li W. Automatic image segmentation and online survival prediction model of medulloblastoma based on machine learning. Eur Radiol 2024; 34:3644-3655. [PMID: 37994966 DOI: 10.1007/s00330-023-10316-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2022] [Revised: 08/19/2023] [Accepted: 08/26/2023] [Indexed: 11/24/2023]
Abstract
OBJECTIVES To develop a dynamic nomogram containing radiomics signature and clinical features for estimating the overall survival (OS) of patients with medulloblastoma (MB) and design an automatic image segmentation model to reduce labor and time costs. METHODS Data from 217 medulloblastoma (MB) patients over the past 4 years were collected and separated into a training set and a test set. Intraclass correlation coefficient (ICC), random survival forest (RSF), and least absolute shrinkage and selection operator (LASSO) regression methods were employed to select variables in the training set. Univariate and multivariate Cox proportional hazard models, as well as Kaplan-Meier analysis, were utilized to determine the relationship among the radiomics signature, clinical features, and overall survival. A dynamic nomogram was developed. Additionally, a 3D-Unet deep learning model was used to train the automatic tumor delineation model. RESULTS Higher Rad-scores were significantly associated with worse OS in both the training and validation sets (p < 0.001 and p = 0.047, respectively). The Cox model combined clinical and radiomics signatures ([IBS = 0.079], [C-index = 0.747, SE = 0.045]) outperformed either radiomics signatures alone ([IBS = 0.081], [C-index = 0.738, SE = 0.041]) or clinical features alone ([IBS = 0.085], [C-index = 0.565, SE = 0.041]). The segmentation model had mean Dice coefficients of 0.80, 0.82, and 0.78 in the training, validation, and test sets respectively. A deep learning-based tumor segmentation model was built with Dice coefficients of 0.8372, 0.8017, and 0.7673 on the training set, validation set, and test set, respectively. CONCLUSIONS A combination of radiomics features and clinical characteristics enhances the accuracy of OS prediction in medulloblastoma patients. Additionally, building an MRI image automatic segmentation model reduces labor and time costs. CLINICAL RELEVANCE STATEMENT A survival prognosis model based on radiomics and clinical characteristics could improve the accuracy of prognosis estimation for medulloblastoma patients, and an MRI-based automatic tumor segmentation model could reduce the cost of time. KEY POINTS • A model that combines radiomics and clinical features can predict the survival prognosis of patients with medulloblastoma. • Online nomogram and image automatic segmentation model can help doctors better judge the prognosis of medulloblastoma and save working time. • The developed AI system can help doctors judge the prognosis of diseases and promote the development of precision medicine.
Collapse
Affiliation(s)
- Lili Zhou
- Cancer Center, Beijing Tiantan Hospital, Capital Medical University, No. 119, Nansihuan West Road, Fengtai District, Beijing, 100070, China
| | - Qiang Ji
- Cancer Center, Beijing Tiantan Hospital, Capital Medical University, No. 119, Nansihuan West Road, Fengtai District, Beijing, 100070, China
| | - Hong Peng
- Department of Radiology, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, No. 639 Zhizaoju Road, Huangpu District, Shanghai, 20011, China
| | - Feng Chen
- Cancer Center, Beijing Tiantan Hospital, Capital Medical University, No. 119, Nansihuan West Road, Fengtai District, Beijing, 100070, China
| | - Yi Zheng
- Cancer Center, Beijing Tiantan Hospital, Capital Medical University, No. 119, Nansihuan West Road, Fengtai District, Beijing, 100070, China
| | | | - Jian Gong
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical Unversity, No. 119, Nansihuan West Road, Fengtai District, Beijing, 100070, China.
| | - Wenbin Li
- Cancer Center, Beijing Tiantan Hospital, Capital Medical University, No. 119, Nansihuan West Road, Fengtai District, Beijing, 100070, China.
| |
Collapse
|
2
|
Guha A, Halder S, Shinde SH, Gawde J, Munnolli S, Talole S, Goda JS. How does deep learning/machine learning perform in comparison to radiologists in distinguishing glioblastomas (or grade IV astrocytomas) from primary CNS lymphomas?: a meta-analysis and systematic review. Clin Radiol 2024; 79:460-472. [PMID: 38614870 DOI: 10.1016/j.crad.2024.03.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Revised: 03/05/2024] [Accepted: 03/07/2024] [Indexed: 04/15/2024]
Abstract
BACKGROUND Several studies have been published comparing deep learning (DL)/machine learning (ML) to radiologists in differentiating PCNSLs from GBMs with equivocal results. We aimed to perform this meta-analysis to evaluate the diagnostic accuracy of ML/DL versus radiologists in classifying PCNSL versus GBM using MRI. METHODOLOGY The study was performed in accordance with PRISMA guidelines. Data was extracted and interpreted by two researchers with 12 and 23 years' experience, respectively, and QUADAS-2 tool was used for quality and risk-bias assessment. We constructed contingency tables to derive sensitivity, specificity accuracy, summary receiver operating characteristic (SROC) curve, and the area under the curve (AUC). RESULTS Our search identified 11 studies, of which 8 satisfied our inclusion criteria and restricted the analysis in each study to reporting the model showing highest accuracy, with a total sample size of 1159 patients. The random effects model showed a pooled sensitivity of 0.89 [95% CI:0.84-0.92] for ML and 0.82 [95% CI:0.76-0.87] for radiologists. Pooled specificity was 0.88 [95% CI: 0.84-0.91] for ML and 0.90 [95% CI: 0.81-0.95] for radiologists. Pooled accuracy was 0.88 [95% CI: 0.86-0.90] for ML and 0.86 [95% CI: 0.78-0.91] for radiologists. Pooled AUC of ML was 0.94 [95% CI:0.92-0.96]and for radiologists, it was 0.90 [95% CI: 0.84-0.93]. CONCLUSIONS MRI-based ML/DL techniques can complement radiologists to improve the accuracy of classifying GBMs from PCNSL, possibly reduce the need for a biopsy, and avoid any unwanted neurosurgical resection of a PCNSL.
Collapse
Affiliation(s)
- A Guha
- Department of Radio-diagnosis, Tata Memorial Hospital, Parel, Mumbai, 400012, India; Homi Bhabha National Institute, Anushakti Nagar, Trombay, 400094, India.
| | - S Halder
- Centre for Cancer Epidemiology, Advanced Centre for Treatment Research & Education in Cancer, Tata Memorial Centre, Kharghar, Navi Mumbai, 410210, India; Homi Bhabha National Institute, Anushakti Nagar, Trombay, 400094, India
| | - S H Shinde
- Department of Radio-diagnosis, Tata Memorial Hospital, Parel, Mumbai, 400012, India; Homi Bhabha National Institute, Anushakti Nagar, Trombay, 400094, India
| | - J Gawde
- Centre for Cancer Epidemiology, Advanced Centre for Treatment Research & Education in Cancer, Tata Memorial Centre, Kharghar, Navi Mumbai, 410210, India; Homi Bhabha National Institute, Anushakti Nagar, Trombay, 400094, India
| | - S Munnolli
- Librarian and Officer In-Charge, Advanced Centre for Treatment Research & Education in Cancer, Tata Memorial Centre, Kharghar, Navi Mumbai, 410210, India; Homi Bhabha National Institute, Anushakti Nagar, Trombay, 400094, India
| | - S Talole
- Biostatistician, Centre for Cancer Epidemiology, Advanced Centre for Treatment Research & Education in Cancer, Tata Memorial Centre, Kharghar, Navi Mumbai, 410210, India; Homi Bhabha National Institute, Anushakti Nagar, Trombay, 400094, India
| | - J S Goda
- Department of Radiation Oncology, Advanced Centre for Treatment Research & Education in Cancer, Tata Memorial Centre, Kharghar, Navi Mumbai, 410210, India; Homi Bhabha National Institute, Anushakti Nagar, Trombay, 400094, India.
| |
Collapse
|
3
|
Zhao C, Song J, Yuan Y, Chu YH, Hsu YC, Huang Q. An improved attention module based on nnU-Net for segmenting primary central nervous system lymphoma (PCNSL) in MRI images1. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2024:XST240016. [PMID: 38728198 DOI: 10.3233/xst-240016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/12/2024]
Abstract
BACKGROUND Accurate volumetric segmentation of primary central nervous system lymphoma (PCNSL) is essential for assessing and monitoring the tumor before radiotherapy and the treatment planning. The tedious manual segmentation leads to interindividual and intraindividual differences, while existing automatic segmentation methods cause under-segmentation of PCNSL due to the complex and multifaceted nature of the tumor. OBJECTIVE To address the challenges of small size, diffused distribution, poor inter-layer continuity on the same axis, and tendency for over-segmentation in brain MRI PCNSL segmentation, we propose an improved attention module based on nnUNet for automated segmentation. METHODS We collected 114 T1 MRI images of patients in the Huashan Hospital, Shanghai. Then randomly split the total of 114 cases into 5 distinct training and test sets for a 5-fold cross-validation. To efficiently and accurately delineate the PCNSL, we proposed an improved attention module based on nnU-Net with 3D convolutions, batch normalization, and residual attention (res-attention) to learn the tumor region information. Additionally, multi-scale dilated convolution kernels with different dilation rates were integrated to broaden the receptive field. We further used attentional feature fusion with 3D convolutions (AFF3D) to fuse the feature maps generated by multi-scale dilated convolution kernels to reduce under-segmentation. RESULTS Compared to existing methods, our attention module improves the ability to distinguish diffuse and edge enhanced types of tumors; and the broadened receptive field captures tumor features of various scales and shapes more effectively, achieving a 0.9349 Dice Similarity Coefficient (DSC). CONCLUSIONS Quantitative results demonstrate the effectiveness of the proposed method in segmenting the PCNSL. To our knowledge, this is the first study to introduce attention modules into deep learning for segmenting PCNSL based on brain magnetic resonance imaging (MRI), promoting the localization of PCNSL before radiotherapy.
Collapse
Affiliation(s)
- Chen Zhao
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Jianping Song
- Department of Neurosurgery, National Center for Neurological Disorders, Huashan Hospital, Fudan University, Shanghai, China
- Department of Neurosurgery, National Regional Medical Center, Huashan Hospital Fujian Campus, Fudan University, Fuzhou, Fujian, China
| | - Yifan Yuan
- Department of Neurosurgery, National Center for Neurological Disorders, Huashan Hospital, Fudan University, Shanghai, China
- Department of Neurosurgery, National Regional Medical Center, Huashan Hospital Fujian Campus, Fudan University, Fuzhou, Fujian, China
| | | | | | - Qiu Huang
- Department of Nuclear Medicine, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| |
Collapse
|
4
|
Yuan J, Zhang Y, Wang X. Application of machine learning in the management of lymphoma: Current practice and future prospects. Digit Health 2024; 10:20552076241247963. [PMID: 38628632 PMCID: PMC11020711 DOI: 10.1177/20552076241247963] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Accepted: 03/28/2024] [Indexed: 04/19/2024] Open
Abstract
In the past decade, digitization of medical records and multiomics data analysis in lymphoma has led to the accessibility of high-dimensional records. The digitization of medical records, the visualization of extensive volume data extracted from medical images, and the integration of multiomics methods into clinical decision-making have produced many datasets. As a promising auxiliary tool, machine learning (ML) intends to extract homologous features in large-scale data sets and encode them into various patterns to complete complicated tasks. At present, artificial intelligence and digital mining have shown promising prospects in the field of lymphoma pathological image analysis. The paradigm shift from qualitative analysis to quantitative analysis makes the pathological diagnosis more intelligent and the results more accurate and objective. ML can promote accurate lymphoma diagnosis and provide patients with prognostic information and more individualized treatment options. Based on the above, this comprehensive review of the general workflow of ML highlights recent advances in ML techniques in the diagnosis, treatment, and prognosis of lymphoma, and clarifies the boundedness and future orientation of the ML technique in the clinical practice of lymphoma.
Collapse
Affiliation(s)
- Junyun Yuan
- Department of Hematology, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, Shandong, China
| | - Ya Zhang
- Department of Hematology, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, Shandong, China
- Department of Hematology, Shandong Provincial Hospital, Shandong University, Jinan, Shandong, China
- Taishan Scholars Program of Shandong Province, Jinan, Shandong, China
| | - Xin Wang
- Department of Hematology, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, Shandong, China
- Department of Hematology, Shandong Provincial Hospital, Shandong University, Jinan, Shandong, China
- Taishan Scholars Program of Shandong Province, Jinan, Shandong, China
- Branch of National Clinical Research Center for Hematologic Diseases, Jinan, Shandong, China
- National Clinical Research Center for Hematologic Diseases, Hospital of Soochow University, Suzhou, China
| |
Collapse
|
5
|
Wang J, Sun J, Xu J, Lu S, Wang H, Huang C, Zhang F, Yu Y, Gao X, Wang M, Wang Y, Ruan X, Pan Y. Detection of Intracranial Aneurysms Using Multiphase CT Angiography with a Deep Learning Model. Acad Radiol 2023; 30:2477-2486. [PMID: 36737273 DOI: 10.1016/j.acra.2022.12.043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2022] [Revised: 12/27/2022] [Accepted: 12/27/2022] [Indexed: 02/04/2023]
Abstract
RATIONALE AND OBJECTIVES Determine the effect of a multiphase fusion deep-learning model with automatic phase selection in detection of intracranial aneurysm (IA) from computed tomography angiography (CTA) images. MATERIALS AND METHODS CTA images of intracranial arteries from patients at Ningbo First Hospital were retrospectively analyzed. Images were randomly classified as training data, internal validation data, or test data. CTA images from cases examined by digital subtraction angiography (DSA) were examined for independent validation. A deep-learning model was constructed by automatic phase selection of multiphase fusion, and compared to the single-phase algorithm to evaluate algorithm sensitivity. RESULTS We analyzed 1110 patients (1493 aneurysms) as training data, 139 patients (174 aneurysms) as internal validation data, and 134 patients (175 aneurysms) as test data. The sensitivity of the multiphase analysis of the internal validation data, test data, and independent validation data were greater than from the single-phase analysis. The recall of the multiphase selection was greater or equal to that of single-phase selection in the aneurysm position, shape, size, and rupture status. Use of the test data to determine the presence and absence of aneurysm rupture led to a recall from multiphase selection of 94.8% and 87.6% respectively; both of these values were greater than those from single-phase selection (89.6% and 79.4%). CONCLUSION A multiphase fusion deep learning model with automatic phase selection provided automated detection of IAs with high sensitivity.
Collapse
Affiliation(s)
- Jinglu Wang
- Department of Radiology, Ningbo First Hospital, Ningbo, Zhejiang Province, People's Republic of China
| | - Jie Sun
- Department of Neurosurgery, Ningbo First Hospital, Ningbo, Zhejiang Province, People's Republic of China
| | - Jingxu Xu
- Deepwise AI Lab, Beijing Deepwise & League of PHD Technology Co., Ltd, Beijing, People's Republic of China
| | - Shiyu Lu
- Deepwise AI Lab, Beijing Deepwise & League of PHD Technology Co., Ltd, Beijing, People's Republic of China
| | - Hao Wang
- Deepwise AI Lab, Beijing Deepwise & League of PHD Technology Co., Ltd, Beijing, People's Republic of China
| | - Chencui Huang
- Deepwise AI Lab, Beijing Deepwise & League of PHD Technology Co., Ltd, Beijing, People's Republic of China
| | - Fandong Zhang
- Deepwise AI Lab, Beijing Deepwise & League of PHD Technology Co., Ltd, Beijing, People's Republic of China
| | - Yizhou Yu
- Deepwise AI Lab, Beijing Deepwise & League of PHD Technology Co., Ltd, Beijing, People's Republic of China
| | - Xiang Gao
- Department of Neurosurgery, Ningbo First Hospital, Ningbo, Zhejiang Province, People's Republic of China
| | - Ming Wang
- Department of Radiology, Ningbo First Hospital, Ningbo, Zhejiang Province, People's Republic of China
| | - Yu Wang
- Department of Radiology, Ningbo First Hospital, Ningbo, Zhejiang Province, People's Republic of China
| | - Xinzhong Ruan
- Department of Radiology, Ningbo First Hospital, Ningbo, Zhejiang Province, People's Republic of China
| | - Yuning Pan
- Department of Radiology, Ningbo First Hospital, Ningbo, Zhejiang Province, People's Republic of China; Key Laboratory of Precision Medicine for Atherosclerotic Diseases of Zhejiang Province, People's Republic of China.
| |
Collapse
|
6
|
Cornell I, Al Busaidi A, Wastling S, Anjari M, Cwynarski K, Fox CP, Martinez-Calle N, Poynton E, Maynard J, Thust SC. Early MRI Predictors of Relapse in Primary Central Nervous System Lymphoma Treated with MATRix Immunochemotherapy. J Pers Med 2023; 13:1182. [PMID: 37511795 PMCID: PMC10381964 DOI: 10.3390/jpm13071182] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2023] [Revised: 07/14/2023] [Accepted: 07/17/2023] [Indexed: 07/30/2023] Open
Abstract
Primary Central Nervous System Lymphoma (PCNSL) is a highly malignant brain tumour. We investigated dynamic changes in tumour volume and apparent diffusion coefficient (ADC) measurements for predicting outcome following treatment with MATRix chemotherapy in PCNSL. Patients treated with MATRix (n = 38) underwent T1 contrast-enhanced (T1CE) and diffusion-weighted imaging (DWI) before treatment, after two cycles and after four cycles of chemotherapy. Response was assessed using the International PCNSL Collaborative Group (IPCG) imaging criteria. ADC histogram parameters and T1CE tumour volumes were compared among response groups, using one-way ANOVA testing. Logistic regression was performed to examine those imaging parameters predictive of response. Response after two cycles of chemotherapy differed from response after four cycles; of the six patients with progressive disease (PD) after four cycles of treatment, two (33%) had demonstrated a partial response (PR) or complete response (CR) after two cycles. ADCmean at baseline, T1CE at baseline and T1CE percentage volume change differed between response groups (0.005 < p < 0.038) and were predictive of MATRix treatment response (area under the curve: 0.672-0.854). Baseline ADC and T1CE metrics are potential biomarkers for risk stratification of PCNSL patients early during remission induction therapy with MATRix. Standard interim response assessment (after two cycles) according to IPCG imaging criteria does not reliably predict early disease progression in the context of a conventional treatment approach.
Collapse
Affiliation(s)
- Isabel Cornell
- UCL Institute of Neurology, Department of Brain Rehabilitation and Repair, Queen Square, London WC1N 3BG, UK
| | - Ayisha Al Busaidi
- Lysholm Department of Neuroradiology, National Hospital for Neurology and Neurosurgery, University College London Hospitals NHS Foundation Trust, London WC1N 3BG, UK
- Neuroradiology Department, Kings College Hospital NHS Foundation Trust, London SE5 9RS, UK
| | - Stephen Wastling
- UCL Institute of Neurology, Department of Brain Rehabilitation and Repair, Queen Square, London WC1N 3BG, UK
- Lysholm Department of Neuroradiology, National Hospital for Neurology and Neurosurgery, University College London Hospitals NHS Foundation Trust, London WC1N 3BG, UK
| | - Mustafa Anjari
- UCL Institute of Neurology, Department of Brain Rehabilitation and Repair, Queen Square, London WC1N 3BG, UK
- Lysholm Department of Neuroradiology, National Hospital for Neurology and Neurosurgery, University College London Hospitals NHS Foundation Trust, London WC1N 3BG, UK
- Radiology Department, Royal Free London NHS Foundation Trust, London NW3 2QG, UK
| | - Kate Cwynarski
- Haematology Department, University College London Hospitals NHS Foundation Trust, London NW1 2BU, UK
| | - Christopher P Fox
- School of Medicine, University of Nottingham, Nottingham NG7 2UH, UK
| | | | - Edward Poynton
- Haematology Department, University College London Hospitals NHS Foundation Trust, London NW1 2BU, UK
| | - John Maynard
- UCL Institute of Neurology, Department of Brain Rehabilitation and Repair, Queen Square, London WC1N 3BG, UK
- Lysholm Department of Neuroradiology, National Hospital for Neurology and Neurosurgery, University College London Hospitals NHS Foundation Trust, London WC1N 3BG, UK
| | - Steffi C Thust
- UCL Institute of Neurology, Department of Brain Rehabilitation and Repair, Queen Square, London WC1N 3BG, UK
- Precision Imaging Beacon, School of Medicine, University of Nottingham, Nottingham NG7 2UH, UK
- Neuroradiology Department, Nottingham University Hospitals NHS Trust, Nottingham NG7 2UH, UK
| |
Collapse
|
7
|
Farah L, Davaze-Schneider J, Martin T, Nguyen P, Borget I, Martelli N. Are current clinical studies on artificial intelligence-based medical devices comprehensive enough to support a full health technology assessment? A systematic review. Artif Intell Med 2023; 140:102547. [PMID: 37210155 DOI: 10.1016/j.artmed.2023.102547] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Revised: 03/28/2023] [Accepted: 04/04/2023] [Indexed: 05/22/2023]
Abstract
INTRODUCTION Artificial Intelligence-based Medical Devices (AI-based MDs) are experiencing exponential growth in healthcare. This study aimed to investigate whether current studies assessing AI contain the information required for health technology assessment (HTA) by HTA bodies. METHODS We conducted a systematic literature review based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses methodology to extract articles published between 2016 and 2021 related to the assessment of AI-based MDs. Data extraction focused on study characteristics, technology, algorithms, comparators, and results. AI quality assessment and HTA scores were calculated to evaluate whether the items present in the included studies were concordant with the HTA requirements. We performed a linear regression for the HTA and AI scores with the explanatory variables of the impact factor, publication date, and medical specialty. We conducted a univariate analysis of the HTA score and a multivariate analysis of the AI score with an alpha risk of 5 %. RESULTS Of 5578 retrieved records, 56 were included. The mean AI quality assessment score was 67 %; 32 % of articles had an AI quality score ≥ 70 %, 50 % had a score between 50 % and 70 %, and 18 % had a score under 50 %. The highest quality scores were observed for the study design (82 %) and optimisation (69 %) categories, whereas the scores were lowest in the clinical practice category (23 %). The mean HTA score was 52 % for all seven domains. 100 % of the studies assessed clinical effectiveness, whereas only 9 % evaluated safety, and 20 % evaluated economic issues. There was a statistically significant relationship between the impact factor and the HTA and AI scores (both p = 0.046). DISCUSSION Clinical studies on AI-based MDs have limitations and often lack adapted, robust, and complete evidence. High-quality datasets are also required because the output data can only be trusted if the inputs are reliable. The existing assessment frameworks are not specifically designed to assess AI-based MDs. From the perspective of regulatory authorities, we suggest that these frameworks should be adapted to assess the interpretability, explainability, cybersecurity, and safety of ongoing updates. From the perspective of HTA agencies, we highlight that transparency, professional and patient acceptance, ethical issues, and organizational changes are required for the implementation of these devices. Economic assessments of AI should rely on a robust methodology (business impact or health economic models) to provide decision-makers with more reliable evidence. CONCLUSION Currently, AI studies are insufficient to cover HTA prerequisites. HTA processes also need to be adapted because they do not consider the important specificities of AI-based MDs. Specific HTA workflows and accurate assessment tools should be designed to standardise evaluations, generate reliable evidence, and create confidence.
Collapse
Affiliation(s)
- Line Farah
- Groupe de Recherche et d'accueil en Droit et Economie de la Santé (GRADES) Department, University Paris-Saclay, Orsay, France; Innovation Center for Medical Devices, Foch Hospital, 40 Rue Worth, 92150 Suresnes, France.
| | - Julie Davaze-Schneider
- Pharmacy Department, Georges Pompidou European Hospital, AP-HP, 20 Rue Leblanc, 75015 Paris, France
| | - Tess Martin
- Groupe de Recherche et d'accueil en Droit et Economie de la Santé (GRADES) Department, University Paris-Saclay, Orsay, France; Pharmacy Department, Georges Pompidou European Hospital, AP-HP, 20 Rue Leblanc, 75015 Paris, France
| | - Pierre Nguyen
- Pharmacy Department, Georges Pompidou European Hospital, AP-HP, 20 Rue Leblanc, 75015 Paris, France
| | - Isabelle Borget
- Groupe de Recherche et d'accueil en Droit et Economie de la Santé (GRADES) Department, University Paris-Saclay, Orsay, France; Department of Biostatistics and Epidemiology, Gustave Roussy, University Paris-Saclay, 94805 Villejuif, France; Oncostat U1018, Inserm, University Paris-Saclay, Équipe Labellisée Ligue Contre le Cancer, Villejuif, France
| | - Nicolas Martelli
- Groupe de Recherche et d'accueil en Droit et Economie de la Santé (GRADES) Department, University Paris-Saclay, Orsay, France; Pharmacy Department, Georges Pompidou European Hospital, AP-HP, 20 Rue Leblanc, 75015 Paris, France
| |
Collapse
|
8
|
Kotsyfakis S, Iliaki-Giannakoudaki E, Anagnostopoulos A, Papadokostaki E, Giannakoudakis K, Goumenakis M, Kotsyfakis M. The application of machine learning to imaging in hematological oncology: A scoping review. Front Oncol 2022; 12:1080988. [PMID: 36605438 PMCID: PMC9808781 DOI: 10.3389/fonc.2022.1080988] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2022] [Accepted: 12/05/2022] [Indexed: 12/24/2022] Open
Abstract
Background Here, we conducted a scoping review to (i) establish which machine learning (ML) methods have been applied to hematological malignancy imaging; (ii) establish how ML is being applied to hematological cancer radiology; and (iii) identify addressable research gaps. Methods The review was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis Extension for Scoping Reviews guidelines. The inclusion criteria were (i) pediatric and adult patients with suspected or confirmed hematological malignancy undergoing imaging (population); (ii) any study using ML techniques to derive models using radiological images to apply to the clinical management of these patients (concept); and (iii) original research articles conducted in any setting globally (context). Quality Assessment of Diagnostic Accuracy Studies 2 criteria were used to assess diagnostic and segmentation studies, while the Newcastle-Ottawa scale was used to assess the quality of observational studies. Results Of 53 eligible studies, 33 applied diverse ML techniques to diagnose hematological malignancies or to differentiate them from other diseases, especially discriminating gliomas from primary central nervous system lymphomas (n=18); 11 applied ML to segmentation tasks, while 9 applied ML to prognostication or predicting therapeutic responses, especially for diffuse large B-cell lymphoma. All studies reported discrimination statistics, but no study calculated calibration statistics. Every diagnostic/segmentation study had a high risk of bias due to their case-control design; many studies failed to provide adequate details of the reference standard; and only a few studies used independent validation. Conclusion To deliver validated ML-based models to radiologists managing hematological malignancies, future studies should (i) adhere to standardized, high-quality reporting guidelines such as the Checklist for Artificial Intelligence in Medical Imaging; (ii) validate models in independent cohorts; (ii) standardize volume segmentation methods for segmentation tasks; (iv) establish comprehensive prospective studies that include different tumor grades, comparisons with radiologists, optimal imaging modalities, sequences, and planes; (v) include side-by-side comparisons of different methods; and (vi) include low- and middle-income countries in multicentric studies to enhance generalizability and reduce inequity.
Collapse
Affiliation(s)
| | | | | | | | | | | | - Michail Kotsyfakis
- Biology Center of the Czech Academy of Sciences, Budweis (Ceske Budejovice), Czechia,*Correspondence: Michail Kotsyfakis,
| |
Collapse
|
9
|
Tang Y, Shi Y, Wang L, Qian ZT, Fan YW, Wu HM, Li X. Preliminary clinical application of multimodal imaging combined with frameless robotic stereotactic biopsy in the diagnosis of primary central nervous system lymphoma. Heliyon 2022; 8:e12162. [DOI: 10.1016/j.heliyon.2022.e12162] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Revised: 11/06/2022] [Accepted: 11/29/2022] [Indexed: 12/13/2022] Open
|
10
|
Lee J, Liu C, Kim J, Chen Z, Sun Y, Rogers JR, Chung WK, Weng C. Deep learning for rare disease: A scoping review. J Biomed Inform 2022; 135:104227. [DOI: 10.1016/j.jbi.2022.104227] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2022] [Revised: 08/22/2022] [Accepted: 10/07/2022] [Indexed: 10/31/2022]
|
11
|
You JB, McCallum C, Wang Y, Riordon J, Nosrati R, Sinton D. Machine learning for sperm selection. Nat Rev Urol 2021; 18:387-403. [PMID: 34002070 DOI: 10.1038/s41585-021-00465-1] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/30/2021] [Indexed: 02/04/2023]
Abstract
Infertility rates and the number of couples seeking fertility care have increased worldwide over the past few decades. Over 2.5 million cycles of assisted reproductive technologies are being performed globally every year, but the success rate has remained at ~33%. Machine learning, an automated method of data analysis based on patterns and inference, is increasingly being deployed within the health-care sector to improve diagnostics and therapeutics. This technique is already aiding embryo selection in some fertility clinics, and has also been applied in research laboratories to improve sperm analysis and selection. Tremendous opportunities exist for machine learning to advance male fertility treatments. The fundamental challenge of sperm selection - selecting the most promising candidate from 108 gametes - presents a challenge that is uniquely well-suited to the high-throughput capabilities of machine learning algorithms paired with modern data processing capabilities.
Collapse
Affiliation(s)
- Jae Bem You
- Department of Mechanical & Industrial Engineering, University of Toronto, Toronto, ON, Canada.,Department of Chemical Engineering, Kyungpook National University, Daegu, Republic of Korea
| | - Christopher McCallum
- Department of Mechanical & Industrial Engineering, University of Toronto, Toronto, ON, Canada
| | - Yihe Wang
- Department of Mechanical & Industrial Engineering, University of Toronto, Toronto, ON, Canada
| | - Jason Riordon
- Department of Mechanical & Industrial Engineering, University of Toronto, Toronto, ON, Canada
| | - Reza Nosrati
- Department of Mechanical & Aerospace Engineering, Monash University, Clayton, VIC, Australia
| | - David Sinton
- Department of Mechanical & Industrial Engineering, University of Toronto, Toronto, ON, Canada.
| |
Collapse
|
12
|
Jünger ST, Hoyer UCI, Schaufler D, Laukamp KR, Goertz L, Thiele F, Grunz JP, Schlamann M, Perkuhn M, Kabbasch C, Persigehl T, Grau S, Borggrefe J, Scheffler M, Shahzad R, Pennig L. Fully Automated MR Detection and Segmentation of Brain Metastases in Non-small Cell Lung Cancer Using Deep Learning. J Magn Reson Imaging 2021; 54:1608-1622. [PMID: 34032344 DOI: 10.1002/jmri.27741] [Citation(s) in RCA: 22] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2021] [Revised: 05/12/2021] [Accepted: 05/12/2021] [Indexed: 12/14/2022] Open
Abstract
BACKGROUND Non-small cell lung cancer (NSCLC) is the most common tumor entity spreading to the brain and up to 50% of patients develop brain metastases (BMs). Detection of BMs on MRI is challenging with an inherent risk of missed diagnosis. PURPOSE To train and evaluate a deep learning model (DLM) for fully automated detection and 3D segmentation of BMs in NSCLC on clinical routine MRI. STUDY TYPE Retrospective. POPULATION Ninety-eight NSCLC patients with 315 BMs on pretreatment MRI, divided into training (66 patients, 248 BMs) and independent test (17 patients, 67 BMs) and control (15 patients, 0 BMs) cohorts. FIELD STRENGTH/SEQUENCE T1 -/T2 -weighted, T1 -weighted contrast-enhanced (T1 CE; gradient-echo and spin-echo sequences), and FLAIR at 1.0, 1.5, and 3.0 T from various vendors and study centers. ASSESSMENT A 3D convolutional neural network (DeepMedic) was trained on the training cohort using 5-fold cross-validation and evaluated on the independent test and control sets. Three-dimensional voxel-wise manual segmentations of BMs by a neurosurgeon and a radiologist on T1 CE served as the reference standard. STATISTICAL TESTS Sensitivity (recall) and false positive (FP) findings per scan, dice similarity coefficient (DSC) to compare the spatial overlap between manual and automated segmentations, Pearson's correlation coefficient (r) to evaluate the relationship between quantitative volumetric measurements of segmentations, and Wilcoxon rank-sum test to compare the volumes of BMs. A P value <0.05 was considered statistically significant. RESULTS In the test set, the DLM detected 57 of the 67 BMs (mean volume: 0.99 ± 4.24 cm3 ), resulting in a sensitivity of 85.1%, while FP findings of 1.5 per scan were observed. Missed BMs had a significantly smaller volume (0.05 ± 0.04 cm3 ) than detected BMs (0.96 ± 2.4 cm3 ). Compared with the reference standard, automated segmentations achieved a median DSC of 0.72 and a good volumetric correlation (r = 0.95). In the control set, 1.8 FPs/scan were observed. DATA CONCLUSION Deep learning provided a high detection sensitivity and good segmentation performance for BMs in NSCLC on heterogeneous scanner data while yielding a low number of FP findings. Level of Evidence 3 Technical Efficacy Stage 2.
Collapse
Affiliation(s)
- Stephanie T Jünger
- Department of General Neurosurgery, Center for Neurosurgery, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany.,Centre for Integrated Oncology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Ulrike Cornelia Isabel Hoyer
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Diana Schaufler
- Department of Internal Medicine, Center for Integrated Oncology Aachen Bonn Cologne Duesseldorf, Network Genomic Medicine, Lung Cancer Group Cologne, Faculty of Medicine and University Hospital of Cologne, University of Cologne, Cologne, Germany
| | - Kai Roman Laukamp
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Lukas Goertz
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Frank Thiele
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany.,Philips GmbH Innovative Technologies, Aachen, Germany
| | - Jan-Peter Grunz
- Department of Diagnostic and Interventional Radiology, University Hospital Würzburg, Würzburg, Germany
| | - Marc Schlamann
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Michael Perkuhn
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany.,Philips GmbH Innovative Technologies, Aachen, Germany
| | - Christoph Kabbasch
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Thorsten Persigehl
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Stefan Grau
- Department of General Neurosurgery, Center for Neurosurgery, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany.,Centre for Integrated Oncology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Jan Borggrefe
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany.,Department of Radiology, Neuroradiology and Nuclear Medicine, Johannes Wesling University Hospital, Ruhr University Bochum, Bochum, Germany
| | - Matthias Scheffler
- Department of Internal Medicine, Center for Integrated Oncology Aachen Bonn Cologne Duesseldorf, Network Genomic Medicine, Lung Cancer Group Cologne, Faculty of Medicine and University Hospital of Cologne, University of Cologne, Cologne, Germany
| | - Rahil Shahzad
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany.,Philips GmbH Innovative Technologies, Aachen, Germany
| | - Lenhard Pennig
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| |
Collapse
|
13
|
Pennig L, Hoyer UCI, Krauskopf A, Shahzad R, Jünger ST, Thiele F, Laukamp KR, Grunz JP, Perkuhn M, Schlamann M, Kabbasch C, Borggrefe J, Goertz L. Deep learning assistance increases the detection sensitivity of radiologists for secondary intracranial aneurysms in subarachnoid hemorrhage. Neuroradiology 2021; 63:1985-1994. [PMID: 33837806 PMCID: PMC8589782 DOI: 10.1007/s00234-021-02697-9] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2021] [Accepted: 03/21/2021] [Indexed: 12/03/2022]
Abstract
Purpose To evaluate whether a deep learning model (DLM) could increase the detection sensitivity of radiologists for intracranial aneurysms on CT angiography (CTA) in aneurysmal subarachnoid hemorrhage (aSAH). Methods Three different DLMs were trained on CTA datasets of 68 aSAH patients with 79 aneurysms with their outputs being combined applying ensemble learning (DLM-Ens). The DLM-Ens was evaluated on an independent test set of 104 aSAH patients with 126 aneuryms (mean volume 129.2 ± 185.4 mm3, 13.0% at the posterior circulation), which were determined by two radiologists and one neurosurgeon in consensus using CTA and digital subtraction angiography scans. CTA scans of the test set were then presented to three blinded radiologists (reader 1: 13, reader 2: 4, and reader 3: 3 years of experience in diagnostic neuroradiology), who assessed them individually for aneurysms. Detection sensitivities for aneurysms of the readers with and without the assistance of the DLM were compared. Results In the test set, the detection sensitivity of the DLM-Ens (85.7%) was comparable to the radiologists (reader 1: 91.2%, reader 2: 86.5%, and reader 3: 86.5%; Fleiss κ of 0.502). DLM-assistance significantly increased the detection sensitivity (reader 1: 97.6%, reader 2: 97.6%,and reader 3: 96.0%; overall P=.024; Fleiss κ of 0.878), especially for secondary aneurysms (88.2% of the additional aneurysms provided by the DLM). Conclusion Deep learning significantly improved the detection sensitivity of radiologists for aneurysms in aSAH, especially for secondary aneurysms. It therefore represents a valuable adjunct for physicians to establish an accurate diagnosis in order to optimize patient treatment.
Collapse
Affiliation(s)
- Lenhard Pennig
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Kerpener Straße 62, 50937, Cologne, Germany.
| | - Ulrike Cornelia Isabel Hoyer
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Kerpener Straße 62, 50937, Cologne, Germany
| | - Alexandra Krauskopf
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Kerpener Straße 62, 50937, Cologne, Germany.,Department of Diagnostic and Interventional Radiology, University Hospital Düsseldorf, Düsseldorf, Germany
| | - Rahil Shahzad
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Kerpener Straße 62, 50937, Cologne, Germany.,Innovative Technologies, Philips Healthcare, Aachen, Germany
| | - Stephanie T Jünger
- Center for Neurosurgery, Department of General Neurosurgery, University of Cologne, Faculty of Medicine and University Hospital, University of Cologne, Cologne, Germany
| | - Frank Thiele
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Kerpener Straße 62, 50937, Cologne, Germany.,Innovative Technologies, Philips Healthcare, Aachen, Germany
| | - Kai Roman Laukamp
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Kerpener Straße 62, 50937, Cologne, Germany
| | - Jan-Peter Grunz
- Department of Diagnostic and Interventional Radiology, University Hospital Würzburg, Würzburg, Germany
| | - Michael Perkuhn
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Kerpener Straße 62, 50937, Cologne, Germany.,Innovative Technologies, Philips Healthcare, Aachen, Germany
| | - Marc Schlamann
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Kerpener Straße 62, 50937, Cologne, Germany
| | - Christoph Kabbasch
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Kerpener Straße 62, 50937, Cologne, Germany
| | - Jan Borggrefe
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Kerpener Straße 62, 50937, Cologne, Germany.,Department of Radiology, Neuroradiology and Nuclear Medicine, Johannes Wesling University Hospital, Ruhr University Bochum, Bochum, Germany
| | - Lukas Goertz
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Kerpener Straße 62, 50937, Cologne, Germany.,Center for Neurosurgery, Department of General Neurosurgery, University of Cologne, Faculty of Medicine and University Hospital, University of Cologne, Cologne, Germany
| |
Collapse
|
14
|
Xia W, Hu B, Li H, Shi W, Tang Y, Yu Y, Geng C, Wu Q, Yang L, Yu Z, Geng D, Li Y. Deep Learning for Automatic Differential Diagnosis of Primary Central Nervous System Lymphoma and Glioblastoma: Multi-Parametric Magnetic Resonance Imaging Based Convolutional Neural Network Model. J Magn Reson Imaging 2021; 54:880-887. [PMID: 33694250 DOI: 10.1002/jmri.27592] [Citation(s) in RCA: 29] [Impact Index Per Article: 9.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2021] [Revised: 02/23/2021] [Accepted: 02/25/2021] [Indexed: 12/12/2022] Open
Abstract
BACKGROUND Differential diagnosis of primary central nervous system lymphoma (PCNSL) and glioblastoma (GBM) is useful to guide treatment strategies. PURPOSE To investigate the use of a convolutional neural network (CNN) model for differentiation of PCNSL and GBM without tumor delineation. STUDY TYPE Retrospective. POPULATION A total of 289 patients with PCNSL (136) or GBM (153) were included, the average age of the cohort was 54 years, and there were 173 men and 116 women. FIELD STRENGTH/SEQUENCE 3.0 T Axial contrast-enhanced T1 -weighted spin-echo inversion recovery sequence (CE-T1 WI), T2 -weighted fluid-attenuation inversion recovery sequence (FLAIR), and diffusion weighted imaging (DWI, b = 0 second/mm2 , 1000 seconds/mm2 ). ASSESSMENT A single-parametric CNN model was built using CE-T1 WI, FLAIR, and the apparent diffusion coefficient (ADC) map derived from DWI, respectively. A decision-level fusion based multi-parametric CNN model (DF-CNN) was built by combining the predictions of single-parametric CNN models through logistic regression. An image-level fusion based multi-parametric CNN model (IF-CNN) was built using the integrated multi-parametric MR images. The radiomics models were developed. The diagnoses by three radiologists with 6 years (junior radiologist Y.Y.), 11 years (intermediate-level radiologist Y.T.), and 21 years (senior radiologist Y.L.) of experience were obtained. STATISTICAL ANALYSIS The 5-fold cross validation was used for model evaluation. The Pearson's chi-squared test was used to compare the accuracies. U-test and Fisher's exact test were used to compare clinical characteristics. RESULTS The CE-T1 WI, FLAIR, and ADC based single-parametric CNN model had accuracy of 0.884, 0.782, and 0.700, respectively. The DF-CNN model had an accuracy of 0.899 which was higher than the IF-CNN model (0.830, P = 0.021), but had no significant difference in accuracy compared to the radiomics model (0.865, P = 0.255), and the senior radiologist (0.906, P = 0.886). DATA CONCLUSION A CNN model can differentiate PCNSL from GBM without tumor delineation, and comparable to the radiomics models and radiologists. LEVEL OF EVIDENCE 4 TECHNICAL EFFICACY: Stage 2.
Collapse
Affiliation(s)
- Wei Xia
- Academy for Engineering and Technology, Fudan University, Shanghai, China.,Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, China.,Department of Radiology, Huashan Hospital, Fudan University, Shanghai, China
| | - Bin Hu
- Department of Radiology, Huashan Hospital, Fudan University, Shanghai, China
| | - Haiqing Li
- Department of Radiology, Huashan Hospital, Fudan University, Shanghai, China
| | - Wei Shi
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, China
| | - Ying Tang
- Department of Radiology, Huashan Hospital, Fudan University, Shanghai, China
| | - Yang Yu
- Department of Radiology, Huashan Hospital, Fudan University, Shanghai, China
| | - Chen Geng
- Academy for Engineering and Technology, Fudan University, Shanghai, China.,Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, China.,Department of Radiology, Huashan Hospital, Fudan University, Shanghai, China
| | - Qiuwen Wu
- Academy for Engineering and Technology, Fudan University, Shanghai, China.,Department of Radiology, Huashan Hospital, Fudan University, Shanghai, China
| | - Liqin Yang
- Academy for Engineering and Technology, Fudan University, Shanghai, China.,Department of Radiology, Huashan Hospital, Fudan University, Shanghai, China
| | - Zekuan Yu
- Academy for Engineering and Technology, Fudan University, Shanghai, China.,Department of Radiology, Huashan Hospital, Fudan University, Shanghai, China
| | - Daoying Geng
- Academy for Engineering and Technology, Fudan University, Shanghai, China.,Department of Radiology, Huashan Hospital, Fudan University, Shanghai, China
| | - Yuxin Li
- Academy for Engineering and Technology, Fudan University, Shanghai, China.,Department of Radiology, Huashan Hospital, Fudan University, Shanghai, China
| |
Collapse
|
15
|
Pennig L, Shahzad R, Caldeira L, Lennartz S, Thiele F, Goertz L, Zopfs D, Meißner AK, Fürtjes G, Perkuhn M, Kabbasch C, Grau S, Borggrefe J, Laukamp KR. Automated Detection and Segmentation of Brain Metastases in Malignant Melanoma: Evaluation of a Dedicated Deep Learning Model. AJNR Am J Neuroradiol 2021; 42:655-662. [PMID: 33541907 DOI: 10.3174/ajnr.a6982] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2020] [Accepted: 10/21/2020] [Indexed: 12/12/2022]
Abstract
BACKGROUND AND PURPOSE Malignant melanoma is an aggressive skin cancer in which brain metastases are common. Our aim was to establish and evaluate a deep learning model for fully automated detection and segmentation of brain metastases in patients with malignant melanoma using clinical routine MR imaging. MATERIALS AND METHODS Sixty-nine patients with melanoma with a total of 135 brain metastases at initial diagnosis and available multiparametric MR imaging datasets (T1-/T2-weighted, T1-weighted gadolinium contrast-enhanced, FLAIR) were included. A previously established deep learning model architecture (3D convolutional neural network; DeepMedic) simultaneously operating on the aforementioned MR images was trained on a cohort of 55 patients with 103 metastases using 5-fold cross-validation. The efficacy of the deep learning model was evaluated using an independent test set consisting of 14 patients with 32 metastases. Manual segmentations of metastases in a voxelwise manner (T1-weighted gadolinium contrast-enhanced imaging) performed by 2 radiologists in consensus served as the ground truth. RESULTS After training, the deep learning model detected 28 of 32 brain metastases (mean volume, 1.0 [SD, 2.4] cm3) in the test cohort correctly (sensitivity of 88%), while false-positive findings of 0.71 per scan were observed. Compared with the ground truth, automated segmentations achieved a median Dice similarity coefficient of 0.75. CONCLUSIONS Deep learning-based automated detection and segmentation of brain metastases in malignant melanoma yields high detection and segmentation accuracy with false-positive findings of <1 per scan.
Collapse
Affiliation(s)
- L Pennig
- From the Institute for Diagnostic and Interventional Radiology (L.P., R.S., L.C., S.L., F.T., D.Z., M.P., C.K., J.B., K.R.L.)
| | - R Shahzad
- From the Institute for Diagnostic and Interventional Radiology (L.P., R.S., L.C., S.L., F.T., D.Z., M.P., C.K., J.B., K.R.L.).,Philips Innovative Technologies (R.S., F.T., M.P.), Aachen, Germany
| | - L Caldeira
- From the Institute for Diagnostic and Interventional Radiology (L.P., R.S., L.C., S.L., F.T., D.Z., M.P., C.K., J.B., K.R.L.)
| | - S Lennartz
- From the Institute for Diagnostic and Interventional Radiology (L.P., R.S., L.C., S.L., F.T., D.Z., M.P., C.K., J.B., K.R.L.)
| | - F Thiele
- From the Institute for Diagnostic and Interventional Radiology (L.P., R.S., L.C., S.L., F.T., D.Z., M.P., C.K., J.B., K.R.L.).,Philips Innovative Technologies (R.S., F.T., M.P.), Aachen, Germany
| | - L Goertz
- Center for Neurosurgery (L.G., G.F., S.G.), Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - D Zopfs
- From the Institute for Diagnostic and Interventional Radiology (L.P., R.S., L.C., S.L., F.T., D.Z., M.P., C.K., J.B., K.R.L.)
| | - A-K Meißner
- Department of Stereotaxy and Functional Neurosurgery (A.-K.M., G.F.), Center for Neurosurgery, University Hospital Cologne, Cologne, Germany
| | - G Fürtjes
- Center for Neurosurgery (L.G., G.F., S.G.), Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany.,Department of Stereotaxy and Functional Neurosurgery (A.-K.M., G.F.), Center for Neurosurgery, University Hospital Cologne, Cologne, Germany
| | - M Perkuhn
- From the Institute for Diagnostic and Interventional Radiology (L.P., R.S., L.C., S.L., F.T., D.Z., M.P., C.K., J.B., K.R.L.).,Philips Innovative Technologies (R.S., F.T., M.P.), Aachen, Germany
| | - C Kabbasch
- From the Institute for Diagnostic and Interventional Radiology (L.P., R.S., L.C., S.L., F.T., D.Z., M.P., C.K., J.B., K.R.L.)
| | - S Grau
- Center for Neurosurgery (L.G., G.F., S.G.), Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - J Borggrefe
- From the Institute for Diagnostic and Interventional Radiology (L.P., R.S., L.C., S.L., F.T., D.Z., M.P., C.K., J.B., K.R.L.)
| | - K R Laukamp
- From the Institute for Diagnostic and Interventional Radiology (L.P., R.S., L.C., S.L., F.T., D.Z., M.P., C.K., J.B., K.R.L.) .,Department of Radiology (K.R.L.), University Hospitals Cleveland Medical Center, Cleveland, Ohio.,Department of Radiology (K.R.L.), Case Western Reserve University, Cleveland, Ohio
| |
Collapse
|
16
|
Fully automated detection and segmentation of intracranial aneurysms in subarachnoid hemorrhage on CTA using deep learning. Sci Rep 2020; 10:21799. [PMID: 33311535 PMCID: PMC7733480 DOI: 10.1038/s41598-020-78384-1] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2020] [Accepted: 11/23/2020] [Indexed: 02/07/2023] Open
Abstract
In aneurysmal subarachnoid hemorrhage (aSAH), accurate diagnosis of aneurysm is essential for subsequent treatment to prevent rebleeding. However, aneurysm detection proves to be challenging and time-consuming. The purpose of this study was to develop and evaluate a deep learning model (DLM) to automatically detect and segment aneurysms in patients with aSAH on computed tomography angiography. In this retrospective single-center study, three different DLMs were trained on 68 patients with 79 aneurysms treated for aSAH (2016–2017) using five-fold-cross-validation. Their outputs were combined to a single DLM via ensemble-learning. The DLM was evaluated on an independent test set consisting of 185 patients with 215 aneurysms (2010–2015). Independent manual segmentations of aneurysms in a 3D voxel-wise manner by two readers (neurosurgeon, radiologist) provided the reference standard. For aneurysms > 30 mm3 (mean diameter of ~ 4 mm) on the test set, the DLM provided a detection sensitivity of 87% with false positives (FPs)/scan of 0.42. Automatic segmentations achieved a median dice similarity coefficient (DSC) of 0.80 compared to the reference standard. Aneurysm location (anterior vs. posterior circulation; P = .07) and bleeding severity (Fisher grade ≤ 3 vs. 4; P = .33) did not impede detection sensitivity or segmentation performance. For aneurysms > 100 mm3 (mean diameter of ~ 6 mm), a sensitivity of 96% with DSC of 0.87 and FPs/scan of 0.14 were obtained. In the present study, we demonstrate that the proposed DLM detects and segments aneurysms > 30 mm3 in patients with aSAH with high sensitivity independent of cerebral circulation and bleeding severity while producing FP findings of less than one per scan. Hence, the DLM can potentially assist treating physicians in aSAH by providing automated detection and segmentations of aneurysms.
Collapse
|
17
|
Chen L. Editorial for: "Primary Central Nervous System Lymphoma: Clinical Evaluation of Automated Segmentation on Multiparametric MRI Using Deep Learning". J Magn Reson Imaging 2020; 53:269-270. [PMID: 32770563 DOI: 10.1002/jmri.27312] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2020] [Accepted: 07/20/2020] [Indexed: 11/08/2022] Open
Affiliation(s)
- Luguang Chen
- Department of Radiology, Changhai Hospital of Shanghai, The Second Military Medical University, No.168 Changhai Road, Shanghai, 200433, China
| |
Collapse
|