1
|
Dupuis A, Chen Y, Chow K, Griswold MA, Boyacioglu R. Repeatability of 3D MR fingerprinting during scanner software upgrades. MAGMA (NEW YORK, N.Y.) 2024:10.1007/s10334-024-01211-5. [PMID: 39499381 DOI: 10.1007/s10334-024-01211-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/31/2024] [Revised: 09/11/2024] [Accepted: 10/08/2024] [Indexed: 11/07/2024]
Abstract
OBJECTIVE This study aims to quantify the repeatability of a 3D Magnetic Resonance Fingerprinting (MRF) research protocol in the context of a scanner software upgrade. All of MRI assumes consistent hardware performance and raw data pre-processing on the acquisition side. Software upgrades can affect hardware specifications and reconstruction chain parameters. Understanding how vendor-provided software upgrades vary MRF-derived T1 and T2 values is crucial for its application in different settings. MATERIALS AND METHODS Eight healthy volunteers were imaged with an in-house developed 3D MRF pulse sequence using a 3T scanner before and after a software upgrade (VA31A to VA50A, MAGNETOM Vida, Siemens Healthineers). Online MRF reconstruction using Singular Value Decomposition (SVD) timeseries compression and B1+ correction was performed. The study involved test-retest repeatability assessment and a comparison of pre- and post-upgrade data based on automatically extracted T1 and T2 values from MNI-152 Harvard-Oxford Subcortical Structural Atlas regions. RESULTS Significant mismatches were found directly after the upgrade. However, after an information exchange with the vendor, the 3D-MRF sequence showed consistent repeatability in both intra-version test-retest scenarios and cross-version comparisons: - 1.16 ± 3.18% variability in T1 and - 0.54 ± 4.84% in T2 for intra-version tests, and - 0.83 ± 3.68% (T1) and - 0.05 ± 5.81% (T2) variability for cross-version comparisons. DISCUSSION The study shows the reliable performance of 3D MRF protocols across software upgrades is possible, but it also highlights the importance of detailed evaluation and vendor collaboration in ensuring consistency. These findings support the application of MRF in longitudinal studies and emphasize the need for systematic assessments following hardware or software modifications.
Collapse
Affiliation(s)
- Andrew Dupuis
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA.
| | - Yong Chen
- Department of Radiology, Case Western Reserve University, Cleveland, OH, USA
| | - Kelvin Chow
- Siemens Medical Solutions USA, Inc, Chicago, IL, USA
| | - Mark A Griswold
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA
- Department of Radiology, Case Western Reserve University, Cleveland, OH, USA
| | - Rasim Boyacioglu
- Department of Radiology, Case Western Reserve University, Cleveland, OH, USA
| |
Collapse
|
2
|
Fujita S, Hagiwara A, Kimura K, Taniguchi Y, Ito K, Nagao H, Takizawa M, Uchida W, Kamagata K, Tateishi U, Aoki S. Three-dimensional simultaneous T1 and T2* relaxation times and quantitative susceptibility mapping at 3 T: A multicenter validation study. Magn Reson Imaging 2024; 112:100-106. [PMID: 38971266 DOI: 10.1016/j.mri.2024.07.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2024] [Revised: 06/27/2024] [Accepted: 07/03/2024] [Indexed: 07/08/2024]
Abstract
We aimed to determine the intra-site repeatability and cross-site reproducibility of T1 and T2* relaxation times and quantitative susceptibility (χ) values obtained through quantitative parameter mapping (QPM) at 3 T. This prospective study included three 3-T scanners with the same hardware and software platform at three sites. The brains of twelve healthy volunteers were scanned three times using QPM at three sites. Intra-site repeatability and cross-site reproducibility were evaluated based on voxel-wise and region-of-interest analyses. The within-subject coefficient of variation (wCV), within-subject standard deviation (wSD), linear regression, Bland-Altman plot, and intraclass correlation coefficient (ICC) were used for evaluation. The intra-site repeatability wCV was 11.9 ± 6.86% for T1 and 3.15 ± 0.03% for T2*, and wSD of χ at 3.35 ± 0.10 parts per billion (ppb). Intra-site ICC(1,k) values for T1, T2*, and χ were 0.878-0.904, 0.972-0.976, and 0.966-0.972, respectively, indicating high consistency within the same scanner. Linear regression analysis revealed a strong agreement between measurements from each site and the site-average measurement, with R-squared values ranging from 0.79 to 0.83 for T1, 0.94-0.95 for T2*, and 0.95-0.96 for χ. The cross-site wCV was 13.4 ± 5.47% for T1 and 3.69 ± 2.25% for T2*, and cross-site wSD of χ at 4.08 ± 3.22 ppb. The cross-site ICC(2,1) was 0.707, 0.913, and 0.902 for T1, T2*, and χ, respectively. QPM provides T1, T2*, and χ values with an intra-site repeatability of <12% and cross-site reproducibility of <14%. These findings may contribute to the development of multisite studies.
Collapse
Affiliation(s)
- Shohei Fujita
- Department of Radiology, Juntendo University, 1-2-1 Hongo, Bunkyo-ku, Tokyo 113-8421, Japan; Department of Radiology, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8654, Japan.
| | - Akifumi Hagiwara
- Department of Radiology, Juntendo University, 1-2-1 Hongo, Bunkyo-ku, Tokyo 113-8421, Japan
| | - Koichiro Kimura
- Department of Radiology and Nuclear Medicine, Tokyo Medical and Dental University, 1-5-45 Yushima, Bunkyo-ku, Tokyo 113-8510, Japan
| | - Yo Taniguchi
- Medical Systems Research & Development Center, FUJIFILM Corporation
| | - Kosuke Ito
- Medical Systems Research & Development Center, FUJIFILM Healthcare Corporation
| | - Hisako Nagao
- Medical Systems Research & Development Center, FUJIFILM Healthcare Corporation
| | - Masahiro Takizawa
- Medical Systems Research & Development Center, FUJIFILM Healthcare Corporation
| | - Wataru Uchida
- Department of Radiology, Juntendo University, 1-2-1 Hongo, Bunkyo-ku, Tokyo 113-8421, Japan; Department of Health Data Science, Faculty of Health Data Science, Juntendo University, 6-8-1 Hinode, Urayasu, Chiba 279-0013, Japan
| | - Koji Kamagata
- Department of Radiology, Juntendo University, 1-2-1 Hongo, Bunkyo-ku, Tokyo 113-8421, Japan
| | - Ukihide Tateishi
- Department of Radiology and Nuclear Medicine, Tokyo Medical and Dental University, 1-5-45 Yushima, Bunkyo-ku, Tokyo 113-8510, Japan
| | - Shigeki Aoki
- Department of Radiology, Juntendo University, 1-2-1 Hongo, Bunkyo-ku, Tokyo 113-8421, Japan; Department of Health Data Science, Faculty of Health Data Science, Juntendo University, 6-8-1 Hinode, Urayasu, Chiba 279-0013, Japan
| |
Collapse
|
3
|
Demircioğlu A. radMLBench: A dataset collection for benchmarking in radiomics. Comput Biol Med 2024; 182:109140. [PMID: 39270457 DOI: 10.1016/j.compbiomed.2024.109140] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2024] [Revised: 08/20/2024] [Accepted: 09/08/2024] [Indexed: 09/15/2024]
Abstract
BACKGROUND New machine learning methods and techniques are frequently introduced in radiomics, but they are often tested on a single dataset, which makes it challenging to assess their true benefit. Currently, there is a lack of a larger, publicly accessible dataset collection on which such assessments could be performed. In this study, a collection of radiomics datasets with binary outcomes in tabular form was curated to allow benchmarking of machine learning methods and techniques. METHODS A variety of journals and online sources were searched to identify tabular radiomics data with binary outcomes, which were then compiled into a homogeneous data collection that is easily accessible via Python. To illustrate the utility of the dataset collection, it was applied to investigate whether feature decorrelation prior to feature selection could improve predictive performance in a radiomics pipeline. RESULTS A total of 50 radiomic datasets were collected, with sample sizes ranging from 51 to 969 and 101 to 11165 features. Using this data, it was observed that decorrelating features did not yield any significant improvement on average. CONCLUSIONS A large collection of datasets, easily accessible via Python, suitable for benchmarking and evaluating new machine learning techniques and methods was curated. Its utility was exemplified by demonstrating that feature decorrelation prior to feature selection does not, on average, lead to significant performance gains and could be omitted, thereby increasing the robustness and reliability of the radiomics pipeline.
Collapse
Affiliation(s)
- Aydin Demircioğlu
- Institute of Diagnostic and Interventional Radiology and Neuroradiology, University Hospital Essen, Hufelandstraße 55, D-45147, Essen, Germany.
| |
Collapse
|
4
|
Scholey J, Nano T, Singhrao K, Mohamad O, Singer L, Larson PEZ, Descovich M. Linac- and CyberKnife-based MRI-only treatment planning of prostate SBRT using an optimized synthetic CT calibration curve. J Appl Clin Med Phys 2024; 25:e14411. [PMID: 38837851 PMCID: PMC11492401 DOI: 10.1002/acm2.14411] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Revised: 02/29/2024] [Accepted: 05/07/2024] [Indexed: 06/07/2024] Open
Abstract
PURPOSE CT Hounsfield Units (HUs) are converted to electron density using a calibration curve obtained from physical measurements of an electron density phantom. HU values assigned to an MRI-derived synthetic computed tomography (sCT) may present a different relationship with electron density compared to CT HU. Correct assignment of sCT HU values is critical for accurate dose calculation and delivery. The goals of this work were to develop a sCT calibration curve using patient data acquired on a clinically commissioned CT scanner and assess for CyberKnife- and volumetric modulated arc therapy (VMAT)-based MR-only treatment planning of prostate SBRT. METHODS Same-day CT and MRI simulation in the treatment position were performed on 10 patients treated with SBRT to the prostate. Dixon in-phase and out-of-phase MRIs were acquired on a 3T scanner using a 3D T1-weighted gradient-echo sequence to generate sCTs using a commercial sCT algorithm. CT and sCT datasets were co-registered and HU values compared using mean absolute error (MAE). An optimized HU-to-density calibration curve was created based on average HU values across an institutional patient database for each of the four sCT tissue types. Clinical CyberKnife and VMAT treatment plans were generated on each patient CT and recomputed onto corresponding sCTs. Dose distributions computed using CT and sCT were compared using gamma criteria and dose-volume-histograms. RESULTS For the optimized calibration curve, HU values were -96, 37, 204, and 1170 and relative electron densities were 0.95, 1.04, 1.1, and 1.7 for adipose, soft tissue, inner bone, and outer bone, respectively. The proposed sCT protocol produced total MAE of 94 ± 20HU. Gamma values mean ± std (min-max) were 98.9% ± 0.9% (97.1%-100%) and 97.7% ± 1.3% (95.3%-99.3%) for VMAT and CyberKnife plans, respectively. CONCLUSION MRI-derived sCT using the proposed approach shows excellent dosimetric agreement with conventional CT simulation, demonstrating the feasibility of MRI-derived sCT for prostate SBRT treatment planning.
Collapse
Affiliation(s)
- Jessica Scholey
- Department of Radiation OncologyUniversity of California San FranciscoSan FranciscoCaliforniaUSA
| | - Tomi Nano
- Department of Radiation OncologyUniversity of California San FranciscoSan FranciscoCaliforniaUSA
| | - Kamal Singhrao
- Department of Radiation OncologyUniversity of California San FranciscoSan FranciscoCaliforniaUSA
| | - Osama Mohamad
- Department of Radiation OncologyUniversity of California San FranciscoSan FranciscoCaliforniaUSA
| | - Lisa Singer
- Department of Radiation OncologyUniversity of California San FranciscoSan FranciscoCaliforniaUSA
| | - Peder Eric Zufall Larson
- Department of Radiology and Biomedical ImagingUniversity of California San FranciscoSan FranciscoCaliforniaUSA
| | - Martina Descovich
- Department of Radiation OncologyUniversity of California San FranciscoSan FranciscoCaliforniaUSA
| |
Collapse
|
5
|
Ong W, Lee A, Tan WC, Fong KTD, Lai DD, Tan YL, Low XZ, Ge S, Makmur A, Ong SJ, Ting YH, Tan JH, Kumar N, Hallinan JTPD. Oncologic Applications of Artificial Intelligence and Deep Learning Methods in CT Spine Imaging-A Systematic Review. Cancers (Basel) 2024; 16:2988. [PMID: 39272846 PMCID: PMC11394591 DOI: 10.3390/cancers16172988] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2024] [Revised: 08/14/2024] [Accepted: 08/26/2024] [Indexed: 09/15/2024] Open
Abstract
In spinal oncology, integrating deep learning with computed tomography (CT) imaging has shown promise in enhancing diagnostic accuracy, treatment planning, and patient outcomes. This systematic review synthesizes evidence on artificial intelligence (AI) applications in CT imaging for spinal tumors. A PRISMA-guided search identified 33 studies: 12 (36.4%) focused on detecting spinal malignancies, 11 (33.3%) on classification, 6 (18.2%) on prognostication, 3 (9.1%) on treatment planning, and 1 (3.0%) on both detection and classification. Of the classification studies, 7 (21.2%) used machine learning to distinguish between benign and malignant lesions, 3 (9.1%) evaluated tumor stage or grade, and 2 (6.1%) employed radiomics for biomarker classification. Prognostic studies included three (9.1%) that predicted complications such as pathological fractures and three (9.1%) that predicted treatment outcomes. AI's potential for improving workflow efficiency, aiding decision-making, and reducing complications is discussed, along with its limitations in generalizability, interpretability, and clinical integration. Future directions for AI in spinal oncology are also explored. In conclusion, while AI technologies in CT imaging are promising, further research is necessary to validate their clinical effectiveness and optimize their integration into routine practice.
Collapse
Affiliation(s)
- Wilson Ong
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
| | - Aric Lee
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
| | - Wei Chuan Tan
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
| | - Kuan Ting Dominic Fong
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
| | - Daoyong David Lai
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
| | - Yi Liang Tan
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
| | - Xi Zhen Low
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - Shuliang Ge
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - Andrew Makmur
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - Shao Jin Ong
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - Yong Han Ting
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - Jiong Hao Tan
- National University Spine Institute, Department of Orthopaedic Surgery, National University Health System, 1E, Lower Kent Ridge Road, Singapore 119228, Singapore
| | - Naresh Kumar
- National University Spine Institute, Department of Orthopaedic Surgery, National University Health System, 1E, Lower Kent Ridge Road, Singapore 119228, Singapore
| | - James Thomas Patrick Decourcy Hallinan
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| |
Collapse
|
6
|
Jogi SP, Peng Q, Jafari R, Otazo R, Wu C. Novel spin-lock time sampling strategies for improved reproducibility in quantitative T1ρ mapping. NMR IN BIOMEDICINE 2024:e5244. [PMID: 39152756 DOI: 10.1002/nbm.5244] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/02/2024] [Revised: 07/12/2024] [Accepted: 08/05/2024] [Indexed: 08/19/2024]
Abstract
This study aimed to optimize the sampling of spin-lock times (TSLs) in quantitative T1ρ mapping for improved reproducibility. Two new TSL sampling schemes were proposed: (i) reproducibility-guided random sampling (RRS) and (ii) reproducibility-guided optimal sampling (ROS). They were compared to the existing linear sampling (LS) and precision-guided sampling (PS) schemes for T1ρ reproducibility through numerical simulations, phantom experiments, and volunteer studies. Each study evaluated the four sampling schemes with three commonly used T1ρ preparations based on composite and balanced spin-locking. Additionally, the phantom and volunteer studies investigated the impact of B0 and B1 field inhomogeneities on T1ρ reproducibility, respectively. The reproducibility was assessed using the coefficient of variation (CoV) by repeating the T1ρ measurements eight times for phantom experiments and five times for volunteer studies. Numerical simulations resulted in lower mean CoVs for the proposed RRS (1.74%) and ROS (0.68%) compared to LS (2.93%) and PS (3.68%). In the phantom study, the mean CoVs were also lower for RRS (2.7%) and ROS (2.6%) compared to LS (4.1%) and PS (3.1%). Furthermore, the mean CoVs of the proposed RRS and ROS were statistically lower (P < 0.001) compared to existing LS and PS schemes at a B1 offset of 20%. In the volunteer study, consistently lower mean CoVs were observed in bilateral thigh muscles for RRS (9.3%) and ROS (9.2%) compared to LS (10.9%) and PS (10.2%), and the difference was more prominent at B0 offsets higher than 50 Hz. The proposed sampling schemes improve the reproducibility of quantitative T1ρ mapping by optimizing the selection of TSLs. This improvement is especially beneficial for longitudinal studies that track and monitor disease progression and treatment response.
Collapse
Affiliation(s)
- Sandeep Panwar Jogi
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, New York, USA
| | - Qi Peng
- Department of Radiology, Albert Einstein College of Medicine and Montefiore Medical Center, Bronx, New York, USA
| | - Ramin Jafari
- Philips Healthcare, MR Clinical Science, Cambridge, Massachusetts, USA
| | - Ricardo Otazo
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, New York, USA
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, New York, USA
| | - Can Wu
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, New York, USA
| |
Collapse
|
7
|
Bhangale PN, Kashikar SV, Kasat PR, Shrivastava P, Kumari A. A Comprehensive Review on the Role of MRI in the Assessment of Supratentorial Neoplasms: Comparative Insights Into Adult and Pediatric Cases. Cureus 2024; 16:e67553. [PMID: 39310617 PMCID: PMC11416707 DOI: 10.7759/cureus.67553] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2024] [Accepted: 08/23/2024] [Indexed: 09/25/2024] Open
Abstract
Magnetic resonance imaging (MRI) is a critical diagnostic tool in assessing supratentorial neoplasms, offering unparalleled detail and specificity in brain imaging. Supratentorial neoplasms in the cerebral hemispheres, basal ganglia, thalamus, and other structures above the tentorium cerebelli present significant diagnostic and therapeutic challenges. These challenges vary notably between adult and pediatric populations due to differences in tumor types, biological behavior, and patient management strategies. This comprehensive review explores the role of MRI in diagnosing, planning treatment, monitoring response, and detecting recurrence in supratentorial neoplasms, providing comparative insights into adult and pediatric cases. The review begins with an overview of the epidemiology and pathophysiology of these tumors in different age groups, followed by a detailed examination of standard and advanced MRI techniques, including diffusion-weighted imaging (DWI), perfusion-weighted imaging (PWI), and magnetic resonance spectroscopy (MRS). We discuss the specific imaging characteristics of various neoplasms and the importance of tailored approaches to optimize diagnostic accuracy and therapeutic efficacy. The review also addresses the technical and interpretative challenges unique to pediatric imaging and the implications for long-term patient outcomes. By highlighting the comparative utility of MRI in adult and pediatric cases, this review aims to enhance the understanding of its pivotal role in managing supratentorial neoplasms. It underscores the necessity of age-specific diagnostic and therapeutic strategies. Emerging MRI technologies and future research directions are also discussed, emphasizing the potential for advancements in personalized imaging approaches and improved patient care across all age groups.
Collapse
Affiliation(s)
- Paritosh N Bhangale
- Radiodiagnosis, Jawaharlal Nehru Medical College, Datta Meghe Institute of Higher Education and Research, Wardha, IND
| | - Shivali V Kashikar
- Radiodiagnosis, Jawaharlal Nehru Medical College, Datta Meghe Institute of Higher Education and Research, Wardha, IND
| | - Paschyanti R Kasat
- Radiodiagnosis, Jawaharlal Nehru Medical College, Datta Meghe Institute of Higher Education and Research, Wardha, IND
| | - Priyal Shrivastava
- Radiodiagnosis, Jawaharlal Nehru Medical College, Datta Meghe Institute of Higher Education and Research, Wardha, IND
| | - Anjali Kumari
- Radiodiagnosis, Jawaharlal Nehru Medical College, Datta Meghe Institute of Higher Education and Research, Wardha, IND
| |
Collapse
|
8
|
Jeon K, Park WY, Kahn CE, Nagy P, You SC, Yoon SH. Advancing Medical Imaging Research Through Standardization: The Path to Rapid Development, Rigorous Validation, and Robust Reproducibility. Invest Radiol 2024:00004424-990000000-00232. [PMID: 38985896 DOI: 10.1097/rli.0000000000001106] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/12/2024]
Abstract
ABSTRACT Artificial intelligence (AI) has made significant advances in radiology. Nonetheless, challenges in AI development, validation, and reproducibility persist, primarily due to the lack of high-quality, large-scale, standardized data across the world. Addressing these challenges requires comprehensive standardization of medical imaging data and seamless integration with structured medical data.Developed by the Observational Health Data Sciences and Informatics community, the OMOP Common Data Model enables large-scale international collaborations with structured medical data. It ensures syntactic and semantic interoperability, while supporting the privacy-protected distribution of research across borders. The recently proposed Medical Imaging Common Data Model is designed to encompass all DICOM-formatted medical imaging data and integrate imaging-derived features with clinical data, ensuring their provenance.The harmonization of medical imaging data and its seamless integration with structured clinical data at a global scale will pave the way for advanced AI research in radiology. This standardization will enable federated learning, ensuring privacy-preserving collaboration across institutions and promoting equitable AI through the inclusion of diverse patient populations. Moreover, it will facilitate the development of foundation models trained on large-scale, multimodal datasets, serving as powerful starting points for specialized AI applications. Objective and transparent algorithm validation on a standardized data infrastructure will enhance reproducibility and interoperability of AI systems, driving innovation and reliability in clinical applications.
Collapse
Affiliation(s)
- Kyulee Jeon
- From the Department of Biomedical Systems Informatics, Yonsei University, Seoul, South Korea (K.J., S.C.Y.); Institution for Innovation in Digital Healthcare, Yonsei University, Seoul, South Korea (K.J., S.C.Y.); Biomedical Informatics and Data Science, Johns Hopkins University, Baltimore, MD (W.Y.P., P.N.); Department of Radiology, University of Pennsylvania, Philadelphia, PA (C.E.K.); and Department of Radiology, Seoul National University College of Medicine, Seoul National University Hospital, Seoul, South Korea (S.H.Y.)
| | | | | | | | | | | |
Collapse
|
9
|
Polizzi A, Leonardi R. Automatic cephalometric landmark identification with artificial intelligence: An umbrella review of systematic reviews. J Dent 2024; 146:105056. [PMID: 38729291 DOI: 10.1016/j.jdent.2024.105056] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2024] [Revised: 04/25/2024] [Accepted: 05/07/2024] [Indexed: 05/12/2024] Open
Abstract
OBJECTIVES The transition from manual to automatic cephalometric landmark identification has not yet reached a consensus for clinical application in orthodontic diagnosis. The present umbrella review aimed to assess artificial intelligence (AI) performance in automatic 2D and 3D cephalometric landmark identification. DATA A combination of free text words and MeSH keywords pooled by boolean operators: Automa* AND cephalo* AND ("artificial intelligence" OR "machine learning" OR "deep learning" OR "learning"). SOURCES A search strategy without a timeframe setting was conducted on PubMed, Scopus, Web of Science, Cochrane Library and LILACS. STUDY SELECTION The study protocol followed the PRISMA guidelines and the PICO question was formulated according to the aim of the article. The database search led to the selection of 15 articles that were assessed for eligibility in full-text. Finally, 11 systematic reviews met the inclusion criteria and were analyzed according to the risk of bias in systematic reviews (ROBIS) tool. CONCLUSIONS AI was not able to identify the various cephalometric landmarks with the same accuracy. Since most of the included studies' conclusions were based on a wrong 2 mm cut-off difference between the AI automatic landmark location and that allocated by human operators, future research should focus on refining the most powerful architectures to improve the clinical relevance of AI-driven automatic cephalometric analysis. CLINICAL SIGNIFICANCE Despite a progressively improved performance, AI has exceeded the recommended magnitude of error for most cephalometric landmarks. Moreover, AI automatic landmarking on 3D CBCT appeared to be less accurate compared to that on 2D X-rays. To date, AI-driven cephalometric landmarking still requires the final supervision of an experienced orthodontist.
Collapse
Affiliation(s)
- Alessandro Polizzi
- Department of General Surgery and Medical-Surgical Specialties, Section of Orthodontics, University of Catania, Policlinico Universitario "Gaspare Rodolico - San Marco", Via Santa Sofia 78, 95123, Catania, Italy.
| | - Rosalia Leonardi
- Department of General Surgery and Medical-Surgical Specialties, Section of Orthodontics, University of Catania, Policlinico Universitario "Gaspare Rodolico - San Marco", Via Santa Sofia 78, 95123, Catania, Italy
| |
Collapse
|
10
|
Koçak B, Yüzkan S, Mutlu S, Karagülle M, Kala A, Kadıoğlu M, Solak S, Sunman Ş, Temiz ZH, Ganiyusufoğlu AK. Influence of image preprocessing on the segmentation-based reproducibility of radiomic features: in vivo experiments on discretization and resampling parameters. Diagn Interv Radiol 2024; 30:152-162. [PMID: 38073244 PMCID: PMC11095065 DOI: 10.4274/dir.2023.232543] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Accepted: 11/14/2023] [Indexed: 05/15/2024]
Abstract
PURPOSE To systematically investigate the impact of image preprocessing parameters on the segmentation-based reproducibility of magnetic resonance imaging (MRI) radiomic features. METHODS The MRI scans of 50 patients were included from the multi-institutional Brain Tumor Segmentation 2021 public glioma dataset. Whole tumor volumes were manually segmented by two independent readers, with the participation of eight readers. Radiomic features were extracted from two sequences: T2-weighted (T2) and contrast-enhanced T1-weighted (T1ce). Two methods were considered for discretization: bin count (i.e., relative discretization) and bin width (i.e., absolute discretization). Ten discretization (five for each method) and five resampling parameters were varied while other parameters were fixed. The intraclass correlation coefficient (ICC) was used for reliability analysis based on two commonly used cut-off values (0.75 and 0.90). RESULTS Image preprocessing parameters had a significant impact on the segmentation-based reproducibility of radiomic features. The bin width method yielded more reproducible features than the bin count method. In discretization experiments using the bin width on both sequences, according to the ICC cut-off values of 0.75 and 0.90, the rate of reproducible features ranged from 70% to 84% and from 35% to 57%, respectively, with an increasing percentage trend as parameter values decreased (from 84 to 5 for T2; 100 to 6 for T1ce). In the resampling experiments, these ranged from 53% to 74% and from 10% to 20%, respectively, with an increasing percentage trend from lower to higher parameter values (physical voxel size; from 1 x 1 x 1 to 2 x 2 x 2 mm3). CONCLUSION The segmentation-based reproducibility of radiomic features appears to be substantially influenced by discretization and resampling parameters. Our findings indicate that the bin width method should be used for discretization and lower bin width and higher resampling values should be used to allow more reproducible features.
Collapse
Affiliation(s)
- Burak Koçak
- University of Health Sciences, Başakşehir Çam and Sakura City Hospital, Clinic of Radiology, İstanbul, Türkiye
| | - Sabahattin Yüzkan
- University of Health Sciences, Başakşehir Çam and Sakura City Hospital, Clinic of Radiology, İstanbul, Türkiye
| | - Samet Mutlu
- University of Health Sciences, Başakşehir Çam and Sakura City Hospital, Clinic of Radiology, İstanbul, Türkiye
| | - Mehmet Karagülle
- University of Health Sciences, Başakşehir Çam and Sakura City Hospital, Clinic of Radiology, İstanbul, Türkiye
| | - Ahmet Kala
- University of Health Sciences, Başakşehir Çam and Sakura City Hospital, Clinic of Radiology, İstanbul, Türkiye
| | - Mehmet Kadıoğlu
- University of Health Sciences, Başakşehir Çam and Sakura City Hospital, Clinic of Radiology, İstanbul, Türkiye
| | - Sıla Solak
- University of Health Sciences, Başakşehir Çam and Sakura City Hospital, Clinic of Radiology, İstanbul, Türkiye
| | - Şeyma Sunman
- University of Health Sciences, Başakşehir Çam and Sakura City Hospital, Clinic of Radiology, İstanbul, Türkiye
| | - Zişan Hayriye Temiz
- University of Health Sciences, Başakşehir Çam and Sakura City Hospital, Clinic of Radiology, İstanbul, Türkiye
| | - Ali Kürşad Ganiyusufoğlu
- University of Health Sciences, Başakşehir Çam and Sakura City Hospital, Clinic of Radiology, İstanbul, Türkiye
| |
Collapse
|
11
|
Parker J, Coey J, Alambrouk T, Lakey SM, Green T, Brown A, Maxwell I, Ripley DP. Evaluating a Novel AI Tool for Automated Measurement of the Aortic Root and Valve in Cardiac Magnetic Resonance Imaging. Cureus 2024; 16:e59647. [PMID: 38832163 PMCID: PMC11146459 DOI: 10.7759/cureus.59647] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/03/2024] [Indexed: 06/05/2024] Open
Abstract
Objective Evaluating an artificial intelligence (AI) tool (AIATELLA, version 1.0; AIATELLA Oy, Helsinki, Finland) in interpreting cardiac magnetic resonance (CMR) imaging to produce measurements of the aortic root and valve by comparison of accuracy and efficiency with that of three National Health Service (NHS) cardiologists. Methods AI-derived aortic root and valve measurements were recorded alongside manual measurements from three experienced NHS consultant cardiologists (CCs) over three separate sites in the northeast part of the United Kingdom. The study utilised a comprehensive dataset of CMR images, with the intraclass correlation coefficient (ICC) being the primary measure of concordance between the AI and the cardiologist assessments. Patient imaging was anonymised and blinded at the point of transfer to a secure data server. Results The study demonstrates a high level of concordance between AI assessment of the aortic root and valve with NHS cardiologists (ICC of 0.98). Notably, the AI delivered results in 2.6 seconds (+/- 0.532) compared to a mean of 334.5 seconds (+/- 61.9) by the cardiologists, a statistically significant improvement in efficiency without compromising accuracy. Conclusion AI's accuracy and speed of analysis suggest that it could be a valuable tool in cardiac diagnostics, addressing the challenges of time-consuming and variable clinician-based assessments. This research reinforces AI's role in optimising the patient journey and improving the efficiency of the diagnostic pathway.
Collapse
Affiliation(s)
- Jack Parker
- Health and Life Sciences, Northumbria University, Newcastle upon Tyne, GBR
- Imaging, AIATELLA Oy, Helsinki, FIN
- Imaging, AIATELLA Ltd., Newcastle upon Tyne, GBR
| | - James Coey
- School of Medicine, St. George's University, Newcastle upon Tyne, GBR
- Health and Life Sciences, Northumbria University, Newcastle upon Tyne, GBR
- Imaging, AIATELLA Oy, Helsinki, FIN
| | - Tarek Alambrouk
- School of Medicine, St. George's University, Newcastle upon Tyne, GBR
| | - Samuel M Lakey
- Cardiology, Northumbria Healthcare NHS Foundation Trust, Newcastle upon Tyne, GBR
| | - Thomas Green
- Cardiology, Northumbria Healthcare NHS Foundation Trust, Newcastle upon Tyne, GBR
| | - Alexander Brown
- Cardiology, Northumbria Healthcare NHS Foundation Trust, Newcastle upon Tyne, GBR
| | - Ian Maxwell
- Faculty of Health Sciences and Wellbeing, University of Sunderland, Sunderland, GBR
| | - David P Ripley
- Cardiology, Northumbria Healthcare NHS Foundation Trust, Newcastle upon Tyne, GBR
- Faculty of Health Sciences and Wellbeing, University of Sunderland, Sunderland, GBR
| |
Collapse
|
12
|
Fujita S, Gagoski B, Hwang KP, Hagiwara A, Warntjes M, Fukunaga I, Uchida W, Saito Y, Sekine T, Tachibana R, Muroi T, Akatsu T, Kasahara A, Sato R, Ueyama T, Andica C, Kamagata K, Amemiya S, Takao H, Hoshino Y, Tomizawa Y, Yokoyama K, Bilgic B, Hattori N, Abe O, Aoki S. Cross-vendor multiparametric mapping of the human brain using 3D-QALAS: A multicenter and multivendor study. Magn Reson Med 2024; 91:1863-1875. [PMID: 38192263 DOI: 10.1002/mrm.29939] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2023] [Revised: 11/06/2023] [Accepted: 11/06/2023] [Indexed: 01/10/2024]
Abstract
PURPOSE To evaluate a vendor-agnostic multiparametric mapping scheme based on 3D quantification using an interleaved Look-Locker acquisition sequence with a T2 preparation pulse (3D-QALAS) for whole-brain T1, T2, and proton density (PD) mapping. METHODS This prospective, multi-institutional study was conducted between September 2021 and February 2022 using five different 3T systems from four prominent MRI vendors. The accuracy of this technique was evaluated using a standardized MRI system phantom. Intra-scanner repeatability and inter-vendor reproducibility of T1, T2, and PD values were evaluated in 10 healthy volunteers (6 men; mean age ± SD, 28.0 ± 5.6 y) who underwent scan-rescan sessions on each scanner (total scans = 100). To evaluate the feasibility of 3D-QALAS, nine patients with multiple sclerosis (nine women; mean age ± SD, 48.2 ± 11.5 y) underwent imaging examination on two 3T MRI systems from different manufacturers. RESULTS Quantitative maps obtained with 3D-QALAS showed high linearity (R2 = 0.998 and 0.998 for T1 and T2, respectively) with respect to reference measurements. The mean intra-scanner coefficients of variation for each scanner and structure ranged from 0.4% to 2.6%. The mean structure-wise test-retest repeatabilities were 1.6%, 1.1%, and 0.7% for T1, T2, and PD, respectively. Overall, high inter-vendor reproducibility was observed for all parameter maps and all structure measurements, including white matter lesions in patients with multiple sclerosis. CONCLUSION The vendor-agnostic multiparametric mapping technique 3D-QALAS provided reproducible measurements of T1, T2, and PD for human tissues within a typical physiological range using 3T scanners from four different MRI manufacturers.
Collapse
Affiliation(s)
- Shohei Fujita
- Department of Radiology, Juntendo University, Tokyo, Japan
- Department of Radiology, The University of Tokyo, Tokyo, Japan
- Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, Massachusetts, USA
- Department of Radiology, Harvard Medical School, Boston, Massachusetts, USA
| | - Borjan Gagoski
- Department of Radiology, Harvard Medical School, Boston, Massachusetts, USA
- Fetal Neonatal Neuroimaging and Developmental Science Center, Boston Children's Hospital, Boston, Massachusetts, USA
| | - Ken-Pin Hwang
- Department of Imaging Physics, MD Anderson Cancer Center, Houston, Texas, USA
| | | | - Marcel Warntjes
- SyntheticMR, Linköping, Sweden
- Center for Medical Imaging Science and Visualization (CMIV), Linköping University, Linköping, Sweden
| | - Issei Fukunaga
- Department of Radiology, Juntendo University, Tokyo, Japan
| | - Wataru Uchida
- Department of Radiology, Juntendo University, Tokyo, Japan
| | - Yuya Saito
- Department of Radiology, Juntendo University, Tokyo, Japan
| | - Towa Sekine
- Department of Radiology, Juntendo University, Tokyo, Japan
| | - Rina Tachibana
- Department of Radiology, Juntendo University, Tokyo, Japan
| | - Tomoya Muroi
- Department of Radiology, Juntendo University, Tokyo, Japan
| | - Toshiya Akatsu
- Department of Radiology, Juntendo University, Tokyo, Japan
| | | | - Ryo Sato
- Department of Radiology, The University of Tokyo, Tokyo, Japan
| | - Tsuyoshi Ueyama
- Department of Radiology, The University of Tokyo, Tokyo, Japan
| | - Christina Andica
- Department of Radiology, Juntendo University, Tokyo, Japan
- Faculty of Health Data Science, Juntendo University, Chiba, Japan
| | - Koji Kamagata
- Department of Radiology, Juntendo University, Tokyo, Japan
| | - Shiori Amemiya
- Department of Radiology, The University of Tokyo, Tokyo, Japan
| | - Hidemasa Takao
- Department of Radiology, The University of Tokyo, Tokyo, Japan
| | | | - Yuji Tomizawa
- Department of Neurology, Juntendo University, Tokyo, Japan
| | | | - Berkin Bilgic
- Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, Massachusetts, USA
- Department of Radiology, Harvard Medical School, Boston, Massachusetts, USA
- Harvard/MIT Health Sciences and Technology, Cambridge, Massachusetts, USA
| | | | - Osamu Abe
- Department of Radiology, The University of Tokyo, Tokyo, Japan
| | - Shigeki Aoki
- Department of Radiology, Juntendo University, Tokyo, Japan
| |
Collapse
|
13
|
Foesleitner O, Sulaj A, Sturm V, Kronlage M, Preisner F, Kender Z, Bendszus M, Szendroedi J, Heiland S, Schwarz D. Diffusion tensor imaging in anisotropic tissues: application of reduced gradient vector schemes in peripheral nerves. Eur Radiol Exp 2024; 8:37. [PMID: 38561526 PMCID: PMC10984907 DOI: 10.1186/s41747-024-00444-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2023] [Accepted: 01/23/2024] [Indexed: 04/04/2024] Open
Abstract
BACKGROUND In contrast to the brain, fibers within peripheral nerves have distinct monodirectional structure questioning the necessity of complex multidirectional gradient vector schemes for DTI. This proof-of-concept study investigated the diagnostic utility of reduced gradient vector schemes in peripheral nerve DTI. METHODS Three-Tesla magnetic resonance neurography of the tibial nerve using 20-vector DTI (DTI20) was performed in 10 healthy volunteers, 12 patients with type 2 diabetes, and 12 age-matched healthy controls. From the full DTI20 dataset, three reduced datasets including only two or three vectors along the x- and/or y- and z-axes were built to calculate major parameters. The influence of nerve angulation and intraneural connective tissue was assessed. The area under the receiver operating characteristics curve (ROC-AUC) was used for analysis. RESULTS Simplified datasets achieved excellent diagnostic accuracy equal to DTI20 (ROC-AUC 0.847-0.868, p ≤ 0.005), but compared to DTI20, the reduced models yielded mostly lower absolute values of DTI scalars: median fractional anisotropy (FA) ≤ 0.12; apparent diffusion coefficient (ADC) ≤ 0.25; axial diffusivity ≤ 0.96, radial diffusivity ≤ 0.07). The precision of FA and ADC with the three-vector model was closest to DTI20. Intraneural connective tissue was negatively correlated with FA and ADC (r ≥ -0.49, p < 0.001). Small deviations of nerve angulation had little effect on FA accuracy. CONCLUSIONS In peripheral nerves, bulk tissue DTI metrics can be approximated with only three predefined gradient vectors along the scanner's main axes, yielding similar diagnostic accuracy as a 20-vector DTI, resulting in substantial scan time reduction. RELEVANCE STATEMENT DTI bulk tissue parameters of peripheral nerves can be calculated with only three predefined gradient vectors at similar diagnostic performance as a standard DTI but providing a substantial scan time reduction. KEY POINTS • In peripheral nerves, DTI parameters can be approximated using only three gradient vectors. • The simplified model achieves a similar diagnostic performance as a standard DTI. • The simplified model allows for a significant acceleration of image acquisition. • This can help to introduce multi-b-value DTI techniques into clinical practice.
Collapse
Affiliation(s)
- Olivia Foesleitner
- Department of Neuroradiology, Heidelberg University Hospital, INF 400, 69120, Heidelberg, Germany
| | - Alba Sulaj
- Department of Internal Medicine I and Clinical Chemistry, Heidelberg University Hospital, INF 410, Heidelberg, Germany
- German Center of Diabetes Research (DZD), Neuherberg, Germany
| | - Volker Sturm
- Department of Neuroradiology, Heidelberg University Hospital, INF 400, 69120, Heidelberg, Germany
| | - Moritz Kronlage
- Department of Neuroradiology, Heidelberg University Hospital, INF 400, 69120, Heidelberg, Germany
| | - Fabian Preisner
- Department of Neuroradiology, Heidelberg University Hospital, INF 400, 69120, Heidelberg, Germany
| | - Zoltan Kender
- Department of Internal Medicine I and Clinical Chemistry, Heidelberg University Hospital, INF 410, Heidelberg, Germany
- German Center of Diabetes Research (DZD), Neuherberg, Germany
| | - Martin Bendszus
- Department of Neuroradiology, Heidelberg University Hospital, INF 400, 69120, Heidelberg, Germany
| | - Julia Szendroedi
- Department of Internal Medicine I and Clinical Chemistry, Heidelberg University Hospital, INF 410, Heidelberg, Germany
- German Center of Diabetes Research (DZD), Neuherberg, Germany
- Joint Heidelberg-IDC Translational Diabetes Program, Helmholtz Center Munich, Neuherberg, Germany
| | - Sabine Heiland
- Department of Neuroradiology, Heidelberg University Hospital, INF 400, 69120, Heidelberg, Germany
| | - Daniel Schwarz
- Department of Neuroradiology, Heidelberg University Hospital, INF 400, 69120, Heidelberg, Germany.
| |
Collapse
|
14
|
Cheong EN, Park JE, Park SY, Jung SC, Kim HS. Achieving imaging and computational reproducibility on multiparametric MRI radiomics features in brain tumor diagnosis: phantom and clinical validation. Eur Radiol 2024; 34:2008-2023. [PMID: 37665391 DOI: 10.1007/s00330-023-10164-7] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2023] [Revised: 07/02/2023] [Accepted: 07/06/2023] [Indexed: 09/05/2023]
Abstract
OBJECTIVES The Image Biomarker Standardization Initiative has helped improve the computational reproducibility of MRI radiomics features. Nonetheless, the MRI sequences and features with high imaging reproducibility are yet to be established. To determine reproducible multiparametric MRI radiomics features across test-retest, multi-scanner, and computational reproducibility comparisons, and to evaluate their clinical value in brain tumor diagnosis. METHODS To assess reproducibility, T1-weighted imaging (T1WI), T2-weighted imaging (T2WI), and diffusion-weighted imaging (DWI) were acquired from three 3-T MRI scanners using standardized phantom, and radiomics features were extracted using two computational algorithms. Reproducible radiomics features were selected when the concordance correlation coefficient value above 0.9 across multiple sessions, scanners, and computational algorithms. Random forest classifiers were trained with reproducible features (n = 117) and validated in a clinical cohort (n = 50) to evaluate whether features with high reproducibility improved the differentiation of glioblastoma from primary central nervous system lymphomas (PCNSLs). RESULTS Radiomics features from T2WI demonstrated higher repeatability (65-94%) than those from DWI (38-48%) or T1WI (2-92%). Across test-retest, multi-scanner, and computational comparisons, T2WI provided 41 reproducible features, DWI provided six, and T1WI provided two. The performance of the classification model with reproducible features was higher than that using non-reproducible features in both training set (AUC, 0.916 vs. 0.877) and validation set (AUC, 0.957 vs. 0.869). CONCLUSION Radiomics features with high reproducibility across multiple sessions, scanners, and computational algorithms were identified, and they showed higher diagnostic performance than non-reproducible radiomics features in the differentiation of glioblastoma from PCNSL. CLINICAL RELEVANCE STATEMENT By identifying the radiomics features showing higher multi-machine reproducibility, our results also demonstrated higher radiomics diagnostic performance in the differentiation of glioblastoma from PCNSL, paving the way for further research designs and clinical application in neuro-oncology. KEY POINTS • Highly reproducible radiomics features across multiple sessions, scanners, and computational algorithms were identified using phantom and applied to clinical diagnosis. • Radiomics features from T2-weighted imaging were more reproducible than those from T1-weighted and diffusion-weighted imaging. • Radiomics features with good reproducibility had better diagnostic performance for brain tumors than features with poor reproducibility.
Collapse
Affiliation(s)
- E-Nae Cheong
- Department of Medical Science and Asan Medical Institute of Convergence Science and Technology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea
| | - Ji Eun Park
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea.
| | - Seo Young Park
- Department of Statistics and Data Science, Korea National Open University, Seoul, Republic of Korea
| | - Seung Chai Jung
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea
| | - Ho Sung Kim
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea
| |
Collapse
|
15
|
Park H, Hwang EJ, Goo JM. Deep Learning-Based Kernel Adaptation Enhances Quantification of Emphysema on Low-Dose Chest CT for Predicting Long-Term Mortality. Invest Radiol 2024; 59:278-286. [PMID: 37428617 DOI: 10.1097/rli.0000000000001003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/12/2023]
Abstract
OBJECTIVES The aim of this study was to ascertain the predictive value of quantifying emphysema using low-dose computed tomography (LDCT) post deep learning-based kernel adaptation on long-term mortality. MATERIALS AND METHODS This retrospective study investigated LDCTs obtained from asymptomatic individuals aged 60 years or older during health checkups between February 2009 and December 2016. These LDCTs were reconstructed using a 1- or 1.25-mm slice thickness alongside high-frequency kernels. A deep learning algorithm, capable of generating CT images that resemble standard-dose and low-frequency kernel images, was applied to these LDCTs. To quantify emphysema, the lung volume percentage with an attenuation value less than or equal to -950 Hounsfield units (LAA-950) was gauged before and after kernel adaptation. Low-dose chest CTs with LAA-950 exceeding 6% were deemed emphysema-positive according to the Fleischner Society statement. Survival data were sourced from the National Registry Database at the close of 2021. The risk of nonaccidental death, excluding causes such as injury or poisoning, was explored according to the emphysema quantification results using multivariate Cox proportional hazards models. RESULTS The study comprised 5178 participants (mean age ± SD, 66 ± 3 years; 3110 males). The median LAA-950 (18.2% vs 2.6%) and the proportion of LDCTs with LAA-950 exceeding 6% (96.3% vs 39.3%) saw a significant decline after kernel adaptation. There was no association between emphysema quantification before kernel adaptation and the risk of nonaccidental death. Nevertheless, after kernel adaptation, higher LAA-950 (hazards ratio for 1% increase, 1.01; P = 0.045) and LAA-950 exceeding 6% (hazards ratio, 1.36; P = 0.008) emerged as independent predictors of nonaccidental death, upon adjusting for age, sex, and smoking status. CONCLUSIONS The application of deep learning for kernel adaptation proves instrumental in quantifying pulmonary emphysema on LDCTs, establishing itself as a potential predictive tool for long-term nonaccidental mortality in asymptomatic individuals.
Collapse
Affiliation(s)
- Hyungin Park
- From the Department of Radiology, Seoul National University Hospital, Seoul, South Korea (H.P., E.J.H., J.M.G.); and Department of Radiology, Seoul National University College of Medicine, Seoul, South Korea (J.M.G.)
| | | | | |
Collapse
|
16
|
Kurokawa R, Hagiwara A, Kurokawa M, Ellingson BM, Baba A, Moritani T. Diffusion histogram profiles predict molecular features of grade 4 in histologically lower-grade adult diffuse gliomas following WHO classification 2021. Eur Radiol 2024; 34:1367-1375. [PMID: 37581661 PMCID: PMC10853353 DOI: 10.1007/s00330-023-10071-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Revised: 06/30/2023] [Accepted: 07/06/2023] [Indexed: 08/16/2023]
Abstract
OBJECTIVES In the latest World Health Organization classification 2021, grade 4 adult diffuse gliomas can be diagnosed with several molecular features even without histological evidence of necrosis or microvascular proliferation. We aimed to explore whole tumor histogram-derived apparent diffusion coefficient (ADC) histogram profiles for differentiating between the presence (Mol-4) and absence (Mol-2/3) of grade 4 molecular features in histologically lower-grade gliomas. METHODS Between June 2019 and October 2022, 184 adult patients with diffuse gliomas underwent MRI. After excluding 121 patients, 18 (median age, 64.5 [range, 37-84 years]) Mol-4 and 45 (median 40 [range, 18-73] years) Mol-2/3 patients with histologically lower-grade gliomas were enrolled. Whole tumor volume-of-interest-derived ADC histogram profiles were calculated and compared between the two groups. Stepwise logistic regression analysis with Akaike's information criterion using the ADC histogram profiles with p values < 0.01 and age at diagnosis was used to identify independent variables for predicting the Mol-4 group. RESULTS The 90th percentile (p < 0.001), median (p < 0.001), mean (p < 0.001), 10th percentile (p = 0.014), and entropy (p < 0.001) of normalized ADC were lower, and kurtosis (p < 0.001) and skewness (p = 0.046) were higher in the Mol-4 group than in the Mol-2/3 group. Multivariate logistic regression analysis revealed that the entropy of normalized ADC and age at diagnosis were independent predictive parameters for the Mol-4 group with an area under the curve of 0.92. CONCLUSION ADC histogram profiles may be promising preoperative imaging biomarkers to predict molecular grade 4 among histologically lower-grade adult diffuse gliomas. CLINICAL RELEVANCE STATEMENT This study highlighted the diagnostic usefulness of ADC histogram profiles to differentiate histologically lower grade adult diffuse gliomas with the presence of molecular grade 4 features and those without. KEY POINTS • ADC histogram profiles to predict molecular CNS WHO grade 4 status among histologically lower-grade adult diffuse gliomas were evaluated. • Entropy of ADC and age were independent predictive parameters for molecular grade 4 status. • ADC histogram analysis is useful for predicting molecular grade 4 among histologically lower-grade gliomas.
Collapse
Affiliation(s)
- Ryo Kurokawa
- Division of Neuroradiology, Department of Radiology, University of Michigan, 1500 E. Medical Center Dr, Ann Arbor, MI, 48109, USA.
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8655, Japan.
| | - Akifumi Hagiwara
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8655, Japan
- Department of Radiology, Juntendo University School of Medicine, 2-1-1 Hongo, Bunkyo-ku, Tokyo, 113-8421, Japan
| | - Mariko Kurokawa
- Division of Neuroradiology, Department of Radiology, University of Michigan, 1500 E. Medical Center Dr, Ann Arbor, MI, 48109, USA
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8655, Japan
| | - Benjamin M Ellingson
- UCLA Brain Tumor Imaging Laboratory, Department of Radiological Sciences, David Geffen School of Medicine, University of California Los Angeles, 924 Westwood Blvd., Suite 615, Los Angeles, CA, 90024, USA
| | - Akira Baba
- Division of Neuroradiology, Department of Radiology, University of Michigan, 1500 E. Medical Center Dr, Ann Arbor, MI, 48109, USA
| | - Toshio Moritani
- Division of Neuroradiology, Department of Radiology, University of Michigan, 1500 E. Medical Center Dr, Ann Arbor, MI, 48109, USA
| |
Collapse
|
17
|
Jeong S, Yu H, Park SH, Woo D, Lee SJ, Chong GO, Han HS, Kim JC. Comparing deep learning and handcrafted radiomics to predict chemoradiotherapy response for locally advanced cervical cancer using pretreatment MRI. Sci Rep 2024; 14:1180. [PMID: 38216687 PMCID: PMC10786874 DOI: 10.1038/s41598-024-51742-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Accepted: 01/09/2024] [Indexed: 01/14/2024] Open
Abstract
Concurrent chemoradiotherapy (CRT) is the standard treatment for locally advanced cervical cancer (LACC), but its responsiveness varies among patients. A reliable tool for predicting CRT responses is necessary for personalized cancer treatment. In this study, we constructed prediction models using handcrafted radiomics (HCR) and deep learning radiomics (DLR) based on pretreatment MRI data to predict CRT response in LACC. Furthermore, we investigated the potential improvement in prediction performance by incorporating clinical factors. A total of 252 LACC patients undergoing curative chemoradiotherapy are included. The patients are randomly divided into two independent groups for the training (167 patients) and test datasets (85 patients). Contrast-enhanced T1- and T2-weighted MR scans are obtained. For HCR analysis, 1890 imaging features are extracted and a support vector machine classifier with a five-fold cross-validation is trained on training dataset to predict CRT response and subsequently validated on test dataset. For DLR analysis, a 3-dimensional convolutional neural network was trained on training dataset and validated on test dataset. In conclusion, both HCR and DLR models could predict CRT responses in patients with LACC. The integration of clinical factors into radiomics prediction models tended to improve performance in HCR analysis. Our findings may contribute to the development of personalized treatment strategies for LACC patients.
Collapse
Affiliation(s)
- Sungmoon Jeong
- Department of Medical Informatics, School of Medicine, Kyungpook National University, Daegu, Republic of Korea
- Research Center for Artificial Intelligence in Medicine, Kyungpook National University Hospital, Daegu, Republic of Korea
| | - Hosang Yu
- Research Center for Artificial Intelligence in Medicine, Kyungpook National University Hospital, Daegu, Republic of Korea
| | - Shin-Hyung Park
- Department of Radiation Oncology, School of Medicine, Kyungpook National University, Daegu, Republic of Korea.
- Department of Radiation Oncology, Kyungpook National University Hospital, Daegu, Republic of Korea.
- Cardiovascular Research Institute, School of Medicine, Kyungpook National University, Daegu, Republic of Korea.
| | - Dongwon Woo
- Research Center for Artificial Intelligence in Medicine, Kyungpook National University Hospital, Daegu, Republic of Korea
| | - Seoung-Jun Lee
- Department of Radiation Oncology, Kyungpook National University Hospital, Daegu, Republic of Korea
| | - Gun Oh Chong
- Department of Gynecology, School of Medicine, Kyungpook National University, Daegu, Republic of Korea
- Clinical Omics Research Center, School of Medicine, Kyungpook National University, Daegu, Republic of Korea
| | - Hyung Soo Han
- Clinical Omics Research Center, School of Medicine, Kyungpook National University, Daegu, Republic of Korea
- Department of Physiology, School of Medicine, Kyungpook National University, Daegu, Republic of Korea
| | - Jae-Chul Kim
- Department of Radiation Oncology, School of Medicine, Kyungpook National University, Daegu, Republic of Korea
- Department of Radiation Oncology, Kyungpook National University Hospital, Daegu, Republic of Korea
| |
Collapse
|
18
|
Schurink NW, van Kranen SR, van Griethuysen JJM, Roberti S, Snaebjornsson P, Bakers FCH, de Bie SH, Bosma GPT, Cappendijk VC, Geenen RWF, Neijenhuis PA, Peterson GM, Veeken CJ, Vliegen RFA, Peters FP, Bogveradze N, El Khababi N, Lahaye MJ, Maas M, Beets GL, Beets-Tan RGH, Lambregts DMJ. Development and multicenter validation of a multiparametric imaging model to predict treatment response in rectal cancer. Eur Radiol 2023; 33:8889-8898. [PMID: 37452176 PMCID: PMC10667134 DOI: 10.1007/s00330-023-09920-6] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/18/2023]
Abstract
OBJECTIVES To develop and validate a multiparametric model to predict neoadjuvant treatment response in rectal cancer at baseline using a heterogeneous multicenter MRI dataset. METHODS Baseline staging MRIs (T2W (T2-weighted)-MRI, diffusion-weighted imaging (DWI) / apparent diffusion coefficient (ADC)) of 509 patients (9 centres) treated with neoadjuvant chemoradiotherapy (CRT) were collected. Response was defined as (1) complete versus incomplete response, or (2) good (Mandard tumor regression grade (TRG) 1-2) versus poor response (TRG3-5). Prediction models were developed using combinations of the following variable groups: (1) Non-imaging: age/sex/tumor-location/tumor-morphology/CRT-surgery interval (2) Basic staging: cT-stage/cN-stage/mesorectal fascia involvement, derived from (2a) original staging reports, or (2b) expert re-evaluation (3) Advanced staging: variables from 2b combined with cTN-substaging/invasion depth/extramural vascular invasion/tumor length (4) Quantitative imaging: tumour volume + first-order histogram features (from T2W-MRI and DWI/ADC) Models were developed with data from 6 centers (n = 412) using logistic regression with the Least Absolute Shrinkage and Selector Operator (LASSO) feature selection, internally validated using repeated (n = 100) random hold-out validation, and externally validated using data from 3 centers (n = 97). RESULTS After external validation, the best model (including non-imaging and advanced staging variables) achieved an area under the curve of 0.60 (95%CI=0.48-0.72) to predict complete response and 0.65 (95%CI=0.53-0.76) to predict a good response. Quantitative variables did not improve model performance. Basic staging variables consistently achieved lower performance compared to advanced staging variables. CONCLUSIONS Overall model performance was moderate. Best results were obtained using advanced staging variables, highlighting the importance of good-quality staging according to current guidelines. Quantitative imaging features had no added value (in this heterogeneous dataset). CLINICAL RELEVANCE STATEMENT Predicting tumour response at baseline could aid in tailoring neoadjuvant therapies for rectal cancer. This study shows that image-based prediction models are promising, though are negatively affected by variations in staging quality and MRI acquisition, urging the need for harmonization. KEY POINTS This multicenter study combining clinical information and features derived from MRI rendered disappointing performance to predict response to neoadjuvant treatment in rectal cancer. Best results were obtained with the combination of clinical baseline information and state-of-the-art image-based staging variables, highlighting the importance of good quality staging according to current guidelines and staging templates. No added value was found for quantitative imaging features in this multicenter retrospective study. This is likely related to acquisition variations, which is a major problem for feature reproducibility and thus model generalizability.
Collapse
Affiliation(s)
- Niels W Schurink
- Department of Radiology, The Netherlands Cancer Institute, Amsterdam, The Netherlands
- GROW School for Oncology & Developmental Biology, University of Maastricht, Maastricht, The Netherlands
| | - Simon R van Kranen
- Department of Radiation Oncology, The Netherlands Cancer Institute, Amsterdam, The Netherlands
| | - Joost J M van Griethuysen
- Department of Radiology, The Netherlands Cancer Institute, Amsterdam, The Netherlands
- GROW School for Oncology & Developmental Biology, University of Maastricht, Maastricht, The Netherlands
| | - Sander Roberti
- Department of Epidemiology and Biostatistics, The Netherlands Cancer Institute, Amsterdam, The Netherlands
| | - Petur Snaebjornsson
- Department of Pathology, The Netherlands Cancer Institute, Amsterdam, The Netherlands
| | - Frans C H Bakers
- Department of Radiology, Maastricht University Medical Centre, Maastricht, The Netherlands
| | - Shira H de Bie
- Department of Radiology, Deventer Ziekenhuis, Schalkhaar, The Netherlands
| | - Gerlof P T Bosma
- Department of Interventional Radiology, Elisabeth Tweesteden Hospital, Tilburg, The Netherlands
| | - Vincent C Cappendijk
- Department of Radiology, Jeroen Bosch Hospital, 's-Hertogenbosch, The Netherlands
| | - Remy W F Geenen
- Department of Radiology, Northwest Clinics, Alkmaar, The Netherlands
| | | | | | - Cornelis J Veeken
- Department of Radiology, IJsselland Hospital, Capelle aan den IJssel, The Netherlands
| | - Roy F A Vliegen
- Department of Radiology, Zuyderland Medical Center, Heerlen, The Netherlands
| | - Femke P Peters
- Department of Radiation Oncology, The Netherlands Cancer Institute, Amsterdam, The Netherlands
| | - Nino Bogveradze
- Department of Radiology, The Netherlands Cancer Institute, Amsterdam, The Netherlands
- GROW School for Oncology & Developmental Biology, University of Maastricht, Maastricht, The Netherlands
- Department of Radiology, Acad. F. Todua Medical Center, Research Institute of Clinical Medicine, Tbilisi, Georgia
| | - Najim El Khababi
- Department of Radiology, The Netherlands Cancer Institute, Amsterdam, The Netherlands
- GROW School for Oncology & Developmental Biology, University of Maastricht, Maastricht, The Netherlands
| | - Max J Lahaye
- Department of Radiology, The Netherlands Cancer Institute, Amsterdam, The Netherlands
- GROW School for Oncology & Developmental Biology, University of Maastricht, Maastricht, The Netherlands
| | - Monique Maas
- Department of Radiology, The Netherlands Cancer Institute, Amsterdam, The Netherlands
- GROW School for Oncology & Developmental Biology, University of Maastricht, Maastricht, The Netherlands
| | - Geerard L Beets
- GROW School for Oncology & Developmental Biology, University of Maastricht, Maastricht, The Netherlands
- Department of Surgery, The Netherlands Cancer Institute, Amsterdam, The Netherlands
| | - Regina G H Beets-Tan
- Department of Radiology, The Netherlands Cancer Institute, Amsterdam, The Netherlands
- GROW School for Oncology & Developmental Biology, University of Maastricht, Maastricht, The Netherlands
- Institute of Regional Health Research, University of Southern Denmark, Vejle, Denmark
| | - Doenja M J Lambregts
- Department of Radiology, The Netherlands Cancer Institute, Amsterdam, The Netherlands.
- GROW School for Oncology & Developmental Biology, University of Maastricht, Maastricht, The Netherlands.
| |
Collapse
|
19
|
Meng Y, Yang Y, Hu M, Zhang Z, Zhou X. Artificial intelligence-based radiomics in bone tumors: Technical advances and clinical application. Semin Cancer Biol 2023; 95:75-87. [PMID: 37499847 DOI: 10.1016/j.semcancer.2023.07.003] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2023] [Revised: 07/21/2023] [Accepted: 07/22/2023] [Indexed: 07/29/2023]
Abstract
Radiomics is the extraction of predefined mathematic features from medical images for predicting variables of clinical interest. Recent research has demonstrated that radiomics can be processed by artificial intelligence algorithms to reveal complex patterns and trends for diagnosis, and prediction of prognosis and response to treatment modalities in various types of cancer. Artificial intelligence tools can utilize radiological images to solve next-generation issues in clinical decision making. Bone tumors can be classified as primary and secondary (metastatic) tumors. Osteosarcoma, Ewing sarcoma, and chondrosarcoma are the dominating primary tumors of bone. The development of bone tumor model systems and relevant research, and the assessment of novel treatment methods are ongoing to improve clinical outcomes, notably for patients with metastases. Artificial intelligence and radiomics have been utilized in almost full spectrum of clinical care of bone tumors. Radiomics models have achieved excellent performance in the diagnosis and grading of bone tumors. Furthermore, the models enable to predict overall survival, metastases, and recurrence. Radiomics features have exhibited promise in assisting therapeutic planning and evaluation, especially neoadjuvant chemotherapy. This review provides an overview of the evolution and opportunities for artificial intelligence in imaging, with a focus on hand-crafted features and deep learning-based radiomics approaches. We summarize the current application of artificial intelligence-based radiomics both in primary and metastatic bone tumors, and discuss the limitations and future opportunities of artificial intelligence-based radiomics in this field. In the era of personalized medicine, our in-depth understanding of emerging artificial intelligence-based radiomics approaches will bring innovative solutions to bone tumors and achieve clinical application.
Collapse
Affiliation(s)
- Yichen Meng
- Department of Orthopedics, Second Affiliated Hospital of Naval Medical University, Shanghai 200003, PR China
| | - Yue Yang
- Department of Orthopedics, Second Affiliated Hospital of Naval Medical University, Shanghai 200003, PR China
| | - Miao Hu
- Department of Orthopedics, Second Affiliated Hospital of Naval Medical University, Shanghai 200003, PR China
| | - Zheng Zhang
- Department of Orthopedics, Second Affiliated Hospital of Naval Medical University, Shanghai 200003, PR China.
| | - Xuhui Zhou
- Department of Orthopedics, Second Affiliated Hospital of Naval Medical University, Shanghai 200003, PR China.
| |
Collapse
|
20
|
Jensen LJ, Kim D, Elgeti T, Steffen IG, Schaafs LA, Hamm B, Nagel SN. The role of parametric feature maps to correct different volume of interest sizes: an in vivo liver MRI study. Eur Radiol Exp 2023; 7:48. [PMID: 37670193 PMCID: PMC10480134 DOI: 10.1186/s41747-023-00362-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2023] [Accepted: 06/13/2023] [Indexed: 09/07/2023] Open
Abstract
BACKGROUND Different volume of interest (VOI) sizes influence radiomic features. This study examined if translating images into feature maps before feature sampling could compensate for these effects in liver magnetic resonance imaging (MRI). METHODS T1- and T2-weighted sequences from three different scanners (two 3-T scanners, one 1.5-T scanner) of 66 patients with normal abdominal MRI were included retrospectively. Three differently sized VOIs (10, 20, and 30 mm in diameter) were drawn in the liver parenchyma (right lobe), excluding adjacent structures. Ninety-three features were extracted conventionally using PyRadiomics. All images were also converted to 93 parametric feature maps using a pretested software. Agreement between the three VOI sizes was assessed with overall concordance correlation coefficients (OCCCs), while OCCCs > 0.85 were rated reproducible. OCCCs were calculated twice: for the VOI sizes of 10, 20, and 30 mm and for those of 20 and 30 mm. RESULTS When extracted from original images, only 4 out of the 93 features were reproducible across all VOI sizes in T1- and T2-weighted images. When the smallest VOI was excluded, 5 features (T1-weighted) and 7 features (T2-weighted) were reproducible. Extraction from parametric maps increased the number of reproducible features to 9 (T1- and T2-weighted) across all VOIs. Excluding the 10-mm VOI, reproducibility improved to 16 (T1-weighted) and 55 features (T2-weighted). The stability of all other features also increased in feature maps. CONCLUSIONS Translating images into parametric maps before feature extraction improves reproducibility across different VOI sizes in normal liver MRI. RELEVANCE STATEMENT The size of the segmented VOI influences the feature quantity of radiomics, while software-based conversion of images into parametric feature maps before feature sampling improves reproducibility across different VOI sizes in MRI of normal liver tissue. KEY POINTS • Parametric feature maps can compensate for different VOI sizes. • The effect seems dependent on the VOI sizes and the MRI sequence. • Feature maps can visualize features throughout the entire image stack.
Collapse
Affiliation(s)
- Laura Jacqueline Jensen
- Charité-Universitätsmedizin Berlin, Department of Radiology, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, Berlin Institute of Health, Hindenburgdamm 30, 12203, Berlin, Germany.
| | - Damon Kim
- Charité-Universitätsmedizin Berlin, Department of Radiology, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, Berlin Institute of Health, Hindenburgdamm 30, 12203, Berlin, Germany.
| | - Thomas Elgeti
- Charité-Universitätsmedizin Berlin, Department of Radiology, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, Berlin Institute of Health, Hindenburgdamm 30, 12203, Berlin, Germany
| | - Ingo Günter Steffen
- Charité-Universitätsmedizin Berlin, Department of Radiology, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, Berlin Institute of Health, Hindenburgdamm 30, 12203, Berlin, Germany
| | - Lars-Arne Schaafs
- Charité-Universitätsmedizin Berlin, Department of Radiology, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, Berlin Institute of Health, Hindenburgdamm 30, 12203, Berlin, Germany
| | - Bernd Hamm
- Charité-Universitätsmedizin Berlin, Department of Radiology, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, Berlin Institute of Health, Hindenburgdamm 30, 12203, Berlin, Germany
| | - Sebastian Niko Nagel
- Charité-Universitätsmedizin Berlin, Department of Radiology, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, Berlin Institute of Health, Hindenburgdamm 30, 12203, Berlin, Germany
| |
Collapse
|
21
|
Farhad A, Reza R, Azamossadat H, Ali G, Arash R, Mehrad A, Zahra K. Artificial intelligence in estimating fractional flow reserve: a systematic literature review of techniques. BMC Cardiovasc Disord 2023; 23:407. [PMID: 37596521 PMCID: PMC10439535 DOI: 10.1186/s12872-023-03447-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2023] [Accepted: 08/12/2023] [Indexed: 08/20/2023] Open
Abstract
BACKGROUND Fractional Flow Reserve (FFR) is the gold standard for the functional evaluation of coronary arteries, which is effective in selecting patients for revascularization, avoiding unnecessary procedures, and reducing treatment costs. However, its use is limited due to invasiveness, high cost, and complexity. Therefore, the non-invasive estimation of FFR using artificial intelligence (AI) methods is crucial. OBJECTIVE This study aimed to identify the AI techniques used for FFR estimation and to explore the features of the studies that applied AI techniques in FFR estimation. METHODS The present systematic review was conducted by searching five databases, PubMed, Scopus, Web of Science, IEEE, and Science Direct, based on the search strategy of each database. RESULTS Five hundred seventy-three articles were extracted, and by applying the inclusion and exclusion criteria, twenty-five were finally selected for review. The findings revealed that AI methods, including Machine Learning (ML) and Deep Learning (DL), have been used to estimate the FFR. CONCLUSION This study shows that AI methods can be used non-invasively to estimate FFR, which can help physicians diagnose and treat coronary artery occlusion and provide significant clinical performance for patients.
Collapse
Affiliation(s)
- Arefinia Farhad
- Department of Health Information Technology and Management, School of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Rabiei Reza
- Department of Health Information Technology and Management, School of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran.
| | - Hosseini Azamossadat
- Department of Health Information Technology and Management, School of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran.
| | - Ghaemian Ali
- Cardiovascular Research Center, Mazandaran University of Medical Sciences, Sari, Iran
| | - Roshanpoor Arash
- Department of Computer Science, Sama Technical and Vocational Training College, Tehran Branch (Tehran), Islamic Azad University (IAU), Tehran, Iran
| | - Aria Mehrad
- Department of Information Technology and Computer Engineering and Ophthalmic Epidemiology Research Center, Azarbaijan Shahid Madani University, Tabriz, Iran
| | - Khorrami Zahra
- Research Institute for Ophthalmology and Vision Science, Shahid Beheshti University of Medical Sciences, Tabriz, Iran
| |
Collapse
|
22
|
Hagiwara A, Fujita S, Kurokawa R, Andica C, Kamagata K, Aoki S. Multiparametric MRI: From Simultaneous Rapid Acquisition Methods and Analysis Techniques Using Scoring, Machine Learning, Radiomics, and Deep Learning to the Generation of Novel Metrics. Invest Radiol 2023; 58:548-560. [PMID: 36822661 PMCID: PMC10332659 DOI: 10.1097/rli.0000000000000962] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2022] [Revised: 01/10/2023] [Indexed: 02/25/2023]
Abstract
ABSTRACT With the recent advancements in rapid imaging methods, higher numbers of contrasts and quantitative parameters can be acquired in less and less time. Some acquisition models simultaneously obtain multiparametric images and quantitative maps to reduce scan times and avoid potential issues associated with the registration of different images. Multiparametric magnetic resonance imaging (MRI) has the potential to provide complementary information on a target lesion and thus overcome the limitations of individual techniques. In this review, we introduce methods to acquire multiparametric MRI data in a clinically feasible scan time with a particular focus on simultaneous acquisition techniques, and we discuss how multiparametric MRI data can be analyzed as a whole rather than each parameter separately. Such data analysis approaches include clinical scoring systems, machine learning, radiomics, and deep learning. Other techniques combine multiple images to create new quantitative maps associated with meaningful aspects of human biology. They include the magnetic resonance g-ratio, the inner to the outer diameter of a nerve fiber, and the aerobic glycolytic index, which captures the metabolic status of tumor tissues.
Collapse
Affiliation(s)
- Akifumi Hagiwara
- From theDepartment of Radiology, Juntendo University School of Medicine, Tokyo, Japan
| | - Shohei Fujita
- From theDepartment of Radiology, Juntendo University School of Medicine, Tokyo, Japan
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| | - Ryo Kurokawa
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
- Division of Neuroradiology, Department of Radiology, University of Michigan, Ann Arbor, Michigan
| | - Christina Andica
- From theDepartment of Radiology, Juntendo University School of Medicine, Tokyo, Japan
| | - Koji Kamagata
- From theDepartment of Radiology, Juntendo University School of Medicine, Tokyo, Japan
| | - Shigeki Aoki
- From theDepartment of Radiology, Juntendo University School of Medicine, Tokyo, Japan
| |
Collapse
|
23
|
Barge P, Oevermann A, Maiolini A, Durand A. Machine learning predicts histologic type and grade of canine gliomas based on MRI texture analysis. Vet Radiol Ultrasound 2023. [PMID: 37133981 DOI: 10.1111/vru.13242] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2022] [Revised: 03/16/2023] [Accepted: 03/21/2023] [Indexed: 05/04/2023] Open
Abstract
Conventional MRI features of canine gliomas subtypes and grades significantly overlap. Texture analysis (TA) quantifies image texture based on spatial arrangement of pixel intensities. Machine learning (ML) models based on MRI-TA demonstrate high accuracy in predicting brain tumor types and grades in human medicine. The aim of this retrospective, diagnostic accuracy study was to investigate the accuracy of ML-based MRI-TA in predicting canine gliomas histologic types and grades. Dogs with histopathological diagnosis of intracranial glioma and available brain MRI were included. Tumors were manually segmented across their entire volume in enhancing part, non-enhancing part, and peri-tumoral vasogenic edema in T2-weighted (T2w), T1-weighted (T1w), FLAIR, and T1w postcontrast sequences. Texture features were extracted and fed into three ML classifiers. Classifiers' performance was assessed using a leave-one-out cross-validation approach. Multiclass and binary models were built to predict histologic types (oligodendroglioma vs. astrocytoma vs. oligoastrocytoma) and grades (high vs. low), respectively. Thirty-eight dogs with a total of 40 masses were included. Machine learning classifiers had an average accuracy of 77% for discriminating tumor types and of 75.6% for predicting high-grade gliomas. The support vector machine classifier had an accuracy of up to 94% for predicting tumor types and up to 87% for predicting high-grade gliomas. The most discriminative texture features of tumor types and grades appeared related to the peri-tumoral edema in T1w images and to the non-enhancing part of the tumor in T2w images, respectively. In conclusion, ML-based MRI-TA has the potential to discriminate intracranial canine gliomas types and grades.
Collapse
Affiliation(s)
- Pablo Barge
- Division of Clinical Radiology, Department of Clinical Veterinary Science, Vetsuisse Faculty, University of Bern, Bern, Switzerland
| | - Anna Oevermann
- Division of Neurological Sciences, Department of Clinical Research and Veterinary Public Health, Vetsuisse Faculty, University of Bern, Bern, Switzerland
| | - Arianna Maiolini
- Division of Clinical Neurology, Department of Clinical Veterinary Science, Vetsuisse Faculty, University of Bern, Bern, Switzerland
| | - Alexane Durand
- Division of Clinical Radiology, Department of Clinical Veterinary Science, Vetsuisse Faculty, University of Bern, Bern, Switzerland
| |
Collapse
|
24
|
Gatidis S, Kart T, Fischer M, Winzeck S, Glocker B, Bai W, Bülow R, Emmel C, Friedrich L, Kauczor HU, Keil T, Kröncke T, Mayer P, Niendorf T, Peters A, Pischon T, Schaarschmidt BM, Schmidt B, Schulze MB, Umutle L, Völzke H, Küstner T, Bamberg F, Schölkopf B, Rueckert D. Better Together: Data Harmonization and Cross-Study Analysis of Abdominal MRI Data From UK Biobank and the German National Cohort. Invest Radiol 2023; 58:346-354. [PMID: 36729536 PMCID: PMC10090309 DOI: 10.1097/rli.0000000000000941] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2022] [Accepted: 10/28/2022] [Indexed: 02/03/2023]
Abstract
OBJECTIVES The UK Biobank (UKBB) and German National Cohort (NAKO) are among the largest cohort studies, capturing a wide range of health-related data from the general population, including comprehensive magnetic resonance imaging (MRI) examinations. The purpose of this study was to demonstrate how MRI data from these large-scale studies can be jointly analyzed and to derive comprehensive quantitative image-based phenotypes across the general adult population. MATERIALS AND METHODS Image-derived features of abdominal organs (volumes of liver, spleen, kidneys, and pancreas; volumes of kidney hilum adipose tissue; and fat fractions of liver and pancreas) were extracted from T1-weighted Dixon MRI data of 17,996 participants of UKBB and NAKO based on quality-controlled deep learning generated organ segmentations. To enable valid cross-study analysis, we first analyzed the data generating process using methods of causal discovery. We subsequently harmonized data from UKBB and NAKO using the ComBat approach for batch effect correction. We finally performed quantile regression on harmonized data across studies providing quantitative models for the variation of image-derived features stratified for sex and dependent on age, height, and weight. RESULTS Data from 8791 UKBB participants (49.9% female; age, 63 ± 7.5 years) and 9205 NAKO participants (49.1% female, age: 51.8 ± 11.4 years) were analyzed. Analysis of the data generating process revealed direct effects of age, sex, height, weight, and the data source (UKBB vs NAKO) on image-derived features. Correction of data source-related effects resulted in markedly improved alignment of image-derived features between UKBB and NAKO. Cross-study analysis on harmonized data revealed comprehensive quantitative models for the phenotypic variation of abdominal organs across the general adult population. CONCLUSIONS Cross-study analysis of MRI data from UKBB and NAKO as proposed in this work can be helpful for future joint data analyses across cohorts linking genetic, environmental, and behavioral risk factors to MRI-derived phenotypes and provide reference values for clinical diagnostics.
Collapse
Affiliation(s)
- Sergios Gatidis
- From the Empirical Inference Department, Max-Planck Institute for Intelligent Systems
- Medical Image and Data Analysis Lab, Department of Radiology, University Hospital Tübingen, Tübingen, Germany
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom
| | - Turkay Kart
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom
| | - Marc Fischer
- Institute of Signal Processing and System Theory, University of Stuttgart, Stuttgart, Germany
| | - Stefan Winzeck
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom
| | - Ben Glocker
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom
| | - Wenjia Bai
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom
- Department of Brain Sciences, Imperial College London, London, United Kingdom
| | - Robin Bülow
- Institute of Diagnostic Radiology and Neuroradiology, University Medicine Greifswald, Greifswald
| | - Carina Emmel
- Institute for Medical Informatics, Biometry, and Epidemiology, University Hospital of Essen, Essen
| | - Lena Friedrich
- Department of Diagnostic and Interventional Radiology, University Hospital Augsburg, Augsburg
| | - Hans-Ulrich Kauczor
- Clinic for Diagnostic and Interventional Radiology, Heidelberg University Hospital, Heidelberg
| | - Thomas Keil
- Institute of Social Medicine, Epidemiology and Health Economics, Charité–Universitätsmedizin Berlin, Berlin
- Institute of Clinical Epidemiology and Biometry, University of Würzburg, Würzburg
- State Institute of Health, Bavarian Health and Food Safety Authority, Erlangen
| | - Thomas Kröncke
- Department of Diagnostic and Interventional Radiology, University Hospital Augsburg, Augsburg
| | - Philipp Mayer
- Clinic for Diagnostic and Interventional Radiology, Heidelberg University Hospital, Heidelberg
| | - Thoralf Niendorf
- Berlin Ultrahigh Field Facility, Max-Delbrueck-Center for Molecular Medicine in the Helmholtz Association, Berlin
| | - Annette Peters
- Institute of Epidemiology, Helmholtz Zentrum München, German Research Center for Environmental Health, Neuherberg
- Institute for Medical Information Processing, Biometry and Epidemiology, Medical Faculty, Ludwig-Maximilians-Universität München, Munich
- German Diabetes Center (DZD e.V.—Partner site Munich), Neuherberg
| | - Tobias Pischon
- Max-Delbrueck-Center for Molecular Medicine in the Helmholtz Association, Molecular Epidemiology Research Group
- Max-Delbrueck-Center for Molecular Medicine in the Helmholtz Association, Biobank Technology Platform
- Berlin Institute of Health at Charité–Universitätsmedizin Berlin, Core Facility Biobank
- Charité–Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin
| | - Benedikt M. Schaarschmidt
- Institute of Diagnostic and Interventional Radiology and Neuroradiology, University Hospital Essen, Essen
| | - Börge Schmidt
- Institute for Medical Informatics, Biometry, and Epidemiology, University Hospital of Essen, Essen
| | - Matthias B. Schulze
- Department of Molecular Epidemiology, German Institute of Human Nutrition Potsdam-Rehbruecke
- Institute of Nutritional Science, University of Potsdam, Nuthetal
| | - Lale Umutle
- Institute of Diagnostic and Interventional Radiology and Neuroradiology, University Hospital Essen, Essen
| | - Henry Völzke
- Institute for Community Medicine, University Medicine Greifswald, Greifswald
| | - Thomas Küstner
- Medical Image and Data Analysis Lab, Department of Radiology, University Hospital Tübingen, Tübingen, Germany
| | - Fabian Bamberg
- Department of Radiology, University Hospital Freiburg, Freiburg
| | - Bernhard Schölkopf
- From the Empirical Inference Department, Max-Planck Institute for Intelligent Systems
| | - Daniel Rueckert
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom
- Institute for AI and Informatics in Medicine, Klinikum rechts der Isar, Technical University of Munich, Munich, Germany
| |
Collapse
|
25
|
Bhandari A, Scott L, Weilbach M, Marwah R, Lasocki A. Assessment of artificial intelligence (AI) reporting methodology in glioma MRI studies using the Checklist for AI in Medical Imaging (CLAIM). Neuroradiology 2023; 65:907-913. [PMID: 36746792 PMCID: PMC10105653 DOI: 10.1007/s00234-023-03126-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2022] [Accepted: 01/30/2023] [Indexed: 02/08/2023]
Abstract
PURPOSE The Checklist for Artificial Intelligence in Medical Imaging (CLAIM) is a recently released guideline designed for the optimal reporting methodology of artificial intelligence (AI) studies. Gliomas are the most common form of primary malignant brain tumour and numerous outcomes derived from AI algorithms such as grading, survival, treatment-related effects and molecular status have been reported. The aim of the study is to evaluate the AI reporting methodology for outcomes relating to gliomas in magnetic resonance imaging (MRI) using the CLAIM criteria. METHODS A literature search was performed on three databases pertaining to AI augmentation of glioma MRI, published between the start of 2018 and the end of 2021 RESULTS: A total of 4308 articles were identified and 138 articles remained after screening. These articles were categorised into four main AI tasks: grading (n= 44), predicting molecular status (n= 50), predicting survival (n= 25) and distinguishing true tumour progression from treatment-related effects (n= 10). The average CLAIM score was 20/42 (range: 10-31). Studies most consistently reported the scientific background and clinical role of their AI approach. Areas of improvement were identified in the reporting of data collection, data management, ground truth and validation of AI performance. CONCLUSION AI may be a means of producing high-accuracy results for certain tasks in glioma MRI; however, there remain issues with reporting quality. AI reporting guidelines may aid in a more reproducible and standardised approach to reporting and will aid in clinical integration.
Collapse
Affiliation(s)
- Abhishta Bhandari
- Townsville University Hospital, 100 Angus Smith Drive, Townsville, QLD, 4814, Australia.
- School of Medicine and Dentistry, James Cook University, 1 James Cook Drive, Townsville, QLD, 4814, Australia.
| | - Luke Scott
- Cairns Hospital, 165 Esplanade, Cairns, QLD, 4870, Australia
| | - Manuela Weilbach
- Redcliffe Hospital, Anzac Avenue, Redcliffe, QLD, 4020, Australia
| | - Ravi Marwah
- Townsville University Hospital, 100 Angus Smith Drive, Townsville, QLD, 4814, Australia
- School of Medicine and Dentistry, James Cook University, 1 James Cook Drive, Townsville, QLD, 4814, Australia
| | - Arian Lasocki
- Department of Cancer Imaging, Peter MacCallum Cancer Centre, Melbourne, Victoria, Australia
- Sir Peter MacCallum Department of Oncology, The University of Melbourne, Melbourne, Victoria, Australia
| |
Collapse
|
26
|
Cho NS, Hagiwara A, Sanvito F, Ellingson BM. A multi-reader comparison of normal-appearing white matter normalization techniques for perfusion and diffusion MRI in brain tumors. Neuroradiology 2023; 65:559-568. [PMID: 36301349 PMCID: PMC9905164 DOI: 10.1007/s00234-022-03072-y] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2022] [Accepted: 10/14/2022] [Indexed: 02/08/2023]
Abstract
PURPOSE There remains no consensus normal-appearing white matter (NAWM) normalization method to compute normalized relative cerebral blood volume (nrCBV) and apparent diffusion coefficient (nADC) in brain tumors. This reader study explored nrCBV and nADC differences using different NAWM normalization methods. METHODS Thirty-five newly diagnosed glioma patients were studied. For each patient, two readers created four NAWM regions of interests: (1) a single plane in the centrum semiovale (CSOp), (2) 3 spheres in the centrum semiovale (CSOs), (3) a single plane in the slice of the tumor center (TUMp), and (4) 3 spheres in the slice of the tumor center (TUMs). Readers repeated NAWM segmentations 1 month later. Differences in nrCBV and nADC of the FLAIR hyperintense tumor, inter-/intra-reader variability, and time to segment NAWM were assessed. As a validation step, the diagnostic performance of each method for IDH-status prediction was evaluated. RESULTS Both readers obtained significantly different nrCBV (P < .001), nADC (P < .001), and time to segment NAWM (P < .001) between the four normalization methods. nrCBV and nADC were significantly different between CSO and TUM methods, but not between planar and spherical methods in the same NAWM region. Broadly, CSO methods were quicker than TUM methods, and spherical methods were quicker than planar methods. For all normalization techniques, inter-reader reproducibility and intra-reader repeatability were excellent (intraclass correlation coefficient > 0.9), and the IDH-status predictive performance remained similar. CONCLUSION The selected NAWM region significantly impacts nrCBV and nADC values. CSO methods, particularly CSOs, may be preferred because of time reduction, similar reader variability, and similar diagnostic performance compared to TUM methods.
Collapse
Affiliation(s)
- Nicholas S Cho
- Department of Radiological Sciences, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA
- UCLA Brain Tumor Imaging Laboratory (BTIL), Center for Computer Vision and Imaging Biomarkers, University of California, Los Angeles, Los Angeles, CA, USA
- Department of Bioengineering, Henry Samueli School of Engineering and Applied Science, University of California, Los Angeles, Los Angeles, CA, USA
- Medical Scientist Training Program, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA
| | - Akifumi Hagiwara
- Department of Radiological Sciences, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA
- UCLA Brain Tumor Imaging Laboratory (BTIL), Center for Computer Vision and Imaging Biomarkers, University of California, Los Angeles, Los Angeles, CA, USA
- Department of Radiology, Juntendo University School of Medicine, Tokyo, Japan
| | - Francesco Sanvito
- Department of Radiological Sciences, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA
- UCLA Brain Tumor Imaging Laboratory (BTIL), Center for Computer Vision and Imaging Biomarkers, University of California, Los Angeles, Los Angeles, CA, USA
- Unit of Radiology, Department of Clinical, Surgical, Diagnostic, and Pediatric Sciences, University of Pavia, Pavia, Italy
| | - Benjamin M Ellingson
- Department of Radiological Sciences, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA.
- UCLA Brain Tumor Imaging Laboratory (BTIL), Center for Computer Vision and Imaging Biomarkers, University of California, Los Angeles, Los Angeles, CA, USA.
- Department of Bioengineering, Henry Samueli School of Engineering and Applied Science, University of California, Los Angeles, Los Angeles, CA, USA.
- Department of Neurosurgery, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA.
- Department of Psychiatry and Biobehavioral Sciences, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA.
| |
Collapse
|
27
|
Ma X, Xia L, Chen J, Wan W, Zhou W. Development and validation of a deep learning signature for predicting lymph node metastasis in lung adenocarcinoma: comparison with radiomics signature and clinical-semantic model. Eur Radiol 2023; 33:1949-1962. [PMID: 36169691 DOI: 10.1007/s00330-022-09153-z] [Citation(s) in RCA: 17] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2022] [Revised: 07/23/2022] [Accepted: 09/08/2022] [Indexed: 11/04/2022]
Abstract
OBJECTIVE To develop and validate a deep learning (DL) signature for predicting lymph node (LN) metastasis in patients with lung adenocarcinoma. METHODS A total of 612 patients with pathologically-confirmed lung adenocarcinoma were retrospectively enrolled and were randomly divided into training cohort (n = 489) and internal validation cohort (n = 123). Besides, 108 patients were enrolled and constituted an independent test cohort (n = 108). Patients' clinical characteristics and CT semantic features were collected. The radiomics features were derived from contrast-enhanced CT images. The clinical-semantic model and radiomics signature were built to predict LN metastasis. Furthermore, Swin Transformer was adopted to develop a DL signature predictive of LN metastasis. Model performance was evaluated by area under the receiver operating characteristic curve (AUC), sensitivity, specificity, calibration curve, and decision curve analysis. The comparisons of AUC were conducted by the DeLong test. RESULTS The proposed DL signature yielded an AUC of 0.948-0.961 across all three cohorts, significantly superior to both clinical-semantic model and radiomics signature (all p < 0.05). The calibration curves show that DL signature predicted probabilities fit well the actual observed probabilities of LN metastasis. DL signature gained a higher net benefit than both clinical-semantic model and radiomics signature. The incorporation of radiomics signature or clinical-semantic risk predictors failed to reveal an incremental value over the DL signature. CONCLUSIONS The proposed DL signature based on Swin Transformer achieved a promising performance in predicting LN metastasis and could confer important information in noninvasive mediastinal LN staging and individualized therapeutic options. KEY POINTS • Accurate prediction for lymph node metastasis is crucial to formulate individualized therapeutic options for patients with lung adenocarcinoma. • The deep learning signature yielded an AUC of 0.948-0.961 across all three cohorts in predicting lymph node metastasis, superior to both radiomics signature and clinical-semantic model. • The incorporation of radiomics signature or clinical-semantic risk predictors into deep learning signature failed to reveal an incremental value over deep learning signature.
Collapse
Affiliation(s)
- Xiaoling Ma
- Medical Imaging Center, People's Hospital of Ningxia Hui Autonomous Region, Yinchuan, China
| | - Liming Xia
- Department of Radiology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, 1095 Jiefang Road, Qiaokou District, Wuhan, 430030, Hubei, China.
| | | | - Weijia Wan
- Department of Radiology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, 1095 Jiefang Road, Qiaokou District, Wuhan, 430030, Hubei, China
| | - Wen Zhou
- Department of Radiology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, 1095 Jiefang Road, Qiaokou District, Wuhan, 430030, Hubei, China
| |
Collapse
|
28
|
Wichtmann BD, Harder FN, Weiss K, Schönberg SO, Attenberger UI, Alkadhi H, Pinto Dos Santos D, Baeßler B. Influence of Image Processing on Radiomic Features From Magnetic Resonance Imaging. Invest Radiol 2023; 58:199-208. [PMID: 36070524 DOI: 10.1097/rli.0000000000000921] [Citation(s) in RCA: 20] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
OBJECTIVE Before implementing radiomics in routine clinical practice, comprehensive knowledge about the repeatability and reproducibility of radiomic features is required. The aim of this study was to systematically investigate the influence of image processing parameters on radiomic features from magnetic resonance imaging (MRI) in terms of feature values as well as test-retest repeatability. MATERIALS AND METHODS Utilizing a phantom consisting of 4 onions, 4 limes, 4 kiwifruits, and 4 apples, we acquired a test-retest dataset featuring 3 of the most commonly used MRI sequences on a 3 T scanner, namely, a T1-weighted, a T2-weighted, and a fluid-attenuated inversion recovery sequence, each at high and low resolution. After semiautomatic image segmentation, image processing with systematic variation of image processing parameters was performed, including spatial resampling, intensity discretization, and intensity rescaling. For each respective image processing setting, a total of 45 radiomic features were extracted, corresponding to the following 7 matrices/feature classes: conventional indices, histogram matrix, shape matrix, gray-level zone length matrix, gray-level run length matrix, neighboring gray-level dependence matrix, and gray-level cooccurrence matrix. Systematic differences of individual features between different resampling steps were assessed using 1-way analysis of variance with Tukey-type post hoc comparisons to adjust for multiple testing. Test-retest repeatability of radiomic features was measured using the concordance correlation coefficient, dynamic range, and intraclass correlation coefficient. RESULTS Image processing influenced radiological feature values. Regardless of the acquired sequence and feature class, significant differences ( P < 0.05) in feature values were found when the size of the resampled voxels was too large, that is, bigger than 3 mm. Almost all higher-order features depended strongly on intensity discretization. The effects of intensity rescaling were negligible except for some features derived from T1-weighted sequences. For all sequences, the percentage of repeatable features (concordance correlation coefficient and dynamic range ≥ 0.9) varied considerably depending on the image processing settings. The optimal image processing setting to achieve the highest percentage of stable features varied per sequence. Irrespective of image processing, the fluid-attenuated inversion recovery sequence in high-resolution overall yielded the highest number of stable features in comparison with the other sequences (89% vs 64%-78% for the respective optimal image processing settings). Across all sequences, the most repeatable features were generally obtained for a spatial resampling close to the originally acquired voxel size and an intensity discretization to at least 32 bins. CONCLUSION Variation of image processing parameters has a significant impact on the values of radiomic features as well as their repeatability. Furthermore, the optimal image processing parameters differ for each MRI sequence. Therefore, it is recommended that these processing parameters be determined in corresponding test-retest scans before clinical application. Extensive repeatability, reproducibility, and validation studies as well as standardization are required before quantitative image analysis and radiomics can be reliably translated into routine clinical care.
Collapse
Affiliation(s)
- Barbara D Wichtmann
- From the Department of Diagnostic and Interventional Radiology, University Hospital Bonn, Bonn, Germany
| | - Felix N Harder
- Institute of Diagnostic and Interventional Radiology, Technical University of Munich, School of Medicine, Munich, Germany
| | | | - Stefan O Schönberg
- Department of Radiology and Nuclear Medicine, University Medical Center Mannheim, Germany
| | - Ulrike I Attenberger
- From the Department of Diagnostic and Interventional Radiology, University Hospital Bonn, Bonn, Germany
| | - Hatem Alkadhi
- Institute of Diagnostic and Interventional Radiology, University Hospital Zurich, University of Zurich, Switzerland
| | | | | |
Collapse
|
29
|
Piri R, Hamakan Y, Vang A, Edenbrandt L, Larsson M, Enqvist O, Gerke O, Høilund-Carlsen PF. Common carotid segmentation in 18 F-sodium fluoride PET/CT scans: Head-to-head comparison of artificial intelligence-based and manual method. Clin Physiol Funct Imaging 2023; 43:71-77. [PMID: 36331059 PMCID: PMC10100011 DOI: 10.1111/cpf.12793] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2022] [Revised: 10/06/2022] [Accepted: 10/14/2022] [Indexed: 11/06/2022]
Abstract
BACKGROUND Carotid atherosclerosis is a major cause of stroke, traditionally diagnosed late. Positron emission tomography/computed tomography (PET/CT) with 18 F-sodium fluoride (NaF) detects arterial wall micro-calcification long before macro-calcification becomes detectable by ultrasound, CT or magnetic resonance imaging. However, manual PET/CT processing is time-consuming and requires experience. We compared a convolutional neural network (CNN) approach with manual segmentation of the common carotids. METHODS Segmentation in NaF-PET/CT scans of 29 healthy volunteers and 20 angina pectoris patients were compared for segmented volume (Vol) and mean, maximal, and total standardized uptake values (SUVmean, SUVmax, and SUVtotal). SUVmean was the average of SUVmeans within the VOI, SUVmax the highest SUV in all voxels in the VOI, and SUVtotal the SUVmean multiplied by the Vol of the VOI. Intra and Interobserver variability with manual segmentation was examined in 25 randomly selected scans. RESULTS Bias for Vol, SUVmean, SUVmax, and SUVtotal were 1.33 ± 2.06, -0.01 ± 0.05, 0.09 ± 0.48, and 1.18 ± 1.99 in the left and 1.89 ± 1.5, -0.07 ± 0.12, 0.05 ± 0.47, and 1.61 ± 1.47, respectively, in the right common carotid artery. Manual segmentation lasted typically 20 min versus 1 min with the CNN-based approach. Mean Vol deviation at repeat manual segmentation was 14% and 27% in left and right common carotids. CONCLUSIONS CNN-based segmentation was much faster and provided SUVmean values virtually identical to manually obtained ones, suggesting CNN-based analysis as a promising substitute of slow and cumbersome manual processing.
Collapse
Affiliation(s)
- Reza Piri
- Department of Nuclear Medicine, Odense University Hospital, Odense, Denmark.,Department of Clinical Research, University of Southern Denmark, Odense, Denmark
| | - Yaran Hamakan
- Department of Nuclear Medicine, Odense University Hospital, Odense, Denmark
| | - Ask Vang
- Department of Nuclear Medicine, Odense University Hospital, Odense, Denmark
| | - Lars Edenbrandt
- Department of Molecular and Clinical Medicine, Institute of Medicine, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden.,Department of Clinical Physiology, Region Västra Götaland, Sahlgrenska University Hospital, Gothenburg, Sweden
| | | | - Olof Enqvist
- Eigenvision AB, Malmö, Sweden.,Department of Electrical Engineering, Chalmers University of Technology, Gothenburg, Sweden
| | - Oke Gerke
- Department of Nuclear Medicine, Odense University Hospital, Odense, Denmark.,Department of Clinical Research, University of Southern Denmark, Odense, Denmark
| | - Poul Flemming Høilund-Carlsen
- Department of Nuclear Medicine, Odense University Hospital, Odense, Denmark.,Department of Clinical Research, University of Southern Denmark, Odense, Denmark
| |
Collapse
|
30
|
Machine Learning Based on Computed Tomography Pulmonary Angiography in Evaluating Pulmonary Artery Pressure in Patients with Pulmonary Hypertension. J Clin Med 2023; 12:jcm12041297. [PMID: 36835832 PMCID: PMC9962514 DOI: 10.3390/jcm12041297] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2022] [Revised: 01/20/2023] [Accepted: 02/02/2023] [Indexed: 02/10/2023] Open
Abstract
BACKGROUND Right heart catheterization is the gold standard for evaluating hemodynamic parameters of pulmonary circulation, especially pulmonary artery pressure (PAP) for diagnosis of pulmonary hypertension (PH). However, the invasive and costly nature of RHC limits its widespread application in daily practice. PURPOSE To develop a fully automatic framework for PAP assessment via machine learning based on computed tomography pulmonary angiography (CTPA). MATERIALS AND METHODS A machine learning model was developed to automatically extract morphological features of pulmonary artery and the heart on CTPA cases collected between June 2017 and July 2021 based on a single center experience. Patients with PH received CTPA and RHC examinations within 1 week. The eight substructures of pulmonary artery and heart were automatically segmented through our proposed segmentation framework. Eighty percent of patients were used for the training data set and twenty percent for the independent testing data set. PAP parameters, including mPAP, sPAP, dPAP, and TPR, were defined as ground-truth. A regression model was built to predict PAP parameters and a classification model to separate patients through mPAP and sPAP with cut-off values of 40 mm Hg and 55 mm Hg in PH patients, respectively. The performances of the regression model and the classification model were evaluated by analyzing the intraclass correlation coefficient (ICC) and the area under the receiver operating characteristic curve (AUC). RESULTS Study participants included 55 patients with PH (men 13; age 47.75 ± 14.87 years). The average dice score for segmentation increased from 87.3% ± 2.9 to 88.2% ± 2.9 through proposed segmentation framework. After features extraction, some of the AI automatic extractions (AAd, RVd, LAd, and RPAd) achieved good consistency with the manual measurements. The differences between them were not statistically significant (t = 1.222, p = 0.227; t = -0.347, p = 0.730; t = 0.484, p = 0.630; t = -0.320, p = 0.750, respectively). The Spearman test was used to find key features which are highly correlated with PAP parameters. Correlations between pulmonary artery pressure and CTPA features show a high correlation between mPAP and LAd, LVd, LAa (r = 0.333, p = 0.012; r = -0.400, p = 0.002; r = -0.208, p = 0.123; r = -0.470, p = 0.000; respectively). The ICC between the output of the regression model and the ground-truth from RHC of mPAP, sPAP, and dPAP were 0.934, 0.903, and 0.981, respectively. The AUC of the receiver operating characteristic curve of the classification model of mPAP and sPAP were 0.911 and 0.833. CONCLUSIONS The proposed machine learning framework on CTPA enables accurate segmentation of pulmonary artery and heart and automatic assessment of the PAP parameters and has the ability to accurately distinguish different PH patients with mPAP and sPAP. Results of this study may provide additional risk stratification indicators in the future with non-invasive CTPA data.
Collapse
|
31
|
Belue MJ, Harmon SA, Lay NS, Daryanani A, Phelps TE, Choyke PL, Turkbey B. The Low Rate of Adherence to Checklist for Artificial Intelligence in Medical Imaging Criteria Among Published Prostate MRI Artificial Intelligence Algorithms. J Am Coll Radiol 2023; 20:134-145. [PMID: 35922018 PMCID: PMC9887098 DOI: 10.1016/j.jacr.2022.05.022] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2022] [Revised: 05/13/2022] [Accepted: 05/18/2022] [Indexed: 02/02/2023]
Abstract
OBJECTIVE To determine the rigor, generalizability, and reproducibility of published classification and detection artificial intelligence (AI) models for prostate cancer (PCa) on MRI using the Checklist for Artificial Intelligence in Medical Imaging (CLAIM) guidelines, a 42-item checklist that is considered a measure of best practice for presenting and reviewing medical imaging AI research. MATERIALS AND METHODS This review searched English literature for studies proposing PCa AI detection and classification models on MRI. Each study was evaluated with the CLAIM checklist. The additional outcomes for which data were sought included measures of AI model performance (eg, area under the curve [AUC], sensitivity, specificity, free-response operating characteristic curves), training and validation and testing group sample size, AI approach, detection versus classification AI, public data set utilization, MRI sequences used, and definition of gold standard for ground truth. The percentage of CLAIM checklist fulfillment was used to stratify studies into quartiles. Wilcoxon's rank-sum test was used for pair-wise comparisons. RESULTS In all, 75 studies were identified, and 53 studies qualified for analysis. The original CLAIM items that most studies did not fulfill includes item 12 (77% no): de-identification methods; item 13 (68% no): handling missing data; item 15 (47% no): rationale for choosing ground truth reference standard; item 18 (55% no): measurements of inter- and intrareader variability; item 31 (60% no): inclusion of validated interpretability maps; item 37 (92% no): inclusion of failure analysis to elucidate AI model weaknesses. An AUC score versus percentage CLAIM fulfillment quartile revealed a significant difference of the mean AUC scores between quartile 1 versus quartile 2 (0.78 versus 0.86, P = .034) and quartile 1 versus quartile 4 (0.78 versus 0.89, P = .003) scores. Based on additional information and outcome metrics gathered in this study, additional measures of best practice are defined. These new items include disclosure of public dataset usage, ground truth definition in comparison to other referenced works in the defined task, and sample size power calculation. CONCLUSION A large proportion of AI studies do not fulfill key items in CLAIM guidelines within their methods and results sections. The percentage of CLAIM checklist fulfillment is weakly associated with improved AI model performance. Additions or supplementations to CLAIM are recommended to improve publishing standards and aid reviewers in determining study rigor.
Collapse
Affiliation(s)
- Mason J Belue
- Medical Research Scholars Program Fellow, Artificial Intelligence Resource, Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland
| | - Stephanie A Harmon
- Staff Scientist, Artificial Intelligence Resource, Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland
| | - Nathan S Lay
- Staff Scientist, Artificial Intelligence Resource, Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland
| | - Asha Daryanani
- Intramural Research Training Program Fellow, Artificial Intelligence Resource, Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland
| | - Tim E Phelps
- Postdoctoral Fellow, Artificial Intelligence Resource, Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland
| | - Peter L Choyke
- Artificial Intelligence Resource, Chief of Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland
| | - Baris Turkbey
- Senior Clinician/Director, Artificial Intelligence Resource, Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland.
| |
Collapse
|
32
|
Hadjiiski L, Cha K, Chan HP, Drukker K, Morra L, Näppi JJ, Sahiner B, Yoshida H, Chen Q, Deserno TM, Greenspan H, Huisman H, Huo Z, Mazurchuk R, Petrick N, Regge D, Samala R, Summers RM, Suzuki K, Tourassi G, Vergara D, Armato SG. AAPM task group report 273: Recommendations on best practices for AI and machine learning for computer-aided diagnosis in medical imaging. Med Phys 2023; 50:e1-e24. [PMID: 36565447 DOI: 10.1002/mp.16188] [Citation(s) in RCA: 19] [Impact Index Per Article: 19.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2022] [Revised: 11/13/2022] [Accepted: 11/22/2022] [Indexed: 12/25/2022] Open
Abstract
Rapid advances in artificial intelligence (AI) and machine learning, and specifically in deep learning (DL) techniques, have enabled broad application of these methods in health care. The promise of the DL approach has spurred further interest in computer-aided diagnosis (CAD) development and applications using both "traditional" machine learning methods and newer DL-based methods. We use the term CAD-AI to refer to this expanded clinical decision support environment that uses traditional and DL-based AI methods. Numerous studies have been published to date on the development of machine learning tools for computer-aided, or AI-assisted, clinical tasks. However, most of these machine learning models are not ready for clinical deployment. It is of paramount importance to ensure that a clinical decision support tool undergoes proper training and rigorous validation of its generalizability and robustness before adoption for patient care in the clinic. To address these important issues, the American Association of Physicists in Medicine (AAPM) Computer-Aided Image Analysis Subcommittee (CADSC) is charged, in part, to develop recommendations on practices and standards for the development and performance assessment of computer-aided decision support systems. The committee has previously published two opinion papers on the evaluation of CAD systems and issues associated with user training and quality assurance of these systems in the clinic. With machine learning techniques continuing to evolve and CAD applications expanding to new stages of the patient care process, the current task group report considers the broader issues common to the development of most, if not all, CAD-AI applications and their translation from the bench to the clinic. The goal is to bring attention to the proper training and validation of machine learning algorithms that may improve their generalizability and reliability and accelerate the adoption of CAD-AI systems for clinical decision support.
Collapse
Affiliation(s)
- Lubomir Hadjiiski
- Department of Radiology, University of Michigan, Ann Arbor, Michigan, USA
| | - Kenny Cha
- U.S. Food and Drug Administration, Silver Spring, Maryland, USA
| | - Heang-Ping Chan
- Department of Radiology, University of Michigan, Ann Arbor, Michigan, USA
| | - Karen Drukker
- Department of Radiology, University of Chicago, Chicago, Illinois, USA
| | - Lia Morra
- Department of Control and Computer Engineering, Politecnico di Torino, Torino, Italy
| | - Janne J Näppi
- 3D Imaging Research, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Boston, Massachusetts, USA
| | - Berkman Sahiner
- U.S. Food and Drug Administration, Silver Spring, Maryland, USA
| | - Hiroyuki Yoshida
- 3D Imaging Research, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Boston, Massachusetts, USA
| | - Quan Chen
- Department of Radiation Medicine, University of Kentucky, Lexington, Kentucky, USA
| | - Thomas M Deserno
- Peter L. Reichertz Institute for Medical Informatics of TU Braunschweig and Hannover Medical School, Braunschweig, Germany
| | - Hayit Greenspan
- Department of Biomedical Engineering, Faculty of Engineering, Tel Aviv, Israel & Department of Radiology, Ichan School of Medicine, Tel Aviv University, Mt Sinai, New York, New York, USA
| | - Henkjan Huisman
- Radboud Institute for Health Sciences, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Zhimin Huo
- Tencent America, Palo Alto, California, USA
| | - Richard Mazurchuk
- Division of Cancer Prevention, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, USA
| | | | - Daniele Regge
- Radiology Unit, Candiolo Cancer Institute, FPO-IRCCS, Candiolo, Italy.,Department of Surgical Sciences, University of Turin, Turin, Italy
| | - Ravi Samala
- U.S. Food and Drug Administration, Silver Spring, Maryland, USA
| | - Ronald M Summers
- Radiology and Imaging Sciences, National Institutes of Health Clinical Center, Bethesda, Maryland, USA
| | - Kenji Suzuki
- Institute of Innovative Research, Tokyo Institute of Technology, Tokyo, Japan
| | | | - Daniel Vergara
- Department of Radiology, Yale New Haven Hospital, New Haven, Connecticut, USA
| | - Samuel G Armato
- Department of Radiology, University of Chicago, Chicago, Illinois, USA
| |
Collapse
|
33
|
Stamoulou E, Spanakis C, Manikis GC, Karanasiou G, Grigoriadis G, Foukakis T, Tsiknakis M, Fotiadis DI, Marias K. Harmonization Strategies in Multicenter MRI-Based Radiomics. J Imaging 2022; 8:303. [PMID: 36354876 PMCID: PMC9695920 DOI: 10.3390/jimaging8110303] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2022] [Revised: 10/28/2022] [Accepted: 10/31/2022] [Indexed: 08/13/2023] Open
Abstract
Radiomics analysis is a powerful tool aiming to provide diagnostic and prognostic patient information directly from images that are decoded into handcrafted features, comprising descriptors of shape, size and textural patterns. Although radiomics is gaining momentum since it holds great promise for accelerating digital diagnostics, it is susceptible to bias and variation due to numerous inter-patient factors (e.g., patient age and gender) as well as inter-scanner ones (different protocol acquisition depending on the scanner center). A variety of image and feature based harmonization methods has been developed to compensate for these effects; however, to the best of our knowledge, none of these techniques has been established as the most effective in the analysis pipeline so far. To this end, this review provides an overview of the challenges in optimizing radiomics analysis, and a concise summary of the most relevant harmonization techniques, aiming to provide a thorough guide to the radiomics harmonization process.
Collapse
Affiliation(s)
- Elisavet Stamoulou
- Computational BioMedicine Laboratory (CBML), Foundation for Research and Technology—Hellas (FORTH), 700 13 Heraklion, Greece
| | - Constantinos Spanakis
- Computational BioMedicine Laboratory (CBML), Foundation for Research and Technology—Hellas (FORTH), 700 13 Heraklion, Greece
| | - Georgios C. Manikis
- Computational BioMedicine Laboratory (CBML), Foundation for Research and Technology—Hellas (FORTH), 700 13 Heraklion, Greece
- Department of Oncology-Pathology, Karolinska Institutet, 171 77 Stockholm, Sweden
| | - Georgia Karanasiou
- Unit of Medical Technology and Intelligent Information Systems, Department of Materials Science and Engineering, University of Ioannina, 451 10 Ioannina, Greece
| | - Grigoris Grigoriadis
- Unit of Medical Technology and Intelligent Information Systems, Department of Materials Science and Engineering, University of Ioannina, 451 10 Ioannina, Greece
| | - Theodoros Foukakis
- Department of Oncology-Pathology, Karolinska Institutet, 171 77 Stockholm, Sweden
| | - Manolis Tsiknakis
- Computational BioMedicine Laboratory (CBML), Foundation for Research and Technology—Hellas (FORTH), 700 13 Heraklion, Greece
- Department of Electrical & Computer Engineering, Hellenic Mediterranean University, 714 10 Heraklion, Greece
| | - Dimitrios I. Fotiadis
- Unit of Medical Technology and Intelligent Information Systems, Department of Materials Science and Engineering, University of Ioannina, 451 10 Ioannina, Greece
- Department of Biomedical Research, Institute of Molecular Biology and Biotechnology—FORTH, University Campus of Ioannina, 451 15 Ioannina, Greece
| | - Kostas Marias
- Computational BioMedicine Laboratory (CBML), Foundation for Research and Technology—Hellas (FORTH), 700 13 Heraklion, Greece
- Department of Electrical & Computer Engineering, Hellenic Mediterranean University, 714 10 Heraklion, Greece
| |
Collapse
|
34
|
Artificial intelligence and machine learning in cancer imaging. COMMUNICATIONS MEDICINE 2022; 2:133. [PMID: 36310650 PMCID: PMC9613681 DOI: 10.1038/s43856-022-00199-0] [Citation(s) in RCA: 73] [Impact Index Per Article: 36.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2020] [Accepted: 10/06/2022] [Indexed: 11/16/2022] Open
Abstract
An increasing array of tools is being developed using artificial intelligence (AI) and machine learning (ML) for cancer imaging. The development of an optimal tool requires multidisciplinary engagement to ensure that the appropriate use case is met, as well as to undertake robust development and testing prior to its adoption into healthcare systems. This multidisciplinary review highlights key developments in the field. We discuss the challenges and opportunities of AI and ML in cancer imaging; considerations for the development of algorithms into tools that can be widely used and disseminated; and the development of the ecosystem needed to promote growth of AI and ML in cancer imaging.
Collapse
|
35
|
Velasco C, Fletcher TJ, Botnar RM, Prieto C. Artificial intelligence in cardiac magnetic resonance fingerprinting. Front Cardiovasc Med 2022; 9:1009131. [PMID: 36204566 PMCID: PMC9530662 DOI: 10.3389/fcvm.2022.1009131] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2022] [Accepted: 08/30/2022] [Indexed: 11/13/2022] Open
Abstract
Magnetic resonance fingerprinting (MRF) is a fast MRI-based technique that allows for multiparametric quantitative characterization of the tissues of interest in a single acquisition. In particular, it has gained attention in the field of cardiac imaging due to its ability to provide simultaneous and co-registered myocardial T1 and T2 mapping in a single breath-held cardiac MRF scan, in addition to other parameters. Initial results in small healthy subject groups and clinical studies have demonstrated the feasibility and potential of MRF imaging. Ongoing research is being conducted to improve the accuracy, efficiency, and robustness of cardiac MRF. However, these improvements usually increase the complexity of image reconstruction and dictionary generation and introduce the need for sequence optimization. Each of these steps increase the computational demand and processing time of MRF. The latest advances in artificial intelligence (AI), including progress in deep learning and the development of neural networks for MRI, now present an opportunity to efficiently address these issues. Artificial intelligence can be used to optimize candidate sequences and reduce the memory demand and computational time required for reconstruction and post-processing. Recently, proposed machine learning-based approaches have been shown to reduce dictionary generation and reconstruction times by several orders of magnitude. Such applications of AI should help to remove these bottlenecks and speed up cardiac MRF, improving its practical utility and allowing for its potential inclusion in clinical routine. This review aims to summarize the latest developments in artificial intelligence applied to cardiac MRF. Particularly, we focus on the application of machine learning at different steps of the MRF process, such as sequence optimization, dictionary generation and image reconstruction.
Collapse
Affiliation(s)
- Carlos Velasco
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
- *Correspondence: Carlos Velasco
| | - Thomas J. Fletcher
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
| | - René M. Botnar
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
- Institute for Biological and Medical Engineering, Pontificia Universidad Católica de Chile, Santiago, Chile
- Millennium Institute for Intelligent Healthcare Engineering, Santiago, Chile
| | - Claudia Prieto
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
- Institute for Biological and Medical Engineering, Pontificia Universidad Católica de Chile, Santiago, Chile
- Millennium Institute for Intelligent Healthcare Engineering, Santiago, Chile
| |
Collapse
|
36
|
Jensen LJ, Kim D, Elgeti T, Steffen IG, Schaafs LA, Hamm B, Nagel SN. Enhancing the stability of CT radiomics across different volume of interest sizes using parametric feature maps: a phantom study. Eur Radiol Exp 2022; 6:43. [PMID: 36104519 PMCID: PMC9474978 DOI: 10.1186/s41747-022-00297-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2022] [Accepted: 07/05/2022] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND In radiomics studies, differences in the volume of interest (VOI) are often inevitable and may confound the extracted features. We aimed to correct this confounding effect of VOI variability by applying parametric maps with a fixed voxel size. METHODS Ten scans of a cup filled with sodium chloride solution were scanned using a multislice computed tomography (CT) unit. Sphere-shaped VOIs with different diameters (4, 8, or 16 mm) were drawn centrally into the phantom. A total of 93 features were extracted conventionally from the original images using PyRadiomics. Using a self-designed and pretested software tool, parametric maps for the same 93 features with a fixed voxel size of 4 mm3 were created. To retrieve the feature values from the maps, VOIs were copied from the original images to preserve the position. Differences in feature quantities between the VOI sizes were tested with the Mann-Whitney U-test and agreement with overall concordance correlation coefficients (OCCC). RESULTS Fifty-five conventionally extracted features were significantly different between the VOI sizes, and none of the features showed excellent agreement in terms of OCCCs. When read from the parametric maps, only 8 features showed significant differences, and 3 features showed an excellent OCCC (≥ 0.85). The OCCCs for 89 features substantially increased using the parametric maps. CONCLUSIONS This phantom study shows that converting CT images into parametric maps resolves the confounding effect of VOI variability and increases feature reproducibility across VOI sizes.
Collapse
Affiliation(s)
- Laura J Jensen
- Klinik für Radiologie, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt- Universität zu Berlin, Hindenburgdamm 30, 12203, Berlin, Germany.
| | - Damon Kim
- Klinik für Radiologie, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt- Universität zu Berlin, Hindenburgdamm 30, 12203, Berlin, Germany.
| | - Thomas Elgeti
- Klinik für Radiologie, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt- Universität zu Berlin, Hindenburgdamm 30, 12203, Berlin, Germany
| | - Ingo G Steffen
- Klinik für Radiologie, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt- Universität zu Berlin, Hindenburgdamm 30, 12203, Berlin, Germany
| | - Lars-Arne Schaafs
- Klinik für Radiologie, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt- Universität zu Berlin, Hindenburgdamm 30, 12203, Berlin, Germany
| | - Bernd Hamm
- Klinik für Radiologie, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt- Universität zu Berlin, Hindenburgdamm 30, 12203, Berlin, Germany
| | - Sebastian N Nagel
- Klinik für Radiologie, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt- Universität zu Berlin, Hindenburgdamm 30, 12203, Berlin, Germany
| |
Collapse
|
37
|
Zhang KS, Schelb P, Netzer N, Tavakoli AA, Keymling M, Wehrse E, Hog R, Rotkopf LT, Wennmann M, Glemser PA, Thierjung H, von Knebel Doeberitz N, Kleesiek J, Görtz M, Schütz V, Hielscher T, Stenzinger A, Hohenfellner M, Schlemmer HP, Maier-Hein K, Bonekamp D. Pseudoprospective Paraclinical Interaction of Radiology Residents With a Deep Learning System for Prostate Cancer Detection: Experience, Performance, and Identification of the Need for Intermittent Recalibration. Invest Radiol 2022; 57:601-612. [PMID: 35467572 DOI: 10.1097/rli.0000000000000878] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
OBJECTIVES The aim of this study was to estimate the prospective utility of a previously retrospectively validated convolutional neural network (CNN) for prostate cancer (PC) detection on prostate magnetic resonance imaging (MRI). MATERIALS AND METHODS The biparametric (T2-weighted and diffusion-weighted) portion of clinical multiparametric prostate MRI from consecutive men included between November 2019 and September 2020 was fully automatically and individually analyzed by a CNN briefly after image acquisition (pseudoprospective design). Radiology residents performed 2 research Prostate Imaging Reporting and Data System (PI-RADS) assessments of the multiparametric dataset independent from clinical reporting (paraclinical design) before and after review of the CNN results and completed a survey. Presence of clinically significant PC was determined by the presence of an International Society of Urological Pathology grade 2 or higher PC on combined targeted and extended systematic transperineal MRI/transrectal ultrasound fusion biopsy. Sensitivities and specificities on a patient and prostate sextant basis were compared using the McNemar test and compared with the receiver operating characteristic (ROC) curve of CNN. Survey results were summarized as absolute counts and percentages. RESULTS A total of 201 men were included. The CNN achieved an ROC area under the curve of 0.77 on a patient basis. Using PI-RADS ≥3-emulating probability threshold (c3), CNN had a patient-based sensitivity of 81.8% and specificity of 54.8%, not statistically different from the current clinical routine PI-RADS ≥4 assessment at 90.9% and 54.8%, respectively ( P = 0.30/ P = 1.0). In general, residents achieved similar sensitivity and specificity before and after CNN review. On a prostate sextant basis, clinical assessment possessed the highest ROC area under the curve of 0.82, higher than CNN (AUC = 0.76, P = 0.21) and significantly higher than resident performance before and after CNN review (AUC = 0.76 / 0.76, P ≤ 0.03). The resident survey indicated CNN to be helpful and clinically useful. CONCLUSIONS Pseudoprospective paraclinical integration of fully automated CNN-based detection of suspicious lesions on prostate multiparametric MRI was demonstrated and showed good acceptance among residents, whereas no significant improvement in resident performance was found. General CNN performance was preserved despite an observed shift in CNN calibration, identifying the requirement for continuous quality control and recalibration.
Collapse
Affiliation(s)
- Kevin Sun Zhang
- From the Division of Radiology, German Cancer Research Center (DKFZ)
| | | | | | | | - Myriam Keymling
- From the Division of Radiology, German Cancer Research Center (DKFZ)
| | - Eckhard Wehrse
- From the Division of Radiology, German Cancer Research Center (DKFZ)
| | - Robert Hog
- From the Division of Radiology, German Cancer Research Center (DKFZ)
| | | | - Markus Wennmann
- From the Division of Radiology, German Cancer Research Center (DKFZ)
| | | | - Heidi Thierjung
- From the Division of Radiology, German Cancer Research Center (DKFZ)
| | | | | | | | - Viktoria Schütz
- Department of Urology, University of Heidelberg Medical Center
| | | | | | | | | | | | | |
Collapse
|
38
|
Ye S, Lim JY, Huang W. Statistical considerations for repeatability and reproducibility of quantitative imaging biomarkers. BJR Open 2022; 4:20210083. [PMID: 36452056 PMCID: PMC9667479 DOI: 10.1259/bjro.20210083] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2021] [Revised: 07/25/2022] [Accepted: 07/26/2022] [Indexed: 11/05/2022] Open
Abstract
Quantitative imaging biomarkers (QIBs) are increasingly used in clinical studies. Because many QIBs are derived through multiple steps in image data acquisition and data analysis, QIB measurements can produce large variabilities, posing a significant challenge in translating QIBs into clinical trials, and ultimately, clinical practice. Both repeatability and reproducibility constitute the reliability of a QIB measurement. In this article, we review the statistical aspects of repeatability and reproducibility of QIB measurements by introducing methods and metrics for assessments of QIB repeatability and reproducibility and illustrating the impact of QIB measurement error on sample size and statistical power calculations, as well as predictive performance with a QIB as a predictive biomarker.
Collapse
Affiliation(s)
- Shangyuan Ye
- Biostatistics Shared Resource, Knight Cancer Institute, Oregon Health and Science University, Portland, OR, United States
| | - Jeong Youn Lim
- Biostatistics Shared Resource, Knight Cancer Institute, Oregon Health and Science University, Portland, OR, United States
| | - Wei Huang
- Advanced Imaging Research Center, Oregon Health and Science University, Portland, OR, United States
| |
Collapse
|
39
|
Salluzzi M, McCreary CR, Gobbi DG, Lauzon ML, Frayne R. Short-term repeatability and long-term reproducibility of quantitative MR imaging biomarkers in a single centre longitudinal study. Neuroimage 2022; 260:119488. [PMID: 35878725 DOI: 10.1016/j.neuroimage.2022.119488] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2022] [Revised: 06/21/2022] [Accepted: 07/14/2022] [Indexed: 10/16/2022] Open
Abstract
Quantitative imaging biomarkers (QIBs) can be defined as objective measures that are sensitive and specific to changes in tissue physiology. Provided the acquired QIBs are not affected by scanner changes, they could play an important role in disease diagnosis, prognosis, management, and treatment monitoring. The precision of selected QIBs was assessed from data collected on a 3-T scanner in four healthy participants over a 5-year period. Inevitable scanner changes and acquisition protocol revisions occurred during this time. Standard and custom processing pipelines were used to calculate regional brain volume, cortical thickness, T2, T2*, quantitative susceptibility, cerebral blood flow, axial, radial and mean diffusivity, peak width of skeletonized mean diffusivity, and fractional anisotropy from the acquired images. Coefficient of variation (CoV) and intra-class correlation (ICC) indices were determined in the short-term (i.e., repeatable over three acquisitions within 4 weeks) and in the long-term (i.e., reproducible over four acquisition sessions in 5 years). Precision indices varied based on acquisition technique, processing pipeline, and anatomical region. Good repeatability (average CoV=2.40% and ICC=0.78) and reproducibility (average CoV=8.86 % and ICC=0.72) were found over all QIBs. The best performance indices were obtained for diffusion derived biomarkers (CoV∼0.96% and ICCs=0.87); conversely, the poorest indices were found for the cerebral blood flow biomarker (CoV>10% and ICC<0.5). These results demonstrate that changes in protocol, along with hardware and software upgrades, did not affect the estimates of the selected biomarkers and their precision. Further characterization of the QIB is necessary to understand meaningful changes in the biomarkers in longitudinal studies of normal brain aging and translation to clinical research.
Collapse
Affiliation(s)
- Marina Salluzzi
- Departments of Radiology and Clinical Neurosciences, Hotchkiss Brain Institute, University of Calgary, Calgary, Alberta, Canada; Calgary Image Processing and Analysis Centre (CIPAC), Foothills Medical Centre, Calgary, Alberta, Canada.
| | - Cheryl R McCreary
- Departments of Radiology and Clinical Neurosciences, Hotchkiss Brain Institute, University of Calgary, Calgary, Alberta, Canada; Seaman Family MR Research Centre, Foothills Medical Centre, Calgary, Alberta, Canada
| | - David G Gobbi
- Departments of Radiology and Clinical Neurosciences, Hotchkiss Brain Institute, University of Calgary, Calgary, Alberta, Canada; Calgary Image Processing and Analysis Centre (CIPAC), Foothills Medical Centre, Calgary, Alberta, Canada
| | - Michel Louis Lauzon
- Departments of Radiology and Clinical Neurosciences, Hotchkiss Brain Institute, University of Calgary, Calgary, Alberta, Canada; Seaman Family MR Research Centre, Foothills Medical Centre, Calgary, Alberta, Canada
| | - Richard Frayne
- Departments of Radiology and Clinical Neurosciences, Hotchkiss Brain Institute, University of Calgary, Calgary, Alberta, Canada; Seaman Family MR Research Centre, Foothills Medical Centre, Calgary, Alberta, Canada; Calgary Image Processing and Analysis Centre (CIPAC), Foothills Medical Centre, Calgary, Alberta, Canada
| |
Collapse
|
40
|
Hagiwara A, Schlossman J, Shabani S, Raymond C, Tatekawa H, Abrey LE, Garcia J, Chinot O, Saran F, Nishikawa R, Henriksson R, Mason WP, Wick W, Cloughesy TF, Ellingson BM. Incidence, molecular characteristics, and imaging features of “clinically-defined pseudoprogression” in newly diagnosed glioblastoma treated with chemoradiation. J Neurooncol 2022; 159:509-518. [DOI: 10.1007/s11060-022-04088-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2022] [Accepted: 07/02/2022] [Indexed: 11/27/2022]
|
41
|
Trotier AJ, Dilharreguy B, Anandra S, Corbin N, Lefrançois W, Ozenne V, Miraux S, Ribot EJ. The Compressed Sensing MP2RAGE as a Surrogate to the MPRAGE for Neuroimaging at 3 T. Invest Radiol 2022; 57:366-378. [PMID: 35030106 PMCID: PMC9390231 DOI: 10.1097/rli.0000000000000849] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2021] [Accepted: 11/08/2021] [Indexed: 11/26/2022]
Abstract
OBJECTIVES The magnetization-prepared 2 rapid acquisition gradient echo (MP2RAGE) sequence provides quantitative T1 maps in addition to high-contrast morphological images. Advanced acceleration techniques such as compressed sensing (CS) allow its acquisition time to be compatible with clinical applications. To consider its routine use in future neuroimaging protocols, the repeatability of the segmented brain structures was evaluated and compared with the standard morphological sequence (magnetization-prepared rapid gradient echo [MPRAGE]). The repeatability of the T1 measurements was also assessed. MATERIALS AND METHODS Thirteen healthy volunteers were scanned either 3 or 4 times at several days of interval, on a 3 T clinical scanner, with the 2 sequences (CS-MP2RAGE and MPRAGE), set with the same spatial resolution (0.8-mm isotropic) and scan duration (6 minutes 21 seconds). The reconstruction time of the CS-MP2RAGE outputs (including the 2 echo images, the MP2RAGE image, and the T1 map) was 3 minutes 33 seconds, using an open-source in-house algorithm implemented in the Gadgetron framework.Both precision and variability of volume measurements obtained from CAT12 and VolBrain were assessed. The T1 accuracy and repeatability were measured on phantoms and on humans and were compared with literature.Volumes obtained from the CS-MP2RAGE and the MPRAGE images were compared using Student t tests (P < 0.05 was considered significant). RESULTS The CS-MP2RAGE acquisition provided morphological images of the same quality and higher contrasts than the standard MPRAGE images. Similar intravolunteer variabilities were obtained with the CS-MP2RAGE and the MPRAGE segmentations. In addition, high-resolution T1 maps were obtained from the CS-MP2RAGE. T1 times of white and gray matters and several deep gray nuclei are consistent with the literature and show very low variability (<1%). CONCLUSIONS The CS-MP2RAGE can be used in future protocols to rapidly obtain morphological images and quantitative T1 maps in 3-dimensions while maintaining high repeatability in volumetry and relaxation times.
Collapse
Affiliation(s)
- Aurélien J. Trotier
- From the Centre de Résonance Magnétique des Systèmes Biologiques, UMR5536, CNRS/Université de Bordeaux
| | - Bixente Dilharreguy
- Biomedical Imaging Facility (pIBIO), UMS3767, CNRS/Université de Bordeaux, Bordeaux, France
| | - Serge Anandra
- Biomedical Imaging Facility (pIBIO), UMS3767, CNRS/Université de Bordeaux, Bordeaux, France
| | - Nadège Corbin
- From the Centre de Résonance Magnétique des Systèmes Biologiques, UMR5536, CNRS/Université de Bordeaux
- UCL Queen Square Institute of Neurology, Wellcome Centre for Human Neuroimaging, University College of London, London, United Kingdom
| | - William Lefrançois
- From the Centre de Résonance Magnétique des Systèmes Biologiques, UMR5536, CNRS/Université de Bordeaux
| | - Valery Ozenne
- From the Centre de Résonance Magnétique des Systèmes Biologiques, UMR5536, CNRS/Université de Bordeaux
| | - Sylvain Miraux
- From the Centre de Résonance Magnétique des Systèmes Biologiques, UMR5536, CNRS/Université de Bordeaux
| | - Emeline J. Ribot
- From the Centre de Résonance Magnétique des Systèmes Biologiques, UMR5536, CNRS/Université de Bordeaux
| |
Collapse
|
42
|
Dieckhaus H, Meijboom R, Okar S, Wu T, Parvathaneni P, Mina Y, Chandran S, Waldman AD, Reich DS, Nair G. Logistic Regression-Based Model Is More Efficient Than U-Net Model for Reliable Whole Brain Magnetic Resonance Imaging Segmentation. Top Magn Reson Imaging 2022; 31:31-39. [PMID: 35767314 PMCID: PMC9258518 DOI: 10.1097/rmr.0000000000000296] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2022] [Accepted: 05/24/2022] [Indexed: 11/25/2022]
Abstract
OBJECTIVES Automated whole brain segmentation from magnetic resonance images is of great interest for the development of clinically relevant volumetric markers for various neurological diseases. Although deep learning methods have demonstrated remarkable potential in this area, they may perform poorly in nonoptimal conditions, such as limited training data availability. Manual whole brain segmentation is an incredibly tedious process, so minimizing the data set size required for training segmentation algorithms may be of wide interest. The purpose of this study was to compare the performance of the prototypical deep learning segmentation architecture (U-Net) with a previously published atlas-free traditional machine learning method, Classification using Derivative-based Features (C-DEF) for whole brain segmentation, in the setting of limited training data. MATERIALS AND METHODS C-DEF and U-Net models were evaluated after training on manually curated data from 5, 10, and 15 participants in 2 research cohorts: (1) people living with clinically diagnosed HIV infection and (2) relapsing-remitting multiple sclerosis, each acquired at separate institutions, and between 5 and 295 participants' data using a large, publicly available, and annotated data set of glioblastoma and lower grade glioma (brain tumor segmentation). Statistics was performed on the Dice similarity coefficient using repeated-measures analysis of variance and Dunnett-Hsu pairwise comparison. RESULTS C-DEF produced better segmentation than U-Net in lesion (29.2%-38.9%) and cerebrospinal fluid (5.3%-11.9%) classes when trained with data from 15 or fewer participants. Unlike C-DEF, U-Net showed significant improvement when increasing the size of the training data (24%-30% higher than baseline). In the brain tumor segmentation data set, C-DEF produced equivalent or better segmentations than U-Net for enhancing tumor and peritumoral edema regions across all training data sizes explored. However, U-Net was more effective than C-DEF for segmentation of necrotic/non-enhancing tumor when trained on 10 or more participants, probably because of the inconsistent signal intensity of the tissue class. CONCLUSIONS These results demonstrate that classical machine learning methods can produce more accurate brain segmentation than the far more complex deep learning methods when only small or moderate amounts of training data are available (n ≤ 15). The magnitude of this advantage varies by tissue and cohort, while U-Net may be preferable for deep gray matter and necrotic/non-enhancing tumor segmentation, particularly with larger training data sets (n ≥ 20). Given that segmentation models often need to be retrained for application to novel imaging protocols or pathology, the bottleneck associated with large-scale manual annotation could be avoided with classical machine learning algorithms, such as C-DEF.
Collapse
Affiliation(s)
- Henry Dieckhaus
- qMRI Core Facility, NINDS, National Institutes of Health, Bethesda, MD, USA
| | | | - Serhat Okar
- Translational Neuroradiology Section, NINDS, National Institutes of Health, Bethesda, MD, USA
| | - Tianxia Wu
- Clinical Trials Unit, NINDS, National Institutes of Health, Bethesda, MD, USA
| | - Prasanna Parvathaneni
- Translational Neuroradiology Section, NINDS, National Institutes of Health, Bethesda, MD, USA
| | - Yair Mina
- Viral Immunology Section, NINDS, National Institutes of Health, Bethesda, MD, USA
- Sackler Faculty of Medicine, Tel Aviv University, Israel
| | | | - Adam D. Waldman
- Centre for Clinical Brain Sciences, University of Edinburgh, UK
| | - Daniel S. Reich
- Translational Neuroradiology Section, NINDS, National Institutes of Health, Bethesda, MD, USA
| | - Govind Nair
- qMRI Core Facility, NINDS, National Institutes of Health, Bethesda, MD, USA
- Corresponding Author: Govind Nair, Room 5C440, 10 Center Drive, Bethesda MD 20892, ; 301-402-6391
| |
Collapse
|
43
|
Danilevicz MF, Gill M, Anderson R, Batley J, Bennamoun M, Bayer PE, Edwards D. Plant Genotype to Phenotype Prediction Using Machine Learning. Front Genet 2022; 13:822173. [PMID: 35664329 PMCID: PMC9159391 DOI: 10.3389/fgene.2022.822173] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2021] [Accepted: 03/07/2022] [Indexed: 12/13/2022] Open
Abstract
Genomic prediction tools support crop breeding based on statistical methods, such as the genomic best linear unbiased prediction (GBLUP). However, these tools are not designed to capture non-linear relationships within multi-dimensional datasets, or deal with high dimension datasets such as imagery collected by unmanned aerial vehicles. Machine learning (ML) algorithms have the potential to surpass the prediction accuracy of current tools used for genotype to phenotype prediction, due to their capacity to autonomously extract data features and represent their relationships at multiple levels of abstraction. This review addresses the challenges of applying statistical and machine learning methods for predicting phenotypic traits based on genetic markers, environment data, and imagery for crop breeding. We present the advantages and disadvantages of explainable model structures, discuss the potential of machine learning models for genotype to phenotype prediction in crop breeding, and the challenges, including the scarcity of high-quality datasets, inconsistent metadata annotation and the requirements of ML models.
Collapse
Affiliation(s)
- Monica F. Danilevicz
- School of Biological Sciences and Institute of Agriculture, University of Western Australia, Perth, WA, Australia
| | - Mitchell Gill
- School of Biological Sciences and Institute of Agriculture, University of Western Australia, Perth, WA, Australia
| | - Robyn Anderson
- School of Biological Sciences and Institute of Agriculture, University of Western Australia, Perth, WA, Australia
| | - Jacqueline Batley
- School of Biological Sciences and Institute of Agriculture, University of Western Australia, Perth, WA, Australia
| | - Mohammed Bennamoun
- School of Physics, Mathematics and Computing, University of Western Australia, Perth, WA, Australia
| | - Philipp E. Bayer
- School of Biological Sciences and Institute of Agriculture, University of Western Australia, Perth, WA, Australia
| | - David Edwards
- School of Biological Sciences and Institute of Agriculture, University of Western Australia, Perth, WA, Australia
- *Correspondence: David Edwards,
| |
Collapse
|
44
|
Ogier AC, Bustin A, Cochet H, Schwitter J, van Heeswijk RB. The Road Toward Reproducibility of Parametric Mapping of the Heart: A Technical Review. Front Cardiovasc Med 2022; 9:876475. [PMID: 35600490 PMCID: PMC9120534 DOI: 10.3389/fcvm.2022.876475] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2022] [Accepted: 04/11/2022] [Indexed: 01/02/2023] Open
Abstract
Parametric mapping of the heart has become an essential part of many cardiovascular magnetic resonance imaging exams, and is used for tissue characterization and diagnosis in a broad range of cardiovascular diseases. These pulse sequences are used to quantify the myocardial T1, T2, T2*, and T1ρ relaxation times, which are unique surrogate indices of fibrosis, edema and iron deposition that can be used to monitor a disease over time or to compare patients to one another. Parametric mapping is now well-accepted in the clinical setting, but its wider dissemination is hindered by limited inter-center reproducibility and relatively long acquisition times. Recently, several new parametric mapping techniques have appeared that address both of these problems, but substantial hurdles remain for widespread clinical adoption. This review serves both as a primer for newcomers to the field of parametric mapping and as a technical update for those already well at home in it. It aims to establish what is currently needed to improve the reproducibility of parametric mapping of the heart. To this end, we first give an overview of the metrics by which a mapping technique can be assessed, such as bias and variability, as well as the basic physics behind the relaxation times themselves and what their relevance is in the prospect of myocardial tissue characterization. This is followed by a summary of routine mapping techniques and their variations. The problems in reproducibility and the sources of bias and variability of these techniques are reviewed. Subsequently, novel fast, whole-heart, and multi-parametric techniques and their merits are treated in the light of their reproducibility. This includes state of the art segmentation techniques applied to parametric maps, and how artificial intelligence is being harnessed to solve this long-standing conundrum. We finish up by sketching an outlook on the road toward inter-center reproducibility, and what to expect in the future.
Collapse
Affiliation(s)
- Augustin C. Ogier
- Department of Diagnostic and Interventional Radiology, Lausanne University Hospital, University of Lausanne, Lausanne, Switzerland
| | - Aurelien Bustin
- Department of Diagnostic and Interventional Radiology, Lausanne University Hospital, University of Lausanne, Lausanne, Switzerland
- IHU LIRYC, Electrophysiology and Heart Modeling Institute, Université de Bordeaux, INSERM, Centre de Recherche Cardio-Thoracique de Bordeaux, U1045, Bordeaux, France
- Department of Cardiovascular Imaging, Hôpital Cardiologique du Haut-Lévêque, CHU de Bordeaux, Avenue de Magellan, Pessac, France
| | - Hubert Cochet
- IHU LIRYC, Electrophysiology and Heart Modeling Institute, Université de Bordeaux, INSERM, Centre de Recherche Cardio-Thoracique de Bordeaux, U1045, Bordeaux, France
- Department of Cardiovascular Imaging, Hôpital Cardiologique du Haut-Lévêque, CHU de Bordeaux, Avenue de Magellan, Pessac, France
| | - Juerg Schwitter
- Cardiac MR Center, Cardiology Service, Lausanne University Hospital, University of Lausanne, Lausanne, Switzerland
| | - Ruud B. van Heeswijk
- Department of Diagnostic and Interventional Radiology, Lausanne University Hospital, University of Lausanne, Lausanne, Switzerland
- *Correspondence: Ruud B. van Heeswijk
| |
Collapse
|
45
|
Yang X, Wisselink HJ, Vliegenthart R, Heuvelmans MA, Groen HJM, Vonder M, Dorrius MD, de Bock GH. Association between Chest CT-defined Emphysema and Lung Cancer: A Systematic Review and Meta-Analysis. Radiology 2022; 304:322-330. [PMID: 35503012 DOI: 10.1148/radiol.212904] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/15/2023]
Abstract
Background Given the different methods of assessing emphysema, controversy exists as to whether it is associated with lung cancer. Purpose To perform a systematic review and meta-analysis of the association between chest CT-defined emphysema and the presence of lung cancer. Materials and Methods The PubMed, Embase, and Cochrane databases were searched up to July 15, 2021, to identify studies on the association between emphysema assessed visually or quantitatively with CT and lung cancer. Associations were determined by emphysema severity (trace, mild, or moderate to severe, assessed visually and quantitatively) and subtype (centrilobular and paraseptal, assessed visually). Overall and stratified pooled odds ratios (ORs) with their 95% CIs were obtained. Results Of the 3343 screened studies, 21 studies (107 082 patients) with 26 subsets were included. The overall pooled ORs for lung cancer given the presence of emphysema were 2.3 (95% CI: 2.0, 2.6; I2 = 35%; 19 subsets) and 1.02 (95% CI: 1.01, 1.02; six subsets) per 1% increase in low attenuation area. Studies with visual (pooled OR, 2.3; 95% CI: 1.9, 2.6; I2 = 48%; 12 subsets) and quantitative (pooled OR, 2.2; 95% CI: 1.8, 2.8; I2 = 3.7%; eight subsets) assessments yielded comparable results for the dichotomous assessment. Based on six studies (1716 patients), the pooled ORs for lung cancer increased with emphysema severity and were higher for visual assessment (2.5, 3.7, and 4.5 for trace, mild, and moderate to severe, respectively) than for quantitative assessment (1.9, 2.2, and 2.5) based on point estimates. Compared with no emphysema, only centrilobular emphysema (three studies) was associated with lung cancer (pooled OR, 2.2; 95% CI: 1.5, 3.2; P < .001). Conclusion Both visual and quantitative CT assessments of emphysema were associated with a higher odds of lung cancer, which also increased with emphysema severity. Regarding subtype, only centrilobular emphysema was significantly associated with lung cancer. Clinical trial registration no. CRD42021262163 © RSNA, 2022 See also the editorial by Hunsaker in this issue. Online supplemental material is available for this article.
Collapse
Affiliation(s)
- Xiaofei Yang
- From the Departments of Epidemiology (X.Y., M.A.H., M.V., M.D.D., G.H.d.B.), Radiology (H.J.W., R.V., M.D.D.), and Pulmonary Diseases (H.J.M.G.), University Medical Center Groningen, University of Groningen, 9700 RB Groningen, the Netherlands
| | - Hendrik Joost Wisselink
- From the Departments of Epidemiology (X.Y., M.A.H., M.V., M.D.D., G.H.d.B.), Radiology (H.J.W., R.V., M.D.D.), and Pulmonary Diseases (H.J.M.G.), University Medical Center Groningen, University of Groningen, 9700 RB Groningen, the Netherlands
| | - Rozemarijn Vliegenthart
- From the Departments of Epidemiology (X.Y., M.A.H., M.V., M.D.D., G.H.d.B.), Radiology (H.J.W., R.V., M.D.D.), and Pulmonary Diseases (H.J.M.G.), University Medical Center Groningen, University of Groningen, 9700 RB Groningen, the Netherlands
| | - Marjolein A Heuvelmans
- From the Departments of Epidemiology (X.Y., M.A.H., M.V., M.D.D., G.H.d.B.), Radiology (H.J.W., R.V., M.D.D.), and Pulmonary Diseases (H.J.M.G.), University Medical Center Groningen, University of Groningen, 9700 RB Groningen, the Netherlands
| | - Harry J M Groen
- From the Departments of Epidemiology (X.Y., M.A.H., M.V., M.D.D., G.H.d.B.), Radiology (H.J.W., R.V., M.D.D.), and Pulmonary Diseases (H.J.M.G.), University Medical Center Groningen, University of Groningen, 9700 RB Groningen, the Netherlands
| | - Marleen Vonder
- From the Departments of Epidemiology (X.Y., M.A.H., M.V., M.D.D., G.H.d.B.), Radiology (H.J.W., R.V., M.D.D.), and Pulmonary Diseases (H.J.M.G.), University Medical Center Groningen, University of Groningen, 9700 RB Groningen, the Netherlands
| | - Monique D Dorrius
- From the Departments of Epidemiology (X.Y., M.A.H., M.V., M.D.D., G.H.d.B.), Radiology (H.J.W., R.V., M.D.D.), and Pulmonary Diseases (H.J.M.G.), University Medical Center Groningen, University of Groningen, 9700 RB Groningen, the Netherlands
| | - Geertruida H de Bock
- From the Departments of Epidemiology (X.Y., M.A.H., M.V., M.D.D., G.H.d.B.), Radiology (H.J.W., R.V., M.D.D.), and Pulmonary Diseases (H.J.M.G.), University Medical Center Groningen, University of Groningen, 9700 RB Groningen, the Netherlands
| |
Collapse
|
46
|
Wang J, Falkson SR, Guo HH. Radiopaque Recreations of Lung Pathologies From Clinical Computed Tomography Images Using Potassium Iodide Inkjet 3-dimensional Printing: Proof of Concept. J Thorac Imaging 2022; 37:146-153. [PMID: 34334783 DOI: 10.1097/rti.0000000000000607] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
PURPOSE The purpose of this study was to develop a 3-dimensional (3D) printing method to create computed tomography (CT) realistic phantoms of lung cancer nodules and lung parenchymal disease from clinical CT images. MATERIALS AND METHODS Low-density paper was used as substrate material for inkjet printing with potassium iodide solution to reproduce phantoms that mimic the CT attenuation of lung parenchyma. The relationship between grayscale values and the corresponding CT numbers of prints was first established through the derivation of exponential fitted equation from scanning data. Next, chest CTs from patients with early-stage lung cancer and coronavirus disease 2019 (COVID-19) pneumonia were chosen for 3D printing. CT images of original lung nodule and the 3D-printed nodule phantom were compared based on pixel-to-pixel correlation and radiomic features. RESULTS CT images of part-solid lung cancer and 3D-printed nodule phantom showed both high visual similarity and quantitative correlation. R2 values from linear regressions of pixel-to-pixel correlations between 5 sets of patient and 3D-printed image pairs were 0.92, 0.94, 0.86, 0.85, and 0.83, respectively. Comparison of radiomic measures between clinical CT and printed models demonstrated 6.1% median difference, with 25th and 75th percentile range at 2.4% and 15.2% absolute difference, respectively. The densities and parenchymal morphologies from COVID-19 pneumonia CT images were well reproduced in the 3D-printed phantom scans. CONCLUSION The 3D printing method presented in this work facilitates creation of CT-realistic reproductions of lung cancer and parenchymal disease from individual patient scans with microbiological and pathology confirmation.
Collapse
Affiliation(s)
- Jia Wang
- Environmental Health and Safety, Stanford University
| | | | - H Henry Guo
- Department of Radiology, Stanford Medical Center, Palo Alto, CA
| |
Collapse
|
47
|
Deep Learning-Based Image Conversion Improves the Reproducibility of Computed Tomography Radiomics Features: A Phantom Study. Invest Radiol 2022; 57:308-317. [PMID: 34839305 DOI: 10.1097/rli.0000000000000839] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
Abstract
OBJECTIVES This study aimed to evaluate the usefulness of deep learning-based image conversion to improve the reproducibility of computed tomography (CT) radiomics features. MATERIALS AND METHODS This study was conducted using an abdominal phantom with liver nodules. We developed an image conversion algorithm using a residual feature aggregation network to reproduce radiomics features with CT images under various CT protocols and reconstruction kernels. External validation was performed using images from different scanners, consisting of 8 different protocols. To evaluate the variability of radiomics features, regions of interest (ROIs) were drawn by targeting the liver parenchyma, vessels, paraspinal area, and liver nodules. We extracted 18 first-order, 68 second-order, and 688 wavelet radiomics features. Measurement variability was assessed using the concordance correlation coefficient (CCC), compared with the ground-truth image. RESULTS In the ROI-based analysis, there was an 83.3% improvement of CCC (80/96; 4 ROIs with 3 categories of radiomics features and 8 protocols) in synthetic images compared with the original images. Among them, the 56 CCC pairs showed a significant increase after image synthesis. In the radiomics feature-based analysis, 62.0% (3838 of 6192; 774 radiomics features with 8 protocols) features showed increased CCC after image synthesis, and a significant increase was noted in 26.9% (1663 of 6192) features. In particular, the first-order feature (79.9%, 115/144) showed better improvement in terms of the reproducibility of radiomics feature than the second-order (59.9%, 326/544) or wavelet feature (61.7%, 3397/5504). CONCLUSIONS Our study demonstrated that a deep learning model for image conversion can improve the reproducibility of radiomics features across various CT protocols, reconstruction kernels, and CT scanners.
Collapse
|
48
|
Dual-Echo Turbo Spin Echo and 12-Echo Multi Spin Echo Sequences as Equivalent Techniques for Obtaining T2-Relaxometry Data: Application in Symptomatic and Asymptomatic Hereditary Transthyretin Amyloidosis as a Surrogate Disease. Invest Radiol 2022; 57:301-307. [PMID: 34839307 DOI: 10.1097/rli.0000000000000837] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
Abstract
OBJECTIVES Multi spin echo (MSE) sequences are often used for obtaining T2-relaxometry data as they provide defined echo times (TEs). Due to their time-consuming acquisition, they are frequently replaced by turbo spin echo (TSE) sequences that in turn bear the risk of systematic errors when analyzing small structures or lesions. With this study, we aim to test whether T2-relaxometry data derived from either dual-echo TSE or 12-echo MSE sequences are equivalent for quantifying peripheral nerve lesions. Hereditary transthyretin (ATTRv) amyloidosis was chosen as a surrogate disease, as it allows the inclusion of both asymptomatic carriers of the underlying variant transthyretin gene (varTTR) and symptomatic ATTRv amyloidosis patients. MATERIALS AND METHODS Overall, 50 participants with genetically confirmed varTTR (20 clinically symptomatic ATTRv amyloidosis; 4 females, 16 males; mean age, 61.8 years; range, 33-76 years; and 30 asymptomatic varTTR-carriers; 18 females, 12 males; mean age, 43.1 years; range, 21-62 years), and 30 healthy volunteers (13 females, 17 males, mean age 41.3 years, range 22-73) were prospectively included and underwent magnetic resonance neurography at 3 T. T2-relaxometry was performed by acquiring an axial 2-dimensional dual-echo TSE sequence with spectral fat saturation (TE1/TE2, 12/73 milliseconds; TR, 5210 milliseconds; acquisition time, 7 minutes, 30 seconds), and an axial 2-dimensional MSE sequence with spectral fat saturation and with 12 different TE (TE1, 10 milliseconds to TE12, 120 milliseconds; ΔTE, 10 milliseconds; TR, 3000 milliseconds; acquisition time, 11 minutes, 23 seconds) at the right mid to lower thigh. Sciatic nerve regions of interest were manually drawn in ImageJ on 10 central slices per participant and sequence, and the apparent T2-relaxation time (T2app) and proton spin density (ρ) were calculated individually from TSE and MSE relaxometry data. RESULTS Linear regression showed that T2app values obtained from the dual-echo TSE (T2appTSE), and those calculated from the 12-echo MSE (T2appMSE) were mathematically connected by a factor of 1.3 throughout all groups (controls: 1.26 ± 0.02; varTTR-carriers: 1.25 ± 0.02; symptomatic ATTRv amyloidosis: 1.28 ± 0.02), whereas a factor of 0.5 was identified between respective ρ values (controls: 0.47 ± 0.01; varTTR-carriers: 0.47 ± 0.01; symptomatic ATTRv amyloidosis: 0.50 ± 0.02). T2app calculated from both TSE and MSE, distinguished between symptomatic ATTRv (T2appTSE 66.38 ± 2.6; T2appMSE 84.6 ± 3.3) and controls (T2appTSE 58.1 ± 1.0, P = 0.0028; T2appMSE 72.8 ± 0.7, P < 0.0001), whereas differences between varTTR-carriers (T2appTSE 61.8 ± 1.5; T2appMSE 76.7 ± 1.3) and ATTRv amyloidosis were observed only for T2appMSE (P = 0.0082). The ρ value differentiated well between healthy controls (ρTSE 365.1 ± 7.2; ρMSE 170.4 ± 3.8) versus varTTR-carriers (ρTSE 415.7 ± 9.8, P = 0.0027; ρMSE 193.7 ± 5.3, P = 0.0398) and versus symptomatic ATTRv amyloidosis (ρTSE 487.8 ± 17.9; ρMSE 244.7 ± 13.1, P < 0.0001, respectively), but also between varTTR-carriers and ATTRv amyloidosis (ρTSEP = 0.0001; ρMSEP < 0.0001). CONCLUSIONS Dual-echo TSE and 12-echo MSE sequences provide equally robust and reliable T2-relaxometry data when calculating T2app and ρ. Due to their shorter acquisition time and higher resolution, TSE sequences may be preferred in future magnetic resonance imaging protocols. As a secondary result, ρ can be confirmed as a sensitive biomarker to detect early nerve lesions as it differentiated best among healthy controls, asymptomatic varTTR-carriers, and symptomatic ATTRv amyloidosis, whereas T2app might be beneficial in already manifest ATTRv amyloidosis.
Collapse
|
49
|
Park YW, Shin SJ, Eom J, Lee H, You SC, Ahn SS, Lim SM, Park RW, Lee SK. Cycle-consistent adversarial networks improves generalizability of radiomics model in grading meningiomas on external validation. Sci Rep 2022; 12:7042. [PMID: 35488007 PMCID: PMC9055063 DOI: 10.1038/s41598-022-10956-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2021] [Accepted: 04/07/2022] [Indexed: 11/13/2022] Open
Abstract
The heterogeneity of MRI is one of the major reasons for decreased performance of a radiomics model on external validation, limiting the model’s generalizability and clinical application. We aimed to establish a generalizable radiomics model to predict meningioma grade on external validation through leveraging Cycle-Consistent Adversarial Networks (CycleGAN). In this retrospective study, 257 patients with meningioma were included in the institutional training set. Radiomic features (n = 214) were extracted from T2-weighted (T2) and contrast-enhanced T1 (T1C) images. After radiomics feature selection, extreme gradient boosting classifiers were developed. The models were validated in the external validation set consisting of 61 patients with meningiomas. To reduce the gap in generalization associated with the inter-institutional heterogeneity of MRI, the smaller image set style of the external validation was translated into the larger image set style of the institutional training set using CycleGAN. On external validation before CycleGAN application, the performance of the combined T2 and T1C models showed an area under the curve (AUC), accuracy, and F1 score of 0.77 (95% confidence interval 0.63–0.91), 70.7%, and 0.54, respectively. After applying CycleGAN, the performance of the combined T2 and T1C models increased, with an AUC, accuracy, and F1 score of 0.83 (95% confidence interval 0.70–0.97), 73.2%, and 0.59, respectively. Quantitative metrics (by Fréchet Inception Distance) showed that CycleGAN can decrease inter-institutional image heterogeneity while preserving predictive information. In conclusion, leveraging CycleGAN may be helpful to increase the generalizability of a radiomics model in differentiating meningioma grade on external validation.
Collapse
Affiliation(s)
- Yae Won Park
- Department of Radiology and Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, 50-1 Yonsei-ro, Seodaemun-gu, Seoul, Korea
| | - Seo Jeong Shin
- Department of Biomedical Sciences, Ajou University Graduate School of Medicine, Suwon, Republic of Korea
| | - Jihwan Eom
- Department of Computer Science, Yonsei University, Seoul, Korea
| | - Heirim Lee
- Department of Biomedical Informatics, Ajou University School of Medicine, Suwon, Republic of Korea.,Office of Biostatistics, Ajou Research Institute for Innovative Medicine, Ajou University Medical Center, Suwon, Republic of Korea
| | - Seng Chan You
- Department of Biomedical Systems Informatics, Yonsei University College of Medicine, 50-1 Yonsei-ro, Seodaemun-gu, Seoul, Korea.
| | - Sung Soo Ahn
- Department of Radiology and Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, 50-1 Yonsei-ro, Seodaemun-gu, Seoul, Korea.
| | - Soo Mee Lim
- Department of Radiology, Ewha Womans University College of Medicine, Seoul, Korea
| | - Rae Woong Park
- Department of Biomedical Sciences, Ajou University Graduate School of Medicine, Suwon, Republic of Korea.,Department of Biomedical Informatics, Ajou University School of Medicine, Suwon, Republic of Korea
| | - Seung-Koo Lee
- Department of Radiology and Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, 50-1 Yonsei-ro, Seodaemun-gu, Seoul, Korea
| |
Collapse
|
50
|
Deep Neural Networks and Machine Learning Radiomics Modelling for Prediction of Relapse in Mantle Cell Lymphoma. Cancers (Basel) 2022; 14:cancers14082008. [PMID: 35454914 PMCID: PMC9028737 DOI: 10.3390/cancers14082008] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2022] [Revised: 04/05/2022] [Accepted: 04/12/2022] [Indexed: 12/12/2022] Open
Abstract
Simple Summary Mantle cell lymphoma (MCL) is an aggressive lymphoid tumour with a poor prognosis. There exist no routine biomarkers for the early prediction of relapse. Our study compared the potential of radiomics-based machine learning and 3D deep learning models as non-invasive biomarkers to risk-stratify MCL patients, thus promoting precision imaging in clinical oncology. Abstract Mantle cell lymphoma (MCL) is a rare lymphoid malignancy with a poor prognosis characterised by frequent relapse and short durations of treatment response. Most patients present with aggressive disease, but there exist indolent subtypes without the need for immediate intervention. The very heterogeneous behaviour of MCL is genetically characterised by the translocation t(11;14)(q13;q32), leading to Cyclin D1 overexpression with distinct clinical and biological characteristics and outcomes. There is still an unfulfilled need for precise MCL prognostication in real-time. Machine learning and deep learning neural networks are rapidly advancing technologies with promising results in numerous fields of application. This study develops and compares the performance of deep learning (DL) algorithms and radiomics-based machine learning (ML) models to predict MCL relapse on baseline CT scans. Five classification algorithms were used, including three deep learning models (3D SEResNet50, 3D DenseNet, and an optimised 3D CNN) and two machine learning models based on K-nearest Neighbor (KNN) and Random Forest (RF). The best performing method, our optimised 3D CNN, predicted MCL relapse with a 70% accuracy, better than the 3D SEResNet50 (62%) and the 3D DenseNet (59%). The second-best performing method was the KNN-based machine learning model (64%) after principal component analysis for improved accuracy. Our optimised CNN developed by ourselves correctly predicted MCL relapse in 70% of the patients on baseline CT imaging. Once prospectively tested in clinical trials with a larger sample size, our proposed 3D deep learning model could facilitate clinical management by precision imaging in MCL.
Collapse
|