1
|
Prieto-González LS, Agulles-Pedrós L. Exploring the Potential of Machine Learning Algorithms to Improve Diffusion Nuclear Magnetic Resonance Imaging Models Analysis. J Med Phys 2024; 49:189-202. [PMID: 39131437 PMCID: PMC11309135 DOI: 10.4103/jmp.jmp_10_24] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2024] [Revised: 03/27/2024] [Accepted: 04/15/2024] [Indexed: 08/13/2024] Open
Abstract
Purpose This paper explores different machine learning (ML) algorithms for analyzing diffusion nuclear magnetic resonance imaging (dMRI) models when analytical fitting shows restrictions. It reviews various ML techniques for dMRI analysis and evaluates their performance on different b-values range datasets, comparing them with analytical methods. Materials and Methods After standard fitting for reference, four sets of diffusion-weighted nuclear magnetic resonance images were used to train/test various ML algorithms for prediction of diffusion coefficient (D), pseudo-diffusion coefficient (D*), perfusion fraction (f), and kurtosis (K). ML classification algorithms, including extra-tree classifier (ETC), logistic regression, C-support vector, extra-gradient boost, and multilayer perceptron (MLP), were used to determine the existence of diffusion parameters (D, D*, f, and K) within single voxels. Regression algorithms, including linear regression, polynomial regression, ridge, lasso, random forest (RF), elastic-net, and support-vector machines, were used to estimate the value of the diffusion parameters. Performance was evaluated using accuracy (ACC), area under the curve (AUC) tests, and cross-validation root mean square error (RMSECV). Computational timing was also assessed. Results ETC and MLP were the best classifiers, with 94.1% and 91.7%, respectively, for the ACC test and 98.7% and 96.3% for the AUC test. For parameter estimation, RF algorithm yielded the most accurate results The RMSECV percentages were: 8.39% for D, 3.57% for D*, 4.52% for f, and 3.53% for K. After the training phase, the ML methods demonstrated a substantial decrease in computational time, being approximately 232 times faster than the conventional methods. Conclusions The findings suggest that ML algorithms can enhance the efficiency of dMRI model analysis and offer new perspectives on the microstructural and functional organization of biological tissues. This paper also discusses the limitations and future directions of ML-based dMRI analysis.
Collapse
Affiliation(s)
| | - Luis Agulles-Pedrós
- Department of Physics, Medical Physics Group, National University of Colombia, Campus Bogotá, Bogotá, Colombia
| |
Collapse
|
2
|
Schuppert C, Rospleszcz S, Hirsch JG, Hoinkiss DC, Köhn A, von Krüchten R, Russe MF, Keil T, Krist L, Schmidt B, Michels KB, Schipf S, Brenner H, Kröncke TJ, Pischon T, Niendorf T, Schulz-Menger J, Forsting M, Völzke H, Hosten N, Bülow R, Zaitsev M, Kauczor HU, Bamberg F, Günther M, Schlett CL. Automated image quality assessment for selecting among multiple magnetic resonance image acquisitions in the German National Cohort study. Sci Rep 2023; 13:22745. [PMID: 38123791 PMCID: PMC10733361 DOI: 10.1038/s41598-023-49569-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2023] [Accepted: 12/09/2023] [Indexed: 12/23/2023] Open
Abstract
In magnetic resonance imaging (MRI), the perception of substandard image quality may prompt repetition of the respective image acquisition protocol. Subsequently selecting the preferred high-quality image data from a series of acquisitions can be challenging. An automated workflow may facilitate and improve this selection. We therefore aimed to investigate the applicability of an automated image quality assessment for the prediction of the subjectively preferred image acquisition. Our analysis included data from 11,347 participants with whole-body MRI examinations performed as part of the ongoing prospective multi-center German National Cohort (NAKO) study. Trained radiologic technologists repeated any of the twelve examination protocols due to induced setup errors and/or subjectively unsatisfactory image quality and chose a preferred acquisition from the resultant series. Up to 11 quantitative image quality parameters were automatically derived from all acquisitions. Regularized regression and standard estimates of diagnostic accuracy were calculated. Controlling for setup variations in 2342 series of two or more acquisitions, technologists preferred the repetition over the initial acquisition in 1116 of 1396 series in which the initial setup was retained (79.9%, range across protocols: 73-100%). Image quality parameters then commonly showed statistically significant differences between chosen and discarded acquisitions. In regularized regression across all protocols, 'structured noise maximum' was the strongest predictor for the technologists' choice, followed by 'N/2 ghosting average'. Combinations of the automatically derived parameters provided an area under the ROC curve between 0.51 and 0.74 for the prediction of the technologists' choice. It is concluded that automated image quality assessment can, despite considerable performance differences between protocols and anatomical regions, contribute substantially to identifying the subjective preference in a series of MRI acquisitions and thus provide effective decision support to readers.
Collapse
Affiliation(s)
- Christopher Schuppert
- Department of Diagnostic and Interventional Radiology, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Hugstetter Str. 55, 79106, Freiburg, Germany
| | - Susanne Rospleszcz
- Chair of Epidemiology, Institute of Medical Information Processing, Biometry and Epidemiology, Ludwig Maximilians University, Faculty of Medicine, Munich, Germany
- Institute of Epidemiology, Helmholtz Zentrum München, German Research Center for Environmental Health, Neuherberg, Germany
- German Centre for Cardiovascular Research (DZHK), Partner Site Munich Heart Alliance, Munich, Germany
| | - Jochen G Hirsch
- Fraunhofer Institute for Digital Medicine MEVIS, Bremen, Germany
| | | | - Alexander Köhn
- Fraunhofer Institute for Digital Medicine MEVIS, Bremen, Germany
| | - Ricarda von Krüchten
- Department of Diagnostic and Interventional Radiology, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Hugstetter Str. 55, 79106, Freiburg, Germany
| | - Maximilian F Russe
- Department of Diagnostic and Interventional Radiology, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Hugstetter Str. 55, 79106, Freiburg, Germany
| | - Thomas Keil
- Institute for Clinical Epidemiology and Biometry, University of Würzburg, Würzburg, Germany
- Institute of Social Medicine, Epidemiology and Health Economics, Charité - Universitätsmedizin Berlin, Berlin, Germany
- State Institute of Health, Bavarian Health and Food Safety Authority, Erlangen, Germany
| | - Lilian Krist
- Institute of Social Medicine, Epidemiology and Health Economics, Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Börge Schmidt
- Institute for Medical Informatics, Biometry and Epidemiology, University Hospital Essen, University of Duisburg-Essen, Essen, Germany
| | - Karin B Michels
- Institute for Prevention and Cancer Epidemiology, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Sabine Schipf
- Institute for Community Medicine, University Medicine Greifswald, Greifswald, Germany
| | - Hermann Brenner
- Division of Clinical Epidemiology and Aging Research, German Cancer Research Center (DKFZ), Heidelberg, Germany
- Division of Preventive Oncology, German Cancer Research Center (DKFZ) and National Center for Tumor Diseases (NCT), Heidelberg, Germany
| | - Thomas J Kröncke
- Department of Diagnostic and Interventional Radiology, University Hospital Augsburg, University of Augsburg, Augsburg, Germany
| | - Tobias Pischon
- Molecular Epidemiology Research Group, Max-Delbrueck-Center for Molecular Medicine in the Helmholtz Association (MDC), Berlin, Germany
- Biobank Technology Platform, Max-Delbrueck-Center for Molecular Medicine in the Helmholtz Association (MDC), Berlin, Germany
- Charité - Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany
| | - Thoralf Niendorf
- Berlin Ultrahigh Field Facility (B.U.F.F.), Max Delbrück Center for Molecular Medicine in the Helmholtz Association (MDC), Berlin, Germany
| | - Jeanette Schulz-Menger
- Charité - Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany
- German Centre for Cardiovascular Research (DZHK), Partner Site Berlin, Berlin, Germany
- Department of Cardiology and Nephrology, HELIOS Hospital Berlin-Buch, Berlin, Germany
| | - Michael Forsting
- Department of Diagnostic and Interventional Radiology and Neuroradiology, University Hospital Essen, University of Duisburg-Essen, Essen, Germany
| | - Henry Völzke
- Institute for Community Medicine, University Medicine Greifswald, Greifswald, Germany
- German Centre for Cardiovascular Research (DZHK), Partner Site Greifswald, University Medicine Greifswald, Greifswald, Germany
| | - Norbert Hosten
- Institute of Diagnostic Radiology and Neuroradiology, University Medicine Greifswald, Greifswald, Germany
| | - Robin Bülow
- Institute of Diagnostic Radiology and Neuroradiology, University Medicine Greifswald, Greifswald, Germany
| | - Maxim Zaitsev
- Division of Medical Physics, Department of Diagnostic and Interventional Radiology, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Hans-Ulrich Kauczor
- Department of Diagnostic and Interventional Radiology, Heidelberg University Hospital, Heidelberg, Germany
| | - Fabian Bamberg
- Department of Diagnostic and Interventional Radiology, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Hugstetter Str. 55, 79106, Freiburg, Germany
| | - Matthias Günther
- Fraunhofer Institute for Digital Medicine MEVIS, Bremen, Germany
| | - Christopher L Schlett
- Department of Diagnostic and Interventional Radiology, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Hugstetter Str. 55, 79106, Freiburg, Germany.
| |
Collapse
|
3
|
Aggarwal K, Manso Jimeno M, Ravi KS, Gonzalez G, Geethanath S. Developing and deploying deep learning models in brain magnetic resonance imaging: A review. NMR IN BIOMEDICINE 2023; 36:e5014. [PMID: 37539775 DOI: 10.1002/nbm.5014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/04/2023] [Revised: 07/12/2023] [Accepted: 07/13/2023] [Indexed: 08/05/2023]
Abstract
Magnetic resonance imaging (MRI) of the brain has benefited from deep learning (DL) to alleviate the burden on radiologists and MR technologists, and improve throughput. The easy accessibility of DL tools has resulted in a rapid increase of DL models and subsequent peer-reviewed publications. However, the rate of deployment in clinical settings is low. Therefore, this review attempts to bring together the ideas from data collection to deployment in the clinic, building on the guidelines and principles that accreditation agencies have espoused. We introduce the need for and the role of DL to deliver accessible MRI. This is followed by a brief review of DL examples in the context of neuropathologies. Based on these studies and others, we collate the prerequisites to develop and deploy DL models for brain MRI. We then delve into the guiding principles to develop good machine learning practices in the context of neuroimaging, with a focus on explainability. A checklist based on the United States Food and Drug Administration's good machine learning practices is provided as a summary of these guidelines. Finally, we review the current challenges and future opportunities in DL for brain MRI.
Collapse
Affiliation(s)
- Kunal Aggarwal
- Accessible MR Laboratory, Biomedical Engineering and Imaging Institute, Department of Diagnostic, Molecular and Interventional Radiology, Mount Sinai Hospital, New York, USA
- Department of Electrical and Computer Engineering, Technical University Munich, Munich, Germany
| | - Marina Manso Jimeno
- Department of Biomedical Engineering, Columbia University in the City of New York, New York, New York, USA
- Columbia Magnetic Resonance Research Center, Columbia University in the City of New York, New York, New York, USA
| | - Keerthi Sravan Ravi
- Department of Biomedical Engineering, Columbia University in the City of New York, New York, New York, USA
- Columbia Magnetic Resonance Research Center, Columbia University in the City of New York, New York, New York, USA
| | - Gilberto Gonzalez
- Division of Neuroradiology, Department of Radiology, Massachusetts General Hospital, Boston, Massachusetts, USA
| | - Sairam Geethanath
- Accessible MR Laboratory, Biomedical Engineering and Imaging Institute, Department of Diagnostic, Molecular and Interventional Radiology, Mount Sinai Hospital, New York, USA
| |
Collapse
|
4
|
Gao R, Luo G, Ding R, Yang B, Sun H. A Lightweight Deep Learning Framework for Automatic MRI Data Sorting and Artifacts Detection. J Med Syst 2023; 47:124. [PMID: 37999807 DOI: 10.1007/s10916-023-02017-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2023] [Accepted: 11/05/2023] [Indexed: 11/25/2023]
Abstract
The purpose of this study is to develop a lightweight and easily deployable deep learning system for fully automated content-based brain MRI sorting and artifacts detection. 22092 MRI volumes from 4076 patients between 2017 and 2021 were involved in this retrospective study. The dataset mainly contains 4 common contrast (T1-weighted (T1w), contrast-enhanced T1-weighted (T1c), T2-weighted (T2w), fluid-attenuated inversion recovery (FLAIR)) in three perspectives (axial, coronal, and sagittal), and magnetic resonance angiography (MRA), as well as three typical artifacts (motion, aliasing, and metal artifacts). In the proposed architecture, a pre-trained EfficientNetB0 with the fully connected layers removed was used as the feature extractor and a multilayer perceptron (MLP) module with four hidden layers was used as the classifier. Precision, recall, F1_Score, accuracy, the number of trainable parameters, and float-point of operations (FLOPs) were calculated to evaluate the performance of the proposed model. The proposed model was also compared with four other existing CNN-based models in terms of classification performance and model size. The overall precision, recall, F1_Score, and accuracy of the proposed model were 0.983, 0.926, 0.950, and 0.991, respectively. The performance of the proposed model was outperformed the other four CNN-based models. The number of trainable parameters and FLOPs were the smallest among the investigated models. Our proposed model can accurately sort head MRI scans and identify artifacts with minimum computational resources and can be used as a tool to support big medical imaging data research and facilitate large-scale database management.
Collapse
Affiliation(s)
- Ronghui Gao
- Department of Radiology, West China Hospital of Sichuan University, Chengdu, Sichuan, China
| | - Guoting Luo
- Department of Radiology, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| | - Renxin Ding
- IT Center, West China Hospital of Sichuan University, Chengdu, Sichuan, China
| | - Bo Yang
- IT Center, West China Hospital of Sichuan University, Chengdu, Sichuan, China
| | - Huaiqiang Sun
- Department of Radiology, West China Hospital of Sichuan University, Chengdu, Sichuan, China.
- Huaxi MR Research Center, West China Hospital of Sichuan University, Chengdu, Sichuan, China.
- Huaxi MR Research Center, Department of Radiology, West China Hospital of Sichuan University, Chengdu, 610041, Sichuan, China.
| |
Collapse
|
5
|
Weaver JM, DiPiero M, Rodrigues PG, Cordash H, Davidson RJ, Planalp EM, Dean DC. Automated motion artifact detection in early pediatric diffusion MRI using a convolutional neural network. IMAGING NEUROSCIENCE (CAMBRIDGE, MASS.) 2023; 1:10.1162/imag_a_00023. [PMID: 38344118 PMCID: PMC10854394 DOI: 10.1162/imag_a_00023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 02/15/2024]
Abstract
Diffusion MRI (dMRI) is a widely used method to investigate the microstructure of the brain. Quality control (QC) of dMRI data is an important processing step that is performed prior to analysis using models such as diffusion tensor imaging (DTI) or neurite orientation dispersion and density imaging (NODDI). When processing dMRI data from infants and young children, where intra-scan motion is common, the identification and removal of motion artifacts is of the utmost importance. Manual QC of dMRI data is (1) time-consuming due to the large number of diffusion directions, (2) expensive, and (3) prone to subjective errors and observer variability. Prior techniques for automated dMRI QC have mostly been limited to adults or school-age children. Here, we propose a deep learning-based motion artifact detection tool for dMRI data acquired from infants and toddlers. The proposed framework uses a simple three-dimensional convolutional neural network (3DCNN) trained and tested on an early pediatric dataset of 2,276 dMRI volumes from 121 exams acquired at 1 month and 24 months of age. An average classification accuracy of 95% was achieved following four-fold cross-validation. A second dataset with different acquisition parameters and ages ranging from 2-36 months (consisting of 2,349 dMRI volumes from 26 exams) was used to test network generalizability, achieving 98% classification accuracy. Finally, to demonstrate the importance of motion artifact volume removal in a dMRI processing pipeline, the dMRI data were fit to the DTI and NODDI models and the parameter maps were compared with and without motion artifact removal.
Collapse
Affiliation(s)
- Jayse Merle Weaver
- Department of Medical Physics, University of Wisconsin–Madison, Madison, WI, United States
- Waisman Center, University of Wisconsin–Madison, Madison, WI, United States
| | - Marissa DiPiero
- Waisman Center, University of Wisconsin–Madison, Madison, WI, United States
- Neuroscience Training Program, University of Wisconsin–Madison, Madison, WI, United States
| | | | - Hassan Cordash
- Waisman Center, University of Wisconsin–Madison, Madison, WI, United States
| | - Richard J. Davidson
- Waisman Center, University of Wisconsin–Madison, Madison, WI, United States
- Department of Psychology, University of Wisconsin–Madison, Madison, WI, United States
- Center for Healthy Minds, University of Wisconsin–Madison, Madison WI, United States
- Department of Psychiatry, University of Wisconsin–Madison, Madison, WI, United States
| | - Elizabeth M. Planalp
- Waisman Center, University of Wisconsin–Madison, Madison, WI, United States
- Department of Medicine, University of Wisconsin–Madison, Madison, WI, United States
| | - Douglas C. Dean
- Department of Medical Physics, University of Wisconsin–Madison, Madison, WI, United States
- Waisman Center, University of Wisconsin–Madison, Madison, WI, United States
- Department of Pediatrics, University of Wisconsin–Madison, Madison, WI, United States
| |
Collapse
|
6
|
Aja-Fernández S, Martín-Martín C, Planchuelo-Gómez Á, Faiyaz A, Uddin MN, Schifitto G, Tiwari A, Shigwan SJ, Kumar Singh R, Zheng T, Cao Z, Wu D, Blumberg SB, Sen S, Goodwin-Allcock T, Slator PJ, Yigit Avci M, Li Z, Bilgic B, Tian Q, Wang X, Tang Z, Cabezas M, Rauland A, Merhof D, Manzano Maria R, Campos VP, Santini T, da Costa Vieira MA, HashemizadehKolowri S, DiBella E, Peng C, Shen Z, Chen Z, Ullah I, Mani M, Abdolmotalleby H, Eckstrom S, Baete SH, Filipiak P, Dong T, Fan Q, de Luis-García R, Tristán-Vega A, Pieciak T. Validation of deep learning techniques for quality augmentation in diffusion MRI for clinical studies. Neuroimage Clin 2023; 39:103483. [PMID: 37572514 PMCID: PMC10440596 DOI: 10.1016/j.nicl.2023.103483] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Revised: 07/24/2023] [Accepted: 07/25/2023] [Indexed: 08/14/2023]
Abstract
The objective of this study is to evaluate the efficacy of deep learning (DL) techniques in improving the quality of diffusion MRI (dMRI) data in clinical applications. The study aims to determine whether the use of artificial intelligence (AI) methods in medical images may result in the loss of critical clinical information and/or the appearance of false information. To assess this, the focus was on the angular resolution of dMRI and a clinical trial was conducted on migraine, specifically between episodic and chronic migraine patients. The number of gradient directions had an impact on white matter analysis results, with statistically significant differences between groups being drastically reduced when using 21 gradient directions instead of the original 61. Fourteen teams from different institutions were tasked to use DL to enhance three diffusion metrics (FA, AD and MD) calculated from data acquired with 21 gradient directions and a b-value of 1000 s/mm2. The goal was to produce results that were comparable to those calculated from 61 gradient directions. The results were evaluated using both standard image quality metrics and Tract-Based Spatial Statistics (TBSS) to compare episodic and chronic migraine patients. The study results suggest that while most DL techniques improved the ability to detect statistical differences between groups, they also led to an increase in false positive. The results showed that there was a constant growth rate of false positives linearly proportional to the new true positives, which highlights the risk of generalization of AI-based tasks when assessing diverse clinical cohorts and training using data from a single group. The methods also showed divergent performance when replicating the original distribution of the data and some exhibited significant bias. In conclusion, extreme caution should be exercised when using AI methods for harmonization or synthesis in clinical studies when processing heterogeneous data in clinical studies, as important information may be altered, even when global metrics such as structural similarity or peak signal-to-noise ratio appear to suggest otherwise.
Collapse
Affiliation(s)
- Santiago Aja-Fernández
- Laboratorio de Procesado de Imagen (LPI), ETSI Telecomunicación, Universidad de Valladolid, Spain.
| | - Carmen Martín-Martín
- Laboratorio de Procesado de Imagen (LPI), ETSI Telecomunicación, Universidad de Valladolid, Spain
| | - Álvaro Planchuelo-Gómez
- Laboratorio de Procesado de Imagen (LPI), ETSI Telecomunicación, Universidad de Valladolid, Spain; Cardiff University Brain Research Imaging Centre (CUBRIC), School of Psychology, Cardiff University, Cardiff, UK
| | | | | | | | | | | | | | | | | | - Dan Wu
- Zhejiang University, China
| | | | | | | | | | | | - Zihan Li
- Athinoula A. Martinos Center for Biomedical Imaging, USA
| | - Berkin Bilgic
- Athinoula A. Martinos Center for Biomedical Imaging, USA
| | - Qiyuan Tian
- Athinoula A. Martinos Center for Biomedical Imaging, USA
| | | | | | | | | | | | | | | | | | | | | | | | | | | | - Zan Chen
- Zhejiang University of Technology, China
| | | | | | | | | | | | | | | | | | - Rodrigo de Luis-García
- Laboratorio de Procesado de Imagen (LPI), ETSI Telecomunicación, Universidad de Valladolid, Spain
| | - Antonio Tristán-Vega
- Laboratorio de Procesado de Imagen (LPI), ETSI Telecomunicación, Universidad de Valladolid, Spain
| | - Tomasz Pieciak
- Laboratorio de Procesado de Imagen (LPI), ETSI Telecomunicación, Universidad de Valladolid, Spain
| |
Collapse
|