1
|
Hu Y, Gan W, Ying C, Wang T, Eldeniz C, Liu J, Chen Y, An H, Kamilov US. SPICER: Self-supervised learning for MRI with automatic coil sensitivity estimation and reconstruction. Magn Reson Med 2024; 92:1048-1063. [PMID: 38725383 DOI: 10.1002/mrm.30121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Revised: 02/28/2024] [Accepted: 04/02/2024] [Indexed: 06/27/2024]
Abstract
PURPOSE To introduce a novel deep model-based architecture (DMBA), SPICER, that uses pairs of noisy and undersampled k-space measurements of the same object to jointly train a model for MRI reconstruction and automatic coil sensitivity estimation. METHODS SPICER consists of two modules to simultaneously reconstructs accurate MR images and estimates high-quality coil sensitivity maps (CSMs). The first module, CSM estimation module, uses a convolutional neural network (CNN) to estimate CSMs from the raw measurements. The second module, DMBA-based MRI reconstruction module, forms reconstructed images from the input measurements and the estimated CSMs using both the physical measurement model and learned CNN prior. With the benefit of our self-supervised learning strategy, SPICER can be efficiently trained without any fully sampled reference data. RESULTS We validate SPICER on both open-access datasets and experimentally collected data, showing that it can achieve state-of-the-art performance in highly accelerated data acquisition settings (up to10 × $$ 10\times $$ ). Our results also highlight the importance of different modules of SPICER-including the DMBA, the CSM estimation, and the SPICER training loss-on the final performance of the method. Moreover, SPICER can estimate better CSMs than pre-estimation methods especially when the ACS data is limited. CONCLUSION Despite being trained on noisy undersampled data, SPICER can reconstruct high-quality images and CSMs in highly undersampled settings, which outperforms other self-supervised learning methods and matches the performance of the well-known E2E-VarNet trained on fully sampled ground-truth data.
Collapse
Affiliation(s)
- Yuyang Hu
- Department of Electrical and Systems Engineering, Washington University in St. Louis, St. Louis, Missouri
| | - Weijie Gan
- Department of Computer Science and Engineering, Washington University in St. Louis, St. Louis, Missouri
| | - Chunwei Ying
- Mallinckrodt Institute of Radiology, Washington University in St. Louis, St. Louis, Missouri
| | - Tongyao Wang
- Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, Missouri
| | - Cihat Eldeniz
- Mallinckrodt Institute of Radiology, Washington University in St. Louis, St. Louis, Missouri
| | - Jiaming Liu
- Department of Electrical and Systems Engineering, Washington University in St. Louis, St. Louis, Missouri
| | - Yasheng Chen
- Department of Neurology, Washington University in St. Louis, St. Louis, Missouri
| | - Hongyu An
- Department of Electrical and Systems Engineering, Washington University in St. Louis, St. Louis, Missouri
- Mallinckrodt Institute of Radiology, Washington University in St. Louis, St. Louis, Missouri
- Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, Missouri
- Department of Neurology, Washington University in St. Louis, St. Louis, Missouri
| | - Ulugbek S Kamilov
- Department of Electrical and Systems Engineering, Washington University in St. Louis, St. Louis, Missouri
- Department of Computer Science and Engineering, Washington University in St. Louis, St. Louis, Missouri
| |
Collapse
|
2
|
Tan F, Delfino JG, Zeng R. Evaluating Machine Learning-Based MRI Reconstruction Using Digital Image Quality Phantoms. Bioengineering (Basel) 2024; 11:614. [PMID: 38927849 PMCID: PMC11200466 DOI: 10.3390/bioengineering11060614] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2024] [Revised: 06/07/2024] [Accepted: 06/12/2024] [Indexed: 06/28/2024] Open
Abstract
Quantitative and objective evaluation tools are essential for assessing the performance of machine learning (ML)-based magnetic resonance imaging (MRI) reconstruction methods. However, the commonly used fidelity metrics, such as mean squared error (MSE), structural similarity (SSIM), and peak signal-to-noise ratio (PSNR), often fail to capture fundamental and clinically relevant MR image quality aspects. To address this, we propose evaluation of ML-based MRI reconstruction using digital image quality phantoms and automated evaluation methods. Our phantoms are based upon the American College of Radiology (ACR) large physical phantom but created in k-space to simulate their MR images, and they can vary in object size, signal-to-noise ratio, resolution, and image contrast. Our evaluation pipeline incorporates evaluation metrics of geometric accuracy, intensity uniformity, percentage ghosting, sharpness, signal-to-noise ratio, resolution, and low-contrast detectability. We demonstrate the utility of our proposed pipeline by assessing an example ML-based reconstruction model across various training and testing scenarios. The performance results indicate that training data acquired with a lower undersampling factor and coils of larger anatomical coverage yield a better performing model. The comprehensive and standardized pipeline introduced in this study can help to facilitate a better understanding of the performance and guide future development and advancement of ML-based reconstruction algorithms.
Collapse
Affiliation(s)
| | | | - Rongping Zeng
- Division of Imaging, Diagnostics and Software Reliability (DIDSR), Office of Science and Engineering Laboratories (OSEL), Center for Devices and Radiological Health (CDRH), U.S. Food and Drug Administration (U.S. FDA), Silver Spring, MD 20993, USA; (F.T.); (J.G.D.)
| |
Collapse
|
3
|
Tavakkoli M, Svenningsen S, Friedlander Y, Konyer NB, Nair P, Noseworthy MD. Sampling pattern discrepancy in the application of compressed sensing hyperpolarized xenon-129 lung MRI. NMR IN BIOMEDICINE 2024; 37:e5121. [PMID: 38423986 DOI: 10.1002/nbm.5121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/04/2023] [Revised: 01/14/2024] [Accepted: 01/23/2024] [Indexed: 03/02/2024]
Abstract
Although hyperpolarized (HP) 129Xe ventilation MRI can be carried out within a breath hold, it is still challenging for many sick patients. Compressed sensing (CS) is a viable alternative to accelerate this approach. However, undersampled images with identical sampling ratios differ from one another. Twenty subjects (n = 10 healthy and n = 10 patients with asthma) were scanned using a GE MR750 3 T scanner, acquiring fully sampled 2D multi-slice HP 129Xe lung ventilation images (10 s breath hold, 128 × 80 (FE × PE-frequency encoding × phase encoding) and 16 slices). Using fully sampled data, 500 variable-density Cartesian random undersampling patterns were generated, each at eight different sampling ratios from 10% to 80%. The parallel imaging and compressed sensing (PICS) command from BART was employed to reconstruct undersampled data. The signal to noise ratio (SNR), structural similarity index measurement (SSIM) and sidelobe to peak ratio of each were subsequently compared. There was a high degree of variation in both SNR and SSIM results from each of the 500 masks of each sampling rate. As the undersampling increases, there is more variation in the quantifying metrics, for both healthy and asthmatic individuals. Our study shows that random undersampling poses a significant challenge when applied at sampling ratios less than 60%, despite fulfilling CS's incoherency criteria. Such low sampling ratios will result in a large variety of undersampling patterns. Therefore, skipped segments of k-space cannot be allowed to happen randomly at low sampling rates. By optimizing the sampling pattern, CS will reach its full potential and be able to be applied to a highly undersampled 129Xe lung dataset.
Collapse
Affiliation(s)
- Mitra Tavakkoli
- Imaging Research Centre, St. Joseph's Healthcare Hamilton, Hamilton, Ontario, Canada
- Department of Electrical and Computer Engineering, McMaster University, Hamilton, Ontario, Canada
| | - Sarah Svenningsen
- Firestone Institute for Respiratory Health, St Joseph's Healthcare Hamilton, Hamilton, Ontario, Canada
- Department of Medicine, Division of Respirology, McMaster University, Hamilton, Ontario, Canada
- School of Biomedical Engineering, McMaster University, 1280 Main St W, Hamilton, Ontario, Canada
| | - Yonni Friedlander
- Firestone Institute for Respiratory Health, St Joseph's Healthcare Hamilton, Hamilton, Ontario, Canada
| | - Norman B Konyer
- Imaging Research Centre, St. Joseph's Healthcare Hamilton, Hamilton, Ontario, Canada
| | - Parameswaran Nair
- Firestone Institute for Respiratory Health, St Joseph's Healthcare Hamilton, Hamilton, Ontario, Canada
- Department of Medicine, Division of Respirology, McMaster University, Hamilton, Ontario, Canada
| | - Michael D Noseworthy
- Imaging Research Centre, St. Joseph's Healthcare Hamilton, Hamilton, Ontario, Canada
- Department of Electrical and Computer Engineering, McMaster University, Hamilton, Ontario, Canada
- School of Biomedical Engineering, McMaster University, 1280 Main St W, Hamilton, Ontario, Canada
- Department of Radiology, McMaster University, Hamilton, Ontario, Canada
| |
Collapse
|
4
|
Jaubert O, Pascale M, Montalt-Tordera J, Akesson J, Virsinskaite R, Knight D, Arridge S, Steeden J, Muthurangu V. Training deep learning based dynamic MR image reconstruction using open-source natural videos. Sci Rep 2024; 14:11774. [PMID: 38783018 PMCID: PMC11116488 DOI: 10.1038/s41598-024-62294-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2024] [Accepted: 05/15/2024] [Indexed: 05/25/2024] Open
Abstract
To develop and assess a deep learning (DL) pipeline to learn dynamic MR image reconstruction from publicly available natural videos (Inter4K). Learning was performed for a range of DL architectures (VarNet, 3D UNet, FastDVDNet) and corresponding sampling patterns (Cartesian, radial, spiral) either from true multi-coil cardiac MR data (N = 692) or from synthetic MR data simulated from Inter4K natural videos (N = 588). Real-time undersampled dynamic MR images were reconstructed using DL networks trained with cardiac data and natural videos, and compressed sensing (CS). Differences were assessed in simulations (N = 104 datasets) in terms of MSE, PSNR, and SSIM and prospectively for cardiac cine (short axis, four chambers, N = 20) and speech cine (N = 10) data in terms of subjective image quality ranking, SNR and Edge sharpness. Friedman Chi Square tests with post-hoc Nemenyi analysis were performed to assess statistical significance. In simulated data, DL networks trained with cardiac data outperformed DL networks trained with natural videos, both of which outperformed CS (p < 0.05). However, in prospective experiments DL reconstructions using both training datasets were ranked similarly (and higher than CS) and presented no statistical differences in SNR and Edge Sharpness for most conditions.The developed pipeline enabled learning dynamic MR reconstruction from natural videos preserving DL reconstruction advantages such as high quality fast and ultra-fast reconstructions while overcoming some limitations (data scarcity or sharing). The natural video dataset, code and pre-trained networks are made readily available on github.
Collapse
Affiliation(s)
- Olivier Jaubert
- UCL Centre for Translational Cardiovascular Imaging, University College London, 30 Guilford St, London, WC1N 1EH, UK
| | - Michele Pascale
- UCL Centre for Translational Cardiovascular Imaging, University College London, 30 Guilford St, London, WC1N 1EH, UK
| | - Javier Montalt-Tordera
- UCL Centre for Translational Cardiovascular Imaging, University College London, 30 Guilford St, London, WC1N 1EH, UK
| | - Julius Akesson
- Clinical Physiology, Department of Clinical Sciences Lund, Lund University, Lund, Sweden
| | - Ruta Virsinskaite
- Department of Cardiology, Royal Free London NHS Foundation Trust, London, NW3 2QG, UK
| | - Daniel Knight
- UCL Centre for Translational Cardiovascular Imaging, University College London, 30 Guilford St, London, WC1N 1EH, UK
- Department of Cardiology, Royal Free London NHS Foundation Trust, London, NW3 2QG, UK
| | - Simon Arridge
- Department of Computer Science, University College London, London, WC1E 6BT, UK
| | - Jennifer Steeden
- UCL Centre for Translational Cardiovascular Imaging, University College London, 30 Guilford St, London, WC1N 1EH, UK
| | - Vivek Muthurangu
- UCL Centre for Translational Cardiovascular Imaging, University College London, 30 Guilford St, London, WC1N 1EH, UK.
| |
Collapse
|
5
|
Ni M, He M, Yang Y, Wen X, Zhao Y, Gao L, Yan R, Xu J, Zhang Y, Chen W, Jiang C, Li Y, Zhao Q, Wu P, Li C, Qu J, Yuan H. Application research of AI-assisted compressed sensing technology in MRI scanning of the knee joint: 3D-MRI perspective. Eur Radiol 2024; 34:3046-3058. [PMID: 37932390 DOI: 10.1007/s00330-023-10368-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2023] [Revised: 08/29/2023] [Accepted: 09/04/2023] [Indexed: 11/08/2023]
Abstract
OBJECTIVE To investigate the potential applicability of AI-assisted compressed sensing (ACS) in knee MRI to enhance and optimize the scanning process. METHODS Volunteers and patients with sports-related injuries underwent prospective MRI scans with a range of acceleration techniques. The volunteers were subjected to varied ACS acceleration levels to ascertain the most effective level. Patients underwent scans at the determined optimal 3D-ACS acceleration level, and 3D compressed sensing (CS) and 2D parallel acquisition technology (PAT) scans were performed. The resultant 3D-ACS images underwent 3.5 mm/2.0 mm multiplanar reconstruction (MPR). Experienced radiologists evaluated and compared the quality of images obtained by 3D-ACS-MRI and 3D-CS-MRI, 3.5 mm/2.0 mm MPR and 2D-PAT-MRI, diagnosed diseases, and compared the results with the arthroscopic findings. The diagnostic agreement was evaluated using Cohen's kappa correlation coefficient, and both absolute and relative evaluation methods were utilized for objective assessment. RESULTS The study involved 15 volunteers and 53 patients. An acceleration factor of 10.69 × was identified as optimal. The quality evaluation showed that 3D-ACS provided poorer bone structure visualization, and improved cartilage visualization and less satisfactory axial images with 3.5 mm/2.0 mm MPR than 2D-PAT. In terms of objective evaluation, the relative evaluation yielded satisfactory results across different groups, while the absolute evaluation revealed significant variances in most features. Nevertheless, high levels of diagnostic agreement (κ: 0.81-0.94) and accuracy (0.83-0.98) were observed across all diagnoses. CONCLUSION ACS technology presents significant potential as a replacement for traditional CS in 3D-MRI knee scans, allowing thinner MPRs and markedly faster scans without sacrificing diagnostic accuracy. CLINICAL RELEVANCE STATEMENT 3D-ACS-MRI of the knee can be completed in the 160 s with good diagnostic consistency and image quality. 3D-MRI-MPR can replace 2D-MRI and reconstruct images with thinner slices, which helps to optimize the current MRI examination process and shorten scanning time. KEY POINTS • AI-assisted compressed sensing technology can reduce knee MRI scan time by over 50%. • 3D AI-assisted compressed sensing MRI and related multiplanar reconstruction can replace traditional accelerated MRI and yield thinner 2D multiplanar reconstructions. • Successful application of 3D AI-assisted compressed sensing MRI can help optimize the current knee MRI process.
Collapse
Affiliation(s)
- Ming Ni
- Department of Radiology, Peking University Third Hospital, Beijing, People's Republic of China
| | - Miao He
- School of Biomedical Engineering, Capital Medical University, Beijing, 100069, People's Republic of China
- Beijing Key Laboratory of Fundamental Research On Biomechanics in Clinical Application, Capital Medical University, Beijing, People's Republic of China
- Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, Capital Medical University, Beijing, People's Republic of China
| | - Yuxin Yang
- United Imaging Research Institute of Intelligent Imaging, Beijing, People's Republic of China
| | - Xiaoyi Wen
- Institute of Statistics and Big Data, Renmin University of China, Beijing, People's Republic of China
| | - Yuqing Zhao
- Department of Radiology, Peking University Third Hospital, Beijing, People's Republic of China
| | - Lixiang Gao
- Department of Radiology, Peking University Third Hospital, Beijing, People's Republic of China
| | - Ruixin Yan
- Department of Radiology, Peking University Third Hospital, Beijing, People's Republic of China
| | - Jiajia Xu
- Department of Radiology, Peking University Third Hospital, Beijing, People's Republic of China
| | - Yarui Zhang
- Department of Radiology, Peking University Third Hospital, Beijing, People's Republic of China
| | - Wen Chen
- Department of Radiology, Peking University Third Hospital, Beijing, People's Republic of China
| | - Chenyu Jiang
- Department of Radiology, Peking University Third Hospital, Beijing, People's Republic of China
| | - Yali Li
- Department of Radiology, Peking University Third Hospital, Beijing, People's Republic of China
| | - Qiang Zhao
- Department of Radiology, Peking University Third Hospital, Beijing, People's Republic of China
| | - Peng Wu
- United Imaging Healthcare Co, Shanghai, People's Republic of China
| | - Chunlin Li
- School of Biomedical Engineering, Capital Medical University, Beijing, 100069, People's Republic of China
- Beijing Key Laboratory of Fundamental Research On Biomechanics in Clinical Application, Capital Medical University, Beijing, People's Republic of China
- Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, Capital Medical University, Beijing, People's Republic of China
| | - Junda Qu
- School of Biomedical Engineering, Capital Medical University, Beijing, 100069, People's Republic of China.
- Beijing Key Laboratory of Fundamental Research On Biomechanics in Clinical Application, Capital Medical University, Beijing, People's Republic of China.
- Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, Capital Medical University, Beijing, People's Republic of China.
| | - Huishu Yuan
- Department of Radiology, Peking University Third Hospital, Beijing, People's Republic of China.
| |
Collapse
|
6
|
Haacke EM, Xu Q, Kokeny P, Gharabaghi S, Chen Y, Wu B, Liu Y, He N, Yan F. Strategically Acquired Gradient Echo (STAGE) Imaging, part IV: Constrained Reconstruction of White Noise (CROWN) Processing as a Means to Improve Signal-to-Noise in STAGE Imaging at 3 Tesla. Magn Reson Imaging 2024; 107:55-68. [PMID: 38181834 DOI: 10.1016/j.mri.2024.01.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Revised: 10/30/2023] [Accepted: 01/01/2024] [Indexed: 01/07/2024]
Abstract
Increasing the signal-to-noise ratio (SNR) has always been of critical importance for magnetic resonance imaging. Although increasing field strength provides a linear increase in SNR, it is more and more costly as field strength increases. Therefore, there is a major effort today to use signal processing methods to improve SNR since it is more efficient and economical. There are a variety of methods to improve SNR such as averaging the data at the expense of imaging time, or collecting the data with a lower resolution, all of these methods, including imaging processing methods, usually come at the expense of loss of image detail or image blurring. Therefore, we developed a new mathematical approach called CROWN (Constrained Reconstruction of White Noise) to enhance SNR without loss of structural detail and without affecting scanning time. In this study, we introduced and tested the concept behind CROWN specifically for STAGE (strategically acquired gradient echo) imaging. The concept itself is presented first, followed by simulations to demonstrate its theoretical effectiveness. Then the SNR improvement on proton spin density (PSD) and R2⁎ maps was investigated using brain STAGE data acquired from 10 healthy controls (HCs) and 10 patients with Parkinson's disease (PD). For the PSD and R2* maps, the SNR and CNR between white matter and gray matter were improved by a factor of 1.87 ± 0.50 and 1.72 ± 0.88, respectively. The white matter hyperintensity lesions in PD patients were more clearly defined after CROWN processing. Using these improved maps, simulated images for any repeat time, echo time or flip angle can be created with improved SNR. The potential applications of this technology are to trade off the increased SNR for higher resolution images and/or faster imaging.
Collapse
Affiliation(s)
- E Mark Haacke
- SpinTech MRI, Bingham Farms, MI 48025, United States of America; Wayne State University, Department of Neurology, Detroit, MI 48201, United States of America; Wayne State University, Department of Radiology, Detroit, MI 48201, United States of America; Zhuyan Limited, Shanghai, China.
| | - Qiuyun Xu
- SpinTech MRI, Bingham Farms, MI 48025, United States of America
| | - Paul Kokeny
- SpinTech MRI, Bingham Farms, MI 48025, United States of America
| | - Sara Gharabaghi
- SpinTech MRI, Bingham Farms, MI 48025, United States of America
| | - Yongsheng Chen
- Wayne State University, Department of Neurology, Detroit, MI 48201, United States of America
| | - Bo Wu
- Zhuyan Limited, Shanghai, China
| | - Yu Liu
- Ruijin Hospital, School of Medicine, Shanghai Jiao Tong University, Department of Radiology, Shanghai, China
| | - Naying He
- Ruijin Hospital, School of Medicine, Shanghai Jiao Tong University, Department of Radiology, Shanghai, China
| | - Fuhua Yan
- Ruijin Hospital, School of Medicine, Shanghai Jiao Tong University, Department of Radiology, Shanghai, China
| |
Collapse
|
7
|
Kim JH, Yoon JH, Kim SW, Park J, Bae SH, Lee JM. Application of a deep learning algorithm for three-dimensional T1-weighted gradient-echo imaging of gadoxetic acid-enhanced MRI in patients at a high risk of hepatocellular carcinoma. Abdom Radiol (NY) 2024; 49:738-747. [PMID: 38095685 DOI: 10.1007/s00261-023-04124-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2023] [Revised: 10/30/2023] [Accepted: 11/03/2023] [Indexed: 03/05/2024]
Abstract
PURPOSE To evaluate the efficacy of a vendor-specific deep learning reconstruction algorithm (DLRA) in enhancing image quality and focal lesion detection using three-dimensional T1-weighted gradient-echo images in gadoxetic acid-enhanced liver magnetic resonance imaging (MRI) in patients at a high risk of hepatocellular carcinoma. MATERIALS AND METHODS In this retrospective analysis, 83 high-risk patients with hepatocellular carcinoma underwent gadoxetic acid-enhanced liver MRI using a 3-T scanner. Triple arterial phase, high-resolution portal venous phase, and high-resolution hepatobiliary phase images were reconstructed using conventional reconstruction techniques and DLRA (AIRTM Recon DL; GE Healthcare) for subsequent comparison. Image quality and solid focal lesion detection were assessed by three abdominal radiologists and compared between conventional and DL methods. Focal liver lesion detection was evaluated using figures of merit (FOMs) from a jackknife alternative free-response receiver operating characteristic analysis on a per-lesion basis. RESULTS DLRA-reconstructed images exhibited significantly improved overall image quality, image contrast, lesion conspicuity, vessel conspicuity, and liver edge sharpness and reduced subjective image noise, ringing artifacts, and motion artifacts compared to conventionally reconstructed images (all P < 0.05). Although there was no significant difference in the FOMs of non-cystic focal liver lesions between the conventional and DL methods, DLRA-reconstructed images showed notably higher pooled sensitivity than conventionally reconstructed images (P < 0.05) in all phases and higher detection rates for viable post-treatment HCCs in the arterial and hepatobiliary phases (all P < 0.05). CONCLUSIONS Implementing DLRA can enhance the image quality in 3D T1-weighted gradient-echo sequences of gadoxetic acid-enhanced liver MRI examinations, leading to improved detection of viable post-treatment HCCs.
Collapse
Affiliation(s)
- Jae Hyun Kim
- Department of Radiology, Seoul National University Hospital, Seoul, Republic of Korea
- Department of Radiology, Seoul National University College of Medicine, 28, Yongon-dong, Chongno-gu, Seoul, 110-744, Republic of Korea
| | - Jeong Hee Yoon
- Department of Radiology, Seoul National University Hospital, Seoul, Republic of Korea
- Department of Radiology, Seoul National University College of Medicine, 28, Yongon-dong, Chongno-gu, Seoul, 110-744, Republic of Korea
| | - Se Woo Kim
- Department of Radiology, Seoul National University Hospital, Seoul, Republic of Korea
- Department of Radiology, Seoul National University College of Medicine, 28, Yongon-dong, Chongno-gu, Seoul, 110-744, Republic of Korea
| | - Junghoan Park
- Department of Radiology, Seoul National University Hospital, Seoul, Republic of Korea
- Department of Radiology, Seoul National University College of Medicine, 28, Yongon-dong, Chongno-gu, Seoul, 110-744, Republic of Korea
| | - Seong Hwan Bae
- Department of Radiology, Soonchunhyang University Seoul Hospital, Seoul, Republic of Korea
| | - Jeong Min Lee
- Department of Radiology, Seoul National University Hospital, Seoul, Republic of Korea.
- Department of Radiology, Seoul National University College of Medicine, 28, Yongon-dong, Chongno-gu, Seoul, 110-744, Republic of Korea.
- Institute of Radiation Medicine, Seoul National University Medical Research Center, Seoul, Republic of Korea.
| |
Collapse
|
8
|
Nigam S, Gjelaj E, Wang R, Wei GW, Wang P. Machine Learning and Deep Learning Applications in Magnetic Particle Imaging. J Magn Reson Imaging 2024. [PMID: 38358090 DOI: 10.1002/jmri.29294] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Revised: 01/29/2024] [Accepted: 01/31/2024] [Indexed: 02/16/2024] Open
Abstract
In recent years, magnetic particle imaging (MPI) has emerged as a promising imaging technique depicting high sensitivity and spatial resolution. It originated in the early 2000s where it proposed a new approach to challenge the low spatial resolution achieved by using relaxometry in order to measure the magnetic fields. MPI presents 2D and 3D images with high temporal resolution, non-ionizing radiation, and optimal visual contrast due to its lack of background tissue signal. Traditionally, the images were reconstructed by the conversion of signal from the induced voltage by generating system matrix and X-space based methods. Because image reconstruction and analyses play an integral role in obtaining precise information from MPI signals, newer artificial intelligence-based methods are continuously being researched and developed upon. In this work, we summarize and review the significance and employment of machine learning and deep learning models for applications with MPI and the potential they hold for the future. LEVEL OF EVIDENCE: 5 TECHNICAL EFFICACY: Stage 1.
Collapse
Affiliation(s)
- Saumya Nigam
- Precision Health Program, Michigan State University, East Lansing, Michigan, USA
- Department of Radiology, College of Human Medicine, Michigan State University, East Lansing, Michigan, USA
| | - Elvira Gjelaj
- Precision Health Program, Michigan State University, East Lansing, Michigan, USA
- Lyman Briggs College, Michigan State University, East Lansing, Michigan, USA
| | - Rui Wang
- Department of Mathematics, College of Natural Science, Michigan State University, East Lansing, Michigan, USA
| | - Guo-Wei Wei
- Department of Mathematics, College of Natural Science, Michigan State University, East Lansing, Michigan, USA
- Department of Electrical and Computer Engineering, College of Engineering, Michigan State University, East Lansing, Michigan, USA
- Department of Biochemistry and Molecular Biology, College of Natural Science, Michigan State University, East Lansing, Michigan, USA
| | - Ping Wang
- Precision Health Program, Michigan State University, East Lansing, Michigan, USA
- Department of Radiology, College of Human Medicine, Michigan State University, East Lansing, Michigan, USA
| |
Collapse
|
9
|
Hossain MB, Shinde RK, Oh S, Kwon KC, Kim N. A Systematic Review and Identification of the Challenges of Deep Learning Techniques for Undersampled Magnetic Resonance Image Reconstruction. SENSORS (BASEL, SWITZERLAND) 2024; 24:753. [PMID: 38339469 PMCID: PMC10856856 DOI: 10.3390/s24030753] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/30/2023] [Revised: 01/05/2024] [Accepted: 01/22/2024] [Indexed: 02/12/2024]
Abstract
Deep learning (DL) in magnetic resonance imaging (MRI) shows excellent performance in image reconstruction from undersampled k-space data. Artifact-free and high-quality MRI reconstruction is essential for ensuring accurate diagnosis, supporting clinical decision-making, enhancing patient safety, facilitating efficient workflows, and contributing to the validity of research studies and clinical trials. Recently, deep learning has demonstrated several advantages over conventional MRI reconstruction methods. Conventional methods rely on manual feature engineering to capture complex patterns and are usually computationally demanding due to their iterative nature. Conversely, DL methods use neural networks with hundreds of thousands of parameters and automatically learn relevant features and representations directly from the data. Nevertheless, there are some limitations to DL-based techniques concerning MRI reconstruction tasks, such as the need for large, labeled datasets, the possibility of overfitting, and the complexity of model training. Researchers are striving to develop DL models that are more efficient, adaptable, and capable of providing valuable information for medical practitioners. We provide a comprehensive overview of the current developments and clinical uses by focusing on state-of-the-art DL architectures and tools used in MRI reconstruction. This study has three objectives. Our main objective is to describe how various DL designs have changed over time and talk about cutting-edge tactics, including their advantages and disadvantages. Hence, data pre- and post-processing approaches are assessed using publicly available MRI datasets and source codes. Secondly, this work aims to provide an extensive overview of the ongoing research on transformers and deep convolutional neural networks for rapid MRI reconstruction. Thirdly, we discuss several network training strategies, like supervised, unsupervised, transfer learning, and federated learning for rapid and efficient MRI reconstruction. Consequently, this article provides significant resources for future improvement of MRI data pre-processing and fast image reconstruction.
Collapse
Affiliation(s)
- Md. Biddut Hossain
- School of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Republic of Korea; (M.B.H.); (R.K.S.)
| | - Rupali Kiran Shinde
- School of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Republic of Korea; (M.B.H.); (R.K.S.)
| | - Sukhoon Oh
- Research Equipment Operation Department, Korea Basic Science Institute, Cheongju-si 28119, Chungcheongbuk-do, Republic of Korea;
| | - Ki-Chul Kwon
- School of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Republic of Korea; (M.B.H.); (R.K.S.)
| | - Nam Kim
- School of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Republic of Korea; (M.B.H.); (R.K.S.)
| |
Collapse
|
10
|
Yoon MA, Gold GE, Chaudhari AS. Accelerated Musculoskeletal Magnetic Resonance Imaging. J Magn Reson Imaging 2023. [PMID: 38156716 DOI: 10.1002/jmri.29205] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2023] [Revised: 12/13/2023] [Accepted: 12/14/2023] [Indexed: 01/03/2024] Open
Abstract
With a substantial growth in the use of musculoskeletal MRI, there has been a growing need to improve MRI workflow, and faster imaging has been suggested as one of the solutions for a more efficient examination process. Consequently, there have been considerable advances in accelerated MRI scanning methods. This article aims to review the basic principles and applications of accelerated musculoskeletal MRI techniques including widely used conventional acceleration methods, more advanced deep learning-based techniques, and new approaches to reduce scan time. Specifically, conventional accelerated MRI techniques, including parallel imaging, compressed sensing, and simultaneous multislice imaging, and deep learning-based accelerated MRI techniques, including undersampled MR image reconstruction, super-resolution imaging, artifact correction, and generation of unacquired contrast images, are discussed. Finally, new approaches to reduce scan time, including synthetic MRI, novel sequences, and new coil setups and designs, are also reviewed. We believe that a deep understanding of these fast MRI techniques and proper use of combined acceleration methods will synergistically improve scan time and MRI workflow in daily practice. EVIDENCE LEVEL: 3 TECHNICAL EFFICACY: Stage 1.
Collapse
Affiliation(s)
- Min A Yoon
- Department of Radiology, Stanford University, Stanford, California, USA
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, South Korea
| | - Garry E Gold
- Department of Radiology, Stanford University, Stanford, California, USA
- Department of Orthopaedic Surgery, Stanford University, Stanford, California, USA
- Department of Bioengineering, Stanford University, Stanford, California, USA
| | | |
Collapse
|
11
|
Li Y, Dong B, Yuan P. The diagnostic value of machine learning for the classification of malignant bone tumor: a systematic evaluation and meta-analysis. Front Oncol 2023; 13:1207175. [PMID: 37746301 PMCID: PMC10513372 DOI: 10.3389/fonc.2023.1207175] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2023] [Accepted: 08/23/2023] [Indexed: 09/26/2023] Open
Abstract
Background Malignant bone tumors are a type of cancer with varying malignancy and prognosis. Accurate diagnosis and classification are crucial for treatment and prognosis assessment. Machine learning has been introduced for early differential diagnosis of malignant bone tumors, but its performance is controversial. This systematic review and meta-analysis aims to explore the diagnostic value of machine learning for malignant bone tumors. Methods PubMed, Embase, Cochrane Library, and Web of Science were searched for literature on machine learning in the differential diagnosis of malignant bone tumors up to October 31, 2022. The risk of bias assessment was conducted using QUADAS-2. A bivariate mixed-effects model was used for meta-analysis, with subgroup analyses by machine learning methods and modeling approaches. Results The inclusion comprised 31 publications with 382,371 patients, including 141,315 with malignant bone tumors. Meta-analysis results showed machine learning sensitivity and specificity of 0.87 [95% CI: 0.81,0.91] and 0.91 [95% CI: 0.86,0.94] in the training set, and 0.83 [95% CI: 0.74,0.89] and 0.87 [95% CI: 0.79,0.92] in the validation set. Subgroup analysis revealed MRI-based radiomics was the most common approach, with sensitivity and specificity of 0.85 [95% CI: 0.74,0.91] and 0.87 [95% CI: 0.81,0.91] in the training set, and 0.79 [95% CI: 0.70,0.86] and 0.79 [95% CI: 0.70,0.86] in the validation set. Convolutional neural networks were the most common model type, with sensitivity and specificity of 0.86 [95% CI: 0.72,0.94] and 0.92 [95% CI: 0.82,0.97] in the training set, and 0.87 [95% CI: 0.51,0.98] and 0.87 [95% CI: 0.69,0.96] in the validation set. Conclusion Machine learning is mainly applied in radiomics for diagnosing malignant bone tumors, showing desirable diagnostic performance. Machine learning can be an early adjunctive diagnostic method but requires further research and validation to determine its practical efficiency and clinical application prospects. Systematic review registration https://www.crd.york.ac.uk/prospero/, identifier CRD42023387057.
Collapse
Affiliation(s)
| | - Bo Dong
- Department of Orthopedics, Xi’an Honghui Hospital, Xi’an Jiaotong University, Xi’an Shaanxi, China
| | | |
Collapse
|
12
|
Li T, Wang J, Yang Y, Glide-Hurst CK, Wen N, Cai J. Multi-parametric MRI for radiotherapy simulation. Med Phys 2023; 50:5273-5293. [PMID: 36710376 PMCID: PMC10382603 DOI: 10.1002/mp.16256] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2021] [Revised: 09/10/2022] [Accepted: 12/06/2022] [Indexed: 01/31/2023] Open
Abstract
Magnetic resonance imaging (MRI) has become an important imaging modality in the field of radiotherapy (RT) in the past decade, especially with the development of various novel MRI and image-guidance techniques. In this review article, we will describe recent developments and discuss the applications of multi-parametric MRI (mpMRI) in RT simulation. In this review, mpMRI refers to a general and loose definition which includes various multi-contrast MRI techniques. Specifically, we will focus on the implementation, challenges, and future directions of mpMRI techniques for RT simulation.
Collapse
Affiliation(s)
- Tian Li
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| | - Jihong Wang
- Department of Radiation Physics, Division of Radiation Oncology, MD Anderson Cancer Center, Houston, Texas, USA
| | - Yingli Yang
- Department of Radiology, Ruijin Hospital, Shanghai Jiaotong Univeristy School of Medicine, Shanghai, China
- SJTU-Ruijing-UIH Institute for Medical Imaging Technology, Ruijin Hospital, Shanghai Jiaotong University School of Medicine, Shanghai, China
| | - Carri K Glide-Hurst
- Department of Radiation Oncology, University of Wisconsin, Madison, Wisconsin, USA
| | - Ning Wen
- Department of Radiology, Ruijin Hospital, Shanghai Jiaotong Univeristy School of Medicine, Shanghai, China
- SJTU-Ruijing-UIH Institute for Medical Imaging Technology, Ruijin Hospital, Shanghai Jiaotong University School of Medicine, Shanghai, China
- The Global Institute of Future Technology, Shanghai Jiaotong University, Shanghai, China
| | - Jing Cai
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| |
Collapse
|
13
|
van de Sande DMJ, Merkofer JP, Amirrajab S, Veta M, van Sloun RJG, Versluis MJ, Jansen JFA, van den Brink JS, Breeuwer M. A review of machine learning applications for the proton MR spectroscopy workflow. Magn Reson Med 2023. [PMID: 37402235 DOI: 10.1002/mrm.29793] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2023] [Revised: 06/20/2023] [Accepted: 06/20/2023] [Indexed: 07/06/2023]
Abstract
This literature review presents a comprehensive overview of machine learning (ML) applications in proton MR spectroscopy (MRS). As the use of ML techniques in MRS continues to grow, this review aims to provide the MRS community with a structured overview of the state-of-the-art methods. Specifically, we examine and summarize studies published between 2017 and 2023 from major journals in the MR field. We categorize these studies based on a typical MRS workflow, including data acquisition, processing, analysis, and artificial data generation. Our review reveals that ML in MRS is still in its early stages, with a primary focus on processing and analysis techniques, and less attention given to data acquisition. We also found that many studies use similar model architectures, with little comparison to alternative architectures. Additionally, the generation of artificial data is a crucial topic, with no consistent method for its generation. Furthermore, many studies demonstrate that artificial data suffers from generalization issues when tested on in vivo data. We also conclude that risks related to ML models should be addressed, particularly for clinical applications. Therefore, output uncertainty measures and model biases are critical to investigate. Nonetheless, the rapid development of ML in MRS and the promising results from the reviewed studies justify further research in this field.
Collapse
Affiliation(s)
- Dennis M J van de Sande
- Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands
| | - Julian P Merkofer
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands
| | - Sina Amirrajab
- Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands
| | - Mitko Veta
- Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands
| | - Ruud J G van Sloun
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands
- Philips Research, Philips Research, Eindhoven, The Netherlands
| | | | - Jacobus F A Jansen
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands
- Department of Radiology and Nuclear Medicine, Maastricht University Medical Center, Maastricht, The Netherlands
- School for Mental Health and Neuroscience, Maastricht University, Maastricht, The Netherlands
| | | | - Marcel Breeuwer
- Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands
- MR R&D - Clinical Science, Philips Healthcare, Best, The Netherlands
| |
Collapse
|
14
|
Kiryu S, Akai H, Yasaka K, Tajima T, Kunimatsu A, Yoshioka N, Akahane M, Abe O, Ohtomo K. Clinical Impact of Deep Learning Reconstruction in MRI. Radiographics 2023; 43:e220133. [PMID: 37200221 DOI: 10.1148/rg.220133] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/20/2023]
Abstract
Deep learning has been recognized as a paradigm-shifting tool in radiology. Deep learning reconstruction (DLR) has recently emerged as a technology used in the image reconstruction process of MRI, which is an essential procedure in generating MR images. Denoising, which is the first DLR application to be realized in commercial MRI scanners, improves signal-to-noise ratio. When applied to lower magnetic field-strength scanners, the signal-to-noise ratio can be increased without extending the imaging time, and image quality is comparable to that of higher-field-strength scanners. Shorter imaging times decrease patient discomfort and reduce MRI scanner running costs. The incorporation of DLR into accelerated acquisition imaging techniques, such as parallel imaging or compressed sensing, shortens the reconstruction time. DLR is based on supervised learning using convolutional layers and is divided into the following three categories: image domain, k-space learning, and direct mapping types. Various studies have reported other derivatives of DLR, and several have shown the feasibility of DLR in clinical practice. Although DLR efficiently reduces Gaussian noise from MR images, denoising makes image artifacts more prominent, and a solution to this problem is desired. Depending on the training of the convolutional neural network, DLR may change the imaging features of lesions and obscure small lesions. Therefore, radiologists may need to adopt the habit of questioning whether any information has been lost on images that appear clean. ©RSNA, 2023 Quiz questions for this article are available in the supplemental material.
Collapse
Affiliation(s)
- Shigeru Kiryu
- From the Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda, Narita 286-0124, Japan (S.K., H.A., K.Y., T.T., A.K., N.Y., M.A.); Department of Radiology, The Institute of Medical Science, The University of Tokyo, Tokyo, Japan (H.A.); Department of Radiology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan (K.Y., O.A.); Department of Radiology, International University of Health and Welfare Mita Hospital, Tokyo, Japan (T.T., A.K.); and International University of Health and Welfare, Otawara, Japan (K.O.)
| | - Hiroyuki Akai
- From the Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda, Narita 286-0124, Japan (S.K., H.A., K.Y., T.T., A.K., N.Y., M.A.); Department of Radiology, The Institute of Medical Science, The University of Tokyo, Tokyo, Japan (H.A.); Department of Radiology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan (K.Y., O.A.); Department of Radiology, International University of Health and Welfare Mita Hospital, Tokyo, Japan (T.T., A.K.); and International University of Health and Welfare, Otawara, Japan (K.O.)
| | - Koichiro Yasaka
- From the Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda, Narita 286-0124, Japan (S.K., H.A., K.Y., T.T., A.K., N.Y., M.A.); Department of Radiology, The Institute of Medical Science, The University of Tokyo, Tokyo, Japan (H.A.); Department of Radiology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan (K.Y., O.A.); Department of Radiology, International University of Health and Welfare Mita Hospital, Tokyo, Japan (T.T., A.K.); and International University of Health and Welfare, Otawara, Japan (K.O.)
| | - Taku Tajima
- From the Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda, Narita 286-0124, Japan (S.K., H.A., K.Y., T.T., A.K., N.Y., M.A.); Department of Radiology, The Institute of Medical Science, The University of Tokyo, Tokyo, Japan (H.A.); Department of Radiology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan (K.Y., O.A.); Department of Radiology, International University of Health and Welfare Mita Hospital, Tokyo, Japan (T.T., A.K.); and International University of Health and Welfare, Otawara, Japan (K.O.)
| | - Akira Kunimatsu
- From the Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda, Narita 286-0124, Japan (S.K., H.A., K.Y., T.T., A.K., N.Y., M.A.); Department of Radiology, The Institute of Medical Science, The University of Tokyo, Tokyo, Japan (H.A.); Department of Radiology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan (K.Y., O.A.); Department of Radiology, International University of Health and Welfare Mita Hospital, Tokyo, Japan (T.T., A.K.); and International University of Health and Welfare, Otawara, Japan (K.O.)
| | - Naoki Yoshioka
- From the Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda, Narita 286-0124, Japan (S.K., H.A., K.Y., T.T., A.K., N.Y., M.A.); Department of Radiology, The Institute of Medical Science, The University of Tokyo, Tokyo, Japan (H.A.); Department of Radiology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan (K.Y., O.A.); Department of Radiology, International University of Health and Welfare Mita Hospital, Tokyo, Japan (T.T., A.K.); and International University of Health and Welfare, Otawara, Japan (K.O.)
| | - Masaaki Akahane
- From the Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda, Narita 286-0124, Japan (S.K., H.A., K.Y., T.T., A.K., N.Y., M.A.); Department of Radiology, The Institute of Medical Science, The University of Tokyo, Tokyo, Japan (H.A.); Department of Radiology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan (K.Y., O.A.); Department of Radiology, International University of Health and Welfare Mita Hospital, Tokyo, Japan (T.T., A.K.); and International University of Health and Welfare, Otawara, Japan (K.O.)
| | - Osamu Abe
- From the Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda, Narita 286-0124, Japan (S.K., H.A., K.Y., T.T., A.K., N.Y., M.A.); Department of Radiology, The Institute of Medical Science, The University of Tokyo, Tokyo, Japan (H.A.); Department of Radiology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan (K.Y., O.A.); Department of Radiology, International University of Health and Welfare Mita Hospital, Tokyo, Japan (T.T., A.K.); and International University of Health and Welfare, Otawara, Japan (K.O.)
| | - Kuni Ohtomo
- From the Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda, Narita 286-0124, Japan (S.K., H.A., K.Y., T.T., A.K., N.Y., M.A.); Department of Radiology, The Institute of Medical Science, The University of Tokyo, Tokyo, Japan (H.A.); Department of Radiology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan (K.Y., O.A.); Department of Radiology, International University of Health and Welfare Mita Hospital, Tokyo, Japan (T.T., A.K.); and International University of Health and Welfare, Otawara, Japan (K.O.)
| |
Collapse
|
15
|
Gatefait CGF, Ellison SLR, Nyangoma S, Schmitter S, Kolbitsch C. Optimisation of data acquisition towards continuous cardiac Magnetic Resonance Fingerprinting applications. Phys Med 2023; 105:102514. [PMID: 36608390 DOI: 10.1016/j.ejmp.2022.102514] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/06/2022] [Revised: 11/10/2022] [Accepted: 12/12/2022] [Indexed: 01/06/2023] Open
Abstract
PURPOSE Assess and optimise acquisition parameters for continuous cardiac Magnetic Resonance Fingerprinting (MRF). METHODS Different acquisition schemes (flip angle amplitude, lobe size, T2-preparation pulses) for cardiac MRF were assessed in simulations and phantom and demonstrated in one healthy volunteer. Three different experimental designs were evaluated using central composite and fractional factorial designs. Relative errors for T1 and T2 were calculated for a wide range of realistic T1 and T2 value combinations. The effect of different designs on the accuracy of T1 and T2 was assessed using response surface modelling and Cohen's f calculations. RESULTS Larger flip angle amplitudes lead to an improvement of T2 accuracy and precision for simulations and phantom experiments. Similar effects could also be shown qualitatively in in-vivo scans. Accuracy and precision of T1 were robust to different design parameters with improved values for faster flip angle variation. Cohen's f showed that T2-preparation pulses influence the accuracy of T2. The number of pulses used is the most important parameter. Without T2-preparation pulses, RMSE were 3.0 ± 8.09 % for T1 and 16.24 ± 14.47 % for T2. Using those pulses reduced the RMSE to 2.3 ± 8.4 % for T1 and 14.11 ± 13.46 % for T2. Nonetheless, even if the improvement is significant, RMSE are still too high for reliable quantification. CONCLUSION In contrast to previous study using triggered MRF sequences using < 30° flip angles, large flip angle amplitudes led to better results for continuous cardiac MRF sequences. T2-preparation pulse can improve the accuracy of T2 estimation but lead to longer scan times.
Collapse
|
16
|
Yang S, Pu Q, Lei C, Zhang Q, Jeon S, Yang X. Low-dose CT denoising with a high-level feature refinement and dynamic convolution network. Med Phys 2022. [PMID: 36542402 DOI: 10.1002/mp.16175] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2022] [Revised: 10/31/2022] [Accepted: 12/08/2022] [Indexed: 12/24/2022] Open
Abstract
BACKGROUND Since the potential health risks of the radiation generated by computer tomography (CT), concerns have been expressed on reducing the radiation dose. However, low-dose CT (LDCT) images contain complex noise and artifacts, bringing uncertainty to medical diagnosis. PURPOSE Existing deep learning (DL)-based denoising methods are difficult to fully exploit hierarchical features of different levels, limiting the effect of denoising. Moreover, the standard convolution kernel is parameter sharing and cannot be adjusted dynamically with input change. This paper proposes an LDCT denoising network using high-level feature refinement and multiscale dynamic convolution to mitigate these problems. METHODS The dual network structure proposed in this paper consists of the feature refinement network (FRN) and the dynamic perception network (DPN). The FDN extracts features of different levels through residual dense connections. The high-level hierarchical information is transmitted to DPN to improve the low-level representations. In DPN, the two networks' features are fused by local channel attention (LCA) to assign weights in different regions and handle CT images' delicate tissues better. Then, the dynamic dilated convolution (DDC) with multibranch and multiscale receptive fields is proposed to enhance the expression and processing ability of the denoising network. The experiments were trained and tested on the dataset "NIH-AAPM-Mayo Clinic Low-Dose CT Grand Challenge," consisting of 10 anonymous patients with normal-dose abdominal CT and LDCT at 25% dose. In addition, external validation was performed on the dataset "Low Dose CT Image and Projection Data," which included 300 chest CT images at 10% dose and 300 head CT images at 25% dose. RESULTS Proposed method compared with seven mainstream LDCT denoising algorithms. On the Mayo dataset, achieved peak signal-to-noise ratio (PSNR): 46.3526 dB (95% CI: 46.0121-46.6931 dB) and structural similarity (SSIM): 0.9844 (95% CI: 0.9834-0.9854). Compared with LDCT, the average increase was 3.4159 dB and 0.0239, respectively. The results are relatively optimal and statistically significant compared with other methods. In external verification, our algorithm can cope well with ultra-low-dose chest CT images at 10% dose and obtain PSNR: 28.6130 (95% CI: 28.1680-29.0580 dB) and SSIM: 0.7201 (95% CI: 0.7101-0.7301). Compared with LDCT, PSNR/SSIM is increased by 3.6536dB and 0.2132, respectively. In addition, the quality of LDCT can also be improved in head CT denoising. CONCLUSIONS This paper proposes a DL-based LDCT denoising algorithm, which utilizes high-level features and multiscale dynamic convolution to optimize the network's denoising effect. This method can realize speedy denoising and performs well in noise suppression and detail preservation, which can be helpful for the diagnosis of LDCT.
Collapse
Affiliation(s)
- Sihan Yang
- College of Electronics and Information Engineering, Sichuan University, Chengdu, Sichuan, China.,School of Aeronautics and Astronautics, Sichuan University, Chengdu, Sichuan, China
| | - Qiang Pu
- Department of Thoracic Surgery, West China Hospital, Sichuan University, Chengdu, Sichuan, China
| | - Chunting Lei
- College of Electronics and Information Engineering, Sichuan University, Chengdu, Sichuan, China.,School of Aeronautics and Astronautics, Sichuan University, Chengdu, Sichuan, China
| | - Qiao Zhang
- Macro Net Communication Co., Ltd., Chongqing, China
| | - Seunggil Jeon
- Samsung Electronics, Suwon-si, Gyeonggi-do, Republic of Korea
| | - Xiaomin Yang
- College of Electronics and Information Engineering, Sichuan University, Chengdu, Sichuan, China.,School of Aeronautics and Astronautics, Sichuan University, Chengdu, Sichuan, China
| |
Collapse
|
17
|
Zerunian M, Pucciarelli F, Caruso D, Polici M, Masci B, Guido G, De Santis D, Polverari D, Principessa D, Benvenga A, Iannicelli E, Laghi A. Artificial intelligence based image quality enhancement in liver MRI: a quantitative and qualitative evaluation. Radiol Med 2022; 127:1098-1105. [PMID: 36070066 PMCID: PMC9512724 DOI: 10.1007/s11547-022-01539-9] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2022] [Accepted: 08/07/2022] [Indexed: 11/25/2022]
Abstract
Purpose To compare liver MRI with AIR Recon Deep Learning™(ARDL) algorithm applied and turned-off (NON-DL) with conventional high-resolution acquisition (NAÏVE) sequences, in terms of quantitative and qualitative image analysis and scanning time. Material and methods This prospective study included fifty consecutive volunteers (31 female, mean age 55.5 ± 20 years) from September to November 2021. 1.5 T MRI was performed and included three sets of images: axial single-shot fast spin-echo (SSFSE) T2 images, diffusion-weighted images(DWI) and apparent diffusion coefficient(ADC) maps acquired with both ARDL and NAÏVE protocol; the NON-DL images, were also assessed. Two radiologists in consensus drew fixed regions of interest in liver parenchyma to calculate signal-to-noise-ratio (SNR) and contrast to-noise-ratio (CNR). Subjective image quality was assessed by two other radiologists independently with a five-point Likert scale. Acquisition time was recorded. Results SSFSE T2 objective analysis showed higher SNR and CNR for ARDL vs NAÏVE, ARDL vs NON-DL(all P < 0.013). Regarding DWI, no differences were found for SNR with ARDL vs NAÏVE and, ARDL vs NON-DL (all P > 0.2517).CNR was higher for ARDL vs NON-DL(P = 0.0170), whereas no differences were found between ARDL and NAÏVE(P = 1). No differences were observed for all three comparisons, in terms of SNR and CNR, for ADC maps (all P > 0.32). Qualitative analysis for all sequences showed better overall image quality for ARDL with lower truncation artifacts, higher sharpness and contrast (all P < 0.0070) with excellent inter-rater agreement (k ≥ 0.8143). Acquisition time was lower in ARDL sequences compared to NAÏVE (SSFSE T2 = 19.08 ± 2.5 s vs. 24.1 ± 2 s and DWI = 207.3 ± 54 s vs. 513.6 ± 98.6 s, all P < 0.0001). Conclusion ARDL applied on upper abdomen showed overall better image quality and reduced scanning time compared with NAÏVE protocol.
Collapse
Affiliation(s)
- Marta Zerunian
- Department of Medical Surgical Sciences and Translational Medicine, Sapienza University of Rome - Sant'Andrea University Hospital, Via di Grottarossa, 1035-1039, 00189, Rome, Italy
| | - Francesco Pucciarelli
- Department of Medical Surgical Sciences and Translational Medicine, Sapienza University of Rome - Sant'Andrea University Hospital, Via di Grottarossa, 1035-1039, 00189, Rome, Italy
| | - Damiano Caruso
- Department of Medical Surgical Sciences and Translational Medicine, Sapienza University of Rome - Sant'Andrea University Hospital, Via di Grottarossa, 1035-1039, 00189, Rome, Italy
| | - Michela Polici
- Department of Medical Surgical Sciences and Translational Medicine, Sapienza University of Rome - Sant'Andrea University Hospital, Via di Grottarossa, 1035-1039, 00189, Rome, Italy
| | - Benedetta Masci
- Department of Medical Surgical Sciences and Translational Medicine, Sapienza University of Rome - Sant'Andrea University Hospital, Via di Grottarossa, 1035-1039, 00189, Rome, Italy
| | - Gisella Guido
- Department of Medical Surgical Sciences and Translational Medicine, Sapienza University of Rome - Sant'Andrea University Hospital, Via di Grottarossa, 1035-1039, 00189, Rome, Italy
| | - Domenico De Santis
- Department of Medical Surgical Sciences and Translational Medicine, Sapienza University of Rome - Sant'Andrea University Hospital, Via di Grottarossa, 1035-1039, 00189, Rome, Italy
| | - Daniele Polverari
- Department of Medical Surgical Sciences and Translational Medicine, Sapienza University of Rome - Sant'Andrea University Hospital, Via di Grottarossa, 1035-1039, 00189, Rome, Italy
| | - Daniele Principessa
- Department of Medical Surgical Sciences and Translational Medicine, Sapienza University of Rome - Sant'Andrea University Hospital, Via di Grottarossa, 1035-1039, 00189, Rome, Italy
| | - Antonella Benvenga
- Department of Medical Surgical Sciences and Translational Medicine, Sapienza University of Rome - Sant'Andrea University Hospital, Via di Grottarossa, 1035-1039, 00189, Rome, Italy
| | - Elsa Iannicelli
- Department of Medical Surgical Sciences and Translational Medicine, Sapienza University of Rome - Sant'Andrea University Hospital, Via di Grottarossa, 1035-1039, 00189, Rome, Italy
| | - Andrea Laghi
- Department of Medical Surgical Sciences and Translational Medicine, Sapienza University of Rome - Sant'Andrea University Hospital, Via di Grottarossa, 1035-1039, 00189, Rome, Italy.
| |
Collapse
|
18
|
Bunch PM, Sachs JR, Kelly HR, Lipford ME, West TG. Magnetic Resonance Imaging of Head and Neck Emergencies, a Symptom-Based Review, Part 1: General Considerations, Vision Loss, and Eye Pain. Magn Reson Imaging Clin N Am 2022; 30:409-424. [PMID: 35995470 DOI: 10.1016/j.mric.2022.04.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
Use of magnetic resonance (MR) imaging in the emergency department continues to increase. Although computed tomography is the first-line imaging modality for most head and neck emergencies, MR is superior in some situations and imparts no ionizing radiation. This article provides a symptom-based approach to nontraumatic head and neck pathologic conditions most relevant to emergency head and neck MR imaging, emphasizing relevant anatomy, "do not miss" findings affecting clinical management, and features that may aid differentiation from potential mimics. Essential MR sequences and strategies for obtaining high-quality images when faced with patient motion and other technical challenges are also discussed.
Collapse
Affiliation(s)
- Paul M Bunch
- Department of Radiology, Wake Forest School of Medicine, Medical Center Boulevard, Winston Salem, NC 27157, USA.
| | - Jeffrey R Sachs
- Department of Radiology, Wake Forest School of Medicine, Medical Center Boulevard, Winston Salem, NC 27157, USA
| | - Hillary R Kelly
- Department of Radiology, Massachusetts General Hospital, 55 Fruit Street, Boston, MA 02114, USA; Department of Radiology, Massachusetts Eye and Ear, 243 Charles Street, Boston, MA 02114, USA; Harvard Medical School, 25 Shattuck Street, Boston, MA 02115, USA
| | - Megan E Lipford
- Department of Radiology, Wake Forest School of Medicine, Medical Center Boulevard, Winston Salem, NC 27157, USA
| | - Thomas G West
- Department of Radiology, Wake Forest School of Medicine, Medical Center Boulevard, Winston Salem, NC 27157, USA
| |
Collapse
|
19
|
Radiomics in Cardiovascular Disease Imaging: from Pixels to the Heart of the Problem. CURRENT CARDIOVASCULAR IMAGING REPORTS 2022. [DOI: 10.1007/s12410-022-09563-z] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
Abstract
Purpose of Review
This review of the literature aims to present potential applications of radiomics in cardiovascular radiology and, in particular, in cardiac imaging.
Recent Findings
Radiomics and machine learning represent a technological innovation which may be used to extract and analyze quantitative features from medical images. They aid in detecting hidden pattern in medical data, possibly leading to new insights in pathophysiology of different medical conditions. In the recent literature, radiomics and machine learning have been investigated for numerous potential applications in cardiovascular imaging. They have been proposed to improve image acquisition and reconstruction, for anatomical structure automated segmentation or automated characterization of cardiologic diseases.
Summary
The number of applications for radiomics and machine learning is continuing to rise, even though methodological and implementation issues still limit their use in daily practice. In the long term, they may have a positive impact in patient management.
Collapse
|
20
|
Taylor AM. The role of artificial intelligence in paediatric cardiovascular magnetic resonance imaging. Pediatr Radiol 2022; 52:2131-2138. [PMID: 34936019 PMCID: PMC9537201 DOI: 10.1007/s00247-021-05218-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/05/2021] [Revised: 08/13/2021] [Accepted: 10/05/2021] [Indexed: 11/24/2022]
Abstract
Artificial intelligence (AI) offers the potential to change many aspects of paediatric cardiac imaging. At present, there are only a few clinically validated examples of AI applications in this field. This review focuses on the use of AI in paediatric cardiovascular MRI, using examples from paediatric cardiovascular MRI, adult cardiovascular MRI and other radiologic experience.
Collapse
Affiliation(s)
- Andrew M. Taylor
- Great Ormond Street Hospital for Children, Zayed Centre for Research, 20 Guildford St., Room 3.7, London, WC1N 1DZ UK ,Cardiovascular Imaging, UCL Institute of Cardiovascular Science, London, UK
| |
Collapse
|
21
|
Retico A, Avanzo M, Boccali T, Bonacorsi D, Botta F, Cuttone G, Martelli B, Salomoni D, Spiga D, Trianni A, Stasi M, Iori M, Talamonti C. Enhancing the impact of Artificial Intelligence in Medicine: A joint AIFM-INFN Italian initiative for a dedicated cloud-based computing infrastructure. Phys Med 2021; 91:140-150. [PMID: 34801873 DOI: 10.1016/j.ejmp.2021.10.005] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/26/2021] [Revised: 10/04/2021] [Accepted: 10/05/2021] [Indexed: 12/23/2022] Open
Abstract
Artificial Intelligence (AI) techniques have been implemented in the field of Medical Imaging for more than forty years. Medical Physicists, Clinicians and Computer Scientists have been collaborating since the beginning to realize software solutions to enhance the informative content of medical images, including AI-based support systems for image interpretation. Despite the recent massive progress in this field due to the current emphasis on Radiomics, Machine Learning and Deep Learning, there are still some barriers to overcome before these tools are fully integrated into the clinical workflows to finally enable a precision medicine approach to patients' care. Nowadays, as Medical Imaging has entered the Big Data era, innovative solutions to efficiently deal with huge amounts of data and to exploit large and distributed computing resources are urgently needed. In the framework of a collaboration agreement between the Italian Association of Medical Physicists (AIFM) and the National Institute for Nuclear Physics (INFN), we propose a model of an intensive computing infrastructure, especially suited for training AI models, equipped with secure storage systems, compliant with data protection regulation, which will accelerate the development and extensive validation of AI-based solutions in the Medical Imaging field of research. This solution can be developed and made operational by Physicists and Computer Scientists working on complementary fields of research in Physics, such as High Energy Physics and Medical Physics, who have all the necessary skills to tailor the AI-technology to the needs of the Medical Imaging community and to shorten the pathway towards the clinical applicability of AI-based decision support systems.
Collapse
Affiliation(s)
- Alessandra Retico
- National Institute for Nuclear Physics (INFN), Pisa Division, 56127 Pisa, Italy
| | - Michele Avanzo
- Medical Physics Department, Centro di Riferimento Oncologico di Aviano (CRO) IRCCS, 33081 Aviano, Italy
| | - Tommaso Boccali
- National Institute for Nuclear Physics (INFN), Pisa Division, 56127 Pisa, Italy
| | - Daniele Bonacorsi
- University of Bologna, 40126 Bologna, Italy; INFN, Bologna Division, 40126 Bologna, Italy
| | - Francesca Botta
- Medical Physics Unit, Istituto Europeo di oncologia IRCCS, 20141 Milan, Italy
| | - Giacomo Cuttone
- INFN, Southern National Laboratory (LNS), 95123 Catania, Italy
| | | | | | | | - Annalisa Trianni
- Medical Physics Unit, Ospedale Santa Chiara APSS, 38122 Trento, Italy
| | - Michele Stasi
- Medical Physics Unit, A.O. Ordine Mauriziano di Torino, 10128 Torino, Italy
| | - Mauro Iori
- Medical Physics Unit, Azienda USL-IRCCS di Reggio Emilia, 42122 Reggio Emilia, Italy.
| | - Cinzia Talamonti
- Department Biomedical Experimental and Clinical Science "Mario Serio", University of Florence, 50134 Florence, Italy; INFN, Florence Division, 50134 Florence, Italy
| |
Collapse
|
22
|
Zanca F, Avanzo M, Colgan N, Crijns W, Guidi G, Hernandez-Giron I, Kagadis GC, Diaz O, Zaidi H, Russo P, Toma-Dasu I, Kortesniemi M. Focus issue: Artificial intelligence in medical physics. Phys Med 2021; 83:287-291. [PMID: 34004585 DOI: 10.1016/j.ejmp.2021.05.008] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/27/2022] Open
Affiliation(s)
- F Zanca
- Palindromo Consulting, Leuven, Belgium
| | - M Avanzo
- Centro di Riferimento Oncologico di Aviano (CRO) IRCCS, Department of Medical Physics, 33081 Aviano, PN, Italy
| | - N Colgan
- School of Physics, National University of Ireland Galway, Galway, Ireland
| | - W Crijns
- Department Oncology, Laboratory of Experimental Radiotherapy, KU Leuven and Department of Radiation Oncology, UZ Leuven, Belgium
| | - G Guidi
- Medical Physics, Az. Ospedaliero-Universitaria di Modena, Modena, Italy
| | - I Hernandez-Giron
- Leiden University Medical Center (LUMC), Radiology Department, Division of Image Processing, Albinusdreef 2, 2333ZA Leiden, The Netherlands
| | - G C Kagadis
- 3DMI Research Group, Department of Medical Physics, School of Medicine, University of Patras, GR 265 04, Greece
| | - O Diaz
- Faculty of Mathematics and Computer Science, University of Barcelona, Barcelona, Spain
| | - H Zaidi
- Geneva University Hospital, Division of Nuclear Medicine and Molecular Imaging, CH-1211 Geneva, Switzerland
| | - P Russo
- Università di Napoli Federico II, Dipartimento di Fisica "Ettore Pancini", I-80126 Naples, Italy
| | - I Toma-Dasu
- Department of Physics, Medical Radiation Physics, Stockholm University, Stockholm, Sweden; Department of Oncology and Pathology, Medical Radiation Physics, Karolinska Institutet, Stockholm, Sweden
| | - M Kortesniemi
- HUS Medical Imaging Center, University of Helsinki and Helsinki University Hospital, Helsinki, Finland
| |
Collapse
|