1
|
Bahloul MA, Jabeen S, Benoumhani S, Alsaleh HA, Belkhatir Z, Al-Wabil A. Advancements in synthetic CT generation from MRI: A review of techniques, and trends in radiation therapy planning. J Appl Clin Med Phys 2024:e14499. [PMID: 39325781 DOI: 10.1002/acm2.14499] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2024] [Revised: 06/27/2024] [Accepted: 07/26/2024] [Indexed: 09/28/2024] Open
Abstract
BACKGROUND Magnetic resonance imaging (MRI) and Computed tomography (CT) are crucial imaging techniques in both diagnostic imaging and radiation therapy. MRI provides excellent soft tissue contrast but lacks the direct electron density data needed to calculate dosage. CT, on the other hand, remains the gold standard due to its accurate electron density information in radiation therapy planning (RTP) but it exposes patients to ionizing radiation. Synthetic CT (sCT) generation from MRI has been a focused study field in the last few years due to cost effectiveness as well as for the objective of minimizing side-effects of using more than one imaging modality for treatment simulation. It offers significant time and cost efficiencies, bypassing the complexities of co-registration, and potentially improving treatment accuracy by minimizing registration-related errors. In an effort to navigate the quickly developing field of precision medicine, this paper investigates recent advancements in sCT generation techniques, particularly those using machine learning (ML) and deep learning (DL). The review highlights the potential of these techniques to improve the efficiency and accuracy of sCT generation for use in RTP by improving patient care and reducing healthcare costs. The intricate web of sCT generation techniques is scrutinized critically, with clinical implications and technical underpinnings for enhanced patient care revealed. PURPOSE This review aims to provide an overview of the most recent advancements in sCT generation from MRI with a particular focus of its use within RTP, emphasizing on techniques, performance evaluation, clinical applications, future research trends and open challenges in the field. METHODS A thorough search strategy was employed to conduct a systematic literature review across major scientific databases. Focusing on the past decade's advancements, this review critically examines emerging approaches introduced from 2013 to 2023 for generating sCT from MRI, providing a comprehensive analysis of their methodologies, ultimately fostering further advancement in the field. This study highlighted significant contributions, identified challenges, and provided an overview of successes within RTP. Classifying the identified approaches, contrasting their advantages and disadvantages, and identifying broad trends were all part of the review's synthesis process. RESULTS The review identifies various sCT generation approaches, consisting atlas-based, segmentation-based, multi-modal fusion, hybrid approaches, ML and DL-based techniques. These approaches are evaluated for image quality, dosimetric accuracy, and clinical acceptability. They are used for MRI-only radiation treatment, adaptive radiotherapy, and MR/PET attenuation correction. The review also highlights the diversity of methodologies for sCT generation, each with its own advantages and limitations. Emerging trends incorporate the integration of advanced imaging modalities including various MRI sequences like Dixon sequences, T1-weighted (T1W), T2-weighted (T2W), as well as hybrid approaches for enhanced accuracy. CONCLUSIONS The study examines MRI-based sCT generation, to minimize negative effects of acquiring both modalities. The study reviews 2013-2023 studies on MRI to sCT generation methods, aiming to revolutionize RTP by reducing use of ionizing radiation and improving patient outcomes. The review provides insights for researchers and practitioners, emphasizing the need for standardized validation procedures and collaborative efforts to refine methods and address limitations. It anticipates the continued evolution of techniques to improve the precision of sCT in RTP.
Collapse
Affiliation(s)
- Mohamed A Bahloul
- College of Engineering, Alfaisal University, Riyadh, Saudi Arabia
- Translational Biomedical Engineering Research Lab, College of Engineering, Alfaisal University, Riyadh, Saudi Arabia
| | - Saima Jabeen
- College of Engineering, Alfaisal University, Riyadh, Saudi Arabia
- Translational Biomedical Engineering Research Lab, College of Engineering, Alfaisal University, Riyadh, Saudi Arabia
- AI Research Center, College of Engineering, Alfaisal University, Riyadh, Saudi Arabia
| | - Sara Benoumhani
- College of Engineering, Alfaisal University, Riyadh, Saudi Arabia
- AI Research Center, College of Engineering, Alfaisal University, Riyadh, Saudi Arabia
| | | | - Zehor Belkhatir
- School of Electronics and Computer Science, University of Southampton, Southampton, UK
| | - Areej Al-Wabil
- College of Engineering, Alfaisal University, Riyadh, Saudi Arabia
- AI Research Center, College of Engineering, Alfaisal University, Riyadh, Saudi Arabia
| |
Collapse
|
2
|
Villegas F, Dal Bello R, Alvarez-Andres E, Dhont J, Janssen T, Milan L, Robert C, Salagean GAM, Tejedor N, Trnková P, Fusella M, Placidi L, Cusumano D. Challenges and opportunities in the development and clinical implementation of artificial intelligence based synthetic computed tomography for magnetic resonance only radiotherapy. Radiother Oncol 2024; 198:110387. [PMID: 38885905 DOI: 10.1016/j.radonc.2024.110387] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2023] [Revised: 06/13/2024] [Accepted: 06/13/2024] [Indexed: 06/20/2024]
Abstract
Synthetic computed tomography (sCT) generated from magnetic resonance imaging (MRI) can serve as a substitute for planning CT in radiation therapy (RT), thereby removing registration uncertainties associated with multi-modality imaging pairing, reducing costs and patient radiation exposure. CE/FDA-approved sCT solutions are nowadays available for pelvis, brain, and head and neck, while more complex deep learning (DL) algorithms are under investigation for other anatomic sites. The main challenge in achieving a widespread clinical implementation of sCT lies in the absence of consensus on sCT commissioning and quality assurance (QA), resulting in variation of sCT approaches across different hospitals. To address this issue, a group of experts gathered at the ESTRO Physics Workshop 2022 to discuss the integration of sCT solutions into clinics and report the process and its outcomes. This position paper focuses on aspects of sCT development and commissioning, outlining key elements crucial for the safe implementation of an MRI-only RT workflow.
Collapse
Affiliation(s)
- Fernanda Villegas
- Department of Oncology-Pathology, Karolinska Institute, Solna, Sweden; Radiotherapy Physics and Engineering, Medical Radiation Physics and Nuclear Medicine, Karolinska University Hospital, Solna, Sweden
| | - Riccardo Dal Bello
- Department of Radiation Oncology, University Hospital Zurich and University of Zurich, Zurich, Switzerland
| | - Emilie Alvarez-Andres
- OncoRay - National Center for Radiation Research in Oncology, Medical Faculty and University Hospital Carl Gustav Carus, TUD Dresden University of Technology, Helmholtz-Zentrum Dresden-Rossendorf, Dresden, Germany; Faculty of Medicine Carl Gustav Carus, TUD Dresden University of Technology, Dresden, Germany
| | - Jennifer Dhont
- Université libre de Bruxelles (ULB), Hôpital Universitaire de Bruxelles (H.U.B), Institut Jules Bordet, Department of Medical Physics, Brussels, Belgium; Université Libre De Bruxelles (ULB), Radiophysics and MRI Physics Laboratory, Brussels, Belgium
| | - Tomas Janssen
- Department of Radiation Oncology, The Netherlands Cancer Institute, Amsterdam, The Netherlands
| | - Lisa Milan
- Medical Physics Unit, Imaging Institute of Southern Switzerland (IIMSI), Ente Ospedaliero Cantonale, Bellinzona, Switzerland
| | - Charlotte Robert
- UMR 1030 Molecular Radiotherapy and Therapeutic Innovations, ImmunoRadAI, Paris-Saclay University, Institut Gustave Roussy, Inserm, Villejuif, France; Department of Radiation Oncology, Gustave Roussy, Villejuif, France
| | - Ghizela-Ana-Maria Salagean
- Faculty of Physics, Babes-Bolyai University, Cluj-Napoca, Romania; Department of Radiation Oncology, TopMed Medical Centre, Targu Mures, Romania
| | - Natalia Tejedor
- Department of Medical Physics and Radiation Protection, Hospital de la Santa Creu i Sant Pau, Barcelona, Spain
| | - Petra Trnková
- Department of Radiation Oncology, Medical University of Vienna, Vienna, Austria
| | - Marco Fusella
- Department of Radiation Oncology, Abano Terme Hospital, Italy
| | - Lorenzo Placidi
- Fondazione Policlinico Universitario Agostino Gemelli, IRCCS, Department of Diagnostic Imaging, Oncological Radiotherapy and Hematology, Rome, Italy.
| | - Davide Cusumano
- Mater Olbia Hospital, Strada Statale Orientale Sarda 125, Olbia, Sassari, Italy
| |
Collapse
|
3
|
Chauhan V, Harikishore K, Girdhar S, Kaushik S, Wiesinger F, Cozzini C, Carl M, Fung M, Mehta BB, Thomas B, Kesavadas C. Utility of zero echo time (ZTE) sequence for assessing bony lesions of skull base and calvarium. Clin Radiol 2024:S0009-9260(24)00499-9. [PMID: 39322533 DOI: 10.1016/j.crad.2024.08.029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2024] [Revised: 06/09/2024] [Accepted: 08/26/2024] [Indexed: 09/27/2024]
Abstract
BACKGROUND The emergence of zero echo time (ZTE) imaging has transformed bone imaging, overcoming historical limitations in capturing detailed bone structures. By minimizing the time gap between radiofrequency excitation and data acquisition, ZTE generates CT-like images. While ZTE has shown promise in various applications, its potential in assessing skull base and calvarium lesions remains unexplored. Hence we aim to introduce a novel perspective by investigating the utility of inverted ZTE images (iZTE) and pseudoCT (pCT) images for studying lesions in the skull base and calvarium. MATERIALS AND METHODS A total of 35 eligible patients, with an average age of 42 years and a male/female ratio of 1:4, underwent ZTE MRI and images are processed to generate iZTE and pCT images were generated through a series of steps including intensity equalization, thresholding, and deep learning-based pCT generation. These images were then compared to CT scans using a rating scale; inter-rater kappa coefficient evaluated observer consensus while statistical metrics like sensitivity and specificity assessed their performance in capturing bone-related characteristics. RESULTS The study revealed excellent interobserver agreement for lesion assessment using both pCT and iZTE imaging modalities, with kappa coefficient of 0.91 (P < 0.0001) and 0.92 respectively (P < 0.0001). Also, pCT and iZTE accurately predicted various lesion characteristics with sensitivity ranging from 84.3% to 95.1% and 82.6%-94.2% (95% CI) with a diagnostic accuracy of 95.56% and 94.44% respectively. Although both of them encountered challenges with ground glassing, hyperostosis, and intralesional bony fragments, they showed good performance in other bony lesion assessments. CONCLUSIONS The pilot study suggests strong potential for integrating the ZTE imaging into standard care for skull base and calvarial bony lesions assessment. Additionally, larger-scale studies are needed for comprehensive assessment of its efficacy.
Collapse
Affiliation(s)
- V Chauhan
- Sree Chitra Tirunal Institute of Medical Sciences and Technology, Trivandrum, Kerala, India.
| | - K Harikishore
- Sree Chitra Tirunal Institute of Medical Sciences and Technology, Trivandrum, Kerala, India.
| | - S Girdhar
- Sree Chitra Tirunal Institute of Medical Sciences and Technology, Trivandrum, Kerala, India.
| | | | | | | | | | | | | | - B Thomas
- Sree Chitra Tirunal Institute of Medical Sciences and Technology, Trivandrum, Kerala, India.
| | - C Kesavadas
- Sree Chitra Tirunal Institute of Medical Sciences and Technology, Trivandrum, Kerala, India.
| |
Collapse
|
4
|
Getzmann JM, Deininger-Czermak E, Melissanidis S, Ensle F, Kaushik SS, Wiesinger F, Cozzini C, Sconfienza LM, Guggenberger R. Deep learning-based pseudo-CT synthesis from zero echo time MR sequences of the pelvis. Insights Imaging 2024; 15:202. [PMID: 39120752 PMCID: PMC11315823 DOI: 10.1186/s13244-024-01751-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2024] [Accepted: 06/17/2024] [Indexed: 08/10/2024] Open
Abstract
OBJECTIVES To generate pseudo-CT (pCT) images of the pelvis from zero echo time (ZTE) MR sequences and compare them to conventional CT. METHODS Ninety-one patients were prospectively scanned with CT and MRI including ZTE sequences of the pelvis. Eleven ZTE image volumes were excluded due to implants and severe B1 field inhomogeneity. Out of the 80 data sets, 60 were used to train and update a deep learning (DL) model for pCT image synthesis from ZTE sequences while the remaining 20 cases were selected as an evaluation cohort. CT and pCT images were assessed qualitatively and quantitatively by two readers. RESULTS Mean pCT ratings of qualitative parameters were good to perfect (2-3 on a 4-point scale). Overall intermodality agreement between CT and pCT was good (ICC = 0.88 (95% CI: 0.85-0.90); p < 0.001) with excellent interreader agreements for pCT (ICC = 0.91 (95% CI: 0.88-0.93); p < 0.001). Most geometrical measurements did not show any significant difference between CT and pCT measurements (p > 0.05) with the exception of transverse pelvic diameter measurements and lateral center-edge angle measurements (p = 0.001 and p = 0.002, respectively). Image quality and tissue differentiation in CT and pCT were similar without significant differences between CT and pCT CNRs (all p > 0.05). CONCLUSIONS Using a DL-based algorithm, it is possible to synthesize pCT images of the pelvis from ZTE sequences. The pCT images showed high bone depiction quality and accurate geometrical measurements compared to conventional CT. CRITICAL RELEVANCE STATEMENT: pCT images generated from MR sequences allow for high accuracy in evaluating bone without the need for radiation exposure. Radiological applications are broad and include assessment of inflammatory and degenerative bone disease or preoperative planning studies. KEY POINTS pCT, based on DL-reconstructed ZTE MR images, may be comparable with true CT images. Overall, the intermodality agreement between CT and pCT was good with excellent interreader agreements for pCT. Geometrical measurements and tissue differentiation were similar in CT and pCT images.
Collapse
Affiliation(s)
- Jonas M Getzmann
- Institute of Diagnostic and Interventional Radiology, University Hospital Zurich (USZ), Zurich, Switzerland.
- University of Zurich (UZH), Zurich, Switzerland.
- Unit of Diagnostic and Interventional Radiology, IRCCS Istituto Ortopedico Galeazzi, Milan, Italy.
| | - Eva Deininger-Czermak
- Institute of Diagnostic and Interventional Radiology, University Hospital Zurich (USZ), Zurich, Switzerland
- University of Zurich (UZH), Zurich, Switzerland
- Institute of Forensic Medicine, University of Zurich (UZH), Zurich, Switzerland
| | - Savvas Melissanidis
- Institute of Diagnostic and Interventional Radiology, University Hospital Zurich (USZ), Zurich, Switzerland
- University of Zurich (UZH), Zurich, Switzerland
| | - Falko Ensle
- Institute of Diagnostic and Interventional Radiology, University Hospital Zurich (USZ), Zurich, Switzerland
- University of Zurich (UZH), Zurich, Switzerland
| | | | | | | | - Luca M Sconfienza
- Unit of Diagnostic and Interventional Radiology, IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
- University of Milan, Department of Biomedical Sciences for Health, Milan, Italy
| | - Roman Guggenberger
- Institute of Diagnostic and Interventional Radiology, University Hospital Zurich (USZ), Zurich, Switzerland
- University of Zurich (UZH), Zurich, Switzerland
| |
Collapse
|
5
|
Wyatt JJ, Kaushik S, Cozzini C, Pearson RA, Petrides G, Wiesinger F, McCallum HM, Maxwell RJ. Evaluating a radiotherapy deep learning synthetic CT algorithm for PET-MR attenuation correction in the pelvis. EJNMMI Phys 2024; 11:10. [PMID: 38282050 PMCID: PMC11266329 DOI: 10.1186/s40658-024-00617-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Accepted: 01/15/2024] [Indexed: 01/30/2024] Open
Abstract
BACKGROUND Positron emission tomography-magnetic resonance (PET-MR) attenuation correction is challenging because the MR signal does not represent tissue density and conventional MR sequences cannot image bone. A novel zero echo time (ZTE) MR sequence has been previously developed which generates signal from cortical bone with images acquired in 65 s. This has been combined with a deep learning model to generate a synthetic computed tomography (sCT) for MR-only radiotherapy. This study aimed to evaluate this algorithm for PET-MR attenuation correction in the pelvis. METHODS Ten patients being treated with ano-rectal radiotherapy received a [Formula: see text]F-FDG-PET-MR in the radiotherapy position. Attenuation maps were generated from ZTE-based sCT (sCTAC) and the standard vendor-supplied MRAC. The radiotherapy planning CT scan was rigidly registered and cropped to generate a gold standard attenuation map (CTAC). PET images were reconstructed using each attenuation map and compared for standard uptake value (SUV) measurement, automatic thresholded gross tumour volume (GTV) delineation and GTV metabolic parameter measurement. The last was assessed for clinical equivalence to CTAC using two one-sided paired t tests with a significance level corrected for multiple testing of [Formula: see text]. Equivalence margins of [Formula: see text] were used. RESULTS Mean whole-image SUV differences were -0.02% (sCTAC) compared to -3.0% (MRAC), with larger differences in the bone regions (-0.5% to -16.3%). There was no difference in thresholded GTVs, with Dice similarity coefficients [Formula: see text]. However, there were larger differences in GTV metabolic parameters. Mean differences to CTAC in [Formula: see text] were [Formula: see text] (± standard error, sCTAC) and [Formula: see text] (MRAC), and [Formula: see text] (sCTAC) and [Formula: see text] (MRAC) in [Formula: see text]. The sCTAC was statistically equivalent to CTAC within a [Formula: see text] equivalence margin for [Formula: see text] and [Formula: see text] ([Formula: see text] and [Formula: see text]), whereas the MRAC was not ([Formula: see text] and [Formula: see text]). CONCLUSION Attenuation correction using this radiotherapy ZTE-based sCT algorithm was substantially more accurate than current MRAC methods with only a 40 s increase in MR acquisition time. This did not impact tumour delineation but did significantly improve the accuracy of whole-image and tumour SUV measurements, which were clinically equivalent to CTAC. This suggests PET images reconstructed with sCTAC would enable accurate quantitative PET images to be acquired on a PET-MR scanner.
Collapse
Affiliation(s)
- Jonathan J Wyatt
- Translation and Clinical Research Institute, Newcastle University, Newcastle upon Tyne, UK.
- Northern Centre for Cancer Care, Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK.
| | - Sandeep Kaushik
- GE Healthcare, Munich, Germany
- Department of Quantitative Biomedicine, University of Zurich, Zurich, Switzerland
| | | | - Rachel A Pearson
- Translation and Clinical Research Institute, Newcastle University, Newcastle upon Tyne, UK
- Northern Centre for Cancer Care, Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK
| | - George Petrides
- Nuclear Medicine Department, Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK
| | | | - Hazel M McCallum
- Translation and Clinical Research Institute, Newcastle University, Newcastle upon Tyne, UK
- Northern Centre for Cancer Care, Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK
| | - Ross J Maxwell
- Translation and Clinical Research Institute, Newcastle University, Newcastle upon Tyne, UK
| |
Collapse
|