51
|
Gao L, Xie K, Sun J, Lin T, Sui J, Yang G, Ni X. Streaking artifact reduction for CBCT-based synthetic CT generation in adaptive radiotherapy. Med Phys 2023; 50:879-893. [PMID: 36183234 DOI: 10.1002/mp.16017] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2022] [Revised: 09/02/2022] [Accepted: 09/25/2022] [Indexed: 11/07/2022] Open
Abstract
BACKGROUND Cone-beam computed tomography (CBCT) is widely used for daily image guidance in radiation therapy, enhancing the reproducibility of patient setup. However, its application in adaptive radiotherapy (ART) is limited by many imaging artifacts and inaccurate Hounsfield units (HUs). The correction of CBCT image is necessary and of great value for CBCT-based ART. PURPOSE To explore the synthetic CT (sCT) generation from CBCT images of thorax and abdomen patients, which usually surfer from serious artifacts duo to organ state changes. In this study, a streaking artifact reduction network (SARN) is proposed to reduce artifacts and combine with cycleGAN to generate high-quality sCT images from CBCT and achieve an accurate dose calculation. METHODS The proposed SARN was trained in a self-supervised manner. Artifact-CT images were generated from planning CT by random deformation and projection replacement, and SARN was trained based on paired artifact-CT and CT images. The planning CT and CBCT images of 260 patients with cancer, including 120 thoracic and 140 abdominal CT scans, were used to train and evaluate neural networks. The CBCT images of another 12 patients in late treatment fractions, which contained large anatomy changes, were also tested by trained models. The trained models include commonly used U-Net, cycleGAN, attention-gated cycleGAN (cycAT), and cascade models combined SARN with cycleGAN or cycAT. The generated sCT images were compared in terms of image quality and dose calculation accuracy. RESULTS The sCT images generated by SARN combined with cycleGAN and cycAT showed the best image quality, removed the most artifacts, and retained the normal anatomical structure. The SARN+cycleGAN performed best in streaking artifacts removal with the maximum percent integrity uniformity (PIUm ) of 91.0% and minimum standard deviation (SD) of 35.4 HU for delineated artifact regions among all models. The mean absolute error (MAE) of CBCT images in the thorax and abdomen were 71.6 and 55.2 HU, respectively, using planning CT images after deformable registration as ground truth. Compared with CBCT, the thoracic and abdominal sCT images generated by each model had significantly improved image quality with smaller MAE (p < 0.05). The SARN+cycAT obtained the minimum MAEs of 42.5 HU in the thorax while SARN+cycleGAN got the minimum MAEs of 32.0 HU in the abdomen. The sCT generated by U-Net had a remarkably lower anatomical structure accuracy compared with the other models. The thoracic and abdominal sCT images generated by SARN+cycleGAN showed optimal dose calculation accuracy with gamma passing rates (2 mm/2%) of 98.2% and 96.9%, respectively. CONCLUSIONS The proposed SARN can reduce serious streaking artifacts in CBCT images. The SARN combined with cycleGAN can generate high-quality sCT images with fewer artifacts, high-accuracy HU values, and accurate anatomical structures, thus providing reliable dose calculation in ART.
Collapse
Affiliation(s)
- Liugang Gao
- School of Computer Science and Engineering, Southeast University, Nanjing, China
- The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
| | - Kai Xie
- The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
| | - Jiawei Sun
- The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
| | - Tao Lin
- The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
| | - Jianfeng Sui
- The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
| | - Guanyu Yang
- School of Computer Science and Engineering, Southeast University, Nanjing, China
| | - Xinye Ni
- The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
| |
Collapse
|
52
|
Garcia Hernandez A, Fau P, Wojak J, Mailleux H, Benkreira M, Rapacchi S, Adel M. Synthetic computed tomography generation for abdominal adaptive radiotherapy using low-field magnetic resonance imaging. Phys Imaging Radiat Oncol 2023; 25:100425. [PMID: 36896334 PMCID: PMC9988674 DOI: 10.1016/j.phro.2023.100425] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2022] [Revised: 02/12/2023] [Accepted: 02/17/2023] [Indexed: 02/24/2023] Open
Abstract
Background and Purpose Magnetic Resonance guided Radiotherapy (MRgRT) still needs the acquisition of Computed Tomography (CT) images and co-registration between CT and Magnetic Resonance Imaging (MRI). The generation of synthetic CT (sCT) images from the MR data can overcome this limitation. In this study we aim to propose a Deep Learning (DL) based approach for sCT image generation for abdominal Radiotherapy using low field MR images. Materials and methods CT and MR images were collected from 76 patients treated on abdominal sites. U-Net and conditional Generative Adversarial Network (cGAN) architectures were used to generate sCT images. Additionally, sCT images composed of only six bulk densities were generated with the aim of having a Simplified sCT.Radiotherapy plans calculated using the generated images were compared to the original plan in terms of gamma pass rate and Dose Volume Histogram (DVH) parameters. Results sCT images were generated in 2 s and 2.5 s with U-Net and cGAN architectures respectively.Gamma pass rates for 2%/2mm and 3%/3mm criteria were 91% and 95% respectively. Dose differences within 1% for DVH parameters on the target volume and organs at risk were obtained. Conclusion U-Net and cGAN architectures are able to generate abdominal sCT images fast and accurately from low field MRI.
Collapse
Affiliation(s)
- Armando Garcia Hernandez
- Aix Marseille Univ, CNRS, Centrale Marseille, Institut Fresnel, Marseille, France
- Corresponding author.
| | - Pierre Fau
- Institut Paoli-Calmettes, Bouches du Rhône, Marseille, France
| | - Julien Wojak
- Aix Marseille Univ, CNRS, Centrale Marseille, Institut Fresnel, Marseille, France
| | - Hugues Mailleux
- Institut Paoli-Calmettes, Bouches du Rhône, Marseille, France
| | | | | | - Mouloud Adel
- Aix Marseille Univ, CNRS, Centrale Marseille, Institut Fresnel, Marseille, France
| |
Collapse
|
53
|
Anatomical evaluation of deep-learning synthetic computed tomography images generated from male pelvis cone-beam computed tomography. Phys Imaging Radiat Oncol 2023; 25:100416. [PMID: 36969503 PMCID: PMC10037090 DOI: 10.1016/j.phro.2023.100416] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2022] [Revised: 01/17/2023] [Accepted: 01/18/2023] [Indexed: 01/25/2023] Open
Abstract
Background and purpose To improve cone-beam computed tomography (CBCT), deep-learning (DL)-models are being explored to generate synthetic CTs (sCT). The sCT evaluation is mainly focused on image quality and CT number accuracy. However, correct representation of daily anatomy of the CBCT is also important for sCTs in adaptive radiotherapy. The aim of this study was to emphasize the importance of anatomical correctness by quantitatively assessing sCT scans generated from CBCT scans using different paired and unpaired dl-models. Materials and methods Planning CTs (pCT) and CBCTs of 56 prostate cancer patients were included to generate sCTs. Three different dl-models, Dual-UNet, Single-UNet and Cycle-consistent Generative Adversarial Network (CycleGAN), were evaluated on image quality and anatomical correctness. The image quality was assessed using image metrics, such as Mean Absolute Error (MAE). The anatomical correctness between sCT and CBCT was quantified using organs-at-risk volumes and average surface distances (ASD). Results MAE was 24 Hounsfield Unit (HU) [range:19-30 HU] for Dual-UNet, 40 HU [range:34-56 HU] for Single-UNet and 41HU [range:37-46 HU] for CycleGAN. Bladder ASD was 4.5 mm [range:1.6-12.3 mm] for Dual-UNet, 0.7 mm [range:0.4-1.2 mm] for Single-UNet and 0.9 mm [range:0.4-1.1 mm] CycleGAN. Conclusions Although Dual-UNet performed best in standard image quality measures, such as MAE, the contour based anatomical feature comparison with the CBCT showed that Dual-UNet performed worst on anatomical comparison. This emphasizes the importance of adding anatomy based evaluation of sCTs generated by dl-models. For applications in the pelvic area, direct anatomical comparison with the CBCT may provide a useful method to assess the clinical applicability of dl-based sCT generation methods.
Collapse
|
54
|
Goodburn RJ, Philippens MEP, Lefebvre TL, Khalifa A, Bruijnen T, Freedman JN, Waddington DEJ, Younus E, Aliotta E, Meliadò G, Stanescu T, Bano W, Fatemi‐Ardekani A, Wetscherek A, Oelfke U, van den Berg N, Mason RP, van Houdt PJ, Balter JM, Gurney‐Champion OJ. The future of MRI in radiation therapy: Challenges and opportunities for the MR community. Magn Reson Med 2022; 88:2592-2608. [PMID: 36128894 PMCID: PMC9529952 DOI: 10.1002/mrm.29450] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2022] [Revised: 08/17/2022] [Accepted: 08/22/2022] [Indexed: 01/11/2023]
Abstract
Radiation therapy is a major component of cancer treatment pathways worldwide. The main aim of this treatment is to achieve tumor control through the delivery of ionizing radiation while preserving healthy tissues for minimal radiation toxicity. Because radiation therapy relies on accurate localization of the target and surrounding tissues, imaging plays a crucial role throughout the treatment chain. In the treatment planning phase, radiological images are essential for defining target volumes and organs-at-risk, as well as providing elemental composition (e.g., electron density) information for radiation dose calculations. At treatment, onboard imaging informs patient setup and could be used to guide radiation dose placement for sites affected by motion. Imaging is also an important tool for treatment response assessment and treatment plan adaptation. MRI, with its excellent soft tissue contrast and capacity to probe functional tissue properties, holds great untapped potential for transforming treatment paradigms in radiation therapy. The MR in Radiation Therapy ISMRM Study Group was established to provide a forum within the MR community to discuss the unmet needs and fuel opportunities for further advancement of MRI for radiation therapy applications. During the summer of 2021, the study group organized its first virtual workshop, attended by a diverse international group of clinicians, scientists, and clinical physicists, to explore our predictions for the future of MRI in radiation therapy for the next 25 years. This article reviews the main findings from the event and considers the opportunities and challenges of reaching our vision for the future in this expanding field.
Collapse
Affiliation(s)
- Rosie J. Goodburn
- Joint Department of PhysicsInstitute of Cancer Research and Royal Marsden NHS Foundation TrustLondonUnited Kingdom
| | | | - Thierry L. Lefebvre
- Department of PhysicsUniversity of CambridgeCambridgeUnited Kingdom
- Cancer Research UK Cambridge Research InstituteUniversity of CambridgeCambridgeUnited Kingdom
| | - Aly Khalifa
- Department of Medical BiophysicsUniversity of TorontoTorontoOntarioCanada
| | - Tom Bruijnen
- Department of RadiotherapyUniversity Medical Center UtrechtUtrechtNetherlands
| | | | - David E. J. Waddington
- Faculty of Medicine and Health, Sydney School of Health Sciences, ACRF Image X InstituteThe University of SydneySydneyNew South WalesAustralia
| | - Eyesha Younus
- Department of Medical Physics, Odette Cancer CentreSunnybrook Health Sciences CentreTorontoOntarioCanada
| | - Eric Aliotta
- Department of Medical PhysicsMemorial Sloan Kettering Cancer CenterNew YorkNew YorkUSA
| | - Gabriele Meliadò
- Unità Operativa Complessa di Fisica SanitariaAzienda Ospedaliera Universitaria Integrata VeronaVeronaItaly
| | - Teo Stanescu
- Department of Radiation Oncology, University of Toronto and Medical Physics, Princess Margaret Cancer CentreUniversity Health NetworkTorontoOntarioCanada
| | - Wajiha Bano
- Joint Department of PhysicsInstitute of Cancer Research and Royal Marsden NHS Foundation TrustLondonUnited Kingdom
| | - Ali Fatemi‐Ardekani
- Department of PhysicsJackson State University (JSU)JacksonMississippiUSA
- SpinTecxJacksonMississippiUSA
- Department of Radiation OncologyCommunity Health Systems (CHS) Cancer NetworkJacksonMississippiUSA
| | - Andreas Wetscherek
- Joint Department of PhysicsInstitute of Cancer Research and Royal Marsden NHS Foundation TrustLondonUnited Kingdom
| | - Uwe Oelfke
- Joint Department of PhysicsInstitute of Cancer Research and Royal Marsden NHS Foundation TrustLondonUnited Kingdom
| | - Nico van den Berg
- Department of RadiotherapyUniversity Medical Center UtrechtUtrechtNetherlands
| | - Ralph P. Mason
- Department of RadiologyUniversity of Texas Southwestern Medical CenterDallasTexasUSA
| | - Petra J. van Houdt
- Department of Radiation OncologyNetherlands Cancer InstituteAmsterdamNetherlands
| | - James M. Balter
- Department of Radiation OncologyUniversity of MichiganAnn ArborMichiganUSA
| | - Oliver J. Gurney‐Champion
- Imaging and Biomarkers, Cancer Center Amsterdam, Amsterdam UMCUniversity of AmsterdamAmsterdamNetherlands
| |
Collapse
|
55
|
Lapaeva M, La Greca Saint-Esteven A, Wallimann P, Günther M, Konukoglu E, Andratschke N, Guckenberger M, Tanadini-Lang S, Dal Bello R. Synthetic computed tomographies for low-field magnetic resonance-guided radiotherapy in the abdomen. Phys Imaging Radiat Oncol 2022; 24:173-179. [DOI: 10.1016/j.phro.2022.11.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Revised: 11/13/2022] [Accepted: 11/23/2022] [Indexed: 11/29/2022] Open
|
56
|
Abbani N, Baudier T, Rit S, Franco FD, Okoli F, Jaouen V, Tilquin F, Barateau A, Simon A, de Crevoisier R, Bert J, Sarrut D. Deep learning-based segmentation in prostate radiation therapy using Monte Carlo simulated cone-beam computed tomography. Med Phys 2022; 49:6930-6944. [PMID: 36000762 DOI: 10.1002/mp.15946] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2022] [Revised: 07/28/2022] [Accepted: 08/05/2022] [Indexed: 12/13/2022] Open
Abstract
PURPOSE Segmenting organs in cone-beam CT (CBCT) images would allow to adapt the radiotherapy based on the organ deformations that may occur between treatment fractions. However, this is a difficult task because of the relative lack of contrast in CBCT images, leading to high inter-observer variability. Deformable image registration (DIR) and deep-learning based automatic segmentation approaches have shown interesting results for this task in the past years. However, they are either sensitive to large organ deformations, or require to train a convolutional neural network (CNN) from a database of delineated CBCT images, which is difficult to do without improvement of image quality. In this work, we propose an alternative approach: to train a CNN (using a deep learning-based segmentation tool called nnU-Net) from a database of artificial CBCT images simulated from planning CT, for which it is easier to obtain the organ contours. METHODS Pseudo-CBCT (pCBCT) images were simulated from readily available segmented planning CT images, using the GATE Monte Carlo simulation. CT reference delineations were copied onto the pCBCT, resulting in a database of segmented images used to train the neural network. The studied segmentation contours were: bladder, rectum, and prostate contours. We trained multiple nnU-Net models using different training: (1) segmented real CBCT, (2) pCBCT, (3) segmented real CT and tested on pseudo-CT (pCT) generated from CBCT with cycleGAN, and (4) a combination of (2) and (3). The evaluation was performed on different datasets of segmented CBCT or pCT by comparing predicted segmentations with reference ones thanks to Dice similarity score and Hausdorff distance. A qualitative evaluation was also performed to compare DIR-based and nnU-Net-based segmentations. RESULTS Training with pCBCT was found to lead to comparable results to using real CBCT images. When evaluated on CBCT obtained from the same hospital as the CT images used in the simulation of the pCBCT, the model trained with pCBCT scored mean DSCs of 0.92 ± 0.05, 0.87 ± 0.02, and 0.85 ± 0.04 and mean Hausdorff distance 4.67 ± 3.01, 3.91 ± 0.98, and 5.00 ± 1.32 for the bladder, rectum, and prostate contours respectively, while the model trained with real CBCT scored mean DSCs of 0.91 ± 0.06, 0.83 ± 0.07, and 0.81 ± 0.05 and mean Hausdorff distance 5.62 ± 3.24, 6.43 ± 5.11, and 6.19 ± 1.14 for the bladder, rectum, and prostate contours, respectively. It was also found to outperform models using pCT or a combination of both, except for the prostate contour when tested on a dataset from a different hospital. Moreover, the resulting segmentations demonstrated a clinical acceptability, where 78% of bladder segmentations, 98% of rectum segmentations, and 93% of prostate segmentations required minor or no corrections, and for 76% of the patients, all structures of the patient required minor or no corrections. CONCLUSION We proposed to use simulated CBCT images to train a nnU-Net segmentation model, avoiding the need to gather complex and time-consuming reference delineations on CBCT images.
Collapse
Affiliation(s)
- Nelly Abbani
- Univ Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, CNRS, Inserm, Lyon, France
| | - Thomas Baudier
- Univ Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, CNRS, Inserm, Lyon, France
| | - Simon Rit
- Univ Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, CNRS, Inserm, Lyon, France
| | - Francesca di Franco
- Univ Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, CNRS, Inserm, Lyon, France
| | - Franklin Okoli
- LaTIM, Université de Bretagne Occidentale, Inserm, Brest, France
| | - Vincent Jaouen
- LaTIM, Université de Bretagne Occidentale, Inserm, Brest, France
| | | | - Anaïs Barateau
- Univ Rennes, CLCC Eugène Marquis, Inserm, Rennes, France
| | - Antoine Simon
- Univ Rennes, CLCC Eugène Marquis, Inserm, Rennes, France
| | | | - Julien Bert
- LaTIM, Université de Bretagne Occidentale, Inserm, Brest, France
| | - David Sarrut
- Univ Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, CNRS, Inserm, Lyon, France
| |
Collapse
|
57
|
A high-performance method of deep learning for prostate MR-only radiotherapy planning using an optimized Pix2Pix architecture. Phys Med 2022; 103:108-118. [DOI: 10.1016/j.ejmp.2022.10.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/15/2021] [Revised: 07/25/2022] [Accepted: 10/07/2022] [Indexed: 11/20/2022] Open
|
58
|
Evaluation of CBCT based dose calculation in the thorax and pelvis using two generic algorithms. Phys Med 2022; 103:157-165. [DOI: 10.1016/j.ejmp.2022.10.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/02/2022] [Revised: 09/26/2022] [Accepted: 10/22/2022] [Indexed: 11/24/2022] Open
|
59
|
Thummerer A, Seller Oria C, Zaffino P, Visser S, Meijers A, Guterres Marmitt G, Wijsman R, Seco J, Langendijk JA, Knopf AC, Spadea MF, Both S. Deep learning-based 4D-synthetic CTs from sparse-view CBCTs for dose calculations in adaptive proton therapy. Med Phys 2022; 49:6824-6839. [PMID: 35982630 PMCID: PMC10087352 DOI: 10.1002/mp.15930] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2022] [Revised: 07/20/2022] [Accepted: 08/08/2022] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND Time-resolved 4D cone beam-computed tomography (4D-CBCT) allows a daily assessment of patient anatomy and respiratory motion. However, 4D-CBCTs suffer from imaging artifacts that affect the CT number accuracy and prevent accurate proton dose calculations. Deep learning can be used to correct CT numbers and generate synthetic CTs (sCTs) that can enable CBCT-based proton dose calculations. PURPOSE In this work, sparse view 4D-CBCTs were converted into 4D-sCT utilizing a deep convolutional neural network (DCNN). 4D-sCTs were evaluated in terms of image quality and dosimetric accuracy to determine if accurate proton dose calculations for adaptive proton therapy workflows of lung cancer patients are feasible. METHODS A dataset of 45 thoracic cancer patients was utilized to train and evaluate a DCNN to generate 4D-sCTs, based on sparse view 4D-CBCTs reconstructed from projections acquired with a 3D acquisition protocol. Mean absolute error (MAE) and mean error were used as metrics to evaluate the image quality of single phases and average 4D-sCTs against 4D-CTs acquired on the same day. The dosimetric accuracy was checked globally (gamma analysis) and locally for target volumes and organs-at-risk (OARs) (lung, heart, and esophagus). Furthermore, 4D-sCTs were also compared to 3D-sCTs. To evaluate CT number accuracy, proton radiography simulations in 4D-sCT and 4D-CTs were compared in terms of range errors. The clinical suitability of 4D-sCTs was demonstrated by performing a 4D dose reconstruction using patient specific treatment delivery log files and breathing signals. RESULTS 4D-sCTs resulted in average MAEs of 48.1 ± 6.5 HU (single phase) and 37.7 ± 6.2 HU (average). The global dosimetric evaluation showed gamma pass ratios of 92.3% ± 3.2% (single phase) and 94.4% ± 2.1% (average). The clinical target volume showed high agreement in D98 between 4D-CT and 4D-sCT, with differences below 2.4% for all patients. Larger dose differences were observed in mean doses of OARs (up to 8.4%). The comparison with 3D-sCTs showed no substantial image quality and dosimetric differences for the 4D-sCT average. Individual 4D-sCT phases showed slightly lower dosimetric accuracy. The range error evaluation revealed that lung tissues cause range errors about three times higher than the other tissues. CONCLUSION In this study, we have investigated the accuracy of deep learning-based 4D-sCTs for daily dose calculations in adaptive proton therapy. Despite image quality differences between 4D-sCTs and 3D-sCTs, comparable dosimetric accuracy was observed globally and locally. Further improvement of 3D and 4D lung sCTs could be achieved by increasing CT number accuracy in lung tissues.
Collapse
Affiliation(s)
- Adrian Thummerer
- Department, of Radiation Oncology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Carmen Seller Oria
- Department, of Radiation Oncology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Paolo Zaffino
- Department of Experimental and Clinical Medicine, Magna Graecia University, Catanzaro, Italy
| | - Sabine Visser
- Department, of Radiation Oncology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Arturs Meijers
- Department, of Radiation Oncology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands.,Center for Proton Therapy, Paul Scherrer Institute, Villigen, Switzerland
| | - Gabriel Guterres Marmitt
- Department, of Radiation Oncology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Robin Wijsman
- Department, of Radiation Oncology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Joao Seco
- Department of Biomedical Physics in Radiation Oncology, Deutsches Krebsforschungszentrum (DKFZ), Heidelberg, Germany.,Department of Physics and Astronomy, Heidelberg University, Heidelberg, Germany
| | - Johannes Albertus Langendijk
- Department, of Radiation Oncology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Antje Christin Knopf
- Department, of Radiation Oncology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands.,Department I of Internal Medicine, Center for Integrated Oncology Cologne, University Hospital of Cologne, Cologne, Germany
| | - Maria Francesca Spadea
- Department of Experimental and Clinical Medicine, Magna Graecia University, Catanzaro, Italy
| | - Stefan Both
- Department, of Radiation Oncology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| |
Collapse
|
60
|
Chen S, Peng Y, Qin A, Liu Y, Zhao C, Deng X, Deraniyagala R, Stevens C, Ding X. MR-based synthetic CT image for intensity-modulated proton treatment planning of nasopharyngeal carcinoma patients. Acta Oncol 2022; 61:1417-1424. [DOI: 10.1080/0284186x.2022.2140017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/01/2022]
Affiliation(s)
- Shupeng Chen
- Department of Radiation Oncology, William Beaumont Hospital, Royal Oak, MI, USA
| | - Yinglin Peng
- Department of Radiation Oncology, Sun Yat-Sen University, Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangzhou, PR China
- School of Biomedical Engineering, Sun Yat-Sen University, Guangzhou, PR China
| | - An Qin
- Department of Radiation Oncology, William Beaumont Hospital, Royal Oak, MI, USA
| | - Yimei Liu
- Department of Radiation Oncology, Sun Yat-Sen University, Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangzhou, PR China
| | - Chong Zhao
- Department of Radiation Oncology, Sun Yat-Sen University, Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangzhou, PR China
| | - Xiaowu Deng
- Department of Radiation Oncology, Sun Yat-Sen University, Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangzhou, PR China
| | - Rohan Deraniyagala
- Department of Radiation Oncology, William Beaumont Hospital, Royal Oak, MI, USA
| | - Craig Stevens
- Department of Radiation Oncology, William Beaumont Hospital, Royal Oak, MI, USA
| | - Xuanfeng Ding
- Department of Radiation Oncology, William Beaumont Hospital, Royal Oak, MI, USA
| |
Collapse
|
61
|
McGee KP, Campeau NG, Witte RJ, Rossman PJ, Christopherson JA, Tryggestad EJ, Brinkmann DH, Ma DJ, Park SS, Rettmann DW, Robb FJ. Evaluation of a New, Highly Flexible Radiofrequency Coil for MR Simulation of Patients Undergoing External Beam Radiation Therapy. J Clin Med 2022; 11:5984. [PMID: 36294304 PMCID: PMC9604708 DOI: 10.3390/jcm11205984] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2022] [Revised: 09/30/2022] [Accepted: 10/08/2022] [Indexed: 04/20/2024] Open
Abstract
PURPOSE To evaluate the performance of a new, highly flexible radiofrequency (RF) coil system for imaging patients undergoing MR simulation. METHODS Volumetric phantom and in vivo images were acquired with a commercially available and prototype RF coil set. Phantom evaluation was performed using a silicone-filled humanoid phantom of the head and shoulders. In vivo assessment was performed in five healthy and six patient subjects. Phantom data included T1-weighted volumetric imaging, while in vivo acquisitions included both T1- and T2-weighted volumetric imaging. Signal to noise ratio (SNR) and uniformity metrics were calculated in the phantom data, while SNR values were calculated in vivo. Statistical significance was tested by means of a non-parametric analysis of variance test. RESULTS At a threshold of p = 0.05, differences in measured SNR distributions within the entire phantom volume were statistically different in two of the three paired coil set comparisons. Differences in per slice average SNR between the two coil sets were all statistically significant, as well as differences in per slice image uniformity. For patients, SNRs within the entire imaging volume were statistically significantly different in four of the nine comparisons and seven of the nine comparisons performed on the per slice average SNR values. For healthy subjects, SNRs within the entire imaging volume were statistically significantly different in seven of the nine comparisons and eight of the nine comparisons when per slice average SNR was tested. CONCLUSIONS Phantom and in vivo results demonstrate that image quality obtained from the novel flexible RF coil set was similar or improved over the conventional coil system. The results also demonstrate that image quality is impacted by the specific coil configurations used for imaging and should be matched appropriately to the anatomic site imaged to ensure optimal and reproducible image quality.
Collapse
Affiliation(s)
- Kiaran P. McGee
- Department of Radiology, Mayo Clinic and Foundation, Rochester, MN 55905, USA
| | - Norbert G. Campeau
- Department of Radiology, Mayo Clinic and Foundation, Rochester, MN 55905, USA
| | - Robert J. Witte
- Department of Radiology, Mayo Clinic and Foundation, Rochester, MN 55905, USA
| | - Philip J. Rossman
- Department of Radiology, Mayo Clinic and Foundation, Rochester, MN 55905, USA
| | | | - Erik J. Tryggestad
- Department of Radiation Oncology, Mayo Clinic and Foundation, Rochester, MN 55905, USA
| | - Debra H. Brinkmann
- Department of Radiation Oncology, Mayo Clinic and Foundation, Rochester, MN 55905, USA
| | - Daniel J. Ma
- Department of Radiation Oncology, Mayo Clinic and Foundation, Rochester, MN 55905, USA
| | - Sean S. Park
- Department of Radiation Oncology, Mayo Clinic and Foundation, Rochester, MN 55905, USA
| | | | | |
Collapse
|
62
|
Chourak H, Barateau A, Tahri S, Cadin C, Lafond C, Nunes JC, Boue-Rafle A, Perazzi M, Greer PB, Dowling J, de Crevoisier R, Acosta O. Quality assurance for MRI-only radiation therapy: A voxel-wise population-based methodology for image and dose assessment of synthetic CT generation methods. Front Oncol 2022; 12:968689. [PMID: 36300084 PMCID: PMC9589295 DOI: 10.3389/fonc.2022.968689] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2022] [Accepted: 09/20/2022] [Indexed: 11/13/2022] Open
Abstract
The quality assurance of synthetic CT (sCT) is crucial for safe clinical transfer to an MRI-only radiotherapy planning workflow. The aim of this work is to propose a population-based process assessing local errors in the generation of sCTs and their impact on dose distribution. For the analysis to be anatomically meaningful, a customized interpatient registration method brought the population data to the same coordinate system. Then, the voxel-based process was applied on two sCT generation methods: a bulk-density method and a generative adversarial network. The CT and MRI pairs of 39 patients treated by radiotherapy for prostate cancer were used for sCT generation, and 26 of them with delineated structures were selected for analysis. Voxel-wise errors in sCT compared to CT were assessed for image intensities and dose calculation, and a population-based statistical test was applied to identify the regions where discrepancies were significant. The cumulative histograms of the mean absolute dose error per volume of tissue were computed to give a quantitative indication of the error for each generation method. Accurate interpatient registration was achieved, with mean Dice scores higher than 0.91 for all organs. The proposed method produces three-dimensional maps that precisely show the location of the major discrepancies for both sCT generation methods, highlighting the heterogeneity of image and dose errors for sCT generation methods from MRI across the pelvic anatomy. Hence, this method provides additional information that will assist with both sCT development and quality control for MRI-based planning radiotherapy.
Collapse
Affiliation(s)
- Hilda Chourak
- University of Rennes, CLCC Eugène Marquis, INSERM, LTSI - UMR 1099, Rennes, France
- The Australian eHealth Research Centre, Commonwealth Scientific and Industrial Research Organisation (CSIRO), Health and Biosecurity, Brisbane, QLD, Australia
- *Correspondence: Hilda Chourak, ; Jason Dowling,
| | - Anaïs Barateau
- University of Rennes, CLCC Eugène Marquis, INSERM, LTSI - UMR 1099, Rennes, France
| | - Safaa Tahri
- University of Rennes, CLCC Eugène Marquis, INSERM, LTSI - UMR 1099, Rennes, France
| | - Capucine Cadin
- University of Rennes, CLCC Eugène Marquis, INSERM, LTSI - UMR 1099, Rennes, France
| | - Caroline Lafond
- University of Rennes, CLCC Eugène Marquis, INSERM, LTSI - UMR 1099, Rennes, France
| | - Jean-Claude Nunes
- University of Rennes, CLCC Eugène Marquis, INSERM, LTSI - UMR 1099, Rennes, France
| | - Adrien Boue-Rafle
- University of Rennes, CLCC Eugène Marquis, INSERM, LTSI - UMR 1099, Rennes, France
| | - Mathias Perazzi
- University of Rennes, CLCC Eugène Marquis, INSERM, LTSI - UMR 1099, Rennes, France
| | - Peter B. Greer
- School of Mathematical and Physical Sciences, University of Newcastle, Newcastle, NSW, Australia
- Radiation Oncology, Calvary Mater Newcastle Hospital, Newcastle, NSW, Australia
| | - Jason Dowling
- The Australian eHealth Research Centre, Commonwealth Scientific and Industrial Research Organisation (CSIRO), Health and Biosecurity, Brisbane, QLD, Australia
- *Correspondence: Hilda Chourak, ; Jason Dowling,
| | - Renaud de Crevoisier
- University of Rennes, CLCC Eugène Marquis, INSERM, LTSI - UMR 1099, Rennes, France
| | - Oscar Acosta
- University of Rennes, CLCC Eugène Marquis, INSERM, LTSI - UMR 1099, Rennes, France
| |
Collapse
|
63
|
O'Hara CJ, Bird D, Al-Qaisieh B, Speight R. Assessment of CBCT-based synthetic CT generation accuracy for adaptive radiotherapy planning. J Appl Clin Med Phys 2022; 23:e13737. [PMID: 36200179 DOI: 10.1002/acm2.13737] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2022] [Revised: 05/26/2022] [Accepted: 07/04/2022] [Indexed: 11/09/2022] Open
Abstract
PURPOSE Cone-beam CT (CBCT)-based synthetic CT (sCT) dose calculation has the potential to make the adaptive radiotherapy (ART) pathway more efficient while removing subjectivity. This study assessed four sCT generation methods using 15 head-and-neck rescanned ART patients. Each patient's planning CT (pCT), rescan CT (rCT), and CBCT post-rCT was acquired with the CBCT deformably registered to the rCT (dCBCT). METHODS The four methods investigated were as follows: method 1-deformably registering the pCT to the dCBCT. Method 2-assigning six mass density values to the dCBCT. Method 3-iteratively removing artifacts and correcting the dCBCT Hounsfield units (HU). Method 4-using a cycle general adversarial network machine learning model (trained with 45 paired pCT and CBCT). Treatment plans were created on the rCT and recalculated on each sCT. Planning target volume (PTV) and organ-at-risk (OAR) structures were contoured by clinicians on the rCT (high-dose PTV, low-dose PTV, spinal canal, larynx, brainstem, and parotids) to allow the assessment of dose-volume histogram statistics at clinically relevant points. RESULTS The HU mean absolute error (MAE) and minimum dose gamma index pass rate (2%/2 mm) were calculated, and the generation time was measured for 15 patients using the rCT as the comparator. For methods 1-4 the MAE, gamma index analysis, and generation time were as follows: 59.7 HU, 100.0%, and 143 s; 164.2 HU, 95.2%, and 232 s; 75.7 HU, 99.9%, and 153 s; and 79.4 HU, 99.8%, and 112 s, respectively. Dose differences for PTVs and OARs were all <0.3 Gy except for method 2 (<0.5 Gy). CONCLUSION All methods were considered clinically viable. The machine learning method was found to be most suitable for clinical implementation due to its high dosimetric accuracy and short generation time. Further investigation is required for larger anatomical changes between the CBCT and pCT and for other anatomical sites.
Collapse
Affiliation(s)
| | - David Bird
- Leeds Cancer Centre, Leeds Teaching Hospitals NHS Trust, Leeds, UK
| | | | - Richard Speight
- Leeds Cancer Centre, Leeds Teaching Hospitals NHS Trust, Leeds, UK
| |
Collapse
|
64
|
Gurney-Champion OJ, Landry G, Redalen KR, Thorwarth D. Potential of Deep Learning in Quantitative Magnetic Resonance Imaging for Personalized Radiotherapy. Semin Radiat Oncol 2022; 32:377-388. [DOI: 10.1016/j.semradonc.2022.06.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
|
65
|
Claessens M, Oria CS, Brouwer CL, Ziemer BP, Scholey JE, Lin H, Witztum A, Morin O, Naqa IE, Van Elmpt W, Verellen D. Quality Assurance for AI-Based Applications in Radiation Therapy. Semin Radiat Oncol 2022; 32:421-431. [DOI: 10.1016/j.semradonc.2022.06.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
|
66
|
Uncertainty Assessment for Deep Learning Radiotherapy Applications. Semin Radiat Oncol 2022; 32:304-318. [DOI: 10.1016/j.semradonc.2022.06.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
|
67
|
Hsu SH, Han Z, Leeman JE, Hu YH, Mak RH, Sudhyadhom A. Synthetic CT generation for MRI-guided adaptive radiotherapy in prostate cancer. Front Oncol 2022; 12:969463. [PMID: 36212472 PMCID: PMC9539763 DOI: 10.3389/fonc.2022.969463] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2022] [Accepted: 08/26/2022] [Indexed: 11/21/2022] Open
Abstract
Current MRI-guided adaptive radiotherapy (MRgART) workflows require fraction-specific electron and/or mass density maps, which are created by deformable image registration (DIR) between the simulation CT images and daily MR images. Manual density overrides may also be needed where DIR-produced results are inaccurate. This approach slows the adaptive radiotherapy workflow and introduces additional dosimetric uncertainties, especially in the presence of the magnetic field. This study investigated a method based on a conditional generative adversarial network (cGAN) with a multi-planar method to generate synthetic CT images from low-field MR images to improve efficiency in MRgART workflows for prostate cancer. Fifty-seven male patients, who received MRI-guided radiation therapy to the pelvis using the ViewRay MRIdian Linac, were selected. Forty-five cases were randomly assigned to the training cohort with the remaining twelve cases assigned to the validation/testing cohort. All patient datasets had a semi-paired DIR-deformed CT-sim image and 0.35T MR image acquired using a true fast imaging with steady-state precession (TrueFISP) sequence. Synthetic CT images were compared with deformed CT images to evaluate image quality and dosimetric accuracy. To evaluate the dosimetric accuracy of this method, clinical plans were recalculated on synthetic CT images in the MRIdian treatment planning system. Dose volume histograms for planning target volumes (PTVs) and organs-at-risk (OARs) and dose distributions using gamma analyses were evaluated. The mean-absolute-errors (MAEs) in CT numbers were 30.1 ± 4.2 HU, 19.6 ± 2.3 HU and 158.5 ± 26.0 HU for the whole pelvis, soft tissue, and bone, respectively. The peak signal-to-noise ratio was 35.2 ± 1.7 and the structural index similarity measure was 0.9758 ± 0.0035. The dosimetric difference was on average less than 1% for all PTV and OAR metrics. Plans showed good agreement with gamma pass rates of 99% and 99.9% for 1%/1 mm and 2%/2 mm, respectively. Our study demonstrates the potential of using synthetic CT images created with a multi-planar cGAN method from 0.35T MRI TrueFISP images for the MRgART treatment of prostate radiotherapy. Future work will validate the method in a large cohort of patients and investigate the limitations of the method in the adaptive workflow.
Collapse
|
68
|
Emergence of MR-Linac in Radiation Oncology: Successes and Challenges of Riding on the MRgRT Bandwagon. J Clin Med 2022; 11:jcm11175136. [PMID: 36079065 PMCID: PMC9456673 DOI: 10.3390/jcm11175136] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2022] [Revised: 08/26/2022] [Accepted: 08/29/2022] [Indexed: 12/05/2022] Open
Abstract
The special issue of JCM on “Advances of MRI in Radiation Oncology” provides a unique forum for scientific literature related to MR imaging in radiation oncology. This issue covered many aspects, such as MR technology, motion management, economics, soft-tissue–air interface issues, and disease sites such as the pancreas, spine, sarcoma, prostate, head and neck, and rectum from both camps—the Unity and MRIdian systems. This paper provides additional information on the success and challenges of the two systems. A challenging aspect of this technology is low throughput and the monumental task of education and training that hinders its use for the majority of therapy centers. Additionally, the cost of this technology is too high for most institutions, and hence widespread use is still limited. This article highlights some of the difficulties and how to resolve them.
Collapse
|
69
|
Bambach S, Ho ML. Deep Learning for Synthetic CT from Bone MRI in the Head and Neck. AJNR Am J Neuroradiol 2022; 43:1172-1179. [PMID: 36920777 PMCID: PMC9575432 DOI: 10.3174/ajnr.a7588] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2021] [Accepted: 06/13/2022] [Indexed: 11/07/2022]
Abstract
BACKGROUND AND PURPOSE Bone MR imaging techniques enable visualization of cortical bone without the need for ionizing radiation. Automated conversion of bone MR imaging to synthetic CT is highly desirable for downstream image processing and eventual clinical adoption. Given the complex anatomy and pathology of the head and neck, deep learning models are ideally suited for learning such mapping. MATERIALS AND METHODS This was a retrospective study of 39 pediatric and adult patients with bone MR imaging and CT examinations of the head and neck. For each patient, MR imaging and CT data sets were spatially coregistered using multiple-point affine transformation. Paired MR imaging and CT slices were generated for model training, using 4-fold cross-validation. We trained 3 different encoder-decoder models: Light_U-Net (2 million parameters) and VGG-16 U-Net (29 million parameters) without and with transfer learning. Loss functions included mean absolute error, mean squared error, and a weighted average. Performance metrics included Pearson R, mean absolute error, mean squared error, bone precision, and bone recall. We investigated model generalizability by training and validating across different conditions. RESULTS The Light_U-Net architecture quantitatively outperformed VGG-16 models. Mean absolute error loss resulted in higher bone precision, while mean squared error yielded higher bone recall. Performance metrics decreased when using training data captured only in a different environment but increased when local training data were augmented with those from different hospitals, vendors, or MR imaging techniques. CONCLUSIONS We have optimized a robust deep learning model for conversion of bone MR imaging to synthetic CT, which shows good performance and generalizability when trained on different hospitals, vendors, and MR imaging techniques. This approach shows promise for facilitating downstream image processing and adoption into clinical practice.
Collapse
Affiliation(s)
- S Bambach
- From the Abigail Wexner Research Institute at Nationwide Children's Hospital (S.B.), Columbus, Ohio
| | - M-L Ho
- Department of Radiology (M.-L.H.), Nationwide Children's Hospital, Columbus, Ohio.
| |
Collapse
|
70
|
Wiesinger F, Ho ML. Zero-TE MRI: principles and applications in the head and neck. Br J Radiol 2022; 95:20220059. [PMID: 35616709 PMCID: PMC10162052 DOI: 10.1259/bjr.20220059] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022] Open
Abstract
Zero echo-time (ZTE) MRI is a novel imaging technique that utilizes ultrafast readouts to capture signal from short-T2 tissues. Additional sequence advantages include rapid imaging times, silent scanning, and artifact resistance. A robust application of this technology is imaging of cortical bone without the use of ionizing radiation, thus representing a viable alternative to CT for both rapid screening and "one-stop-shop" MRI. Although ZTE is increasingly used in musculoskeletal and body imaging, neuroimaging applications have historically been limited by complex anatomy and pathology. In this article, we review the imaging physics of ZTE including pulse sequence options, practical limitations, and image reconstruction. We then discuss optimization of settings for ZTE bone neuroimaging including acquisition, processing, segmentation, synthetic CT generation, and artifacts. Finally, we examine clinical utility of ZTE in the head and neck with imaging examples including malformations, trauma, tumors, and interventional procedures.
Collapse
Affiliation(s)
- Florian Wiesinger
- Department for Neuroimaging, Institute of Psychiatry & Neuroscience, King's College London, London, UK.,Principal Scientist at GE Healthcare, Munich, Germany
| | - Mai-Lan Ho
- Nationwide Children's Hospital and The Ohio State University, Columbus, USA
| |
Collapse
|
71
|
Possibilities and challenges when using synthetic computed tomography in an adaptive carbon-ion treatment workflow. Z Med Phys 2022:S0939-3889(22)00064-2. [PMID: 35764469 DOI: 10.1016/j.zemedi.2022.05.003] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2022] [Revised: 05/29/2022] [Accepted: 05/29/2022] [Indexed: 11/23/2022]
Abstract
BACKGROUND AND PURPOSE Anatomical surveillance during ion-beam therapy is the basis for an effective tumor treatment and optimal organ at risk (OAR) sparing. Synthetic computed tomography (sCT) based on magnetic resonance imaging (MRI) can replace the X-ray based planning CT (X-rayCT) in photon radiotherapy and improve the workflow efficiency without additional imaging dose. The extension to carbon-ion radiotherapy is highly challenging; complex patient positioning, unique anatomical situations, distinct horizontal and vertical beam incidence directions, and limited training data are only few problems. This study gives insight into the possibilities and challenges of using sCTs in carbon-ion therapy. MATERIALS AND METHODS For head and neck patients immobilised with thermoplastic masks 30 clinically applied actively scanned carbon-ion treatment plans on 15 CTs comprising 60 beams were analyzed. Those treatment plans were re-calculated on MRI based sCTs which were created employing a 3D U-Net. Dose differences and carbon-ion spot displacements between sCT and X-rayCT were evaluated on a patient specific basis. RESULTS Spot displacement analysis showed a peak displacement by 0.2 cm caused by the immobilisation mask not measurable with the MRI. 95.7% of all spot displacements were located within 1 cm. For the clinical target volume (CTV) the median D50% agreed within -0.2% (-1.3 to 1.4%), while the median D0.01cc differed up to 4.2% (-1.3 to 25.3%) comparing the dose distribution on the X-rayCT and the sCT. OAR deviations depended strongly on the position and the dose gradient. For three patients no deterioration of the OAR parameters was observed. Other patients showed large deteriorations, e.g. for one patient D2% of the chiasm differed by 28.1%. CONCLUSION The usage of sCTs opens several new questions, concluding that we are not ready yet for an MR-only workflow in carbon-ion therapy, as envisaged in photon therapy. Although omitting the X-rayCT seems unfavourable in the case of carbon-ion therapy, an sCT could be advantageous for monitoring, re-planning, and adaptation.
Collapse
|
72
|
Target Definition in MR-Guided Adaptive Radiotherapy for Head and Neck Cancer. Cancers (Basel) 2022; 14:cancers14123027. [PMID: 35740691 PMCID: PMC9220977 DOI: 10.3390/cancers14123027] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Revised: 06/14/2022] [Accepted: 06/14/2022] [Indexed: 02/01/2023] Open
Abstract
Simple Summary Adaptive radiotherapy for head and neck cancer has become more routine due to an increase in imaging quality and improvement in radiation techniques. With the availability of faster adaptive workflows, it is possible to adapt more easily to (daily) changes. MRI offers besides great anatomical imaging, also functional information about the tumor and surrounding tissue. The aim of this review is to provide current state of evidence about target definition on MRI for adaptive strategies in the treatment of head and neck cancer. Abstract In recent years, MRI-guided radiotherapy (MRgRT) has taken an increasingly important position in image-guided radiotherapy (IGRT). Magnetic resonance imaging (MRI) offers superior soft tissue contrast in anatomical imaging compared to computed tomography (CT), but also provides functional and dynamic information with selected sequences. Due to these benefits, in current clinical practice, MRI is already used for target delineation and response assessment in patients with head and neck squamous cell carcinoma (HNSCC). Because of the close proximity of target areas and radiosensitive organs at risk (OARs) during HNSCC treatment, MRgRT could provide a more accurate treatment in which OARs receive less radiation dose. With the introduction of several new radiotherapy techniques (i.e., adaptive MRgRT, proton therapy, adaptive cone beam computed tomography (CBCT) RT, (daily) adaptive radiotherapy ensures radiation dose is accurately delivered to the target areas. With the integration of a daily adaptive workflow, interfraction changes have become visible, which allows regular and fast adaptation of target areas. In proton therapy, adaptation is even more important in order to obtain high quality dosimetry, due to its susceptibility for density differences in relation to the range uncertainty of the protons. The question is which adaptations during radiotherapy treatment are oncology safe and at the same time provide better sparing of OARs. For an optimal use of all these new tools there is an urgent need for an update of the target definitions in case of adaptive treatment for HNSCC. This review will provide current state of evidence regarding adaptive target definition using MR during radiotherapy for HNSCC. Additionally, future perspectives for adaptive MR-guided radiotherapy will be discussed.
Collapse
|
73
|
Han R, Jones CK, Lee J, Zhang X, Wu P, Vagdargi P, Uneri A, Helm PA, Luciano M, Anderson WS, Siewerdsen JH. Joint synthesis and registration network for deformable MR-CBCT image registration for neurosurgical guidance. Phys Med Biol 2022; 67:10.1088/1361-6560/ac72ef. [PMID: 35609586 PMCID: PMC9801422 DOI: 10.1088/1361-6560/ac72ef] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2022] [Accepted: 05/24/2022] [Indexed: 01/03/2023]
Abstract
Objective.The accuracy of navigation in minimally invasive neurosurgery is often challenged by deep brain deformations (up to 10 mm due to egress of cerebrospinal fluid during neuroendoscopic approach). We propose a deep learning-based deformable registration method to address such deformations between preoperative MR and intraoperative CBCT.Approach.The registration method uses a joint image synthesis and registration network (denoted JSR) to simultaneously synthesize MR and CBCT images to the CT domain and perform CT domain registration using a multi-resolution pyramid. JSR was first trained using a simulated dataset (simulated CBCT and simulated deformations) and then refined on real clinical images via transfer learning. The performance of the multi-resolution JSR was compared to a single-resolution architecture as well as a series of alternative registration methods (symmetric normalization (SyN), VoxelMorph, and image synthesis-based registration methods).Main results.JSR achieved median Dice coefficient (DSC) of 0.69 in deep brain structures and median target registration error (TRE) of 1.94 mm in the simulation dataset, with improvement from single-resolution architecture (median DSC = 0.68 and median TRE = 2.14 mm). Additionally, JSR achieved superior registration compared to alternative methods-e.g. SyN (median DSC = 0.54, median TRE = 2.77 mm), VoxelMorph (median DSC = 0.52, median TRE = 2.66 mm) and provided registration runtime of less than 3 s. Similarly in the clinical dataset, JSR achieved median DSC = 0.72 and median TRE = 2.05 mm.Significance.The multi-resolution JSR network resolved deep brain deformations between MR and CBCT images with performance superior to other state-of-the-art methods. The accuracy and runtime support translation of the method to further clinical studies in high-precision neurosurgery.
Collapse
Affiliation(s)
- R Han
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, United States of America
| | - C K Jones
- The Malone Center for Engineering in Healthcare, Johns Hopkins University, Baltimore, MD, United States of America
| | - J Lee
- Department of Radiation Oncology and Molecular Radiation Sciences, Johns Hopkins University, Baltimore, MD, United States of America
| | - X Zhang
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, United States of America
| | - P Wu
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, United States of America
| | - P Vagdargi
- Department of Computer Science, Johns Hopkins University, Baltimore, MD, United States of America
| | - A Uneri
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, United States of America
| | - P A Helm
- Medtronic Inc., Littleton, MA, United States of America
| | - M Luciano
- Department of Neurosurgery, Johns Hopkins Hospital, Baltimore, MD, United States of America
| | - W S Anderson
- Department of Neurosurgery, Johns Hopkins Hospital, Baltimore, MD, United States of America
| | - J H Siewerdsen
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, United States of America,The Malone Center for Engineering in Healthcare, Johns Hopkins University, Baltimore, MD, United States of America,Department of Computer Science, Johns Hopkins University, Baltimore, MD, United States of America,Department of Neurosurgery, Johns Hopkins Hospital, Baltimore, MD, United States of America
| |
Collapse
|
74
|
Bäumer C, Frakulli R, Kohl J, Nagaraja S, Steinmeier T, Worawongsakul R, Timmermann B. Adaptive Proton Therapy of Pediatric Head and Neck Cases Using MRI-Based Synthetic CTs: Initial Experience of the Prospective KiAPT Study. Cancers (Basel) 2022; 14:cancers14112616. [PMID: 35681594 PMCID: PMC9179385 DOI: 10.3390/cancers14112616] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2022] [Revised: 05/20/2022] [Accepted: 05/20/2022] [Indexed: 12/07/2022] Open
Abstract
BACKGROUND AND PURPOSE Interfractional anatomical changes might affect the outcome of proton therapy (PT). We aimed to prospectively evaluate the role of Magnetic Resonance Imaging (MRI) based adaptive PT for children with tumors of the head and neck and base of skull. METHODS MRI verification images were acquired at half of the treatment course. A synthetic computed tomography (CT) image was created using this MRI and a deformable image registration (DIR) to the reference MRI. The methodology was verified with in-silico phantoms and validated using a clinical case with a shrinking cystic hygroma on the basis of dosimetric quantities of contoured structures. The dose distributions on the verification X-ray CT and on the synthetic CT were compared with a gamma-index test using global 2 mm/2% criteria. RESULTS Regarding the clinical validation case, the gamma-index pass rate was 98.3%. Eleven patients were included in the clinical study. The most common diagnosis was rhabdomyosarcoma (73%). Craniofacial tumor site was predominant in 64% of patients, followed by base of skull (18%). For one individual case the synthetic CT showed an increase in the median D2 and Dmax dose on the spinal cord from 20.5 GyRBE to 24.8 GyRBE and 14.7 GyRBE to 25.1 GyRBE, respectively. Otherwise, doses received by OARs remained relatively stable. Similarly, the target volume coverage seen by D95% and V95% remained unchanged. CONCLUSIONS The method of transferring anatomical changes from MRIs to a synthetic CTs was successfully implemented and validated with simple, commonly available tools. In the frame of our early results on a small cohort, no clinical relevant deterioration for neither PTV coverage nor an increased dose burden to OARs occurred. However, the study will be continued to identify a pediatric patient cohort, which benefits from adaptive treatment planning.
Collapse
Affiliation(s)
- Christian Bäumer
- West German Proton Therapy Centre Essen, 45147 Essen, Germany; (R.F.); (J.K.); (S.N.); (T.S.); (R.W.); (B.T.)
- University Hospital Essen, 45147 Essen, Germany
- West German Cancer Center (WTZ), 45147 Essen, Germany
- German Cancer Consortium (DKTK), 69120 Heidelberg, Germany
- Department of Physics, Technische Universität Dortmund, 44227 Dortmund, Germany
- Correspondence:
| | - Rezarta Frakulli
- West German Proton Therapy Centre Essen, 45147 Essen, Germany; (R.F.); (J.K.); (S.N.); (T.S.); (R.W.); (B.T.)
- University Hospital Essen, 45147 Essen, Germany
- West German Cancer Center (WTZ), 45147 Essen, Germany
- Department of Particle Therapy, 45147 Essen, Germany
| | - Jessica Kohl
- West German Proton Therapy Centre Essen, 45147 Essen, Germany; (R.F.); (J.K.); (S.N.); (T.S.); (R.W.); (B.T.)
- University Hospital Essen, 45147 Essen, Germany
- West German Cancer Center (WTZ), 45147 Essen, Germany
| | - Sindhu Nagaraja
- West German Proton Therapy Centre Essen, 45147 Essen, Germany; (R.F.); (J.K.); (S.N.); (T.S.); (R.W.); (B.T.)
- University Hospital Essen, 45147 Essen, Germany
- West German Cancer Center (WTZ), 45147 Essen, Germany
- Department of Particle Therapy, 45147 Essen, Germany
| | - Theresa Steinmeier
- West German Proton Therapy Centre Essen, 45147 Essen, Germany; (R.F.); (J.K.); (S.N.); (T.S.); (R.W.); (B.T.)
- University Hospital Essen, 45147 Essen, Germany
- West German Cancer Center (WTZ), 45147 Essen, Germany
- Department of Particle Therapy, 45147 Essen, Germany
| | - Rasin Worawongsakul
- West German Proton Therapy Centre Essen, 45147 Essen, Germany; (R.F.); (J.K.); (S.N.); (T.S.); (R.W.); (B.T.)
- University Hospital Essen, 45147 Essen, Germany
- West German Cancer Center (WTZ), 45147 Essen, Germany
- Department of Particle Therapy, 45147 Essen, Germany
- Radiation Oncology Unit, Department of Diagnostic and Therapeutic Radiology, Ramathibodi Hospital, Mahidol University, Nakhon 73170, Thailand
| | - Beate Timmermann
- West German Proton Therapy Centre Essen, 45147 Essen, Germany; (R.F.); (J.K.); (S.N.); (T.S.); (R.W.); (B.T.)
- University Hospital Essen, 45147 Essen, Germany
- West German Cancer Center (WTZ), 45147 Essen, Germany
- German Cancer Consortium (DKTK), 69120 Heidelberg, Germany
- Department of Particle Therapy, 45147 Essen, Germany
| |
Collapse
|
75
|
Ozaki S, Kaji S, Nawa K, Imae T, Aoki A, Nakamoto T, Ohta T, Nozawa Y, Yamashita H, Haga A, Nakagawa K. Training of deep cross-modality conversion models with a small dataset, and their application in megavoltage CT to kilovoltage CT conversion. Med Phys 2022; 49:3769-3782. [PMID: 35315529 DOI: 10.1002/mp.15626] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2021] [Revised: 02/21/2022] [Accepted: 03/14/2022] [Indexed: 11/06/2022] Open
Abstract
PURPOSE In recent years, deep-learning-based image processing has emerged as a valuable tool for medical imaging owing to its high performance. However, the quality of deep-learning-based methods heavily relies on the amount of training data; the high cost of acquiring a large dataset is a limitation to their utilization in medical fields. Herein, based on deep learning, we developed a computed tomography (CT) modality conversion method requiring only a few unsupervised images. METHODS The proposed method is based on CycleGAN with several extensions tailored for CT images, which aims at preserving the structure in the processed images and reducing the amount of training data. This method was applied to realize the conversion of megavoltage computed tomography (MVCT) to kilovoltage computed tomography (kVCT) images. Training was conducted using several datasets acquired from patients with head and neck cancer. The size of the datasets ranged from 16 slices (two patients) to 2745 slices (137 patients) for MVCT and 2824 slices (98 patients) for kVCT. RESULTS The required size of the training data was found to be as small as a few hundred slices. By statistical and visual evaluations, the quality improvement and structure preservation of the MVCT images converted by the proposed model were investigated. As a clinical benefit, it was observed by medical doctors that the converted images enhanced the precision of contouring. CONCLUSIONS We developed an MVCT to kVCT conversion model based on deep learning, which can be trained using only a few hundred unpaired images. The stability of the model against changes in data size was demonstrated. This study promotes the reliable use of deep learning in clinical medicine by partially answering commonly asked questions, such as "Is our data sufficient?" and "How much data should we acquire?" This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Sho Ozaki
- Graduate School of Medicine, University of Tokyo, Tokyo, 113-8655, Japan
| | - Shizuo Kaji
- Institute of Mathematics for Industry, Kyushu University, 744 Motooka, Nishi-ku, Fukuoka, 819-0395, Japan
| | - Kanabu Nawa
- Department of Radiology, University of Tokyo Hospital, Tokyo, 113-8655, Japan
| | - Toshikazu Imae
- Department of Radiology, University of Tokyo Hospital, Tokyo, 113-8655, Japan
| | - Atsushi Aoki
- Department of Radiology, University of Tokyo Hospital, Tokyo, 113-8655, Japan
| | - Takahiro Nakamoto
- Department of Biological Science and Engineering, Faculty of Health Sciences, Hokkaido University, N12-W5, Kita-ku, Sapporo, Hokkaido, 060-0812, Japan
| | - Takeshi Ohta
- Department of Radiology, University of Tokyo Hospital, Tokyo, 113-8655, Japan
| | - Yuki Nozawa
- Department of Radiology, University of Tokyo Hospital, Tokyo, 113-8655, Japan
| | - Hideomi Yamashita
- Department of Radiology, University of Tokyo Hospital, Tokyo, 113-8655, Japan
| | - Akihiro Haga
- Graduate School of Biomedical Science, Tokushima University, Tokushima, 770-8503, Japan
| | - Keiichi Nakagawa
- Graduate School of Medicine, University of Tokyo, Tokyo, 113-8655, Japan
| |
Collapse
|
76
|
Olin AB, Hansen AE, Rasmussen JH, Jakoby B, Berthelsen AK, Ladefoged CN, Kjær A, Fischer BM, Andersen FL. Deep learning for Dixon MRI-based attenuation correction in PET/MRI of head and neck cancer patients. EJNMMI Phys 2022; 9:20. [PMID: 35294629 PMCID: PMC8927520 DOI: 10.1186/s40658-022-00449-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2021] [Accepted: 03/02/2022] [Indexed: 11/10/2022] Open
Abstract
Background Quantitative whole-body PET/MRI relies on accurate patient-specific MRI-based attenuation correction (AC) of PET, which is a non-trivial challenge, especially for the anatomically complex head and neck region. We used a deep learning model developed for dose planning in radiation oncology to derive MRI-based attenuation maps of head and neck cancer patients and evaluated its performance on PET AC. Methods Eleven head and neck cancer patients, referred for radiotherapy, underwent CT followed by PET/MRI with acquisition of Dixon MRI. Both scans were performed in radiotherapy position. PET AC was performed with three different patient-specific attenuation maps derived from: (1) Dixon MRI using a deep learning network (PETDeep). (2) Dixon MRI using the vendor-provided atlas-based method (PETAtlas). (3) CT, serving as reference (PETCT). We analyzed the effect of the MRI-based AC methods on PET quantification by assessing the average voxelwise error within the entire body, and the error as a function of distance to bone/air. The error in mean uptake within anatomical regions of interest and the tumor was also assessed. Results The average (± standard deviation) PET voxel error was 0.0 ± 11.4% for PETDeep and −1.3 ± 21.8% for PETAtlas. The error in mean PET uptake in bone/air was much lower for PETDeep (−4%/12%) than for PETAtlas (−15%/84%) and PETDeep also demonstrated a more rapidly decreasing error with distance to bone/air affecting only the immediate surroundings (less than 1 cm). The regions with the largest error in mean uptake were those containing bone (mandible) and air (larynx) for both methods, and the error in tumor mean uptake was −0.6 ± 2.0% for PETDeep and −3.5 ± 4.6% for PETAtlas. Conclusion The deep learning network for deriving MRI-based attenuation maps of head and neck cancer patients demonstrated accurate AC and exceeded the performance of the vendor-provided atlas-based method both overall, on a lesion-level, and in vicinity of challenging regions such as bone and air.
Collapse
Affiliation(s)
- Anders B Olin
- Department of Clinical Physiology, Nuclear Medicine and PET & Cluster for Molecular Imaging, Rigshospitalet, University of Copenhagen, Blegdamsvej 9, 2100, Copenhagen, Denmark.
| | - Adam E Hansen
- Department of Clinical Physiology, Nuclear Medicine and PET & Cluster for Molecular Imaging, Rigshospitalet, University of Copenhagen, Blegdamsvej 9, 2100, Copenhagen, Denmark.,Faculty of Health and Medical Science, University of Copenhagen, Copenhagen, Denmark.,Department of Radiology, Rigshospitalet, University of Copenhagen, Copenhagen, Denmark
| | - Jacob H Rasmussen
- Department of Otorhinolaryngology, Head and Neck Surgery and Audiology, Rigshospitalet, University of Copenhagen, Copenhagen, Denmark
| | - Björn Jakoby
- Siemens Healthcare GmbH, Erlangen, Germany.,University of Surrey, Guildford, Surrey, UK
| | - Anne K Berthelsen
- Department of Oncology, Section of Radiotherapy, Rigshospitalet, University of Copenhagen, Copenhagen, Denmark
| | - Claes N Ladefoged
- Department of Clinical Physiology, Nuclear Medicine and PET & Cluster for Molecular Imaging, Rigshospitalet, University of Copenhagen, Blegdamsvej 9, 2100, Copenhagen, Denmark
| | - Andreas Kjær
- Department of Clinical Physiology, Nuclear Medicine and PET & Cluster for Molecular Imaging, Rigshospitalet, University of Copenhagen, Blegdamsvej 9, 2100, Copenhagen, Denmark
| | - Barbara M Fischer
- Department of Clinical Physiology, Nuclear Medicine and PET & Cluster for Molecular Imaging, Rigshospitalet, University of Copenhagen, Blegdamsvej 9, 2100, Copenhagen, Denmark.,King's College London and Guy's and St Thomas' PET Centre, School of Biomedical Engineering and Imaging Sciences, King's College London, King's Health Partners, London, UK
| | - Flemming L Andersen
- Department of Clinical Physiology, Nuclear Medicine and PET & Cluster for Molecular Imaging, Rigshospitalet, University of Copenhagen, Blegdamsvej 9, 2100, Copenhagen, Denmark
| |
Collapse
|
77
|
Rao F, Wu Z, Han L, Yang B, Han W, Zhu W. Delayed PET imaging using image synthesis network and nonrigid registration without additional CT scan. Med Phys 2022; 49:3233-3245. [PMID: 35218053 DOI: 10.1002/mp.15574] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2021] [Revised: 02/02/2022] [Accepted: 02/15/2022] [Indexed: 11/10/2022] Open
Abstract
PURPOSE Attenuation correction is critical for positron emission tomography (PET) image reconstruction. The standard protocol for obtaining attenuation information in a clinical PET scanner is via the coregistered computed tomography (CT) images. Therefore for delayed PET imaging, the CT scan is repeated twice, which increases the radiation dose for the patient. In this paper, we propose a zero-extra-dose delayed PET imaging method which requires no additional CT scans. METHODS A deep learning based synthesis network is designed to convert the PET data into a pseudo CT image for the delayed scan. Then, nonrigid registration is performed between this pseudo CT image and the CT image of the first scan, warping the CT image of the first scan to an estimated CT images for the delayed scan. Finally, the PET image attenuation correction in the delayed scan is obtained from this estimated CT image. Experiments with clinical datasets are implemented to assess the effectiveness of the proposed method with the well-recognized GAN method. The average peak signal-to-noise ratio (PSNR) and the mean absolute percent error (MAPE) are used in comparison. We also use scoring from three experienced radiologists as subjective measurement means, based on the diagnostic consistency of the PET images reconstructed from GAN and the proposed method with respect to the ground truth images. RESULTS The experiments show that the average PSNR is 47.04 dB (the proposed method) v.s. 44.41 dB (the traditional GAN method) for the reconstructed delayed PET images in our evaluation dataset. The average MAPEs are 1.59% for the proposed method and 3.32% for the traditional GAN method across five organ Regions of Interest (ROIs). The scores for the GAN and the proposed method rated by three experienced radiologists are 8.08±0.60 and 9.02±0.52, indicating that the proposed method yields more consistent PET images with the ground truth. CONCLUSIONS This work proposes a novel method for CT-less delayed PET imaging based on image synthesis network and nonrigid image registration. The PET image reconstructed using the proposed method yields delayed PET images with high image quality without artifacts, and is quantitatively more accurate compared with the traditional GAN method. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Fan Rao
- Research Center for Healthcare Data Science, Zhejiang Lab, China
| | - Zhuoxuan Wu
- Department of Medical Oncology, Sir Run Run Shaw Hospital, College of Medicine, Zhejiang University, China
| | - Lu Han
- Research Center for Healthcare Data Science, Zhejiang Lab, China
| | - Bao Yang
- Research Center for Healthcare Data Science, Zhejiang Lab, China
| | - Weidong Han
- Department of Medical Oncology, Sir Run Run Shaw Hospital, College of Medicine, Zhejiang University, China
| | - Wentao Zhu
- Research Center for Healthcare Data Science, Zhejiang Lab, China
| |
Collapse
|
78
|
Florkow MC, Willemsen K, Mascarenhas VV, Oei EHG, van Stralen M, Seevinck PR. Magnetic Resonance Imaging Versus Computed Tomography for Three-Dimensional Bone Imaging of Musculoskeletal Pathologies: A Review. J Magn Reson Imaging 2022; 56:11-34. [PMID: 35044717 PMCID: PMC9305220 DOI: 10.1002/jmri.28067] [Citation(s) in RCA: 23] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2021] [Revised: 12/31/2021] [Accepted: 01/05/2022] [Indexed: 12/18/2022] Open
Abstract
Magnetic resonance imaging (MRI) is increasingly utilized as a radiation‐free alternative to computed tomography (CT) for the diagnosis and treatment planning of musculoskeletal pathologies. MR imaging of hard tissues such as cortical bone remains challenging due to their low proton density and short transverse relaxation times, rendering bone tissues as nonspecific low signal structures on MR images obtained from most sequences. Developments in MR image acquisition and post‐processing have opened the path for enhanced MR‐based bone visualization aiming to provide a CT‐like contrast and, as such, ease clinical interpretation. The purpose of this review is to provide an overview of studies comparing MR and CT imaging for diagnostic and treatment planning purposes in orthopedic care, with a special focus on selective bone visualization, bone segmentation, and three‐dimensional (3D) modeling. This review discusses conventional gradient‐echo derived techniques as well as dedicated short echo time acquisition techniques and post‐processing techniques, including the generation of synthetic CT, in the context of 3D and specific bone visualization. Based on the reviewed literature, it may be concluded that the recent developments in MRI‐based bone visualization are promising. MRI alone provides valuable information on both bone and soft tissues for a broad range of applications including diagnostics, 3D modeling, and treatment planning in multiple anatomical regions, including the skull, spine, shoulder, pelvis, and long bones.
Collapse
Affiliation(s)
- Mateusz C Florkow
- Image Sciences Institute, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Koen Willemsen
- Department of Orthopedics, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Vasco V Mascarenhas
- Musculoskeletal Imaging Unit, Imaging Center, Hospital da Luz, Lisbon, Portugal
| | - Edwin H G Oei
- Department of Radiology and Nuclear Medicine, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands
| | - Marijn van Stralen
- Image Sciences Institute, University Medical Center Utrecht, Utrecht, The Netherlands.,MRIguidance BV, Utrecht, The Netherlands
| | - Peter R Seevinck
- Image Sciences Institute, University Medical Center Utrecht, Utrecht, The Netherlands.,MRIguidance BV, Utrecht, The Netherlands
| |
Collapse
|
79
|
Zheng S, Yang X, Wang Y, Ding M, Hou W. Unsupervised Cross-Modality Domain Adaptation Network for CNN-Based X-ray to CT. IEEE J Biomed Health Inform 2021; 26:2637-2647. [PMID: 34914602 DOI: 10.1109/jbhi.2021.3135890] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
2D/3D registration that achieves high accuracy and real-time computation is one of the enabling technologies for radiotherapy and image-guided surgeries. Recently, the Convolutional Neural Network(CNN) has been explored to significantly improve the accuracy and efficiency of 2D/3D registration. A pair of intraoperative 2-D x-ray images and synthetic data from pre-operative volume are often required to model the nonconvex mappings between registration parameters and image residual. However, a large clinical dataset collection with accurate poses for x-ray images can be very challenging or even impractical, while exclusive training on synthetic data can frequently cause performance degradation when tested on x-rays. Thus, we propose to train a model on source domain (i.e., synthetic data) to build appearance-pose relationship first and then use an unsupervised cross-modality domain adaptation network (UCMDAN) to adapt the model to target domain (i.e., X-rays) through adversarial learning. We propose to narrow the significant domain gap by alignment in both pixel and feature space. In particular, the image appearance transformation and domain-invariance feature learning by multiple aspects are conducted synergistically. Extensive experiments on CT and CBCT dataset show that the proposed UCMDAN outperforms the existing state-of-the-art domain adaptation approaches.
Collapse
|
80
|
Zijlema SE, Branderhorst W, Bastiaannet R, Tijssen RHN, Lagendijk JJW, van den Berg CAT. Minimizing the need for coil attenuation correction in integrated PET/MRI at 1.5 T using low-density MR-linac receive arrays. Phys Med Biol 2021; 66. [PMID: 34571496 DOI: 10.1088/1361-6560/ac2a8a] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2021] [Accepted: 09/27/2021] [Indexed: 11/12/2022]
Abstract
The simultaneous use of positron emission tomography (PET) and magnetic resonance imaging (MRI) requires attenuation correction (AC) of photon-attenuating objects, such as MRI receive arrays. However, AC of flexible, on-body arrays is complex and therefore often omitted. This can lead to significant, spatially varying PET signal losses when conventional MRI receive arrays are used. Only few dedicated, photon transparent PET/MRI arrays exist, none of which are compatible with our new, wide-bore 1.5 T PET/MRI system dedicated to radiotherapy planning. In this work, we investigated the use of 1.5 T MR-linac (MRL) receive arrays for PET/MRI, as these were designed to have a low photon attenuation for accurate dose delivery and can be connected to the new 1.5 T PET/MRI scanner. Three arrays were assessed: an 8-channel clinically-used MRL array, a 32-channel prototype MRL array, and a conventional MRI receive array. We experimentally determined, simulated, and compared the impact of these arrays on the PET sensitivity and image reconstructions. Furthermore, MRI performance was compared. Overall coil-induced PET sensitivity losses were reduced from 8.5% (conventional) to 1.7% (clinical MRL) and 0.7% (prototype MRL). Phantom measurements showed local signal errors of up to 32.7% (conventional) versus 3.6% (clinical MRL) and 3.5% (prototype MRL). Simulations with data of eight cancer patients showed average signal losses were reduced from 14.3% (conventional) to 1.2% (clinical MRL) and 1.0% (prototype MRL). MRI data showed that the signal-to-noise ratio of the MRL arrays was slightly lower at depth (110 versus 135). The parallel imaging performance of the conventional and prototype MRL arrays was similar, while the clinical MRL array's performance was lower. In conclusion, MRL arrays reducein-vivoPET signal losses >10×, which decreases, or eliminates, the need for coil AC on a new 1.5 T PET/MRI system. The prototype MRL array allows flexible coil positioning without compromising PET or MRI performance. One limitation of MRL arrays is their limited radiolucent PET window (field of view) in the craniocaudal direction.
Collapse
Affiliation(s)
- Stefan E Zijlema
- Department of Radiotherapy, University Medical Center Utrecht, Utrecht, The Netherlands.,Computational Imaging Group for MR Diagnostics & Therapy, Center for Image Sciences, University Medical Center Utrecht, The Netherlands
| | - Woutjan Branderhorst
- Department of Radiology and Nuclear Medicine, University Medical Center Utrecht, The Netherlands
| | - Remco Bastiaannet
- Department of Radiology and Nuclear Medicine, University Medical Center Utrecht, The Netherlands.,Department of Radiology, The Johns Hopkins University, School of Medicine, Baltimore, Maryland, United States of America
| | - Rob H N Tijssen
- Department of Radiotherapy, University Medical Center Utrecht, Utrecht, The Netherlands.,Department of Radiation Oncology, Catharina Hospital, Eindhoven, The Netherlands
| | - Jan J W Lagendijk
- Department of Radiotherapy, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Cornelis A T van den Berg
- Department of Radiotherapy, University Medical Center Utrecht, Utrecht, The Netherlands.,Computational Imaging Group for MR Diagnostics & Therapy, Center for Image Sciences, University Medical Center Utrecht, The Netherlands
| |
Collapse
|
81
|
McMillan AB, Bradshaw TJ. Artificial Intelligence-Based Data Corrections for Attenuation and Scatter in Position Emission Tomography and Single-Photon Emission Computed Tomography. PET Clin 2021; 16:543-552. [PMID: 34364816 PMCID: PMC10562009 DOI: 10.1016/j.cpet.2021.06.010] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
Abstract
Recent developments in artificial intelligence (AI) technology have enabled new developments that can improve attenuation and scatter correction in PET and single-photon emission computed tomography (SPECT). These technologies will enable the use of accurate and quantitative imaging without the need to acquire a computed tomography image, greatly expanding the capability of PET/MR imaging, PET-only, and SPECT-only scanners. The use of AI to aid in scatter correction will lead to improvements in image reconstruction speed, and improve patient throughput. This article outlines the use of these new tools, surveys contemporary implementation, and discusses their limitations.
Collapse
Affiliation(s)
- Alan B McMillan
- Department of Radiology, University of Wisconsin, 3252 Clinical Science Center, 600 Highland Avenue, Madison, WI 53792, USA.
| | - Tyler J Bradshaw
- Department of Radiology, University of Wisconsin, 3252 Clinical Science Center, 600 Highland Avenue, Madison, WI 53792, USA. https://twitter.com/tybradshaw11
| |
Collapse
|