1
|
Gianoli C, De Bernardi E, Parodi K. "Under the hood": artificial intelligence in personalized radiotherapy. BJR Open 2024; 6:tzae017. [PMID: 39104573 PMCID: PMC11299549 DOI: 10.1093/bjro/tzae017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Revised: 05/10/2024] [Accepted: 07/10/2024] [Indexed: 08/07/2024] Open
Abstract
This review presents and discusses the ways in which artificial intelligence (AI) tools currently intervene, or could potentially intervene in the future, to enhance the diverse tasks involved in the radiotherapy workflow. The radiotherapy framework is presented on 2 different levels for the personalization of the treatment, distinct in tasks and methodologies. The first level is the clinically well-established anatomy-based workflow, known as adaptive radiation therapy. The second level is referred to as biology-driven workflow, explored in the research literature and recently appearing in some preliminary clinical trials for personalized radiation treatments. A 2-fold role for AI is defined according to these 2 different levels. In the anatomy-based workflow, the role of AI is to streamline and improve the tasks in terms of time and variability reductions compared to conventional methodologies. The biology-driven workflow instead fully relies on AI, which introduces decision-making tools opening uncharted frontiers that were in the past deemed challenging to explore. These methodologies are referred to as radiomics and dosiomics, handling imaging and dosimetric information, or multiomics, when complemented by clinical and biological parameters (ie, biomarkers). The review explicitly highlights the methodologies that are currently incorporated into clinical practice or still in research, with the aim of presenting the AI's growing role in personalized radiotherapy.
Collapse
Affiliation(s)
- Chiara Gianoli
- Department of Experimental Physics – Medical Physics, Faculty for Physics of the Ludwig-Maximilians-Universität München (LMU Munich), Geschwister-Scholl-Platz 1, München, 80539, Germany
| | - Elisabetta De Bernardi
- School of Medicine and Surgery, Università degli Studi di Milano-Bicocca, Piazza dell'Ateneo Nuovo 1, Milano, 20126, Italy
| | - Katia Parodi
- Department of Experimental Physics – Medical Physics, Faculty for Physics of the Ludwig-Maximilians-Universität München (LMU Munich), Geschwister-Scholl-Platz 1, München, 80539, Germany
| |
Collapse
|
2
|
Yang P, Ge X, Tsui T, Liang X, Xie Y, Hu Z, Niu T. Four-Dimensional Cone Beam CT Imaging Using a Single Routine Scan via Deep Learning. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; 42:1495-1508. [PMID: 37015393 DOI: 10.1109/tmi.2022.3231461] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
A novel method is proposed to obtain four-dimensional (4D) cone-beam computed tomography (CBCT) images from a routine scan in patients with upper abdominal cancer. The projections are sorted according to the location of the lung diaphragm before being reconstructed to phase-sorted data. A multiscale-discriminator generative adversarial network (MSD-GAN) is proposed to alleviate the severe streaking artifacts in the original images. The MSD-GAN is trained using simulated CBCT datasets from patient planning CT images. The enhanced images are further used to estimate the deformable vector field (DVF) among breathing phases using a deformable image registration method. The estimated DVF is then applied in the motion-compensated ordered-subset simultaneous algebraic reconstruction approach to generate 4D CBCT images. The proposed MSD-GAN is compared with U-Net on the performance of image enhancement. Results show that the proposed method significantly outperforms the total variation regularization-based iterative reconstruction approach and the method using only MSD-GAN to enhance original phase-sorted images in simulation and patient studies on 4D reconstruction quality. The MSD-GAN also shows higher accuracy than the U-Net. The proposed method enables a practical way for 4D-CBCT imaging from a single routine scan in upper abdominal cancer treatment including liver and pancreatic tumors.
Collapse
|
3
|
Rusanov B, Hassan GM, Reynolds M, Sabet M, Kendrick J, Farzad PR, Ebert M. Deep learning methods for enhancing cone-beam CT image quality towards adaptive radiation therapy: A systematic review. Med Phys 2022; 49:6019-6054. [PMID: 35789489 PMCID: PMC9543319 DOI: 10.1002/mp.15840] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2021] [Revised: 05/21/2022] [Accepted: 06/16/2022] [Indexed: 11/11/2022] Open
Abstract
The use of deep learning (DL) to improve cone-beam CT (CBCT) image quality has gained popularity as computational resources and algorithmic sophistication have advanced in tandem. CBCT imaging has the potential to facilitate online adaptive radiation therapy (ART) by utilizing up-to-date patient anatomy to modify treatment parameters before irradiation. Poor CBCT image quality has been an impediment to realizing ART due to the increased scatter conditions inherent to cone-beam acquisitions. Given the recent interest in DL applications in radiation oncology, and specifically DL for CBCT correction, we provide a systematic theoretical and literature review for future stakeholders. The review encompasses DL approaches for synthetic CT generation, as well as projection domain methods employed in the CBCT correction literature. We review trends pertaining to publications from January 2018 to April 2022 and condense their major findings - with emphasis on study design and deep learning techniques. Clinically relevant endpoints relating to image quality and dosimetric accuracy are summarised, highlighting gaps in the literature. Finally, we make recommendations for both clinicians and DL practitioners based on literature trends and the current DL state of the art methods utilized in radiation oncology. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Branimir Rusanov
- School of Physics, Mathematics and Computing, The University of Western Australia, Perth, Western Australia, 6009, Australia.,Department of Radiation Oncology, Sir Chairles Gairdner Hospital, Perth, Western Australia, 6009, Australia
| | - Ghulam Mubashar Hassan
- School of Physics, Mathematics and Computing, The University of Western Australia, Perth, Western Australia, 6009, Australia
| | - Mark Reynolds
- School of Physics, Mathematics and Computing, The University of Western Australia, Perth, Western Australia, 6009, Australia
| | - Mahsheed Sabet
- School of Physics, Mathematics and Computing, The University of Western Australia, Perth, Western Australia, 6009, Australia.,Department of Radiation Oncology, Sir Chairles Gairdner Hospital, Perth, Western Australia, 6009, Australia
| | - Jake Kendrick
- School of Physics, Mathematics and Computing, The University of Western Australia, Perth, Western Australia, 6009, Australia.,Department of Radiation Oncology, Sir Chairles Gairdner Hospital, Perth, Western Australia, 6009, Australia
| | - Pejman Rowshan Farzad
- School of Physics, Mathematics and Computing, The University of Western Australia, Perth, Western Australia, 6009, Australia.,Department of Radiation Oncology, Sir Chairles Gairdner Hospital, Perth, Western Australia, 6009, Australia
| | - Martin Ebert
- School of Physics, Mathematics and Computing, The University of Western Australia, Perth, Western Australia, 6009, Australia.,Department of Radiation Oncology, Sir Chairles Gairdner Hospital, Perth, Western Australia, 6009, Australia
| |
Collapse
|
4
|
Lu K, Ren L, Yin FF. A geometry-guided multi-beamlet deep learning technique for CT reconstruction. Biomed Phys Eng Express 2022; 8. [PMID: 35512654 PMCID: PMC9194758 DOI: 10.1088/2057-1976/ac6d12] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2022] [Accepted: 05/05/2022] [Indexed: 11/11/2022]
Abstract
Purpose. Previous studies have proposed deep-learning techniques to reconstruct CT images from sinograms. However, these techniques employ large fully-connected (FC) layers for projection-to-image domain transformation, producing large models requiring substantial computation power, potentially exceeding the computation memory limit. Our previous work proposed a geometry-guided-deep-learning (GDL) technique for CBCT reconstruction that reduces model size and GPU memory consumption. This study further develops the technique and proposes a novel multi-beamlet deep learning (GMDL) technique of improved performance. The study compares the proposed technique with the FC layer-based deep learning (FCDL) method and the GDL technique through low-dose real-patient CT image reconstruction.Methods. Instead of using a large FC layer, the GMDL technique learns the projection-to-image domain transformation by constructing many small FC layers. In addition to connecting each pixel in the projection domain to beamlet points along the central beamlet in the image domain as GDL does, these smaller FC layers in GMDL connect each pixel to beamlets peripheral to the central beamlet based on the CT projection geometry. We compare ground truth images with low-dose images reconstructed with the GMDL, the FCDL, the GDL, and the conventional FBP methods. The images are quantitatively analyzed in terms of peak-signal-to-noise-ratio (PSNR), structural-similarity-index-measure (SSIM), and root-mean-square-error (RMSE).Results. Compared to other methods, the GMDL reconstructed low-dose CT images show improved image quality in terms of PSNR, SSIM, and RMSE. The optimal number of peripheral beamlets for the GMDL technique is two beamlets on each side of the central beamlet. The model size and memory consumption of the GMDL model is less than 1/100 of the FCDL model.Conclusion. Compared to the FCDL method, the GMDL technique is demonstrated to be able to reconstruct real patient low-dose CT images of improved image quality with significantly reduced model size and GPU memory requirement.
Collapse
Affiliation(s)
- Ke Lu
- Medical Physics Graduate Program, Duke University, Durham, NC, United States of America.,Department of Radiation Oncology, Duke University, Durham, NC, United States of America
| | - Lei Ren
- Department of Radiation Oncology, University of Maryland School of Medicine, Baltimore, MD, United States of America
| | - Fang-Fang Yin
- Medical Physics Graduate Program, Duke University, Durham, NC, United States of America.,Department of Radiation Oncology, Duke University, Durham, NC, United States of America.,Medical Physics Graduate Program, Duke Kunshan University, Kunshan, People's Republic of China
| |
Collapse
|