Personalized brachytherapy dose reconstruction using deep learning

Improvement of accumulated dose distribution in combined cervical cancer radiotherapy with deep learning-based dose prediction

Purpose

Difficulties remain in dose optimization and evaluation of cervical cancer radiotherapy that combines external beam radiotherapy (EBRT) and brachytherapy (BT). This study estimates and improves the accumulated dose distribution of EBRT and BT with deep learning-based dose prediction.

Materials and methods

A total of 30 patients treated with combined cervical cancer radiotherapy were enrolled in this study. The dose distributions of EBRT and BT plans were accumulated using commercial deformable image registration. A ResNet-101-based deep learning model was trained to predict pixel-wise dose distributions. To test the role of the predicted accumulated dose in clinic, each EBRT plan was designed using conventional method and then redesigned referencing the predicted accumulated dose distribution. Bladder and rectum dosimetric parameters and normal tissue complication probability (NTCP) values were calculated and compared between the conventional and redesigned accumulated doses.

Results

The redesigned accumulated doses showed a decrease in mean values of V50, V60, and D2cc for the bladder (-3.02%, -1.71%, and -1.19 Gy, respectively) and rectum (-4.82%, -1.97%, and -4.13 Gy, respectively). The mean NTCP values for the bladder and rectum were also decreased by 0.02‰ and 0.98%, respectively. All values had statistically significant differences (p < 0.01), except for the bladder D2cc (p = 0.112).

Conclusion

This study realized accumulated dose prediction for combined cervical cancer radiotherapy without knowing the BT dose. The predicted dose served as a reference for EBRT treatment planning, leading to a superior accumulated dose distribution and lower NTCP values.

Neural network dose prediction for cervical brachytherapy: Overcoming data scarcity for applicator-specific models

BACKGROUND

3D neural network dose predictions are useful for automating brachytherapy (BT) treatment planning for cervical cancer. Cervical BT can be delivered with numerous applicators, which necessitates developing models that generalize to multiple applicator types. The variability and scarcity of data for any given applicator type poses challenges for deep learning.

PURPOSE

The goal of this work was to compare three methods of neural network training-a single model trained on all applicator data, fine-tuning the combined model to each applicator, and individual (IDV) applicator models-to determine the optimal method for dose prediction.

METHODS

Models were produced for four applicator types-tandem-and-ovoid (T&O), T&O with 1-7 needles (T&ON), tandem-and-ring (T&R) and T&R with 1-4 needles (T&RN). First, the combined model was trained on 859 treatment plans from 266 cervical cancer patients treated from 2010 onwards. The train/validation/test split was 70%/16%/14%, with approximately 49%/10%/19%/22% T&O/T&ON/T&R/T&RN in each dataset. Inputs included four channels for anatomical masks (high-risk clinical target volume [HRCTV], bladder, rectum, and sigmoid), a mask indicating dwell position locations, and applicator channels for each applicator component. Applicator channels were created by mapping the 3D dose for a single dwell position to each dwell position and summing over each applicator component with uniform dwell time weighting. A 3D Cascade U-Net, which consists of two U-Nets in sequence, and mean squared error loss function were used. The combined model was then fine-tuned to produce four applicator-specific models by freezing the first U-Net and encoding layers of the second and resuming training on applicator-specific data. Finally, four IDV models were trained using only data from each applicator type. Performance of these three model types was compared using the following metrics for the test set: mean error (ME, representing model bias) and mean absolute error (MAE) over all dose voxels and ME of clinical metrics (HRCTV D90% and D2cc of bladder, rectum, and sigmoid), averaged over all patients. A positive ME indicates the clinical dose was higher than predicted. 3D global gamma analysis with the prescription dose as reference value was performed. Dice similarity coefficients (DSC) were computed for each isodose volume.

RESULTS

Fine-tuned and combined models showed better performance than IDV applicator training. Fine-tuning resulted in modest improvements in about half the metrics, compared to the combined model, while the remainder were mostly unchanged. Fine-tuned MAE = 3.98%/2.69%/5.36%/3.80% for T&O/T&R/T&ON/T&RN, and ME over all voxels = -0.08%/-0.89%/-0.59%/1.42%. ME D2cc were bladder = -0.77%/1.00%/-0.66%/-1.53%, rectum = 1.11%/-0.22%/-0.29%/-3.37%, sigmoid = -0.47%/-0.06%/-2.37%/-1.40%, and ME D90 = 2.6%/-4.4%/4.8%/0.0%. Gamma pass rates (3%/3 mm) were 86%/91%/83%/89%. Mean DSCs were 0.92%/0.92%/0.88%/0.91% for isodoses ≤ 150% of prescription.

CONCLUSIONS

3D BT dose was accurately predicted for all applicator types, as indicated by the low MAE and MEs, high gamma scores and high DSCs. Training on all treatment data overcomes challenges with data scarcity in each applicator type, resulting in superior performance than can be achieved by training on IDV applicators alone. This could presumably be explained by the fact that the larger, more diverse dataset allows the neural network to learn underlying trends and characteristics in dose that are common to all treatment applicators. Accurate, applicator-specific dose predictions could enable automated, knowledge-based planning for any cervical brachytherapy treatment.

An end-to-end deep convolutional neural network-based dose engine for parotid gland cancer seed implant brachytherapy

BACKGROUND

Seed implant brachytherapy (SIBT) is a promising treatment modality for parotid gland cancers (PGCs). However, the current clinical standard dose calculation method based on the American Association of Physicists in Medicine (AAPM) Task Group 43 (TG-43) Report oversimplifies patient anatomy as a homogeneous water phantom medium, leading to significant dose calculation errors due to heterogeneity surrounding the parotid gland. Monte Carlo Simulation (MCS) can yield accurate dose distributions but the long computation time hinders its wide application in clinical practice.

PURPOSE

This paper aims to develop an end-to-end deep convolutional neural network-based dose engine (DCNN-DE) to achieve fast and accurate dose calculation for PGC SIBT.

METHODS

A DCNN model was trained using the patient's CT images and TG-43-based dose maps as inputs, with the corresponding MCS-based dose maps as the ground truth. The DCNN model was enhanced based on our previously proposed model by incorporating attention gates (AGs) and large kernel convolutions. Training and evaluation of the model were performed using a dataset comprising 188 PGC I-125 SIBT patient cases, and its transferability was tested on an additional 16 non-PGC head and neck cancers (HNCs) I-125 SIBT patient cases. Comparison studies were conducted to validate the superiority of the enhanced model over the original one and compare their overall performance.

RESULTS

On the PGC testing dataset, the DCNN-DE demonstrated the ability to generate accurate dose maps, with percentage absolute errors (PAEs) of 0.67% ± 0.47% for clinical target volume (CTV) D90 and 1.04% ± 1.33% for skin D0.1cc. The comparison studies revealed that incorporating AGs and large kernel convolutions resulted in 8.2% (p < 0.001) and 3.1% (p < 0.001) accuracy improvement, respectively, as measured by dose mean absolute error. On the non-PGC HNC dataset, the DCNN-DE exhibited good transferability, achieving a CTV D90 PAE of 1.88% ± 1.73%. The DCNN-DE can generate a dose map in less than 10 ms.

CONCLUSIONS

We have developed and validated an end-to-end DCNN-DE for PGC SIBT. The proposed DCNN-DE enables fast and accurate dose calculation, making it suitable for application in the plan optimization and evaluation process of PGC SIBT.

A generalization performance study on the boosting radiotherapy dose calculation engine based on super-resolution

PURPOSE

During the radiation treatment planning process, one of the time-consuming procedures is the final high-resolution dose calculation, which obstacles the wide application of the emerging online adaptive radiotherapy techniques (OLART). There is an urgent desire for highly accurate and efficient dose calculation methods. This study aims to develop a dose super resolution-based deep learning model for fast and accurate dose prediction in clinical practice.

METHOD

A Multi-stage Dose Super-Resolution Network (MDSR Net) architecture with sparse masks module and multi-stage progressive dose distribution restoration method were developed to predict high-resolution dose distribution using low-resolution data. A total of 340 VMAT plans from different disease sites were used, among which 240 randomly selected nasopharyngeal, lung, and cervix cases were used for model training, and the remaining 60 cases from the same sites for model benchmark testing, and additional 40 cases from the unseen site (breast and rectum) was used for model generalizability evaluation. The clinical calculated dose with a grid size of 2 mm was used as baseline dose distribution. The input included the dose distribution with 4 mm grid size and CT images. The model performance was compared with HD U-Net and cubic interpolation methods using Dose-volume histograms (DVH) metrics and global gamma analysis with 1%/1 mm and 10% low dose threshold. The correlation between the prediction error and the dose, dose gradient, and CT values was also evaluated.

RESULTS

The prediction errors of MDSR were 0.06-0.84% of Dmean indices, and the gamma passing rate was 83.1-91.0% on the benchmark testing dataset, and 0.02-1.03% and 71.3-90.3% for the generalization dataset respectively. The model performance was significantly higher than the HD U-Net and interpolation methods (p < 0.05). The mean errors of the MDSR model decreased (monotonously by 0.03-0.004%) with dose and increased (by 0.01-0.73%) with the dose gradient. There was no correlation between prediction errors and the CT values.

CONCLUSION

The proposed MDSR model achieved good agreement with the baseline high-resolution dose distribution, with small prediction errors for DVH indices and high gamma passing rate for both seen and unseen sites, indicating a robust and generalizable dose prediction model. The model can provide fast and accurate high-resolution dose distribution for clinical dose calculation, particularly for the routine practice of OLART.

Artificial intelligence-based analysis of whole-body bone scintigraphy: The quest for the optimal deep learning algorithm and comparison with human observer performance

PURPOSE

Whole-body bone scintigraphy (WBS) is one of the most widely used modalities in diagnosing malignant bone diseases during the early stages. However, the procedure is time-consuming and requires vigour and experience. Moreover, interpretation of WBS scans in the early stages of the disorders might be challenging because the patterns often reflect normal appearance that is prone to subjective interpretation. To simplify the gruelling, subjective, and prone-to-error task of interpreting WBS scans, we developed deep learning (DL) models to automate two major analyses, namely (i) classification of scans into normal and abnormal and (ii) discrimination between malignant and non-neoplastic bone diseases, and compared their performance with human observers.

MATERIALS AND METHODS

After applying our exclusion criteria on 7188 patients from three different centers, 3772 and 2248 patients were enrolled for the first and second analyses, respectively. Data were split into two parts, including training and testing, while a fraction of training data were considered for validation. Ten different CNN models were applied to single- and dual-view input (posterior and anterior views) modes to find the optimal model for each analysis. In addition, three different methods, including squeeze-and-excitation (SE), spatial pyramid pooling (SPP), and attention-augmented (AA), were used to aggregate the features for dual-view input models. Model performance was reported through area under the receiver operating characteristic (ROC) curve (AUC), accuracy, sensitivity, and specificity and was compared with the DeLong test applied to ROC curves. The test dataset was evaluated by three nuclear medicine physicians (NMPs) with different levels of experience to compare the performance of AI and human observers.

RESULTS

DenseNet121_AA (DensNet121, with dual-view input aggregated by AA) and InceptionResNetV2_SPP achieved the highest performance (AUC = 0.72) for the first and second analyses, respectively. Moreover, on average, in the first analysis, Inception V3 and InceptionResNetV2 CNN models and dual-view input with AA aggregating method had superior performance. In addition, in the second analysis, DenseNet121 and InceptionResNetV2 as CNN methods and dual-view input with AA aggregating method achieved the best results. Conversely, the performance of AI models was significantly higher than human observers for the first analysis, whereas their performance was comparable in the second analysis, although the AI model assessed the scans in a drastically lower time.

CONCLUSION

Using the models designed in this study, a positive step can be taken toward improving and optimizing WBS interpretation. By training DL models with larger and more diverse cohorts, AI could potentially be used to assist physicians in the assessment of WBS images.

The use of deep learning in interventional radiotherapy (brachytherapy): A review with a focus on open source and open data

Deep learning advanced to one of the most important technologies in almost all medical fields. Especially in areas, related to medical imaging it plays a big role. However, in interventional radiotherapy (brachytherapy) deep learning is still in an early phase. In this review, first, we investigated and scrutinised the role of deep learning in all processes of interventional radiotherapy and directly related fields. Additionally, we summarised the most recent developments. For better understanding, we provide explanations of key terms and approaches to solving common deep learning problems. To reproduce results of deep learning algorithms both source code and training data must be available. Therefore, a second focus of this work is on the analysis of the availability of open source, open data and open models. In our analysis, we were able to show that deep learning plays already a major role in some areas of interventional radiotherapy, but is still hardly present in others. Nevertheless, its impact is increasing with the years, partly self-propelled but also influenced by closely related fields. Open source, data and models are growing in number but are still scarce and unevenly distributed among different research groups. The reluctance in publishing code, data and models limits reproducibility and restricts evaluation to mono-institutional datasets. The conclusion of our analysis is that deep learning can positively change the workflow of interventional radiotherapy but there is still room for improvements when it comes to reproducible results and standardised evaluation methods.

Deep learning for high-resolution dose prediction in high dose rate brachytherapy for breast cancer treatment

Objective.Monte Carlo (MC) simulations are the benchmark for accurate radiotherapy dose calculations, notably in patient-specific high dose rate brachytherapy (HDR BT), in cases where considering tissue heterogeneities is critical. However, the lengthy computational time limits the practical application of MC simulations. Prior research used deep learning (DL) for dose prediction as an alternative to MC simulations. While accurate dose predictions akin to MC were attained, graphics processing unit limitations constrained these predictions to large voxels of 3 mm × 3 mm × 3 mm. This study aimed to enable dose predictions as accurate as MC simulations in 1 mm × 1 mm × 1 mm voxels within a clinically acceptable timeframe.Approach.Computed tomography scans of 98 breast cancer patients treated with Iridium-192-based HDR BT were used: 70 for training, 14 for validation, and 14 for testing. A new cropping strategy based on the distance to the seed was devised to reduce the volume size, enabling efficient training of 3D DL models using 1 mm × 1 mm × 1 mm dose grids. Additionally, novel DL architecture with layer-level fusion were proposed to predict MC simulated dose to medium-in-medium (Dm,m). These architectures fuse information from TG-43 dose to water-in-water (Dw,w) with patient tissue composition at the layer-level. Different inputs describing patient body composition were investigated.Main results.The proposed approach demonstrated state-of-the-art performance, on par with the MCDm,mmaps, but 300 times faster. The mean absolute percent error for dosimetric indices between the MC and DL-predicted complete treatment plans was 0.17% ± 0.15% for the planning target volumeV100, 0.30% ± 0.32% for the skinD2cc, 0.82% ± 0.79% for the lungD2cc, 0.34% ± 0.29% for the chest wallD2ccand 1.08% ± 0.98% for the heartD2cc.Significance.Unlike the time-consuming MC simulations, the proposed novel strategy efficiently converts TG-43Dw,wmaps into preciseDm,mmaps at high resolution, enabling clinical integration.

Aleatoric and epistemic uncertainty extraction of patient-specific deep learning-based dose predictions in LDR prostate brachytherapy

Objective.In brachytherapy, deep learning (DL) algorithms have shown the capability of predicting 3D dose volumes. The reliability and accuracy of such methodologies remain under scrutiny for prospective clinical applications. This study aims to establish fast DL-based predictive dose algorithms for low-dose rate (LDR) prostate brachytherapy and to evaluate their uncertainty and stability.Approach.Data from 200 prostate patients, treated with125I sources, was collected. The Monte Carlo (MC) ground truth dose volumes were calculated with TOPAS considering the interseed effects and an organ-based material assignment. Two 3D convolutional neural networks, UNet and ResUNet TSE, were trained using the patient geometry and the seed positions as the input data. The dataset was randomly split into training (150), validation (25) and test (25) sets. The aleatoric (associated with the input data) and epistemic (associated with the model) uncertainties of the DL models were assessed.Main results.For the full test set, with respect to the MC reference, the predicted prostateD90metric had mean differences of -0.64% and 0.08% for the UNet and ResUNet TSE models, respectively. In voxel-by-voxel comparisons, the average global dose difference ratio in the [-1%, 1%] range included 91.0% and 93.0% of voxels for the UNet and the ResUNet TSE, respectively. One forward pass or prediction took 4 ms for a 3D dose volume of 2.56 M voxels (128 × 160 × 128). The ResUNet TSE model closely encoded the well-known physics of the problem as seen in a set of uncertainty maps. The ResUNet TSE rectum D2cchad the largest uncertainty metric of 0.0042.Significance.The proposed DL models serve as rapid dose predictors that consider the patient anatomy and interseed attenuation effects. The derived uncertainty is interpretable, highlighting areas where DL models may struggle to provide accurate estimations. The uncertainty analysis offers a comprehensive evaluation tool for dose predictor model assessment.

Automatic planning for head and neck seed implant brachytherapy based on deep convolutional neural network dose engine

BACKGROUND

Seed implant brachytherapy (SIBT) is an effective treatment modality for head and neck (H&N) cancers; however, current clinical planning requires manual setting of needle paths and utilizes inaccurate dose calculation algorithms.

PURPOSE

This study aims to develop an accurate and efficient deep convolutional neural network dose engine (DCNN-DE) and an automatic SIBT planning method for H&N SIBT.

METHODS

A cohort of 25 H&N patients who received SIBT was utilized to develop and validate the methods. The DCNN-DE was developed based on 3D-unet model. It takes single seed dose distribution from a modified TG-43 method, the CT image and a novel inter-seed shadow map (ISSM) as inputs, and predicts the dose map of accuracy close to the one from Monte Carlo simulations (MCS). The ISSM was proposed to better handle inter-seed attenuation. The accuracy and efficacy of the DCNN-DE were validated by comparing with other methods taking MCS dose as reference. For SIBT planning, a novel strategy inspired by clinical practice was proposed to automatically generate parallel or non-parallel potential needle paths that avoid puncturing bone and critical organs. A heuristic-based optimization method was developed to optimize the seed positions to meet clinical prescription requirements. The proposed planning method was validated by re-planning the 25 cases and comparing with clinical plans.

RESULTS

The absolute percentage error in the TG-43 calculation for CTV V100 and D90 was reduced from 5.4% and 13.2% to 0.4% and 1.1% with DCNN-DE, an accuracy improvement of 93% and 92%, respectively. The proposed planning method could automatically obtain a plan in 2.5 ± 1.5 min. The generated plans were judged clinically acceptable with dose distribution comparable with those of the clinical plans.

CONCLUSIONS

The proposed method can generate clinically acceptable plans quickly with high accuracy in dose evaluation, and thus has a high potential for clinical use in SIBT.

Deep learning-based dose map prediction for high-dose-rate brachytherapy

Background. Creating a clinically acceptable plan in the time-sensitive clinic workflow of brachytherapy is challenging. Deep learning-based dose prediction techniques have been reported as promising solutions with high efficiency and accuracy. However, current dose prediction studies mainly target EBRT which are inappropriate for brachytherapy, the model designed specifically for brachytherapy has not yet well-established.Purpose. To predict dose distribution in brachytherapy using a novel Squeeze and Excitation Attention Net (SE_AN) model.Method. We hypothesized the tracks of192Ir inside applicators are essential for brachytherapy dose prediction. To emphasize the applicator contribution, a novel SE module was integrated into a Cascaded UNet to recalibrate informative features and suppress less useful ones. The Cascaded UNet consists of two stacked UNets, with the first designed to predict coarse dose distribution and the second added for fine-tuning 250 cases including all typical clinical applicators were studied, including vaginal, tandem and ovoid, multi-channel, and free needle applicators. The developed SE_AN was subsequently compared to the classic UNet and classic Cascaded UNet (without SE module) models. The model performance was evaluated by comparing the predicted dose against the clinically approved plans using mean absolute error (MAE) of DVH metrics, includingD2ccandD90%.Results. The MAEs of DVH metrics demonstrated that SE_AN accurately predicted the dose with 0.37 ± 0.25 difference for HRCTVD90%, 0.23 ± 0.14 difference for bladderD2cc, and 0.28 ± 0.20 difference for rectumD2cc. In comparison studies, UNet achieved 0.34 ± 0.24 for HRCTV, 0.25 ± 0.20 for bladder, 0.25 ± 0.21 for rectum, and Cascaded UNet achieved 0.42 ± 0.31 for HRCTV, 0.24 ± 0.19 for bladder, 0.23 ± 0.19 for rectum.Conclusion. We successfully developed a method specifically for 3D brachytherapy dose prediction. Our model demonstrated comparable performance to clinical plans generated by experienced dosimetrists. The developed technique is expected to improve the standardization and quality control of brachytherapy treatment planning.

Artificial intelligence applications in brachytherapy: A literature review

PURPOSE

Artificial intelligence (AI) has the potential to simplify and optimize various steps of the brachytherapy workflow, and this literature review aims to provide an overview of the work done in this field.

METHODS AND MATERIALS

We conducted a literature search in June 2022 on PubMed, Embase, and Cochrane for papers that proposed AI applications in brachytherapy.

RESULTS

A total of 80 papers satisfied inclusion/exclusion criteria. These papers were categorized as follows: segmentation (24), registration and image processing (6), preplanning (13), dose prediction and treatment planning (11), applicator/catheter/needle reconstruction (16), and quality assurance (10). AI techniques ranged from classical models such as support vector machines and decision tree-based learning to newer techniques such as U-Net and deep reinforcement learning, and were applied to facilitate small steps of a process (e.g., optimizing applicator selection) or even automate the entire step of the workflow (e.g., end-to-end preplanning). Many of these algorithms demonstrated human-level performance and offer significant improvements in speed.

CONCLUSIONS

AI has potential to augment, automate, and/or accelerate many steps of the brachytherapy workflow. We recommend that future studies adhere to standard reporting guidelines. We also stress the importance of using larger sample sizes and reporting results using clinically interpretable measures.

Automated treatment planning framework for brachytherapy of cervical cancer using 3D dose predictions

Objective. To lay the foundation for automated knowledge-based brachytherapy treatment planning using 3D dose estimations, we describe an optimization framework to convert brachytherapy dose distributions directly into dwell times (DTs).Approach. A dose rate kernelḋ(r,θ,φ)was produced by exporting 3D dose for one dwell position from the treatment planning system and normalizing by DT. By translating and rotating this kernel to each dwell position, scaling by DT and summing over all dwell positions, dose was computed (Dcalc). We used a Python-coded COBYLA optimizer to iteratively determine the DTs that minimize the mean squared error betweenDcalcand reference doseDref, computed using voxels withDref80%-120% of prescription. As validation of the optimization, we showed that the optimizer replicates clinical plans whenDref= clinical dose in 40 patients treated with tandem-and-ovoid (T&O) or tandem-and-ring (T&R) and 0-3 needles. Then we demonstrated automated planning in 10 T&O usingDref= dose predicted from a convolutional neural network developed in past work. Validation and automated plans were compared to clinical plans using mean absolute differences (MAD=1N∑n=1Nabsxn-xn') over all voxels (xn= Dose,N= #voxels) and DTs (xn= DT,N= #dwell positions), mean differences (MD) in organD2ccand high-risk CTV D90 over all patients (where positive indicates higher clinical dose), and mean Dice similarity coefficients (DSC) for 100% isodose contours.Main results. Validation plans agreed well with clinical plans (MADdose= 1.1%, MADDT= 4 s or 0.8% of total plan time,D2ccMD = -0.2% to 0.2% and D90 MD = -0.6%, DSC = 0.99). For automated plans, MADdose= 6.5% and MADDT= 10.3 s (2.1%). The slightly higher clinical metrics in automated plans (D2ccMD = -3.8% to 1.3% and D90 MD = -5.1%) were due to higher neural network dose predictions. The overall shape of the automated dose distributions were similar to clinical doses (DSC = 0.91).Significance. Automated planning with 3D dose predictions could provide significant time savings and standardize treatment planning across practitioners, regardless of experience.

Deep Learning-based Non-rigid Image Registration for High-dose Rate Brachytherapy in Inter-fraction Cervical Cancer

In this study, an inter-fraction organ deformation simulation framework for the locally advanced cervical cancer (LACC), which considers the anatomical flexibility, rigidity, and motion within an image deformation, was proposed. Data included 57 CT scans (7202 2D slices) of patients with LACC randomly divided into the train (n = 42) and test (n = 15) datasets. In addition to CT images and the corresponding RT structure (bladder, cervix, and rectum), the bone was segmented, and the coaches were eliminated. The correlated stochastic field was simulated using the same size as the target image (used for deformation) to produce the general random deformation. The deformation field was optimized to have a maximum amplitude in the rectum region, a moderate amplitude in the bladder region, and an amplitude as minimum as possible within bony structures. The DIRNet is a convolutional neural network that consists of convolutional regressors, spatial transformation, as well as resampling blocks. It was implemented by different parameters. Mean Dice indices of 0.89 ± 0.02, 0.96 ± 0.01, and 0.93 ± 0.02 were obtained for the cervix, bladder, and rectum (defined as at-risk organs), respectively. Furthermore, a mean average symmetric surface distance of 1.61 ± 0.46 mm for the cervix, 1.17 ± 0.15 mm for the bladder, and 1.06 ± 0.42 mm for the rectum were achieved. In addition, a mean Jaccard of 0.86 ± 0.04 for the cervix, 0.93 ± 0.01 for the bladder, and 0.88 ± 0.04 for the rectum were observed on the test dataset (15 subjects). Deep learning-based non-rigid image registration is, therefore, proposed for the high-dose-rate brachytherapy in inter-fraction cervical cancer since it outperformed conventional algorithms.

COLI-Net: Deep learning-assisted fully automated COVID-19 lung and infection pneumonia lesion detection and segmentation from chest computed tomography images

We present a deep learning (DL)-based automated whole lung and COVID-19 pneumonia infectious lesions (COLI-Net) detection and segmentation from chest computed tomography (CT) images. This multicenter/multiscanner study involved 2368 (347'259 2D slices) and 190 (17 341 2D slices) volumetric CT exams along with their corresponding manual segmentation of lungs and lesions, respectively. All images were cropped, resized, and the intensity values clipped and normalized. A residual network with non-square Dice loss function built upon TensorFlow was employed. The accuracy of lung and COVID-19 lesions segmentation was evaluated on an external reverse transcription-polymerase chain reaction positive COVID-19 dataset (7'333 2D slices) collected at five different centers. To evaluate the segmentation performance, we calculated different quantitative metrics, including radiomic features. The mean Dice coefficients were 0.98 ± 0.011 (95% CI, 0.98-0.99) and 0.91 ± 0.038 (95% CI, 0.90-0.91) for lung and lesions segmentation, respectively. The mean relative Hounsfield unit differences were 0.03 ± 0.84% (95% CI, -0.12 to 0.18) and -0.18 ± 3.4% (95% CI, -0.8 to 0.44) for the lung and lesions, respectively. The relative volume difference for lung and lesions were 0.38 ± 1.2% (95% CI, 0.16-0.59) and 0.81 ± 6.6% (95% CI, -0.39 to 2), respectively. Most radiomic features had a mean relative error less than 5% with the highest mean relative error achieved for the lung for the range first-order feature (-6.95%) and least axis length shape feature (8.68%) for lesions. We developed an automated DL-guided three-dimensional whole lung and infected regions segmentation in COVID-19 patients to provide fast, consistent, robust, and human error immune framework for lung and pneumonia lesion detection and quantification.