Dual-energy CT for automatic organs-at-risk segmentation in brain-tumor patients using a multi-atlas and deep-learning approach

The evolution and current situation in the application of dual-energy computed tomography: a bibliometric study

Background

Dual-energy computed tomography (DECT) has received extensive attention in clinical practice; however, a quantitative assessment of published literature in this domain is presently lacking. This study thus aimed to characterize the application conditions, developmental trends, and research hot spots of DECT using bibliometric analysis.

Methods

All literature on DECT was retrieved from the Web of Science Core Collection (WoSCC) on January 22, 2023. The co-occurrence, cooperation network, and co-citation of countries, institutions, references, authors, journals, and keywords were analyzed using CiteSpace, VOSviewer, and R-bibliometrix software.

Results

In total, 4,720 original articles and reviews were included. The number of publications related to DECT has rapidly increased since 2006. The USA (n=1,662) and Mayo Clinic (n=178) were found to be the most productive country and institution, respectively. The most cited article was published by Johnson TRC et al., while the article published by McCollough CH et al. in 2015 had the most co-citations. Schoepf UJ ranked first with most articles among 16,838 authors. The journal with the most published articles was European Radiology, with 411 publications. The timeline analysis indicated that material decomposition was the most recent topic, followed by gout, radiomics, proton therapy, and bone marrow edema.

Conclusions

An increasing number of researchers are committed to researching DECT, with the USA making the most significant contributions in this area. Prior studies have primarily concentrated on cardiovascular diseases, and contemporary hot spots include expansion into to other fields, such as iodine quantification, deep learning, and bone marrow edema.

Inpainting truncated areas of CT images based on generative adversarial networks with gated convolution for radiotherapy

This study aimed to inpaint the truncated areas of CT images by using generative adversarial networks with gated convolution (GatedConv) and apply these images to dose calculations in radiotherapy. CT images were collected from 100 patients with esophageal cancer under thermoplastic membrane placement, and 85 cases were used for training based on randomly generated circle masks. In the prediction stage, 15 cases of data were used to evaluate the accuracy of the inpainted CT in anatomy and dosimetry based on the mask with a truncated volume covering 40% of the arm volume, and they were compared with the inpainted CT synthesized by U-Net, pix2pix, and PConv with partial convolution. The results showed that GatedConv could directly and effectively inpaint incomplete CT images in the image domain. For the results of U-Net, pix2pix, PConv, and GatedConv, the mean absolute errors for the truncated tissue were 195.54, 196.20, 190.40, and 158.45 HU, respectively. The mean dose of the planning target volume, heart, and lung in the truncated CT was statistically different (p < 0.05) from those of the ground truth CT ([Formula: see text]). The differences in dose distribution between the inpainted CT obtained by the four models and [Formula: see text] were minimal. The inpainting effect of clinical truncated CT images based on GatedConv showed better stability compared with the other models. GatedConv can effectively inpaint the truncated areas with high image quality, and it is closer to [Formula: see text] in terms of image visualization and dosimetry than other inpainting models.

Synthetic cranial MRI from 3D optical surface scans using deep learning for radiation therapy treatment planning

BACKGROUND

Optical scanning technologies are increasingly being utilised to supplement treatment workflows in radiation oncology, such as surface-guided radiotherapy or 3D printing custom bolus. One limitation of optical scanning devices is the absence of internal anatomical information of the patient being scanned. As a result, conventional radiation therapy treatment planning using this imaging modality is not feasible. Deep learning is useful for automating various manual tasks in radiation oncology, most notably, organ segmentation and treatment planning. Deep learning models have also been used to transform MRI datasets into synthetic CT datasets, facilitating the development of MRI-only radiation therapy planning.

AIMS

To train a pix2pix generative adversarial network to transform 3D optical scan data into estimated MRI datasets for a given patient to provide additional anatomical data for a select few radiation therapy treatment sites. The proposed network may provide useful anatomical information for treatment planning of surface mould brachytherapy, total body irradiation, and total skin electron therapy, for example, without delivering any imaging dose.

METHODS

A 2D pix2pix GAN was trained on 15,000 axial MRI slices of healthy adult brains paired with corresponding external mask slices. The model was validated on a further 5000 previously unseen external mask slices. The predictions were compared with the "ground-truth" MRI slices using the multi-scale structural similarity index (MSSI) metric. A certified neuro-radiologist was subsequently consulted to provide an independent review of the model's performance in terms of anatomical accuracy and consistency. The network was then applied to a 3D photogrammetry scan of a test subject to demonstrate the feasibility of this novel technique.

RESULTS

The trained pix2pix network predicted MRI slices with a mean MSSI of 0.831 ± 0.057 for the 5000 validation images indicating that it is possible to estimate a significant proportion of a patient's gross cranial anatomy from a patient's exterior contour. When independently reviewed by a certified neuro-radiologist, the model's performance was described as "quite amazing, but there are limitations in the regions where there is wide variation within the normal population." When the trained network was applied to a 3D model of a human subject acquired using optical photogrammetry, the network could estimate the corresponding MRI volume for that subject with good qualitative accuracy. However, a ground-truth MRI baseline was not available for quantitative comparison.

CONCLUSIONS

A deep learning model was developed, to transform 3D optical scan data of a patient into an estimated MRI volume, potentially increasing the usefulness of optical scanning in radiation therapy planning. This work has demonstrated that much of the human cranial anatomy can be predicted from the external shape of the head and may provide an additional source of valuable imaging data. Further research is required to investigate the feasibility of this approach for use in a clinical setting and further improve the model's accuracy.

Dual- and multi-energy CT for particle stopping-power estimation: current state, challenges and potential

Range uncertainty has been a key factor preventing particle radiotherapy from reaching its full physical potential. One of the main contributing sources is the uncertainty in estimating particle stopping power (ρ_s) within patients. Currently, theρ_sdistribution in a patient is derived from a single-energy CT (SECT) scan acquired for treatment planning by converting CT number expressed in Hounsfield units (HU) of each voxel toρ_susing a Hounsfield look-up table (HLUT), also known as the CT calibration curve. HU andρ_sshare a linear relationship with electron density but differ in their additional dependence on elemental composition through different physical properties, i.e. effective atomic number and mean excitation energy, respectively. Because of that, the HLUT approach is particularly sensitive to differences in elemental composition between real human tissues and tissue surrogates as well as tissue variations within and among individual patients. The use of dual-energy CT (DECT) forρ_sprediction has been shown to be effective in reducing the uncertainty inρ_sestimation compared to SECT. The acquisition of CT data over different x-ray spectra yields additional information on the material elemental composition. Recently, multi-energy CT (MECT) has been explored to deduct material-specific information with higher dimensionality, which has the potential to further improve the accuracy ofρ_sestimation. Even though various DECT and MECT methods have been proposed and evaluated over the years, these approaches are still only scarcely implemented in routine clinical practice. In this topical review, we aim at accelerating this translation process by providing: (1) a comprehensive review of the existing DECT/MECT methods forρ_sestimation with their respective strengths and weaknesses; (2) a general review of uncertainties associated with DECT/MECT methods; (3) a general review of different aspects related to clinical implementation of DECT/MECT methods; (4) other potential advanced DECT/MECT applications beyondρ_sestimation.

A deep image-to-image network organ segmentation algorithm for radiation treatment planning: principles and evaluation

Background

We describe and evaluate a deep network algorithm which automatically contours organs at risk in the thorax and pelvis on computed tomography (CT) images for radiation treatment planning.

Methods

The algorithm identifies the region of interest (ROI) automatically by detecting anatomical landmarks around the specific organs using a deep reinforcement learning technique. The segmentation is restricted to this ROI and performed by a deep image-to-image network (DI2IN) based on a convolutional encoder-decoder architecture combined with multi-level feature concatenation. The algorithm is commercially available in the medical products “syngo.via RT Image Suite VB50” and “AI-Rad Companion Organs RT VA20” (Siemens Healthineers). For evaluation, thoracic CT images of 237 patients and pelvic CT images of 102 patients were manually contoured following the Radiation Therapy Oncology Group (RTOG) guidelines and compared to the DI2IN results using metrics for volume, overlap and distance, e.g., Dice Similarity Coefficient (DSC) and Hausdorff Distance (HD₉₅). The contours were also compared visually slice by slice.

Results

We observed high correlations between automatic and manual contours. The best results were obtained for the lungs (DSC 0.97, HD₉₅ 2.7 mm/2.9 mm for left/right lung), followed by heart (DSC 0.92, HD₉₅ 4.4 mm), bladder (DSC 0.88, HD₉₅ 6.7 mm) and rectum (DSC 0.79, HD₉₅ 10.8 mm). Visual inspection showed excellent agreements with some exceptions for heart and rectum.

Conclusions

The DI2IN algorithm automatically generated contours for organs at risk close to those by a human expert, making the contouring step in radiation treatment planning simpler and faster. Few cases still required manual corrections, mainly for heart and rectum.

A novel multichannel deep learning model for fast denoising of Monte Carlo dose calculations: preclinical applications

Objective. In preclinical radiotherapy with kilovolt (kV) x-ray beams, accurate treatment planning is needed to improve the translation potential to clinical trials. Monte Carlo based radiation transport simulations are the gold standard to calculate the absorbed dose distribution in external beam radiotherapy. However, these simulations are notorious for their long computation time, causing a bottleneck in the workflow. Previous studies have used deep learning models to speed up these simulations for clinical megavolt (MV) beams. For kV beams, dose distributions are more affected by tissue type than for MV beams, leading to steep dose gradients. This study aims to speed up preclinical kV dose simulations by proposing a novel deep learning pipeline. Approach. A deep learning model is proposed that denoises low precision (∼106 simulated particles) dose distributions to produce high precision (109 simulated particles) dose distributions. To effectively denoise the steep dose gradients in preclinical kV dose distributions, the model uses the novel approach to use the low precision Monte Carlo dose calculation as well as the Monte Carlo uncertainty (MCU) map and the mass density map as additional input channels. The model was trained on a large synthetic dataset and tested on a real dataset with a different data distribution. To keep model inference time to a minimum, a novel method for inference optimization was developed as well. Main results. The proposed model provides dose distributions which achieve a median gamma pass rate (3%/0.3 mm) of 98% with a lower bound of 95% when compared to the high precision Monte Carlo dose distributions from the test set, which represents a different dataset distribution than the training set. Using the proposed model together with the novel inference optimization method, the total computation time was reduced from approximately 45 min to less than six seconds on average. Significance. This study presents the first model that can denoise preclinical kV instead of clinical MV Monte Carlo dose distributions. This was achieved by using the MCU and mass density maps as additional model inputs. Additionally, this study shows that training such a model on a synthetic dataset is not only a viable option, but even increases the generalization of the model compared to training on real data due to the sheer size and variety of the synthetic dataset. The application of this model will enable speeding up treatment plan optimization in the preclinical workflow.

Impact of Denoising on Deep-Learning-Based Automatic Segmentation Framework for Breast Cancer Radiotherapy Planning

Objective: This study aimed to investigate the segmentation accuracy of organs at risk (OARs) when denoised computed tomography (CT) images are used as input data for a deep-learning-based auto-segmentation framework. Methods: We used non-contrast enhanced planning CT scans from 40 patients with breast cancer. The heart, lungs, esophagus, spinal cord, and liver were manually delineated by two experienced radiation oncologists in a double-blind manner. The denoised CT images were used as input data for the AccuContourTM segmentation software to increase the signal difference between structures of interest and unwanted noise in non-contrast CT. The accuracy of the segmentation was assessed using the Dice similarity coefficient (DSC), and the results were compared with those of conventional deep-learning-based auto-segmentation without denoising. Results: The average DSC outcomes were higher than 0.80 for all OARs except for the esophagus. AccuContourTM-based and denoising-based auto-segmentation demonstrated comparable performance for the lungs and spinal cord but showed limited performance for the esophagus. Denoising-based auto-segmentation for the liver was minimal but had statistically significantly better DSC than AccuContourTM-based auto-segmentation (p < 0.05). Conclusions: Denoising-based auto-segmentation demonstrated satisfactory performance in automatic liver segmentation from non-contrast enhanced CT scans. Further external validation studies with larger cohorts are needed to verify the usefulness of denoising-based auto-segmentation.

Artificial Intelligence in Radiation Therapy

Artificial intelligence (AI) has great potential to transform the clinical workflow of radiotherapy. Since the introduction of deep neural networks, many AI-based methods have been proposed to address challenges in different aspects of radiotherapy. Commercial vendors have started to release AI-based tools that can be readily integrated to the established clinical workflow. To show the recent progress in AI-aided radiotherapy, we have reviewed AI-based studies in five major aspects of radiotherapy including image reconstruction, image registration, image segmentation, image synthesis, and automatic treatment planning. In each section, we summarized and categorized the recently published methods, followed by a discussion of the challenges, concerns, and future development. Given the rapid development of AI-aided radiotherapy, the efficiency and effectiveness of radiotherapy in the future could be substantially improved through intelligent automation of various aspects of radiotherapy.

Improving radiation physics, tumor visualisation, and treatment quantification in radiotherapy with spectral or dual-energy CT

Over the past decade, spectral or dual‐energy CT has gained relevancy, especially in oncological radiology. Nonetheless, its use in the radiotherapy (RT) clinic remains limited. This review article aims to give an overview of the current state of spectral CT and to explore opportunities for applications in RT.

In this article, three groups of benefits of spectral CT over conventional CT in RT are recognized. Firstly, spectral CT provides more information of physical properties of the body, which can improve dose calculation. Furthermore, it improves the visibility of tumors, for a wide variety of malignancies as well as organs‐at‐risk OARs, which could reduce treatment uncertainty. And finally, spectral CT provides quantitative physiological information, which can be used to personalize and quantify treatment.

A Segmentation Method of Foramen Ovale Based on Multiatlas

Trigeminal neuralgia is a neurological disease. It is often treated by puncturing the trigeminal nerve through the skin and the oval foramen of the skull to selectively destroy the pain nerve. The process of puncture operation is difficult because the morphology of the foramen ovale in the skull base is varied and the surrounding anatomical structure is complex. Computer-aided puncture guidance technology is extremely valuable for the treatment of trigeminal neuralgia. Computer-aided guidance can help doctors determine the puncture target by accurately locating the foramen ovale in the skull base. Foramen ovale segmentation is a prerequisite for locating but is a tedious and error-prone task if done manually. In this paper, we present an image segmentation solution based on the multiatlas method that automatically segments the foramen ovale. We developed a data set of 30 CT scans containing 20 foramen ovale atlas and 10 CT scans for testing. Our approach can perform foramen ovale segmentation in puncture operation scenarios based solely on limited data. We propose to utilize this method as an enabler in clinical work.

Clinical implementation of deep-learning based auto-contouring tools-Experience of three French radiotherapy centers

Deep-learning (DL)-based auto-contouring solutions have recently been proposed as a convincing alternative to decrease workload of target volumes and organs-at-risk (OAR) delineation in radiotherapy planning and improve inter-observer consistency. However, there is minimal literature of clinical implementations of such algorithms in a clinical routine. In this paper we first present an update of the state-of-the-art of DL-based solutions. We then summarize recent recommendations proposed by the European society for radiotherapy and oncology (ESTRO) to be followed before any clinical implementation of artificial intelligence-based solutions in clinic. The last section describes the methodology carried out by three French radiation oncology departments to deploy CE-marked commercial solutions. Based on the information collected, a majority of OAR are retained by the centers among those proposed by the manufacturers, validating the usefulness of DL-based models to decrease clinicians' workload. Target volumes, with the exception of lymph node areas in breast, head and neck and pelvic regions, whole breast, breast wall, prostate and seminal vesicles, are not available in the three commercial solutions at this time. No implemented workflows are currently available to continuously improve the models, but these can be adapted/retrained in some solutions during the commissioning phase to best fit local practices. In reported experiences, automatic workflows were implemented to limit human interactions and make the workflow more fluid. Recommendations published by the ESTRO group will be of importance for guiding physicists in the clinical implementation of patient specific and regular quality assurances.

Head and neck multi-organ segmentation on dual-energy CT using dual pyramid convolutional neural networks

Organ delineation is crucial to diagnosis and therapy, while it is also labor-intensive and observer-dependent. Dual energy CT (DECT) provides additional image contrast than conventional single energy CT (SECT), which may facilitate automatic organ segmentation. This work aims to develop an automatic multi-organ segmentation approach using deep learning for head-and-neck region on DECT. We proposed a mask scoring regional convolutional neural network (R-CNN) where comprehensive features are firstly learnt from two independent pyramid networks and are then combined via deep attention strategy to highlight the informative ones extracted from both two channels of low and high energy CT. To perform multi-organ segmentation and avoid misclassification, a mask scoring subnetwork was integrated into the Mask R-CNN framework to build the correlation between the class of potential detected organ's region-of-interest (ROI) and the shape of that organ's segmentation within that ROI. We evaluated our model on DECT images from 127 head-and-neck cancer patients (66 training, 61 testing) with manual contours of 19 organs as training target and ground truth. For large- and mid-sized organs such as brain and parotid, the proposed method successfully achieved average Dice similarity coefficient (DSC) larger than 0.8. For small-sized organs with very low contrast such as chiasm, cochlea, lens and optic nerves, the DSCs ranged between around 0.5 and 0.8. With the proposed method, using DECT images outperforms using SECT in almost all 19 organs with statistical significance in DSC (p<0.05). Meanwhile, by using the DECT, the proposed method is also significantly superior to a recently developed FCN-based method in most of organs in terms of DSC and the 95th percentile Hausdorff distance. Quantitative results demonstrated the feasibility of the proposed method, the superiority of using DECT to SECT, and the advantage of the proposed R-CNN over FCN on the head-and-neck patient study. The proposed method has the potential to facilitate the current head-and-neck cancer radiation therapy workflow in treatment planning.

Artificial intelligence supported single detector multi-energy proton radiography system

Proton radiography imaging was proposed as a promising technique to evaluate internal anatomical changes, to enable pre-treatment patient alignment, and most importantly, to optimize the patient specific CT number to stopping-power ratio conversion. The clinical implementation rate of proton radiography systems is still limited due to their complex bulky design, together with the persistent problem of (in)elastic nuclear interactions and multiple Coulomb scattering (i.e. range mixing). In this work, a compact multi-energy proton radiography system was proposed in combination with an artificial intelligence network architecture (ProtonDSE) to remove the persistent problem of proton scatter in proton radiography. A realistic Monte Carlo model of the Proteus^®One accelerator was built at 200 and 220 MeV to isolate the scattered proton signal in 236 proton radiographies of 80 digital anthropomorphic phantoms. ProtonDSE was trained to predict the proton scatter distribution at two beam energies in a 60%/25%/15% scheme for training, testing, and validation. A calibration procedure was proposed to derive the water equivalent thickness image based on the detector dose response relationship at both beam energies. ProtonDSE network performance was evaluated with quantitative metrics that showed an overall mean absolute percentage error below 1.4% ± 0.4% in our test dataset. For one example patient, detector dose to WET conversions were performed based on the total dose (ITotal), the primary proton dose (IPrimary), and the ProtonDSE corrected detector dose (ICorrected). The determined WET accuracy was compared with respect to the reference WET by idealistic raytracing in a manually delineated region-of-interest inside the brain. The error was determined 4.3% ± 4.1% forWET(ITotal),2.2% ± 1.4% forWET(IPrimary),and 2.5% ± 2.0% forWET(ICorrected).

A review of deep learning based methods for medical image multi-organ segmentation

Deep learning has revolutionized image processing and achieved the-state-of-art performance in many medical image segmentation tasks. Many deep learning-based methods have been published to segment different parts of the body for different medical applications. It is necessary to summarize the current state of development for deep learning in the field of medical image segmentation. In this paper, we aim to provide a comprehensive review with a focus on multi-organ image segmentation, which is crucial for radiotherapy where the tumor and organs-at-risk need to be contoured for treatment planning. We grouped the surveyed methods into two broad categories which are 'pixel-wise classification' and 'end-to-end segmentation'. Each category was divided into subgroups according to their network design. For each type, we listed the surveyed works, highlighted important contributions and identified specific challenges. Following the detailed review, we discussed the achievements, shortcomings and future potentials of each category. To enable direct comparison, we listed the performance of the surveyed works that used thoracic and head-and-neck benchmark datasets.

Quantitative salivary gland SPECT/CT using deep convolutional neural networks

Quantitative single-photon emission computed tomography/computed tomography (SPECT/CT) using Tc-99m pertechnetate aids in evaluating salivary gland function. However, gland segmentation and quantitation of gland uptake is challenging. We develop a salivary gland SPECT/CT with automated segmentation using a deep convolutional neural network (CNN). The protocol comprises SPECT/CT at 20 min, sialagogue stimulation, and SPECT at 40 min post-injection of Tc-99m pertechnetate (555 MBq). The 40-min SPECT was reconstructed using the 20-min CT after misregistration correction. Manual salivary gland segmentation for %injected dose (%ID) by human experts proved highly reproducible, but took 15 min per scan. An automatic salivary segmentation method was developed using a modified 3D U-Net for end-to-end learning from the human experts (n = 333). The automatic segmentation performed comparably with human experts in voxel-wise comparison (mean Dice similarity coefficient of 0.81 for parotid and 0.79 for submandibular, respectively) and gland %ID correlation (R2 = 0.93 parotid, R2 = 0.95 submandibular) with an operating time less than 1 min. The algorithm generated results that were comparable to the reference data. In conclusion, with the aid of a CNN, we developed a quantitative salivary gland SPECT/CT protocol feasible for clinical applications. The method saves analysis time and manual effort while reducing patients' radiation exposure.

Auto-segmentation of organs at risk for head and neck radiotherapy planning: From atlas-based to deep learning methods

Radiotherapy (RT) is one of the basic treatment modalities for cancer of the head and neck (H&N), which requires a precise spatial description of the target volumes and organs at risk (OARs) to deliver a highly conformal radiation dose to the tumor cells while sparing the healthy tissues. For this purpose, target volumes and OARs have to be delineated and segmented from medical images. As manual delineation is a tedious and time-consuming task subjected to intra/interobserver variability, computerized auto-segmentation has been developed as an alternative. The field of medical imaging and RT planning has experienced an increased interest in the past decade, with new emerging trends that shifted the field of H&N OAR auto-segmentation from atlas-based to deep learning-based approaches. In this review, we systematically analyzed 78 relevant publications on auto-segmentation of OARs in the H&N region from 2008 to date, and provided critical discussions and recommendations from various perspectives: image modality - both computed tomography and magnetic resonance image modalities are being exploited, but the potential of the latter should be explored more in the future; OAR - the spinal cord, brainstem, and major salivary glands are the most studied OARs, but additional experiments should be conducted for several less studied soft tissue structures; image database - several image databases with the corresponding ground truth are currently available for methodology evaluation, but should be augmented with data from multiple observers and multiple institutions; methodology - current methods have shifted from atlas-based to deep learning auto-segmentation, which is expected to become even more sophisticated; ground truth - delineation guidelines should be followed and participation of multiple experts from multiple institutions is recommended; performance metrics - the Dice coefficient as the standard volumetric overlap metrics should be accompanied with at least one distance metrics, and combined with clinical acceptability scores and risk assessments; segmentation performance - the best performing methods achieve clinically acceptable auto-segmentation for several OARs, however, the dosimetric impact should be also studied to provide clinically relevant endpoints for RT planning.

Deep learning approach for quantification of organelles and misfolded polypeptide delivery within degradative compartments

Endolysosomal compartments maintain cellular fitness by clearing dysfunctional organelles and proteins from cells. Modulation of their activity offers therapeutic opportunities. Quantification of cargo delivery to and/or accumulation within endolysosomes is instrumental for characterizing lysosome-driven pathways at the molecular level and monitoring consequences of genetic or environmental modifications. Here we introduce LysoQuant, a deep learning approach for segmentation and classification of fluorescence images capturing cargo delivery within endolysosomes for clearance. LysoQuant is trained for unbiased and rapid recognition with human-level accuracy, and the pipeline informs on a series of quantitative parameters such as endolysosome number, size, shape, position within cells, and occupancy, which report on activity of lysosome-driven pathways. In our selected examples, LysoQuant successfully determines the magnitude of mechanistically distinct catabolic pathways that ensure lysosomal clearance of a model organelle, the endoplasmic reticulum, and of a model protein, polymerogenic ATZ. It does so with accuracy and velocity compatible with those of high-throughput analyses.

Status and innovations in pre-treatment CT imaging for proton therapy

Pre-treatment CT imaging is a topic of growing importance in particle therapy. Improvements in the accuracy of stopping-power prediction are demanded to allow for a dose conformality that is not inferior to state-of-the-art image-guided photon therapy. Although range uncertainty has been kept practically constant over the last decades, recent technological and methodological developments, like the clinical application of dual-energy CT, have been introduced or arise at least on the horizon to improve the accuracy and precision of range prediction. This review gives an overview of the current status, summarizes the innovations in dual-energy CT and its potential impact on the field as well as potential alternative technologies for stopping-power prediction.

Brain Tumor Analysis Empowered with Deep Learning: A Review, Taxonomy, and Future Challenges

Deep Learning (DL) algorithms enabled computational models consist of multiple processing layers that represent data with multiple levels of abstraction. In recent years, usage of deep learning is rapidly proliferating in almost every domain, especially in medical image processing, medical image analysis, and bioinformatics. Consequently, deep learning has dramatically changed and improved the means of recognition, prediction, and diagnosis effectively in numerous areas of healthcare such as pathology, brain tumor, lung cancer, abdomen, cardiac, and retina. Considering the wide range of applications of deep learning, the objective of this article is to review major deep learning concepts pertinent to brain tumor analysis (e.g., segmentation, classification, prediction, evaluation.). A review conducted by summarizing a large number of scientific contributions to the field (i.e., deep learning in brain tumor analysis) is presented in this study. A coherent taxonomy of research landscape from the literature has also been mapped, and the major aspects of this emerging field have been discussed and analyzed. A critical discussion section to show the limitations of deep learning techniques has been included at the end to elaborate open research challenges and directions for future work in this emergent area.

Artificial Intelligence: reshaping the practice of radiological sciences in the 21st century

Advances in computing hardware and software platforms have led to the recent resurgence in artificial intelligence (AI) touching almost every aspect of our daily lives by its capability for automating complex tasks or providing superior predictive analytics. AI applications are currently spanning many diverse fields from economics to entertainment, to manufacturing, as well as medicine. Since modern AI's inception decades ago, practitioners in radiological sciences have been pioneering its development and implementation in medicine, particularly in areas related to diagnostic imaging and therapy. In this anniversary article, we embark on a journey to reflect on the learned lessons from past AI's chequered history. We further summarize the current status of AI in radiological sciences, highlighting, with examples, its impressive achievements and effect on re-shaping the practice of medical imaging and radiotherapy in the areas of computer-aided detection, diagnosis, prognosis, and decision support. Moving beyond the commercial hype of AI into reality, we discuss the current challenges to overcome, for AI to achieve its promised hope of providing better precision healthcare for each patient while reducing cost burden on their families and the society at large.

Segmentation of organs-at-risk in cervical cancer CT images with a convolutional neural network

PURPOSE

We introduced and evaluated an end-to-end organs-at-risk (OARs) segmentation model that can provide accurate and consistent OARs segmentation results in much less time.

METHODS

We collected 105 patients' Computed Tomography (CT) scans that diagnosed locally advanced cervical cancer and treated with radiotherapy in one hospital. Seven organs, including the bladder, bone marrow, left femoral head, right femoral head, rectum, small intestine and spinal cord were defined as OARs. The annotated contours of the OARs previously delineated manually by the patient's radiotherapy oncologist and confirmed by the professional committee consisted of eight experienced oncologists before the radiotherapy were used as the ground truth masks. A multi-class segmentation model based on U-Net was designed to fulfil the OARs segmentation task. The Dice Similarity Coefficient (DSC) and 95th Hausdorff Distance (HD) are used as quantitative evaluation metrics to evaluate the proposed method.

RESULTS

The mean DSC values of the proposed method are 0.924, 0.854, 0.906, 0.900, 0.791, 0.833 and 0.827 for the bladder, bone marrow, femoral head left, femoral head right, rectum, small intestine, and spinal cord, respectively. The mean HD values are 5.098, 1.993, 1.390, 1.435, 5.949, 5.281 and 3.269 for the above OARs respectively.

CONCLUSIONS

Our proposed method can help reduce the inter-observer and intra-observer variability of manual OARs delineation and lessen oncologists' efforts. The experimental results demonstrate that our model outperforms the benchmark U-Net model and the oncologists' evaluations show that the segmentation results are highly acceptable to be used in radiation therapy planning.

Automatic multi-organ segmentation in dual-energy CT (DECT) with dedicated 3D fully convolutional DECT networks

PURPOSE

Dual-energy computed tomography (DECT) has shown great potential in many clinical applications. By incorporating the information from two different energy spectra, DECT provides higher contrast and reveals more material differences of tissues compared to conventional single-energy CT (SECT). Recent research shows that automatic multi-organ segmentation of DECT data can improve DECT clinical applications. However, most segmentation methods are designed for SECT, while DECT has been significantly less pronounced in research. Therefore, a novel approach is required that is able to take full advantage of the extra information provided by DECT.

METHODS

In the scope of this work, we proposed four three-dimensional (3D) fully convolutional neural network algorithms for the automatic segmentation of DECT data. We incorporated the extra energy information differently and embedded the fusion of information in each of the network architectures.

RESULTS

Quantitative evaluation using 45 thorax/abdomen DECT datasets acquired with a clinical dual-source CT system was investigated. The segmentation of six thoracic and abdominal organs (left and right lungs, liver, spleen, and left and right kidneys) were evaluated using a fivefold cross-validation strategy. In all of the tests, we achieved the best average Dice coefficients of 98% for the right lung, 98% for the left lung, 96% for the liver, 92% for the spleen, 95% for the right kidney, 93% for the left kidney, respectively. The network architectures exploit dual-energy spectra and outperform deep learning for SECT.

CONCLUSIONS

The results of the cross-validation show that our methods are feasible and promising. Successful tests on special clinical cases reveal that our methods have high adaptability in the practical application.