Big Data Analytics for Prostate Radiotherapy

Artificial Intelligence Radiotherapy Planning: Automatic Segmentation of Human Organs in CT Images Based on a Modified Convolutional Neural Network

Objective:

Precise segmentation of human organs and anatomic structures (especially organs at risk, OARs) is the basis and prerequisite for the treatment planning of radiation therapy. In order to ensure rapid and accurate design of radiotherapy treatment planning, an automatic organ segmentation technique was investigated based on deep learning convolutional neural network.

Method

A deep learning convolutional neural network (CNN) algorithm called BCDU-Net has been modified and developed further by us. Twenty two thousand CT images and the corresponding organ contours of 17 types delineated manually by experienced physicians from 329 patients were used to train and validate the algorithm. The CT images randomly selected were employed to test the modified BCDU-Net algorithm. The weight parameters of the algorithm model were acquired from the training of the convolutional neural network.

Result

The average Dice similarity coefficient (DSC) of the automatic segmentation and manual segmentation of the human organs of 17 types reached 0.8376, and the best coefficient reached up to 0.9676. It took 1.5–2 s and about 1 h to automatically segment the contours of an organ in an image of the CT dataset for a patient and the 17 organs for the CT dataset with the method developed by us, respectively.

Conclusion

The modified deep neural network algorithm could be used to automatically segment human organs of 17 types quickly and accurately. The accuracy and speed of the method meet the requirements of its application in radiotherapy.

Radiomic and radiogenomic modeling for radiotherapy: strategies, pitfalls, and challenges

The power of predictive modeling for radiotherapy outcomes has historically been limited by an inability to adequately capture patient-specific variabilities; however, next-generation platforms together with imaging technologies and powerful bioinformatic tools have facilitated strategies and provided optimism. Integrating clinical, biological, imaging, and treatment-specific data for more accurate prediction of tumor control probabilities or risk of radiation-induced side effects are high-dimensional problems whose solutions could have widespread benefits to a diverse patient population-we discuss technical approaches toward this objective. Increasing interest in the above is specifically reflected by the emergence of two nascent fields, which are distinct but complementary: radiogenomics, which broadly seeks to integrate biological risk factors together with treatment and diagnostic information to generate individualized patient risk profiles, and radiomics, which further leverages large-scale imaging correlates and extracted features for the same purpose. We review classical analytical and data-driven approaches for outcomes prediction that serve as antecedents to both radiomic and radiogenomic strategies. Discussion then focuses on uses of conventional and deep machine learning in radiomics. We further consider promising strategies for the harmonization of high-dimensional, heterogeneous multiomics datasets (panomics) and techniques for nonparametric validation of best-fit models. Strategies to overcome common pitfalls that are unique to data-intensive radiomics are also discussed.

Ethical evaluation of artificial intelligence applications in radiotherapy using the Four Topics Approach

Artificial Intelligence is the capability of a machine to imitate intelligent human behavior. An important impact can be expected from Artificial Intelligence throughout the workflow of radiotherapy (such as automated organ segmentation, treatment planning, prediction of outcome and quality assurance). However, ethical concerns regarding the binding agreement between the patient and the physician have followed the introduction of artificial intelligence. Through the recording of personal and social moral values in addition to the usual demographics and the implementation of these as distinctive inputs to matching algorithms, ethical concerns such as consistency, applicability and relevance can be solved. In the meantime, physicians' awareness of the ethical dimension in their decision-making should be challenged, so that they prioritize treating their patients and not diseases, remain vigilant to preserve patient safety, avoid unintended harm and establish institutional policies on these issues.

Data Mining in Healthcare: Applying Strategic Intelligence Techniques to Depict 25 Years of Research Development

In order to identify the strategic topics and the thematic evolution structure of data mining applied to healthcare, in this paper, a bibliometric performance and network analysis (BPNA) was conducted. For this purpose, 6138 articles were sourced from the Web of Science covering the period from 1995 to July 2020 and the SciMAT software was used. Our results present a strategic diagram composed of 19 themes, of which the 8 motor themes ('NEURAL-NETWORKS', 'CANCER', 'ELETRONIC-HEALTH-RECORDS', 'DIABETES-MELLITUS', 'ALZHEIMER'S-DISEASE', 'BREAST-CANCER', 'DEPRESSION', and 'RANDOM-FOREST') are depicted in a thematic network. An in-depth analysis was carried out in order to find hidden patterns and to provide a general perspective of the field. The thematic network structure is arranged thusly that its subjects are organized into two different areas, (i) practices and techniques related to data mining in healthcare, and (ii) health concepts and disease supported by data mining, embodying, respectively, the hotspots related to the data mining and medical scopes, hence demonstrating the field's evolution over time. Such results make it possible to form the basis for future research and facilitate decision-making by researchers and practitioners, institutions, and governments interested in data mining in healthcare.

Deep Learning Based HPV Status Prediction for Oropharyngeal Cancer Patients

Simple Summary

Determination of human papillomavirus (HPV) status for oropharyngeal cancer patients depicts a essential diagnostic factor and is important for treatment decisions. Current histological methods are invasive, time consuming and costly. We tested the ability of deep learning models for HPV status testing based on routinely acquired diagnostic CT images. A network trained for sports video clip classification was modified and then fine tuned for HPV status prediction. In this way, very basic information about image structures is induced into the model before training is started, while still allowing for exploitation of full 3D information in the CT images. Usage of this approach helps the network to cope with a small number of training examples and makes it more robust. For comparison, two other models were trained, one not relying on a pre-training task and another one pre-trained on 2D Data. The pre-trained video model preformed best.

Abstract

Infection with the human papillomavirus (HPV) has been identified as a major risk factor for oropharyngeal cancer (OPC). HPV-related OPCs have been shown to be more radiosensitive and to have a reduced risk for cancer related death. Hence, the histological determination of HPV status of cancer patients depicts an essential diagnostic factor. We investigated the ability of deep learning models for imaging based HPV status detection. To overcome the problem of small medical datasets, we used a transfer learning approach. A 3D convolutional network pre-trained on sports video clips was fine-tuned, such that full 3D information in the CT images could be exploited. The video pre-trained model was able to differentiate HPV-positive from HPV-negative cases, with an area under the receiver operating characteristic curve (AUC) of 0.81 for an external test set. In comparison to a 3D convolutional neural network (CNN) trained from scratch and a 2D architecture pre-trained on ImageNet, the video pre-trained model performed best. Deep learning models are capable of CT image-based HPV status determination. Video based pre-training has the ability to improve training for 3D medical data, but further studies are needed for verification.

National Cancer Institute Workshop on Artificial Intelligence in Radiation Oncology: Training the Next Generation

PURPOSE

Artificial intelligence (AI) is about to touch every aspect of radiation therapy, from consultation to treatment planning, quality assurance, therapy delivery, and outcomes modeling. There is an urgent need to train radiation oncologists and medical physicists in data science to help shepherd AI solutions into clinical practice. Poorly trained personnel may do more harm than good when attempting to apply rapidly developing and complex technologies. As the amount of AI research expands in our field, the radiation oncology community needs to discuss how to educate future generations in this area.

METHODS AND MATERIALS

The National Cancer Institute (NCI) Workshop on AI in Radiation Oncology (Shady Grove, MD, April 4-5, 2019) was the first of 2 data science workshops in radiation oncology hosted by the NCI in 2019. During this workshop, the Training and Education Working Group was formed by volunteers among the invited attendees. Its members represent radiation oncology, medical physics, radiology, computer science, industry, and the NCI.

RESULTS

In this perspective article written by members of the Training and Education Working Group, we provide and discuss action points relevant for future trainees interested in radiation oncology AI: (1) creating AI awareness and responsible conduct; (2) implementing a practical didactic curriculum; (3) creating a publicly available database of training resources; and (4) accelerating learning and funding opportunities.

CONCLUSION

Together, these action points can facilitate the translation of AI into clinical practice.

Mini review: Personalization of the radiation therapy management of prostate cancer using MRI-based radiomics

Decisions on how to treat prostate cancer with radiation therapy are guideline-based but as such guidelines have been developed for populations of patients, this invariably leads to overly aggressive treatment in some patients and insufficient treatment in others. Heterogeneity within prostate tumors and in metastatic sites, even within the same patient, is believed to be a major cause of treatment failure. Radiomics biomarkers, more commonly referred to as radiomics 'features", provide readily available, cost-effective, non-invasive tools for screening, detecting tumors and serial monitoring of patients, including assessments of response to therapy and identification of therapeutic complications. Radiomics offers the potential to analyse whole tumors in 3D, as well as sub-regions or 'habitats' within tumors. Combining quantitative information from imaging with pathology, demographic details and other biomarkers will pave the way for personalised treatment selection and monitoring in prostate cancer. The aim of this review is to consider if MRI-based radiomics can bridge the gap between population-based management and personalised management of prostate cancer.

Artificial intelligence in radiotherapy

Artificial intelligence (AI) has already been implemented widely in the medical field in the recent years. This paper first reviews the background of AI and radiotherapy. Then it explores the basic concepts of different AI algorithms and machine learning methods, such as neural networks, that are available to us today and how they are being implemented in radiotherapy and diagnostic processes, such as medical imaging, treatment planning, patient simulation, quality assurance and radiation dose delivery. It also explores the ongoing research on AI methods that are to be implemented in radiotherapy in the future. The review shows very promising progress and future for AI to be widely used in various areas of radiotherapy. However, basing on various concerns such as availability and security of using big data, and further work on polishing and testing AI algorithms, it is found that we may not ready to use AI primarily in radiotherapy at the moment.

Genomics models in radiotherapy: From mechanistic to machine learning

Machine learning (ML) provides a broad framework for addressing high-dimensional prediction problems in classification and regression. While ML is often applied for imaging problems in medical physics, there are many efforts to apply these principles to biological data toward questions of radiation biology. Here, we provide a review of radiogenomics modeling frameworks and efforts toward genomically guided radiotherapy. We first discuss medical oncology efforts to develop precision biomarkers. We next discuss similar efforts to create clinical assays for normal tissue or tumor radiosensitivity. We then discuss modeling frameworks for radiosensitivity and the evolution of ML to create predictive models for radiogenomics.

Artificial Neural Network with Composite Architectures for Prediction of Local Control in Radiotherapy

In this study, we investigated the application of artificial neural networks (ANNs) with composite architectures into the prediction of local control (LC) of lung cancer patients after radiotherapy. The motivation of this study was to take advantage of the temporal associations among longitudinal (sequential) data to improve the predictive performance of outcome models under the circumstance of limited sample sizes. Two composite architectures: (1) a one dimension (1D) convolutional + fully connected and (2) a locally-connected+ fully connected architectures were implemented for this purpose. Compared with the fully-connected architecture (multi-layer perceptron [MLP]), our composite architectures yielded better predictive performance of LC in lung cancer patients who received radiotherapy. Specifically, in a cohort of 98 patients (29 patients failed locally), the composite architecture of 1D convolutional layers and fully-connected layers achieved an AUC (area under receiver operating characteristic curve) of 0.83 (95% confidence interval (CI): 0.807~0.841) with 18 features (14 features are longitudinal data). Whereas, the composite architecture of locally- connected layers and fully-connected layers achieved an AUC of 0.80 (95%CI: 0.775~0.811). Both outperformed an MLP in the prediction performance with the same set of features, which achieved an AUC of 0.78 (95%CI: 0.751~0.790); (P-values for differences in AUC using the DeLong tests were 1.609 × 10^-14and 1.407 × 10^-4, respectively).

Current Applications and Future Impact of Machine Learning in Radiology

Recent advances and future perspectives of machine learning techniques offer promising applications in medical imaging. Machine learning has the potential to improve different steps of the radiology workflow including order scheduling and triage, clinical decision support systems, detection and interpretation of findings, postprocessing and dose estimation, examination quality control, and radiology reporting. In this article, the authors review examples of current applications of machine learning and artificial intelligence techniques in diagnostic radiology. In addition, the future impact and natural extension of these techniques in radiology practice are discussed.

Machine Learning and Radiogenomics: Lessons Learned and Future Directions

Due to the rapid increase in the availability of patient data, there is significant interest in precision medicine that could facilitate the development of a personalized treatment plan for each patient on an individual basis. Radiation oncology is particularly suited for predictive machine learning (ML) models due to the enormous amount of diagnostic data used as input and therapeutic data generated as output. An emerging field in precision radiation oncology that can take advantage of ML approaches is radiogenomics, which is the study of the impact of genomic variations on the sensitivity of normal and tumor tissue to radiation. Currently, patients undergoing radiotherapy are treated using uniform dose constraints specific to the tumor and surrounding normal tissues. This is suboptimal in many ways. First, the dose that can be delivered to the target volume may be insufficient for control but is constrained by the surrounding normal tissue, as dose escalation can lead to significant morbidity and rare. Second, two patients with nearly identical dose distributions can have substantially different acute and late toxicities, resulting in lengthy treatment breaks and suboptimal control, or chronic morbidities leading to poor quality of life. Despite significant advances in radiogenomics, the magnitude of the genetic contribution to radiation response far exceeds our current understanding of individual risk variants. In the field of genomics, ML methods are being used to extract harder-to-detect knowledge, but these methods have yet to fully penetrate radiogenomics. Hence, the goal of this publication is to provide an overview of ML as it applies to radiogenomics. We begin with a brief history of radiogenomics and its relationship to precision medicine. We then introduce ML and compare it to statistical hypothesis testing to reflect on shared lessons and to avoid common pitfalls. Current ML approaches to genome-wide association studies are examined. The application of ML specifically to radiogenomics is next presented. We end with important lessons for the proper integration of ML into radiogenomics.

Survey on deep learning for radiotherapy

More than 50% of cancer patients are treated with radiotherapy, either exclusively or in combination with other methods. The planning and delivery of radiotherapy treatment is a complex process, but can now be greatly facilitated by artificial intelligence technology. Deep learning is the fastest-growing field in artificial intelligence and has been successfully used in recent years in many domains, including medicine. In this article, we first explain the concept of deep learning, addressing it in the broader context of machine learning. The most common network architectures are presented, with a more specific focus on convolutional neural networks. We then present a review of the published works on deep learning methods that can be applied to radiotherapy, which are classified into seven categories related to the patient workflow, and can provide some insights of potential future applications. We have attempted to make this paper accessible to both radiotherapy and deep learning communities, and hope that it will inspire new collaborations between these two communities to develop dedicated radiotherapy applications.

Radiomics in radiooncology - Challenging the medical physicist

PURPOSE

Noticing the fast growing translation of artificial intelligence (AI) technologies to medical image analysis this paper emphasizes the future role of the medical physicist in this evolving field. Specific challenges are addressed when implementing big data concepts with high-throughput image data processing like radiomics and machine learning in a radiooncology environment to support clinical decisions.

METHODS

Based on the experience of our interdisciplinary radiomics working group, techniques for processing minable data, extracting radiomics features and associating this information with clinical, physical and biological data for the development of prediction models are described. A special emphasis was placed on the potential clinical significance of such an approach.

RESULTS

Clinical studies demonstrate the role of radiomics analysis as an additional independent source of information with the potential to influence the radiooncology practice, i.e. to predict patient prognosis, treatment response and underlying genetic changes. Extending the radiomics approach to integrate imaging, clinical, genetic and dosimetric data ('panomics') challenges the medical physicist as member of the radiooncology team.

CONCLUSIONS

The new field of big data processing in radiooncology offers opportunities to support clinical decisions, to improve predicting treatment outcome and to stimulate fundamental research on radiation response both of tumor and normal tissue. The integration of physical data (e.g. treatment planning, dosimetric, image guidance data) demands an involvement of the medical physicist in the radiomics approach of radiooncology. To cope with this challenge national and international organizations for medical physics should organize more training opportunities in artificial intelligence technologies in radiooncology.

Selection of external beam radiotherapy approaches for precise and accurate cancer treatment

Physically precise external-beam radiotherapy (EBRT) technologies may not translate to the best outcome in individual patients. On the other hand, clinical considerations alone are often insufficient to guide the selection of a specific EBRT approach in patients. We examine the ways in which to compare different EBRT approaches based on physical, biological and clinical considerations, and how they can be enhanced with the addition of biophysical models and machine-learning strategies. The process of selecting an EBRT modality is expected to improve in tandem with knowledge-based treatment planning.

Internet-based computer technology on radiotherapy

Recent rapid development of Internet-based computer technologies has made possible many novel applications in radiation dose delivery. However, translational speed of applying these new technologies in radiotherapy could hardly catch up due to the complex commissioning process and quality assurance protocol. Implementing novel Internet-based technology in radiotherapy requires corresponding design of algorithm and infrastructure of the application, set up of related clinical policies, purchase and development of software and hardware, computer programming and debugging, and national to international collaboration. Although such implementation processes are time consuming, some recent computer advancements in the radiation dose delivery are still noticeable. In this review, we will present the background and concept of some recent Internet-based computer technologies such as cloud computing, big data processing and machine learning, followed by their potential applications in radiotherapy, such as treatment planning and dose delivery. We will also discuss the current progress of these applications and their impacts on radiotherapy. We will explore and evaluate the expected benefits and challenges in implementation as well.

Radiogenomics and radiotherapy response modeling

Advances in patient-specific information and biotechnology have contributed to a new era of computational medicine. Radiogenomics has emerged as a new field that investigates the role of genetics in treatment response to radiation therapy. Radiation oncology is currently attempting to embrace these recent advances and add to its rich history by maintaining its prominent role as a quantitative leader in oncologic response modeling. Here, we provide an overview of radiogenomics starting with genotyping, data aggregation, and application of different modeling approaches based on modifying traditional radiobiological methods or application of advanced machine learning techniques. We highlight the current status and potential for this new field to reshape the landscape of outcome modeling in radiotherapy and drive future advances in computational oncology.

Clinical and histopathological characteristics of patients with prostate cancer in the BioBank Japan project

Background

Prostate cancer is the sixth leading cause of cancer-related deaths in Japan. We aimed to elucidate the clinical and histopathological characteristics of patients with prostate cancer in the BioBank Japan (BBJ) project.

Methods

Four thousand, seven hundred and ninety-three patients diagnosed with prostate cancer in the BBJ project were included. Clinical and histopathological data, including causes of death, were analyzed. Relative survival (RS) rates of prostate cancer were calculated.

Results

Four thousand, one hundred and seventy-one prostate cancer patients with available histological data had adenocarcinoma. The mean age of the patients was 72.5 years. The proportion of patients who were non-smokers, non-drinkers, had a normal body mass index, did not exercise, had a normal prostate-specific antigen level, and had a family history of prostate cancer were 30.7%, 28.0%, 66.6%, 58.1%, 67.6%, and 6.5%, respectively. The proportion of patients with Stage II, III, and IV disease were 24.4%, 7.3%, and 4.4%, respectively. After limiting to patients with a time from the initial diagnosis of prostate cancer to entry into the study cohort of ≤90 days (n = 869), the 5- and 10-year RS rates were 96.3% and 100.5%, respectively, although we were unable to consider management strategies due to a plenty of data missing.

Conclusions

We provide an overview of patients with prostate cancer in the BBJ project. Our findings, coupled with those from various high throughput “omics” technologies, will contribute to the implementation of prevention interventions and medical management of prostate cancer patients.

•

Prostate cancer represents the second leading cause of cancer incidence worldwide.

•

We aimed to provide an overview of patients with prostate cancer.

•

Based on prostate cancer histology, 99.3% had adenocarcinoma.

•

The 5- and 10-year relative survival rates were 96.3% and 100.5%.

•

Future studies will help develop preventive programs for prostate cancer.

Predictive modelling analysis for development of a radiotherapy decision support system in prostate cancer: a preliminary study

Purpose

The aim of this study is to develop predictive models to predict organ at risk (OAR) complication level, classification of OAR dose-volume and combination of this function with our in-house developed treatment decision support system.

Materials and methods

We analysed the support vector machine and decision tree algorithm for predicting OAR complication level and toxicity in order to integrate this function into our in-house radiation treatment planning decision support system. A total of 12 TomoTherapyTM treatment plans for prostate cancer were established, and a hundred modelled plans were generated to analyse the toxicity prediction for bladder and rectum.

Results

The toxicity prediction algorithm analysis showed 91·0% accuracy in the training process. A scatter plot for bladder and rectum was obtained by 100 modelled plans and classification result derived. OAR complication level was analysed and risk factor for 25% bladder and 50% rectum was detected by decision tree. Therefore, it was shown that complication prediction of patients using big data-based clinical information is possible.

Conclusion

We verified the accuracy of the tested algorithm using prostate cancer cases. Side effects can be minimised by applying this predictive modelling algorithm with the planning decision support system for patient-specific radiotherapy planning.

Networks Models of Actin Dynamics during Spermatozoa Postejaculatory Life: A Comparison among Human-Made and Text Mining-Based Models

Here we realized a networks-based model representing the process of actin remodelling that occurs during the acquisition of fertilizing ability of human spermatozoa (HumanMade_ActinSpermNetwork, HM_ASN). Then, we compared it with the networks provided by two different text mining tools: Agilent Literature Search (ALS) and PESCADOR. As a reference, we used the data from the online repository Kyoto Encyclopaedia of Genes and Genomes (KEGG), referred to the actin dynamics in a more general biological context. We found that HM_ALS and the networks from KEGG data shared the same scale-free topology following the Barabasi-Albert model, thus suggesting that the information is spread within the network quickly and efficiently. On the contrary, the networks obtained by ALS and PESCADOR have a scale-free hierarchical architecture, which implies a different pattern of information transmission. Also, the hubs identified within the networks are different: HM_ALS and KEGG networks contain as hubs several molecules known to be involved in actin signalling; ALS was unable to find other hubs than “actin,” whereas PESCADOR gave some nonspecific result. This seems to suggest that the human-made information retrieval in the case of a specific event, such as actin dynamics in human spermatozoa, could be a reliable strategy.