An image-based deep learning framework for individualizing radiotherapy dose

Principles of artificial intelligence in radiooncology

PURPOSE

In the rapidly expanding field of artificial intelligence (AI) there is a wealth of literature detailing the myriad applications of AI, particularly in the realm of deep learning. However, a review that elucidates the technical principles of deep learning as relevant to radiation oncology in an easily understandable manner is still notably lacking. This paper aims to fill this gap by providing a comprehensive guide to the principles of deep learning that is specifically tailored toward radiation oncology.

METHODS

In light of the extensive variety of AI methodologies, this review selectively concentrates on the specific domain of deep learning. It emphasizes the principal categories of deep learning models and delineates the methodologies for training these models effectively.

RESULTS

This review initially delineates the distinctions between AI and deep learning as well as between supervised and unsupervised learning. Subsequently, it elucidates the fundamental principles of major deep learning models, encompassing multilayer perceptrons (MLPs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), transformers, generative adversarial networks (GANs), diffusion-based generative models, and reinforcement learning. For each category, it presents representative networks alongside their specific applications in radiation oncology. Moreover, the review outlines critical factors essential for training deep learning models, such as data preprocessing, loss functions, optimizers, and other pivotal training parameters including learning rate and batch size.

CONCLUSION

This review provides a comprehensive overview of deep learning principles tailored toward radiation oncology. It aims to enhance the understanding of AI-based research and software applications, thereby bridging the gap between complex technological concepts and clinical practice in radiation oncology.

The role of saliency maps in enhancing ophthalmologists' trust in artificial intelligence models

PURPOSE

Saliency maps (SM) allow clinicians to better understand the opaque decision-making process in artificial intelligence (AI) models by visualising the important features responsible for predictions. This ultimately improves interpretability and confidence. In this work, we review the use case for SMs, exploring their impact on clinicians' understanding and trust in AI models. We use the following ophthalmic conditions as examples: (1) glaucoma, (2) myopia, (3) age-related macular degeneration, and (4) diabetic retinopathy.

METHOD

A multi-field search on MEDLINE, Embase, and Web of Science was conducted using specific keywords. Only studies on the use of SMs in glaucoma, myopia, AMD, or DR were considered for inclusion.

RESULTS

Findings reveal that SMs are often used to validate AI models and advocate for their adoption, potentially leading to biased claims. Overlooking the technical limitations of SMs, and the conductance of superficial assessments of their quality and relevance, was discerned. Uncertainties persist regarding the role of saliency maps in building trust in AI. It is crucial to enhance understanding of SMs' technical constraints and improve evaluation of their quality, impact, and suitability for specific tasks. Establishing a standardised framework for selecting and assessing SMs, as well as exploring their relationship with other reliability sources (e.g. safety and generalisability), is essential for enhancing clinicians' trust in AI.

CONCLUSION

We conclude that SMs are not beneficial for interpretability and trust-building purposes in their current forms. Instead, SMs may confer benefits to model debugging, model performance enhancement, and hypothesis testing (e.g. novel biomarkers).

Patient-ventilator asynchrony classification in mechanically ventilated patients: Model-based or machine learning method?

BACKGROUND AND OBJECTIVE

Patient-ventilator asynchrony (PVA) is associated with poor clinical outcomes and remains under-monitored. Automated PVA detection would enable complete monitoring standard observational methods do not allow. While model-based and machine learning PVA approaches exist, they have variable performance and can miss specific PVA events. This study compares a model and rule-based algorithm with a machine learning PVA method by retrospectively validating both methods using an independent patient cohort.

METHODS

Hysteresis loop analysis (HLA) which is a rule-based method (RBM) and a tri-input convolutional neural network (TCNN) machine learning model are used to classify 7 different types of PVA, including: 1) flow asynchrony; 2) reverse triggering; 3) premature cycling; 4) double triggering; 5) delayed cycling; 6) ineffective efforts; and 7) auto triggering. Class activation mapping (CAM) heatmaps visualise sections of respiratory waveforms the TCNN model uses for decision making, improving result interpretability. Both PVA classification methods were used to classify incidence in an independent retrospective clinical cohort of 11 mechanically ventilated patients for validation and performance comparison.

RESULTS

Self-validation with the training dataset shows overall better HLA performance (accuracy, sensitivity, specificity: 97.5 %, 96.6 %, 98.1 %) compared to the TCNN model (accuracy, sensitivity, specificity: 89.5 %, 98.3 %, 83.9 %). In this study, the TCNN model demonstrates higher sensitivity in detecting PVA, but HLA was better at identifying non-PVA breathing cycles due to its rule-based nature. While the overall AI identified by both classification methods are very similar, the intra-patient distribution of each PVA type varies between HLA and TCNN.

CONCLUSION

The collective findings underscore the efficacy of both HLA and TCNN in PVA detection, indicating the potential for real-time continuous monitoring of PVA. While ML methods such as TCNN demonstrate good PVA identification performance, it is essential to ensure optimal model architecture and diversity in training data before widespread uptake as standard care. Moving forward, further validation and adoption of RBM methods, such as HLA, offers an effective approach to PVA detection while providing clear distinction into the underlying patterns of PVA, better aligning with clinical needs for transparency, explicability, adaptability and reliability of these emerging tools for clinical care.

Evaluation of Relationship between Intrinsic Radiosensitivity (Survival Fraction at 2 Gy) and Gamma-H2AX Test and Apoptosis of Lymphocytes in Breast Cancer Patients

Background

Radiotherapy is one of the routine treatment strategies for breast cancer (BC) patients. Different responses of the patient to radiation due to different intrinsic radiosensitivity (RS) were induced to the researcher try to introduce a standard assay for the prediction of RS. Clonogenic assay is recognized as a gold standard method in this subject but because of some of its disadvantages, it is needed for alternative assays. In this study, two assays were evaluated for this reason in ten BC patients with different RSs.

Methods

The peripheral blood of 10 volunteers with BC was obtained, and the peripheral blood mononuclear cells were extracted. After exposed with 2 Gy, survival fraction at 2 Gy (SF2) was calculated by clonogenic assay. γ-H2AX assay was performed for all patients, and apoptosis assay was evaluated for three represented categorized patients.

Results

RS of patients showed SF2 and categorized in three groups (high, medium, and low RS). Double-strand breaks (DSBs) were decreased in high radiosensitive patients, but the residual DSBs were clearly higher than other two groups. It is shown that the repair system in these patients is lower active than others. Apoptosis frequency in patient 4 is highly active which could induce the enhancement of her RS.

Conclusion

γ-H2AX and apoptosis assays could predict the intrinsic RS, but evaluation of them separately is not sufficient for this aim. It is necessary to consider all the parameters together and consideration of the combination of assays could fit a better prediction of intrinsic RS.

Exploring Deep Learning for Estimating the Isoeffective Dose of FLASH Irradiation From Mouse Intestinal Histological Images

PURPOSE

Ultrahigh-dose-rate (FLASH) irradiation has been reported to reduce normal tissue damage compared with conventional dose rate (CONV) irradiation without compromising tumor control. This proof-of-concept study aims to develop a deep learning (DL) approach to quantify the FLASH isoeffective dose (dose of CONV that would be required to produce the same effect as the given physical FLASH dose) with postirradiation mouse intestinal histology images.

METHODS AND MATERIALS

Eighty-four healthy C57BL/6J female mice underwent 16 MeV electron CONV (0.12 Gy/s; n = 41) or FLASH (200 Gy/s; n = 43) single fraction whole abdominal irradiation. Physical dose ranged from 12 to 16 Gy for FLASH and 11 to 15 Gy for CONV in 1 Gy increments. Four days after irradiation, 9 jejunum cross-sections from each mouse were hematoxylin and eosin stained and digitized for histological analysis. CONV data set was randomly split into training (n = 33) and testing (n = 8) data sets. ResNet101-based DL models were retrained using the CONV training data set to estimate the dose based on histological features. The classical manual crypt counting (CC) approach was implemented for model comparison. Cross-section-wise mean squared error was computed to evaluate the dose estimation accuracy of both approaches. The validated DL model was applied to the FLASH data set to map the physical FLASH dose into the isoeffective dose.

RESULTS

The DL model achieved a cross-section-wise mean squared error of 0.20 Gy2 on the CONV testing data set compared with 0.40 Gy2 of the CC approach. Isoeffective doses estimated by the DL model for FLASH doses of 12, 13, 14, 15, and 16 Gy were 12.19 ± 0.46, 12.54 ± 0.37, 12.69 ± 0.26, 12.84 ± 0.26, and 13.03 ± 0.28 Gy, respectively.

CONCLUSIONS

Our proposed DL model achieved accurate CONV dose estimation. The DL model results indicate that in the physical dose range of 13 to 16 Gy, the biologic dose response of small intestinal tissue to FLASH irradiation is represented by a lower isoeffective dose compared with the physical dose. Our DL approach can be a tool for studying isoeffective doses of other radiation dose modifying interventions.

Application and progress of artificial intelligence in radiation therapy dose prediction

Radiation therapy (RT) nowadays is a main treatment modality of cancer. To ensure the therapeutic efficacy of patients, accurate dose distribution is often required, which is a time-consuming and labor-intensive process. In addition, due to the differences in knowledge and experience among participants and diverse institutions, the predicted dose are often inconsistent. In last several decades, artificial intelligence (AI) has been applied in various aspects of RT, several products have been implemented in clinical practice and confirmed superiority. In this paper, we will review the research of AI in dose prediction, focusing on the progress in deep learning (DL).

Histology-driven hypofractionated radiation therapy schemes for early-stage lung adenocarcinoma and squamous cell carcinoma

BACKGROUND AND PURPOSE

Histology was found to be an important prognostic factor for local tumor control probability (TCP) after stereotactic body radiotherapy (SBRT) of early-stage non-small-cell lung cancer (NSCLC). A histology-driven SBRT approach has not been explored in routine clinical practice and histology-dependent fractionation schemes remain unknown. Here, we analyzed pooled histologic TCP data as a function of biologically effective dose (BED) to determine histology-driven fractionation schemes for SBRT and hypofractionated radiotherapy of two predominant early-stage NSCLC histologic subtypes adenocarcinoma (ADC) and squamous cell carcinoma (SCC).

MATERIAL AND METHODS

The least-χ2 method was used to fit the collected histologic TCP data of 8510 early-stage NSCLC patients to determine parameters for a well-developed radiobiological model per the Hypofractionated Treatment Effects in the Clinic (HyTEC) initiative.

RESULTS

A fit to the histologic TCP data yielded independent radiobiological parameter sets for radiotherapy of early-stage lung ADC and SCC. TCP increases steeply with BED and reaches an asymptotic maximal plateau, allowing us to determine model-independent optimal fractionation schemes of least doses in 1-30 fractions to achieve maximal tumor control for early-stage lung ADC and SCC, e.g., 30, 44, 48, and 51 Gy for ADC, and 32, 48, 54, and 58 Gy for SCC in 1, 3, 4, and 5 fractions, respectively.

CONCLUSION

We presented the first determination of histology-dependent radiobiological parameters and model-independent histology-driven optimal SBRT and hypofractionated radiation therapy schemes for early-stage lung ADC and SCC. SCC requires substantially higher radiation doses to maximize tumor control than ADC, plausibly attributed to tumor genetic diversity and microenvironment. The determined optimal SBRT schemes agree well with clinical practice for early-stage lung ADC. These proposed optimal fractionation schemes provide first insights for histology-based personalized radiotherapy of two predominant early-stage NSCLC subtypes ADC and SCC, which require further validation with large-scale histologic TCP data.

Implementation of Artificial Intelligence in Personalized Prognostic Assessment of Lung Cancer: A Narrative Review

Artificial Intelligence (AI) has revolutionized the management of non-small-cell lung cancer (NSCLC) by enhancing different aspects, including staging, prognosis assessment, treatment prediction, response evaluation, recurrence/prognosis prediction, and personalized prognostic assessment. AI algorithms may accurately classify NSCLC stages using machine learning techniques and deep imaging data analysis. This could potentially improve precision and efficiency in staging, facilitating personalized treatment decisions. Furthermore, there are data suggesting the potential application of AI-based models in predicting prognosis in terms of survival rates and disease progression by integrating clinical, imaging and molecular data. In the present narrative review, we will analyze the preliminary studies reporting on how AI algorithms could predict responses to various treatment modalities, such as surgery, radiotherapy, chemotherapy, targeted therapy, and immunotherapy. There is robust evidence suggesting that AI also plays a crucial role in predicting the likelihood of tumor recurrence after surgery and the pattern of failure, which has significant implications for tailoring adjuvant treatments. The successful implementation of AI in personalized prognostic assessment requires the integration of different data sources, including clinical, molecular, and imaging data. Machine learning (ML) and deep learning (DL) techniques enable AI models to analyze these data and generate personalized prognostic predictions, allowing for a precise and individualized approach to patient care. However, challenges relating to data quality, interpretability, and the ability of AI models to generalize need to be addressed. Collaboration among clinicians, data scientists, and regulators is critical for the responsible implementation of AI and for maximizing its benefits in providing a more personalized prognostic assessment. Continued research, validation, and collaboration are essential to fully exploit the potential of AI in NSCLC management and improve patient outcomes. Herein, we have summarized the state of the art of applications of AI in lung cancer for predicting staging, prognosis, and pattern of recurrence after treatment in order to provide to the readers a large comprehensive overview of this challenging issue.

Automated peripancreatic vessel segmentation and labeling based on iterative trunk growth and weakly supervised mechanism

Peripancreatic vessel segmentation and anatomical labeling are pivotal aspects in aiding surgical planning and prognosis for patients with pancreatic tumors. Nevertheless, prevailing techniques often fall short in achieving satisfactory segmentation performance for the peripancreatic vein (PPV), leading to predictions characterized by poor integrity and connectivity. Besides, unsupervised labeling algorithms usually cannot deal with complex anatomical variation while fully supervised methods require a large number of voxel-wise annotations for training, which is very labor-intensive and time-consuming. To address these two problems, we propose an Automated Peripancreatic vEssel Segmentation and lAbeling (APESA) framework, to not only highly improve the segmentation performance for PPV, but also efficiently identify the peripancreatic artery (PPA) branches. There are two core modules in our proposed APESA framework: iterative trunk growth module (ITGM) for vein segmentation and weakly supervised labeling mechanism (WSLM) for artery labeling. The ITGM is composed of a series of iterative submodules, each of which chooses the largest connected component of the previous PPV segmentation as the trunk of a tree structure, seeks for the potential missing branches around the trunk by our designed branch proposal network, and facilitates trunk growth under the connectivity constraint. The WSLM incorporates the rule-based pseudo label generation with less expert participation, an anatomical labeling network to learn the branch distribution voxel by voxel, and adaptive radius-based postprocessing to refine the branch structures of the labeling predictions. Our achieved Dice of 94.01% for PPV segmentation on our collected dataset represents an approximately 10% accuracy improvement compared to state-of-the-art methods. Additionally, we attained a Dice of 97.01% for PPA segmentation and competitive labeling performance for PPA labeling compared to prior works. Our source codes will be publicly available at https://github.com/ZouLiwen-1999/APESA.

Deep learning radiomics based prediction of axillary lymph node metastasis in breast cancer

This study aimed to develop and validate a deep learning radiomics nomogram (DLRN) for the preoperative evaluation of axillary lymph node (ALN) metastasis status in patients with a newly diagnosed unifocal breast cancer. A total of 883 eligible patients with breast cancer who underwent preoperative breast and axillary ultrasound were retrospectively enrolled between April 1, 2016, and June 30, 2022. The training cohort comprised 621 patients from Hospital I; the external validation cohorts comprised 112, 87, and 63 patients from Hospitals II, III, and IV, respectively. A DLR signature was created based on the deep learning and handcrafted features, and the DLRN was then developed based on the signature and four independent clinical parameters. The DLRN exhibited good performance, yielding areas under the receiver operating characteristic curve (AUC) of 0.914, 0.929, and 0.952 in the three external validation cohorts, respectively. Decision curve and calibration curve analyses demonstrated the favorable clinical value and calibration of the nomogram. In addition, the DLRN outperformed five experienced radiologists in all cohorts. This has the potential to guide appropriate management of the axilla in patients with breast cancer, including avoiding overtreatment.

Concordance and generalization of an AI algorithm with real-world clinical data in the pre-omicron and omicron era

All viruses, including SARS-CoV-2, the virus responsible for COVID-19, continue to evolve, which can lead to new variants. The objective of this study is to assess the agreement between real-world clinical data and an algorithm that utilizes laboratory markers and age to predict the progression of disease severity in COVID-19 patients during the pre-Omicron and Omicron variant periods. The study evaluated the performance of a deep learning (DL) algorithm in predicting disease severity scores for COVID-19 patients using data from the USA, Spain, and Turkey (Ankara City Hospital (ACH) data set). The algorithm was developed and validated using pre-Omicron era data and was tested on both pre-Omicron and Omicron-era data. The predictions were compared to the actual clinical outcomes using a multidisciplinary approach. The concordance index values for all datasets ranged from 0.71 to 0.81. In the ACH cohort, a negative predictive value (NPV) of 0.78 or higher was observed for severe patients in both the pre-Omicron and Omicron eras, which is consistent with the algorithm's performance in the development cohort.

Data pyramid structure for optimizing EUS-based GISTs diagnosis in multi-center analysis with missing label

This study introduces the Data Pyramid Structure (DPS) to address data sparsity and missing labels in medical image analysis. The DPS optimizes multi-task learning and enables sustainable expansion of multi-center data analysis. Specifically, It facilitates attribute prediction and malignant tumor diagnosis tasks by implementing a segmentation and aggregation strategy on data with absent attribute labels. To leverage multi-center data, we propose the Unified Ensemble Learning Framework (UELF) and the Unified Federated Learning Framework (UFLF), which incorporate strategies for data transfer and incremental learning in scenarios with missing labels. The proposed method was evaluated on a challenging EUS patient dataset from five centers, achieving promising diagnostic performance. The average accuracy was 0.984 with an AUC of 0.927 for multi-center analysis, surpassing state-of-the-art approaches. The interpretability of the predictions further highlights the potential clinical relevance of our method.

Big data and artificial intelligence in cancer research

The field of oncology has witnessed an extraordinary surge in the application of big data and artificial intelligence (AI). AI development has made multiscale and multimodal data fusion and analysis possible. A new era of extracting information from complex big data is rapidly evolving. However, challenges related to efficient data curation, in-depth analysis, and utilization remain. We provide a comprehensive overview of the current state of the art in big data and computational analysis, highlighting key applications, challenges, and future opportunities in cancer research. By sketching the current landscape, we seek to foster a deeper understanding and facilitate the advancement of big data utilization in oncology, call for interdisciplinary collaborations, ultimately contributing to improved patient outcomes and a profound understanding of cancer.

Performance reporting design in artificial intelligence studies using image-based TNM staging and prognostic parameters in rectal cancer: a systematic review

PURPOSE

The integration of artificial intelligence (AI) and magnetic resonance imaging in rectal cancer has the potential to enhance diagnostic accuracy by identifying subtle patterns and aiding tumor delineation and lymph node assessment. According to our systematic review focusing on convolutional neural networks, AI-driven tumor staging and the prediction of treatment response facilitate tailored treat-ment strategies for patients with rectal cancer.

METHODS

This paper summarizes the current landscape of AI in the imaging field of rectal cancer, emphasizing the performance reporting design based on the quality of the dataset, model performance, and external validation.

RESULTS

AI-driven tumor segmentation has demonstrated promising results using various convolutional neural network models. AI-based predictions of staging and treatment response have exhibited potential as auxiliary tools for personalized treatment strategies. Some studies have indicated superior performance than conventional models in predicting microsatellite instability and KRAS status, offer-ing noninvasive and cost-effective alternatives for identifying genetic mutations.

CONCLUSION

Image-based AI studies for rectal can-cer have shown acceptable diagnostic performance but face several challenges, including limited dataset sizes with standardized data, the need for multicenter studies, and the absence of oncologic relevance and external validation for clinical implantation. Overcoming these pitfalls and hurdles is essential for the feasible integration of AI models in clinical settings for rectal cancer, warranting further research.

AI in Orthodontics: Revolutionizing Diagnostics and Treatment Planning-A Comprehensive Review

The advent of artificial intelligence (AI) in medicine has transformed various medical specialties, including orthodontics. AI has shown promising results in enhancing the accuracy of diagnoses, treatment planning, and predicting treatment outcomes. Its usage in orthodontic practices worldwide has increased with the availability of various AI applications and tools. This review explores the principles of AI, its applications in orthodontics, and its implementation in clinical practice. A comprehensive literature review was conducted, focusing on AI applications in dental diagnostics, cephalometric evaluation, skeletal age determination, temporomandibular joint (TMJ) evaluation, decision making, and patient telemonitoring. Due to study heterogeneity, no meta-analysis was possible. AI has demonstrated high efficacy in all these areas, but variations in performance and the need for manual supervision suggest caution in clinical settings. The complexity and unpredictability of AI algorithms call for cautious implementation and regular manual validation. Continuous AI learning, proper governance, and addressing privacy and ethical concerns are crucial for successful integration into orthodontic practice.

"Under the hood": artificial intelligence in personalized radiotherapy

This review presents and discusses the ways in which artificial intelligence (AI) tools currently intervene, or could potentially intervene in the future, to enhance the diverse tasks involved in the radiotherapy workflow. The radiotherapy framework is presented on 2 different levels for the personalization of the treatment, distinct in tasks and methodologies. The first level is the clinically well-established anatomy-based workflow, known as adaptive radiation therapy. The second level is referred to as biology-driven workflow, explored in the research literature and recently appearing in some preliminary clinical trials for personalized radiation treatments. A 2-fold role for AI is defined according to these 2 different levels. In the anatomy-based workflow, the role of AI is to streamline and improve the tasks in terms of time and variability reductions compared to conventional methodologies. The biology-driven workflow instead fully relies on AI, which introduces decision-making tools opening uncharted frontiers that were in the past deemed challenging to explore. These methodologies are referred to as radiomics and dosiomics, handling imaging and dosimetric information, or multiomics, when complemented by clinical and biological parameters (ie, biomarkers). The review explicitly highlights the methodologies that are currently incorporated into clinical practice or still in research, with the aim of presenting the AI's growing role in personalized radiotherapy.

Application of radiomics in diagnosis and treatment of lung cancer

Radiomics has become a research field that involves the process of converting standard nursing images into quantitative image data, which can be combined with other data sources and subsequently analyzed using traditional biostatistics or artificial intelligence (Al) methods. Due to the capture of biological and pathophysiological information by radiomics features, these quantitative radiomics features have been proven to provide fast and accurate non-invasive biomarkers for lung cancer risk prediction, diagnosis, prognosis, treatment response monitoring, and tumor biology. In this review, radiomics has been emphasized and discussed in lung cancer research, including advantages, challenges, and drawbacks.

Prediction of Radiation Treatment Response for Locally Advanced Rectal Cancer via a Longitudinal Trend Analysis Framework on Cone-Beam CT

Locally advanced rectal cancer (LARC) presents a significant challenge in terms of treatment management, particularly with regards to identifying patients who are likely to respond to radiation therapy (RT) at an individualized level. Patients respond to the same radiation treatment course differently due to inter- and intra-patient variability in radiosensitivity. In-room volumetric cone-beam computed tomography (CBCT) is widely used to ensure proper alignment, but also allows us to assess tumor response during the treatment course. In this work, we proposed a longitudinal radiomic trend (LRT) framework for accurate and robust treatment response assessment using daily CBCT scans for early detection of patient response. The LRT framework consists of four modules: (1) Automated registration and evaluation of CBCT scans to planning CT; (2) Feature extraction and normalization; (3) Longitudinal trending analyses; and (4) Feature reduction and model creation. The effectiveness of the framework was validated via leave-one-out cross-validation (LOOCV), using a total of 840 CBCT scans for a retrospective cohort of LARC patients. The trending model demonstrates significant differences between the responder vs. non-responder groups with an Area Under the Curve (AUC) of 0.98, which allows for systematic monitoring and early prediction of patient response during the RT treatment course for potential adaptive management.

Artificial intelligence in cancer diagnosis and therapy: Current status and future perspective

Artificial intelligence (AI) in healthcare plays a pivotal role in combating many fatal diseases, such as skin, breast, and lung cancer. AI is an advanced form of technology that uses mathematical-based algorithmic principles similar to those of the human mind for cognizing complex challenges of the healthcare unit. Cancer is a lethal disease with many etiologies, including numerous genetic and epigenetic mutations. Cancer being a multifactorial disease is difficult to be diagnosed at an early stage. Therefore, genetic variations and other leading factors could be identified in due time through AI and machine learning (ML). AI is the synergetic approach for mining the drug targets, their mechanism of action, and drug-organism interaction from massive raw data. This synergetic approach is also facing several challenges in data mining but computational algorithms from different scientific communities for multi-target drug discovery are highly helpful to overcome the bottlenecks in AI for drug-target discovery. AI and ML could be the epicenter in the medical world for the diagnosis, treatment, and evaluation of almost any disease in the near future. In this comprehensive review, we explore the immense potential of AI and ML when integrated with the biological sciences, specifically in the context of cancer research. Our goal is to illuminate the many ways in which AI and ML are being applied to the study of cancer, from diagnosis to individualized treatment. We highlight the prospective role of AI in supporting oncologists and other medical professionals in making informed decisions and improving patient outcomes by examining the intersection of AI and cancer control. Although AI-based medical therapies show great potential, many challenges must be overcome before they can be implemented in clinical practice. We critically assess the current hurdles and provide insights into the future directions of AI-driven approaches, aiming to pave the way for enhanced cancer interventions and improved patient care.

SEMPAI: a Self-Enhancing Multi-Photon Artificial Intelligence for Prior-Informed Assessment of Muscle Function and Pathology

Deep learning (DL) shows notable success in biomedical studies. However, most DL algorithms work as black boxes, exclude biomedical experts, and need extensive data. This is especially problematic for fundamental research in the laboratory, where often only small and sparse data are available and the objective is knowledge discovery rather than automation. Furthermore, basic research is usually hypothesis-driven and extensive prior knowledge (priors) exists. To address this, the Self-Enhancing Multi-Photon Artificial Intelligence (SEMPAI) that is designed for multiphoton microscopy (MPM)-based laboratory research is presented. It utilizes meta-learning to optimize prior (and hypothesis) integration, data representation, and neural network architecture simultaneously. By this, the method allows hypothesis testing with DL and provides interpretable feedback about the origin of biological information in 3D images. SEMPAI performs multi-task learning of several related tasks to enable prediction for small datasets. SEMPAI is applied on an extensive MPM database of single muscle fibers from a decade of experiments, resulting in the largest joint analysis of pathologies and function for single muscle fibers to date. It outperforms state-of-the-art biomarkers in six of seven prediction tasks, including those with scarce data. SEMPAI's DL models with integrated priors are superior to those without priors and to prior-only approaches.

Nanoparticle-mediated cancer cell therapy: basic science to clinical applications

Every sixth person in the world dies due to cancer, making it the second leading severe cause of death after cardiovascular diseases. According to WHO, cancer claimed nearly 10 million deaths in 2020. The most common types of cancers reported have been breast (lung, colon and rectum, prostate cases), skin (non-melanoma) and stomach. In addition to surgery, the most widely used traditional types of anti-cancer treatment are radio- and chemotherapy. However, these do not distinguish between normal and malignant cells. Additional treatment methods have evolved over time for early detection and targeted therapy of cancer. However, each method has its limitations and the associated treatment costs are quite high with adverse effects on the quality of life of patients. Use of individual atoms or a cluster of atoms (nanoparticles) can cause a paradigm shift by virtue of providing point of sight sensing and diagnosis of cancer. Nanoparticles (1-100 nm in size) are 1000 times smaller in size than the human cell and endowed with safer relocation capability to attack mechanically and chemically at a precise location which is one avenue that can be used to destroy cancer cells precisely. This review summarises the extant understanding and the work done in this area to pave the way for physicians to accelerate the use of hybrid mode of treatments by leveraging the use of various nanoparticles.

Novel tools for early diagnosis and precision treatment based on artificial intelligence

Lung cancer has the highest mortality rate among all cancers in the world. Hence, early diagnosis and personalized treatment plans are crucial to improving its 5-year survival rate. Chest computed tomography (CT) serves as an essential tool for lung cancer screening, and pathology images are the gold standard for lung cancer diagnosis. However, medical image evaluation relies on manual labor and suffers from missed diagnosis or misdiagnosis, and physician heterogeneity. The rapid development of artificial intelligence (AI) has brought a whole novel opportunity for medical task processing, demonstrating the potential for clinical application in lung cancer diagnosis and treatment. AI technologies, including machine learning and deep learning, have been deployed extensively for lung nodule detection, benign and malignant classification, and subtype identification based on CT images. Furthermore, AI plays a role in the non-invasive prediction of genetic mutations and molecular status to provide the optimal treatment regimen, and applies to the assessment of therapeutic efficacy and prognosis of lung cancer patients, enabling precision medicine to become a reality. Meanwhile, histology-based AI models assist pathologists in typing, molecular characterization, and prognosis prediction to enhance the efficiency of diagnosis and treatment. However, the leap to extensive clinical application still faces various challenges, such as data sharing, standardized label acquisition, clinical application regulation, and multimodal integration. Nevertheless, AI holds promising potential in the field of lung cancer to improve cancer care.

Radiomics and artificial intelligence for precision medicine in lung cancer treatment

Lung cancer is the leading cause of cancer-related deaths worldwide. It exhibits, at the mesoscopic scale, phenotypic characteristics that are generally indiscernible to the human eye but can be captured non-invasively on medical imaging as radiomic features, which can form a high dimensional data space amenable to machine learning. Radiomic features can be harnessed and used in an artificial intelligence paradigm to risk stratify patients, and predict for histological and molecular findings, and clinical outcome measures, thereby facilitating precision medicine for improving patient care. Compared to tissue sampling-driven approaches, radiomics-based methods are superior for being non-invasive, reproducible, cheaper, and less susceptible to intra-tumoral heterogeneity. This review focuses on the application of radiomics, combined with artificial intelligence, for delivering precision medicine in lung cancer treatment, with discussion centered on pioneering and groundbreaking works, and future research directions in the area.

The Promise and Future of Radiomics for Personalized Radiotherapy Dosing and Adaptation

Quantitative image analysis, also known as radiomics, aims to analyze large-scale quantitative features extracted from acquired medical images using hand-crafted or machine-engineered feature extraction approaches. Radiomics has great potential for a variety of clinical applications in radiation oncology, an image-rich treatment modality that utilizes computed tomography (CT), magnetic resonance imaging (MRI), and positron emission tomography (PET) for treatment planning, dose calculation, and image guidance. A promising application of radiomics is in predicting treatment outcomes after radiotherapy such as local control and treatment-related toxicity using features extracted from pretreatment and on-treatment images. Based on these individualized predictions of treatment outcomes, radiotherapy dose can be sculpted to meet the specific needs and preferences of each patient. Radiomics can aid in tumor characterization for personalized targeting, especially for identifying high-risk regions within a tumor that cannot be easily discerned based on size or intensity alone. Radiomics-based treatment response prediction can aid in developing personalized fractionation and dose adjustments. In order to make radiomics models more applicable across different institutions with varying scanners and patient populations, further efforts are needed to harmonize and standardize the acquisition protocols by minimizing uncertainties within the imaging data.

Status of Government-Funded Radiotherapy Services in Nigeria

PURPOSE

Access to radiotherapy (RT) is now one of the stark examples of global cancer inequities. More than 800,000 new cancer cases require potentially curative or palliative RT services in Africa, arguably <15% of these patients currently have access to this important service. For a population of more than 206 million, Nigeria requires a minimum of 280 RT machines for the increasing number of cancer cases. Painfully, the country has only eight Government-funded RT machines. This study aimed to evaluate the status of the eight Government-funded RT services in Nigeria and their ability to deliver effective RT to their patients.

METHODS

A survey addressing 10 critical areas was used to assess the eight Government-funded RT services in Nigeria.

RESULTS

Unfortunately, six of the eight centers (75%) surveyed have not treated patients with RT because they do not have functioning teletherapy machines in 2021. Only two RT centers have the capability of treating patients using advanced RT techniques. There is no positron emission tomography-computed tomography scan in any of the Government-funded RT centers. The workforce capacity and infrastructure across the eight centers are limited. All of the centers lack residency training programs for medical physicists and radiation therapy technologists resulting in very few well-trained staff.

CONCLUSION

As the Nigerian Government plans for the new National Cancer Control Plan, there is an urgent need to scale up access to RT by upgrading the RT equipment, workforce, and infrastructure to meet the current needs of Nigerian patients with cancer. Although the shortfall is apparent from a variety of RT-capacity databases, this detailed analysis provides essential information for an implementation plan involving solutions from within Nigeria and with global partners.

Stereotactic body radiation therapy in unresectable stage III non-small cell lung cancer: A systematic review

In unresectable stage III non-small cell lung cancer (NSCLC), the standard of care for most fit patients is concurrent chemotherapy with normofractionated radiotherapy (NFRT), followed by durvalumab consolidation. Nevertheless, almost half of patients will present locoregional or metastatic intrathoracic relapse. Improving locoregional control thus remains an important objective. For this purpose, stereotactic body radiotherapy (SBRT) may be a relevant treatment modality. We performed a systematic review of the literature that evaluate the efficacy and safety of SBRT in this situation, either instead of or in addition to NFRT. Among 1788 unique reports, 18 met the inclusion criteria. They included 447 patients and were mainly prospective (n = 10, including 5 phase 2 trials). In none, maintenance durvalumab was administered. Most reported SBRT boost after NFRT (n = 8), or definitive tumor and nodal SBRT (n = 7). Median OS varied from 10 to 52 months, due to the heterogeneity of the included populations and according to treatment regimen. The rate of severe side effects was low, with <5 % grade 5 toxicity, and mainly observed when mediastinal SBRT was performed without dose constraints to the proximal bronchovascular tree. It was suggested that a biologically effective dose higher than 112.3 Gy may increase locoregional control. SBRT for selected stage III NSCLC bears potential to improve loco-regional tumor control, but at present, this should only be done in prospective clinical trials.

Artificial intelligence-assisted selection and efficacy prediction of antineoplastic strategies for precision cancer therapy

The rapid development of artificial intelligence (AI) technologies in the context of the vast amount of collectable data obtained from high-throughput sequencing has led to an unprecedented understanding of cancer and accelerated the advent of a new era of clinical oncology with a tone of precision treatment and personalized medicine. However, the gains achieved by a variety of AI models in clinical oncology practice are far from what one would expect, and in particular, there are still many uncertainties in the selection of clinical treatment options that pose significant challenges to the application of AI in clinical oncology. In this review, we summarize emerging approaches, relevant datasets and open-source software of AI and show how to integrate them to address problems from clinical oncology and cancer research. We focus on the principles and procedures for identifying different antitumor strategies with the assistance of AI, including targeted cancer therapy, conventional cancer therapy, and cancer immunotherapy. In addition, we also highlight the current challenges and directions of AI in clinical oncology translation. Overall, we hope this article will provide researchers and clinicians with a deeper understanding of the role and implications of AI in precision cancer therapy, and help AI move more quickly into accepted cancer guidelines.

Predictive power of deep-learning segmentation based prognostication model in non-small cell lung cancer

Purpose

The study aims to create a model to predict survival outcomes for non-small cell lung cancer (NSCLC) after treatment with stereotactic body radiotherapy (SBRT) using deep-learning segmentation based prognostication (DESEP).

Methods

The DESEP model was trained using imaging from 108 patients with NSCLC with various clinical stages and treatment histories. The model generated predictions based on unsupervised features learned by a deep-segmentation network from computed tomography imaging to categorize patients into high and low risk groups for overall survival (DESEP-predicted-OS), disease specific survival (DESEP-predicted-DSS), and local progression free survival (DESEP-predicted-LPFS). Serial assessments were also performed using auto-segmentation based volumetric RECISTv1.1 and computer-based unidimensional RECISTv1.1 patients was performed.

Results

There was a concordance between the DESEP-predicted-LPFS risk category and manually calculated RECISTv1.1 (φ=0.544, p=0.001). Neither the auto-segmentation based volumetric RECISTv1.1 nor the computer-based unidimensional RECISTv1.1 correlated with manual RECISTv1.1 (p=0.081 and p=0.144, respectively). While manual RECISTv1.1 correlated with LPFS (HR=6.97,3.51-13.85, c=0.70, p&lt;0.001), it could not provide insight regarding DSS (p=0.942) or OS (p=0.662). In contrast, the DESEP-predicted methods were predictive of LPFS (HR=3.58, 1.66-7.18, c=0.60, p&lt;0.001), OS (HR=6.31, 3.65-10.93, c=0.71, p&lt;0.001) and DSS (HR=9.25, 4.50-19.02, c=0.69, p&lt;0.001). The promising results of the DESEP model were reproduced for the independent, external datasets of Stanford University, classifying survival and ‘dead’ group in their Kaplan-Meyer curves (p = 0.019).

Conclusion

Deep-learning segmentation based prognostication can predict LPFS as well as OS, and DSS after SBRT for NSCLC. It can be used in conjunction with current standard of care, manual RECISTv1.1 to provide additional insights regarding DSS and OS in NSCLC patients receiving SBRT.

Summary

While current standard of care, manual RECISTv1.1 correlated with local progression free survival (LPFS) (HR=6.97,3.51-13.85, c=0.70, p&lt;0.001), it could not provide insight regarding disease specific survival (DSS) (p=0.942) or overall survival (OS) (p=0.662). In contrast, the deep-learning segmentation based prognostication (DESEP)-predicted methods were predictive of LPFS (HR=3.58, 1.66-7.18, c=0.60, p&lt;0.001), OS (HR=6.31, 3.65-10.93, c=0.71, p&lt;0.001) and DSS (HR=9.25, 4.50-19.02, c=0.69, p&lt;0.001). DESEP can be used in conjunction with current standard of care, manual RECISTv1.1 to provide additional insights regarding DSS and OS in NSCLC patients.

Virtual clinical trial based on outcome modeling with iteratively redistributed extrapolation data

Virtual clinical trials (VCTs) can potentially simulate clinical trials on a computer, but their application with a limited number of past clinical cases is challenging due to the biased estimation of the statistical population. In this study, we developed ExMixup, a novel training technique based on machine learning, using iteratively redistributed extrapolated data. Information obtained from 100 patients with prostate cancer and 385 patients with oropharyngeal cancer was used to predict the recurrence after radiotherapy. Model performance was evaluated by developing outcome prediction models based on three types of training methods: training with original data (baseline), interpolation data (Mixup), and interpolation + extrapolation data (ExMixup). Two types of VCTs were conducted to predict the treatment response of patients with distinct characteristics compared to the training data obtained from patient cohorts categorized under risk classification or cancer stage. The prediction models developed with ExMixup yielded concordance indices (95% confidence intervals) of 0.751 (0.719-0.818) and 0.752 (0.734-0.785) for VCTs on the prostate and oropharyngeal cancer datasets, respectively, which significantly outperformed the baseline and Mixup models (P < 0.01). The proposed approach could enhance the ability of VCTs to predict treatment results in patients excluded from past clinical trials.

Systematic Review of Tumor Segmentation Strategies for Bone Metastases

Purpose: To investigate the segmentation approaches for bone metastases in differentiating benign from malignant bone lesions and characterizing malignant bone lesions. Method: The literature search was conducted in Scopus, PubMed, IEEE and MedLine, and Web of Science electronic databases following the guidelines of Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). A total of 77 original articles, 24 review articles, and 1 comparison paper published between January 2010 and March 2022 were included in the review. Results: The results showed that most studies used neural network-based approaches (58.44%) and CT-based imaging (50.65%) out of 77 original articles. However, the review highlights the lack of a gold standard for tumor boundaries and the need for manual correction of the segmentation output, which largely explains the absence of clinical translation studies. Moreover, only 19 studies (24.67%) specifically mentioned the feasibility of their proposed methods for use in clinical practice. Conclusion: Development of tumor segmentation techniques that combine anatomical information and metabolic activities is encouraging despite not having an optimal tumor segmentation method for all applications or can compensate for all the difficulties built into data limitations.

Stage III Non-Small-Cell Lung Cancer: An Overview of Treatment Options

Lung cancer is the second-most commonly diagnosed cancer and the leading cause of cancer death worldwide. The most common histological type is non-small-cell lung cancer, accounting for 85% of all lung cancer cases. About one out of three new cases of non-small-cell lung cancer are diagnosed at a locally advanced stage—mainly stage III—consisting of a widely heterogeneous group of patients presenting significant differences in terms of tumor volume, local diffusion, and lymph nodal involvement. Stage III NSCLC therapy is based on the pivotal role of multimodal treatment, including surgery, radiotherapy, and a wide-ranging option of systemic treatments. Radical surgery is indicated in the case of hilar lymphnodal involvement or single station mediastinal ipsilateral involvement, possibly after neoadjuvant chemotherapy; the best appropriate treatment for multistation mediastinal lymph node involvement still represents a matter of debate. Although the main scope of treatments in this setting is potentially curative, the overall survival rates are still poor, ranging from 36% to 26% and 13% in stages IIIA, IIIB, and IIIC, respectively. The aim of this article is to provide an up-to-date, comprehensive overview of the state-of-the-art treatments for stage III non-small-cell lung cancer.

Multi-task deep learning for medical image computing and analysis: A review

The renaissance of deep learning has provided promising solutions to various tasks. While conventional deep learning models are constructed for a single specific task, multi-task deep learning (MTDL) that is capable to simultaneously accomplish at least two tasks has attracted research attention. MTDL is a joint learning paradigm that harnesses the inherent correlation of multiple related tasks to achieve reciprocal benefits in improving performance, enhancing generalizability, and reducing the overall computational cost. This review focuses on the advanced applications of MTDL for medical image computing and analysis. We first summarize four popular MTDL network architectures (i.e., cascaded, parallel, interacted, and hybrid). Then, we review the representative MTDL-based networks for eight application areas, including the brain, eye, chest, cardiac, abdomen, musculoskeletal, pathology, and other human body regions. While MTDL-based medical image processing has been flourishing and demonstrating outstanding performance in many tasks, in the meanwhile, there are performance gaps in some tasks, and accordingly we perceive the open challenges and the perspective trends. For instance, in the 2018 Ischemic Stroke Lesion Segmentation challenge, the reported top dice score of 0.51 and top recall of 0.55 achieved by the cascaded MTDL model indicate further research efforts in high demand to escalate the performance of current models.

HiRAND: A novel GCN semi-supervised deep learning-based framework for classification and feature selection in drug research and development

The prediction of response to drugs before initiating therapy based on transcriptome data is a major challenge. However, identifying effective drug response label data costs time and resources. Methods available often predict poorly and fail to identify robust biomarkers due to the curse of dimensionality: high dimensionality and low sample size. Therefore, this necessitates the development of predictive models to effectively predict the response to drugs using limited labeled data while being interpretable. In this study, we report a novel Hierarchical Graph Random Neural Networks (HiRAND) framework to predict the drug response using transcriptome data of few labeled data and additional unlabeled data. HiRAND completes the information integration of the gene graph and sample graph by graph convolutional network (GCN). The innovation of our model is leveraging data augmentation strategy to solve the dilemma of limited labeled data and using consistency regularization to optimize the prediction consistency of unlabeled data across different data augmentations. The results showed that HiRAND achieved better performance than competitive methods in various prediction scenarios, including both simulation data and multiple drug response data. We found that the prediction ability of HiRAND in the drug vorinostat showed the best results across all 62 drugs. In addition, HiRAND was interpreted to identify the key genes most important to vorinostat response, highlighting critical roles for ribosomal protein-related genes in the response to histone deacetylase inhibition. Our HiRAND could be utilized as an efficient framework for improving the drug response prediction performance using few labeled data.

Image-Based Deep Neural Network for Individualizing Radiotherapy Dose Is Transportable Across Health Systems

PURPOSE

We developed a deep neural network that queries the lung computed tomography-derived feature space to identify radiation sensitivity parameters that can predict treatment failures and hence guide the individualization of radiotherapy dose. In this article, we examine the transportability of this model across health systems.

METHODS

This multicenter cohort-based registry included 1,120 patients with cancer in the lung treated with stereotactic body radiotherapy. Pretherapy lung computed tomography images from the internal study cohort (n = 849) were input into a multitask deep neural network to generate an image fingerprint score that predicts time to local failure. Deep learning (DL) scores were input into a regression model to derive iGray, an individualized radiation dose estimate that projects a treatment failure probability of < 5% at 24 months. We validated our findings in an external, holdout cohort (n = 271).

RESULTS

There were substantive differences in the baseline patient characteristics of the two study populations, permitting an assessment of model transportability. In the external cohort, radiation treatments in patients with high DL scores failed at a significantly higher rate with 3-year cumulative incidences of local failure of 28.5% (95% CI, 19.8 to 37.8) versus 10.2% (95% CI, 5.9 to 16.2; hazard ratio, 3.3 [95% CI, 1.74 to 6.49]; P < .001). A model that included DL score alone predicted treatment failures with a concordance index of 0.68 (95% CI, 0.59 to 0.77), which had a similar performance to a nested model derived from within the internal cohort (0.70 [0.64 to 0.75]). External cohort patients with iGray values that exceeded the delivered doses had proportionately higher rates of local failure (P < .001).

CONCLUSION

Our results support the development and implementation of new DL-guided treatment guidance tools in the image-replete and highly standardized discipline of radiation oncology.

Deep learning empowered volume delineation of whole-body organs-at-risk for accelerated radiotherapy

In radiotherapy for cancer patients, an indispensable process is to delineate organs-at-risk (OARs) and tumors. However, it is the most time-consuming step as manual delineation is always required from radiation oncologists. Herein, we propose a lightweight deep learning framework for radiotherapy treatment planning (RTP), named RTP-Net, to promote an automatic, rapid, and precise initialization of whole-body OARs and tumors. Briefly, the framework implements a cascade coarse-to-fine segmentation, with adaptive module for both small and large organs, and attention mechanisms for organs and boundaries. Our experiments show three merits: 1) Extensively evaluates on 67 delineation tasks on a large-scale dataset of 28,581 cases; 2) Demonstrates comparable or superior accuracy with an average Dice of 0.95; 3) Achieves near real-time delineation in most tasks with <2 s. This framework could be utilized to accelerate the contouring process in the All-in-One radiotherapy scheme, and thus greatly shorten the turnaround time of patients.

Gross tumour volume radiomics for prognostication of recurrence & death following radical radiotherapy for NSCLC

Recurrence occurs in up to 36% of patients treated with curative-intent radiotherapy for NSCLC. Identifying patients at higher risk of recurrence for more intensive surveillance may facilitate the earlier introduction of the next line of treatment. We aimed to use radiotherapy planning CT scans to develop radiomic classification models that predict overall survival (OS), recurrence-free survival (RFS) and recurrence two years post-treatment for risk-stratification. A retrospective multi-centre study of >900 patients receiving curative-intent radiotherapy for stage I-III NSCLC was undertaken. Models using radiomic and/or clinical features were developed, compared with 10-fold cross-validation and an external test set, and benchmarked against TNM-stage. Respective validation and test set AUCs (with 95% confidence intervals) for the radiomic-only models were: (1) OS: 0.712 (0.592–0.832) and 0.685 (0.585–0.784), (2) RFS: 0.825 (0.733–0.916) and 0.750 (0.665–0.835), (3) Recurrence: 0.678 (0.554–0.801) and 0.673 (0.577–0.77). For the combined models: (1) OS: 0.702 (0.583–0.822) and 0.683 (0.586–0.78), (2) RFS: 0.805 (0.707–0.903) and 0·755 (0.672–0.838), (3) Recurrence: 0·637 (0.51–0.·765) and 0·738 (0.649–0.826). Kaplan-Meier analyses demonstrate OS and RFS difference of >300 and >400 days respectively between low and high-risk groups. We have developed validated and externally tested radiomic-based prediction models. Such models could be integrated into the routine radiotherapy workflow, thus informing a personalised surveillance strategy at the point of treatment. Our work lays the foundations for future prospective clinical trials for quantitative personalised risk-stratification for surveillance following curative-intent radiotherapy for NSCLC.

Radiomic and Volumetric Measurements as Clinical Trial Endpoints—A Comprehensive Review

Simple Summary

The extraction of quantitative data from standard-of-care imaging modalities offers opportunities to improve the relevance and salience of imaging biomarkers used in drug development. This review aims to identify the challenges and opportunities for discovering new imaging-based biomarkers based on radiomic and volumetric assessment in the single-site solid tumor sites: breast cancer, rectal cancer, lung cancer and glioblastoma. Developing approaches to harmonize three essential areas: segmentation, validation and data sharing may expedite regulatory approval and adoption of novel cancer imaging biomarkers.

Abstract

Clinical trials for oncology drug development have long relied on surrogate outcome biomarkers that assess changes in tumor burden to accelerate drug registration (i.e., Response Evaluation Criteria in Solid Tumors version 1.1 (RECIST v1.1) criteria). Drug-induced reduction in tumor size represents an imperfect surrogate marker for drug activity and yet a radiologically determined objective response rate is a widely used endpoint for Phase 2 trials. With the addition of therapies targeting complex biological systems such as immune system and DNA damage repair pathways, incorporation of integrative response and outcome biomarkers may add more predictive value. We performed a review of the relevant literature in four representative tumor types (breast cancer, rectal cancer, lung cancer and glioblastoma) to assess the preparedness of volumetric and radiomics metrics as clinical trial endpoints. We identified three key areas—segmentation, validation and data sharing strategies—where concerted efforts are required to enable progress of volumetric- and radiomics-based clinical trial endpoints for wider clinical implementation.

A transformer-based deep-learning approach for classifying brain metastases into primary organ sites using clinical whole-brain MRI images

Treatment decisions for brain metastatic disease rely on knowledge of the primary organ site and are currently made with biopsy and histology. Here, we develop a deep-learning approach for accurate non-invasive digital histology with whole-brain magnetic resonance imaging (MRI) data. Contrast-enhanced T1-weighted and fast spoiled gradient echo brain MRI exams (n = 1,582) were preprocessed and input to the proposed deep-learning workflow for tumor segmentation, modality transfer, and primary site classification into one of five classes. Tenfold cross-validation generated an overall area under the receiver operating characteristic curve (AUC) of 0.878 (95% confidence interval [CI]: 0.873,0.883). These data establish that whole-brain imaging features are discriminative enough to allow accurate diagnosis of the primary organ site of malignancy. Our end-to-end deep radiomic approach has great potential for classifying metastatic tumor types from whole-brain MRI images. Further refinement may offer an invaluable clinical tool to expedite primary cancer site identification for precision treatment and improved outcomes.

Artificial intelligence in radiotherapy

Radiotherapy is a discipline closely integrated with computer science. Artificial intelligence (AI) has developed rapidly over the past few years. With the explosive growth of medical big data, AI promises to revolutionize the field of radiotherapy through highly automated workflow, enhanced quality assurance, improved regional balances of expert experiences, and individualized treatment guided by multi-omics. In addition to independent researchers, the increasing number of large databases, biobanks, and open challenges significantly facilitated AI studies on radiation oncology. This article reviews the latest research, clinical applications, and challenges of AI in each part of radiotherapy including image processing, contouring, planning, quality assurance, motion management, and outcome prediction. By summarizing cutting-edge findings and challenges, we aim to inspire researchers to explore more future possibilities and accelerate the arrival of AI radiotherapy.

Evaluation of auto-segmentation for EBRT planning structures using deep learning-based workflow on cervical cancer

Deep learning (DL) based approach aims to construct a full workflow solution for cervical cancer with external beam radiation therapy (EBRT) and brachytherapy (BT). The purpose of this study was to evaluate the accuracy of EBRT planning structures derived from DL based auto-segmentation compared with standard manual delineation. Auto-segmentation model based on convolutional neural networks (CNN) was developed to delineate clinical target volumes (CTVs) and organs at risk (OARs) in cervical cancer radiotherapy. A total of 300 retrospective patients from multiple cancer centers were used to train and validate the model, and 75 independent cases were selected as testing data. The accuracy of auto-segmented contours were evaluated using geometric and dosimetric metrics including dice similarity coefficient (DSC), 95% hausdorff distance (95%HD), jaccard coefficient (JC) and dose-volume index (DVI). The correlation between geometric metrics and dosimetric difference was performed by Spearman’s correlation analysis. The right and left kidney, bladder, right and left femoral head showed superior geometric accuracy (DSC: 0.88–0.93; 95%HD: 1.03 mm–2.96 mm; JC: 0.78–0.88), and the Bland–Altman test obtained dose agreement for these contours (P > 0.05) between manual and DL based methods. Wilcoxon’s signed-rank test indicated significant dosimetric differences in CTV, spinal cord and pelvic bone (P < 0.001). A strong correlation between the mean dose of pelvic bone and its 95%HD (R = 0.843, P < 0.001) was found in Spearman’s correlation analysis, and the remaining structures showed weak link between dosimetric difference and all of geometric metrics. Our auto-segmentation achieved a satisfied agreement for most EBRT planning structures, although the clinical acceptance of CTV was a concern. DL based auto-segmentation was an essential component in cervical cancer workflow which would generate the accurate contouring.

Glioma survival prediction from whole-brain MRI without tumor segmentation using deep attention network: a multicenter study

OBJECTIVES

To develop and validate a deep learning model for predicting overall survival from whole-brain MRI without tumor segmentation in patients with diffuse gliomas.

METHODS

In this multicenter retrospective study, two deep learning models were built for survival prediction from MRI, including a DeepRisk model built from whole-brain MRI, and an original ResNet model built from expert-segmented tumor images. Both models were developed using a training dataset (n = 935) and an internal tuning dataset (n = 156) and tested on two external test datasets (n = 194 and 150) and a TCIA dataset (n = 121). C-index, integrated Brier score (IBS), prediction error curves, and calibration curves were used to assess the model performance.

RESULTS

In total, 1556 patients were enrolled (age, 49.0 ± 13.1 years; 830 male). The DeepRisk score was an independent predictor and can stratify patients in each test dataset into three risk subgroups. The IBS and C-index for DeepRisk were 0.14 and 0.83 in external test dataset 1, 0.15 and 0.80 in external dataset 2, and 0.16 and 0.77 in TCIA dataset, respectively, which were comparable with those for original ResNet. The AUCs at 6, 12, 24, 26, and 48 months for DeepRisk ranged between 0.77 and 0.94. Combining DeepRisk score with clinicomolecular factors resulted in a nomogram with a better calibration and classification accuracy (net reclassification improvement 0.69, p < 0.001) than the clinical nomogram.

CONCLUSIONS

DeepRisk that obviated the need of tumor segmentation can predict glioma survival from whole-brain MRI and offers incremental prognostic value.

KEY POINTS

• DeepRisk can predict overall survival directly from whole-brain MRI without tumor segmentation. • DeepRisk achieves comparable accuracy in survival prediction with deep learning model built using expert-segmented tumor images. • DeepRisk has independent and incremental prognostic value over existing clinical parameters and IDH mutation status.

The Use and Utility of Machine Learning in Achieving Precision Medicine in Systemic Sclerosis: A Narrative Review

Background: Systemic sclerosis (SSc) is a rare connective tissue disease that can affect different organs and has extremely heterogenous presentations. This complexity makes it difficult to perform an early diagnosis and a subsequent subclassification of the disease. This hinders a personalized approach in clinical practice. In this context, machine learning (ML), a branch of artificial intelligence (AI), is able to recognize relationships in data and predict outcomes. Methods: Here, we performed a narrative review concerning the application of ML in SSc to define the state of art and evaluate its role in a precision medicine context. Results: Currently, ML has been used to stratify SSc patients and identify those at high risk of severe complications. Additionally, ML may be useful in the early detection of organ involvement. Furthermore, ML might have a role in target therapy approach and in predicting drug response. Conclusion: Available evidence about the utility of ML in SSc is sparse but promising. Future improvements in this field could result in a big step toward precision medicine. Further research is needed to define ML application in clinical practice.

Radiomics and deep learning for myocardial scar screening in hypertrophic cardiomyopathy

BACKGROUND

Myocardial scar burden quantified using late gadolinium enhancement (LGE) cardiovascular magnetic resonance (CMR), has important prognostic value in hypertrophic cardiomyopathy (HCM). However, nearly 50% of HCM patients have no scar but undergo repeated gadolinium-based CMR over their life span. We sought to develop an artificial intelligence (AI)-based screening model using radiomics and deep learning (DL) features extracted from balanced steady state free precession (bSSFP) cine sequences to identify HCM patients without scar.

METHODS

We evaluated three AI-based screening models using bSSFP cine image features extracted by radiomics, DL, or combined DL-Radiomics. Images for 759 HCM patients (50 ± 16 years, 66% men) in a multi-center/vendor study were used to develop and test model performance. An external dataset of 100 HCM patients (53 ± 14 years, 70% men) was used to assess model generalizability. Model performance was evaluated using area-under-receiver-operating curve (AUC).

RESULTS

The DL-Radiomics model demonstrated higher AUC compared to DL and Radiomics in the internal (0.83 vs 0.77, p = 0.006 and 0.78, p = 0.05; n = 159) and external (0.74 vs 0.64, p = 0.006 and 0.71, p = 0.27; n = 100) datasets. The DL-Radiomics model correctly identified 43% and 28% of patients without scar in the internal and external datasets compared to 42% and 16% by Radiomics model and 42% and 23% by DL model, respectively.

CONCLUSIONS

A DL-Radiomics AI model using bSSFP cine images outperforms DL or Radiomics models alone as a scar screening tool prior to gadolinium administration. Despite its potential, the clinical utility of the model remains limited and further investigation is needed to improve the accuracy and generalizability.

A Survey on Deep Learning for Precision Oncology

Precision oncology, which ensures optimized cancer treatment tailored to the unique biology of a patient’s disease, has rapidly developed and is of great clinical importance. Deep learning has become the main method for precision oncology. This paper summarizes the recent deep-learning approaches relevant to precision oncology and reviews over 150 articles within the last six years. First, we survey the deep-learning approaches categorized by various precision oncology tasks, including the estimation of dose distribution for treatment planning, survival analysis and risk estimation after treatment, prediction of treatment response, and patient selection for treatment planning. Secondly, we provide an overview of the studies per anatomical area, including the brain, bladder, breast, bone, cervix, esophagus, gastric, head and neck, kidneys, liver, lung, pancreas, pelvis, prostate, and rectum. Finally, we highlight the challenges and discuss potential solutions for future research directions.

Applying Artificial Neural Networks to Develop a Decision Support Tool for Tis-4N0M0 Non-Small-Cell Lung Cancer Treated With Stereotactic Body Radiotherapy

PURPOSE

Clear evidence indicating whether surgery or stereotactic body radiation therapy (SBRT) is best for non-small-cell lung cancer (NSCLC) is lacking. SBRT has many advantages. We used artificial neural networks (NNs) to predict treatment outcomes for patients with NSCLC receiving SBRT, aiming to aid in decision making.

PATIENTS AND METHODS

Among consecutive patients receiving SBRT between 2005 and 2019 in our institution, we retrospectively identified those with Tis-T4N0M0 NSCLC. We constructed two NNs for prediction of overall survival (OS) and cancer progression in the first 5 years after SBRT, which were tested using an internal and an external test data set. We performed risk group stratification, wherein 5-year OS and cancer progression were stratified into three groups.

RESULTS

In total, 692 patients in our institution and 100 patients randomly chosen in the external institution were enrolled. The NNs resulted in concordance indexes for OS of 0.76 (95% CI, 0.73 to 0.79), 0.68 (95% CI, 0.60 to 0.75), and 0.69 (95% CI, 0.61 to 0.76) and area under the curve for cancer progression of 0.80 (95% CI, 0.75 to 0.84), 0.72 (95% CI, 0.60 to 0.83), and 0.70 (95% CI, 0.57 to 0.81) in the training, internal test, and external test data sets, respectively. The survival and cumulative incidence curves were significantly stratified. NNs selected low-risk cancer progression groups of 5.6%, 6.9%, and 7.0% in the training, internal test, and external test data sets, respectively, suggesting that 48% of patients with peripheral Tis-4N0M0 NSCLC can be at low-risk for cancer progression.

CONCLUSION

Predictions of SBRT outcomes using NNs were useful for Tis-4N0M0 NSCLC. Our results are anticipated to open new avenues for NN predictions and provide decision-making guidance for patients and physicians.

A narrative review of deep learning applications in lung cancer research: from screening to prognostication

Background and Objective

Deep learning (DL) algorithms have been developed for various tasks, including lung nodule detection on chest radiographs or lung cancer computed tomography screening, potential candidate selection in lung cancer screening, malignancy prediction for indeterminate pulmonary nodules, lung cancer staging, treatment response prediction, prognostication, and prediction of genetic mutations in lung cancer. Furthermore, these DL algorithms have been applied in various clinical settings in order for them to be generalized in real-world clinical practice. Multiple DL algorithms have been corroborated to be on par with experts or current clinical prediction models for several specific tasks. However, no article has yet comprehensively reviewed DL algorithms dedicated to lung cancer research. This narrative review presents an overview of the literature dealing with DL techniques applied in lung cancer research and briefly summarizes the results according to the DL algorithms’ clinical use cases.

Methods

we performed a narrative review by searching the Embase and OVID-MEDLINE databases for articles published in English from October, 2016 until September, 2021 and reviewing the bibliographies of key references to identify important literature related to DL in lung cancer research. The background, development, results, and clinical implications of each DL algorithm are briefly discussed. Lastly, we end this review article by highlighting future directions in lung cancer research using DL techniques.

Key Content and Findings

DL algorithms have been introduced to show comparable or higher performance than human experts in various clinical settings. Specifically, they have been actively applied to detect lung nodules in chest radiographs or computed tomography (CT) examinations, optimize candidate selection for lung cancer screening (LCS), predict the malignancy of lung nodules, stage lung cancer, and predict treatment response, patients’ prognoses, and genetic mutations in lung cancers.

Conclusions

DL algorithms have corroborated their potential value for various tasks, ranging from lung cancer screening to prognostication of lung cancer patients. Future research is warranted for the clinical application of these algorithms in daily clinical practice and verification of their real-world clinical usefulness.

The value of AI in the Diagnosis, Treatment, and Prognosis of Malignant Lung Cancer

Malignant tumors is a serious public health threat. Among them, lung cancer, which has the highest fatality rate globally, has significantly endangered human health. With the development of artificial intelligence (AI) and its integration with medicine, AI research in malignant lung tumors has become critical. This article reviews the value of CAD, computer neural network deep learning, radiomics, molecular biomarkers, and digital pathology for the diagnosis, treatment, and prognosis of malignant lung tumors.