Implementation of the Australian Computer-Assisted Theragnostics (AusCAT) network for radiation oncology data extraction, reporting and distributed learning

Federated Learning Survival Model and Potential Radiotherapy Decision Support Impact Assessment for Non-small Cell Lung Cancer Using Real-World Data

AIMS

The objective of this study was to develop a two-year overall survival model for inoperable stage I-III non-small cell lung cancer (NSCLC) patients using routine radiation oncology data over a federated (distributed) learning network and evaluate the potential of decision support for curative versus palliative radiotherapy.

METHODS

A federated infrastructure of data extraction, de-identification, standardisation, image analysis, and modelling was installed for seven clinics to obtain clinical and imaging features and survival information for patients treated in 2011-2019. A logistic regression model was trained for the 2011-2016 curative patient cohort and validated for the 2017-2019 cohort. Features were selected with univariate and model-based analysis and optimised using bootstrapping. System performance was assessed by the receiver operating characteristic (ROC) and corresponding area under curve (AUC), C-index, calibration metrics and Kaplan-Meier survival curves, with risk groups defined by model probability quartiles. Decision support was evaluated using a case-control analysis using propensity matching between treatment groups.

RESULTS

1655 patient datasets were included. The overall model AUC was 0.68. Fifty-eight percent of patients treated with palliative radiotherapy had a low-to-moderate risk prediction according to the model, with survival times not significantly different (p = 0.87 and 0.061) from patients treated with curative radiotherapy classified as high-risk by the model. When survival was simulated by risk group and model-indicated treatment, there was an estimated 11% increase in survival rate at two years (p < 0.01).

CONCLUSION

Federated learning over multiple institution data can be used to develop and validate decision support systems for lung cancer while quantifying the potential impact of their use in practice. This paves the way for personalised medicine, where decisions can be based more closely on individual patient details from routine care.

Minimum data elements for the Australian Particle Therapy Clinical Quality Registry

INTRODUCTION

Construction of the first Australian particle therapy (PT) centre is underway. Establishment of a national registry, to be known as the Australian Particle Therapy Clinical Quality Registry (ASPIRE), has been identified as a mandatory requirement for PT treatment to be reimbursed by the Australian Medicare Benefits Schedule. This study aimed to determine a consensus set of Minimum Data Elements (MDEs) for ASPIRE.

METHODS

A modified Delphi and expert consensus process was completed. Stage 1 compiled currently operational English-language international PT registries. Stage 2 listed the MDEs included in each of these four registries. Those included in three or four registries were automatically included as a potential MDE for ASPIRE. Stage 3 interrogated the remaining data items, and involved three rounds - an online survey to a panel of experts, followed by a live poll session of PT-interested participants, and finally a virtual discussion forum of the original expert panel.

RESULTS

One hundred and twenty-three different MDEs were identified across the four international registries. The multi-staged Delphi and expert consensus process resulted in a total of 27 essential MDEs for ASPIRE; 14 patient factors, four tumour factors and nine treatment factors.

CONCLUSIONS

The MDEs provide the core mandatory data items for the national PT registry. Registry data collection for PT is paramount in the ongoing global effort to accumulate more robust clinical evidence regarding PT patient and tumour outcomes, quantifying the magnitude of clinical benefit and justifying the relatively higher costs of PT investment.

Automated detection, delineation and quantification of whole-body bone metastasis using FDG-PET/CT images

Non-small cell lung cancer (NSCLC) patients with the metastatic spread of disease to the bone have high morbidity and mortality. Stereotactic ablative body radiotherapy increases the progression free survival and overall survival of these patients with oligometastases. FDG-PET/CT, a functional imaging technique combining positron emission tomography (PET) with 18 F-fluorodeoxyglucose (FDG) and computer tomography (CT) provides improved staging and identification of treatment response. It is also associated with reduction in size of the radiotherapy tumour volume delineation compared with CT based contouring in radiotherapy, thus allowing for dose escalation to the target volume with lower doses to the surrounding organs at risk. FDG-PET/CT is increasingly being used for the clinical management of NSCLC patients undergoing radiotherapy and has shown high sensitivity and specificity for the detection of bone metastases in these patients. Here, we present a software tool for detection, delineation and quantification of bone metastases using FDG-PET/CT images. The tool extracts standardised uptake values (SUV) from FDG-PET images for auto-segmentation of bone lesions and calculates volume of each lesion and associated mean and maximum SUV. The tool also allows automatic statistical validation of the auto-segmented bone lesions against the manual contours of a radiation oncologist. A retrospective review of FDG-PET/CT scans of more than 30 candidate NSCLC patients was performed and nine patients with one or more metastatic bone lesions were selected for the present study. The SUV threshold prediction model was designed by splitting the cohort of patients into a subset of 'development' and 'validation' cohorts. The development cohort yielded an optimum SUV threshold of 3.0 for automatic detection of bone metastases using FDG-PET/CT images. The validity of the derived optimum SUV threshold on the validation cohort demonstrated that auto-segmented and manually contoured bone lesions showed strong concordance for volume of bone lesion (r = 0.993) and number of detected lesions (r = 0.996). The tool has various applications in radiotherapy, including but not limited to studies determining optimum SUV threshold for accurate and standardised delineation of bone lesions and in scientific studies utilising large patient populations for instance for investigation of the number of metastatic lesions that can be treated safety with an ablative dose of radiotherapy without exceeding the normal tissue toxicity.

Standardising Breast Radiotherapy Structure Naming Conventions: A Machine Learning Approach

In progressing the use of big data in health systems, standardised nomenclature is required to enable data pooling and analyses. In many radiotherapy planning systems and their data archives, target volumes (TV) and organ-at-risk (OAR) structure nomenclature has not been standardised. Machine learning (ML) has been utilised to standardise volumes nomenclature in retrospective datasets. However, only subsets of the structures have been targeted. Within this paper, we proposed a new approach for standardising all the structures nomenclature by using multi-modal artificial neural networks. A cohort consisting of 1613 breast cancer patients treated with radiotherapy was identified from Liverpool & Macarthur Cancer Therapy Centres, NSW, Australia. Four types of volume characteristics were generated to represent each target and OAR volume: textual features, geometric features, dosimetry features, and imaging data. Five datasets were created from the original cohort, the first four represented different subsets of volumes and the last one represented the whole list of volumes. For each dataset, 15 sets of combinations of features were generated to investigate the effect of using different characteristics on the standardisation performance. The best model reported 99.416% classification accuracy over the hold-out sample when used to standardise all the nomenclatures in a breast cancer radiotherapy plan into 21 classes. Our results showed that ML based automation methods can be used for standardising naming conventions in a radiotherapy plan taking into consideration the inclusion of multiple modalities to better represent each volume.

Larynx cancer survival model developed through open-source federated learning

INTRODUCTION

Federated learning has the potential to perfrom analysis on decentralised data; however, there are some obstacles to survival analyses as there is a risk of data leakage. This study demonstrates how to perform a stratified Cox regression survival analysis specifically designed to avoid data leakage using federated learning on larynx cancer patients from centres in three different countries.

METHODS

Data were obtained from 1821 larynx cancer patients treated with radiotherapy in three centres. Tumour volume was available for all 786 of the included patients. Parameter selection among eleven clinical and radiotherapy parameters were performed using best subset selection and cross-validation through the federated learning system, AusCAT. After parameter selection, β regression coefficients were estimated using bootstrap. Calibration plots were generated at 2 and 5-years survival, and inner and outer risk groups' Kaplan-Meier curves were compared to the Cox model prediction.

RESULTS

The best performing Cox model included log(GTV), performance status, age, smoking, haemoglobin and N-classification; however, the simplest model with similar statistical prediction power included log(GTV) and performance status only. The Harrell C-indices for the simplest model were for Odense, Christie and Liverpool 0.75[0.71-0.78], 0.65[0.59-0.71], and 0.69[0.59-0.77], respectively. The values are slightly higher for the full model with C-index 0.77[0.74-0.80], 0.67[0.62-0.73] and 0.71[0.61-0.80], respectively. Smoking during treatment has the same hazard as a ten-years older nonsmoking patient.

CONCLUSION

Without any patient-specific data leaving the hospitals, a stratified Cox regression model based on data from centres in three countries was developed without data leakage risks. The overall survival model is primarily driven by tumour volume and performance status.

Using Artificial Intelligence for Optimization of the Processes and Resource Utilization in Radiotherapy

The radiotherapy (RT) process from planning to treatment delivery is a multistep, complex operation involving numerous levels of human-machine interaction and requiring high precision. These steps are labor-intensive and time-consuming and require meticulous coordination between professionals with diverse expertise. We reviewed and summarized the current status and prospects of artificial intelligence and machine learning relevant to the various steps in RT treatment planning and delivery workflow specifically in low- and middle-income countries (LMICs). We also searched the PubMed database using the search terms (Artificial Intelligence OR Machine Learning OR Deep Learning OR Automation OR knowledge-based planning AND Radiotherapy) AND (list of Low- and Middle-Income Countries as defined by the World Bank at the time of writing this review). The search yielded a total of 90 results, of which results with first authors from the LMICs were chosen. The reference lists of retrieved articles were also reviewed to search for more studies. No language restrictions were imposed. A total of 20 research items with unique study objectives conducted with the aim of enhancing RT processes were examined in detail. Artificial intelligence and machine learning can improve the overall efficiency of RT processes by reducing human intervention, aiding decision making, and efficiently executing lengthy, repetitive tasks. This improvement could permit the radiation oncologist to redistribute resources and focus on responsibilities such as patient counseling, education, and research, especially in resource-constrained LMICs.

Infrastructure platform for privacy-preserving distributed machine learning development of computer-assisted theragnostics in cancer

INTRODUCTION

Emerging evidence suggests that data-driven support tools have found their way into clinical decision-making in a number of areas, including cancer care. Improving them and widening their scope of availability in various differing clinical scenarios, including for prognostic models derived from retrospective data, requires co-ordinated data sharing between clinical centres, secondary analyses of large multi-institutional clinical trial data, or distributed (federated) learning infrastructures. A systematic approach to utilizing routinely collected data across cancer care clinics remains a significant challenge due to privacy, administrative and political barriers.

METHODS

An information technology infrastructure and web service software was developed and implemented which uses machine learning to construct clinical decision support systems in a privacy-preserving manner across datasets geographically distributed in different hospitals. The infrastructure was deployed in a network of Australian hospitals. A harmonized, international ontology-linked, set of lung cancer databases were built with the routine clinical and imaging data at each centre. The infrastructure was demonstrated with the development of logistic regression models to predict major cardiovascular events following radiation therapy.

RESULTS

The infrastructure implemented forms the basis of the Australian computer-assisted theragnostics (AusCAT) network for radiation oncology data extraction, reporting and distributed learning. Four radiation oncology departments (across seven hospitals) in New South Wales (NSW) participated in this demonstration study. Infrastructure was deployed at each centre and used to develop a model predicting for cardiovascular admission within a year of receiving curative radiotherapy for non-small cell lung cancer. A total of 10417 lung cancer patients were identified with 802 being eligible for the model. Twenty features were chosen for analysis from the clinical record and linked registries. After selection, 8 features were included and a logistic regression model achieved an area under the receiver operating characteristic (AUROC) curve of 0.70 and C-index of 0.65 on out-of-sample data.

CONCLUSION

The infrastructure developed was demonstrated to be usable in practice between clinical centres to harmonize routinely collected oncology data and develop models with federated learning. It provides a promising approach to enable further research studies in radiation oncology using real world clinical data.

Open-source distributed learning validation for a larynx cancer survival model following radiotherapy

INTRODUCTION

Prediction models are useful to design personalised treatment. However, safe and effective implementation relies on external validation. Retrospective data are available in many institutions, but sharing between institutions can be challenging due to patient data sensitivity and governance or legal barriers. This study validates a larynx cancer survival model performed using distributed learning without any sensitive data leaving the institution.

METHODS

Open-source distributed learning software based on a stratified Cox proportional hazard model was developed and used to validate the Egelmeer et al. MAASTRO survival model across two hospitals in two countries. The validation optimised a single scaling parameter multiplied by the original predicted prognostic index. All analyses and figures were based on the distributed system, ensuring no information leakage from the individual centres. All applied software is provided as freeware to facilitate distributed learning in other institutions.

RESULTS

1745 patients received radiotherapy for larynx cancer in the two centres from Jan 2005 to Dec 2018. Limiting to a maximum of one missing value in the parameters of the survival model reduced the cohort to 1095 patients. The Harrell C-index was 0.74 (CI95%, 0.71-0.76) and 0.70 (0.66-0.75) for the two centres. However, the model needed a scaling update. In addition, it was found that survival predictions of patients undergoing hypofractionation were less precise.

CONCLUSION

Open-source distributed learning software was able to validate, and suggest a minor update to the original survival model without central access to patient sensitive information. Even without the update, the original MAASTRO survival model of Egelmeer et al. performed reasonably well, providing similar results in this validation as in its original validation.

Predicting 2-year survival in stage I-III non-small cell lung cancer: the development and validation of a scoring system from an Australian cohort

Background

There are limited data on survival prediction models in contemporary inoperable non-small cell lung cancer (NSCLC) patients. The objective of this study was to develop and validate a survival prediction model in a cohort of inoperable stage I-III NSCLC patients treated with radiotherapy.

Methods

Data from inoperable stage I-III NSCLC patients diagnosed from 1/1/2016 to 31/12/2017 were collected from three radiation oncology clinics. Patient, tumour and treatment-related variables were selected for model inclusion using univariate and multivariate analysis. Cox proportional hazards regression was used to develop a 2-year overall survival prediction model, the South West Sydney Model (SWSM) in one clinic (n = 117) and validated in the other clinics (n = 144). Model performance, assessed internally and on one independent dataset, was expressed as Harrell’s concordance index (c-index).

Results

The SWSM contained five variables: Eastern Cooperative Oncology Group performance status, diffusing capacity of the lung for carbon monoxide, histological diagnosis, tumour lobe and equivalent dose in 2 Gy fractions. The SWSM yielded a c-index of 0.70 on internal validation and 0.72 on external validation. Survival probability could be stratified into three groups using a risk score derived from the model.

Conclusions

A 2-year survival model with good discrimination was developed. The model included tumour lobe as a novel variable and has the potential to guide treatment decisions. Further validation is needed in a larger patient cohort.

Recent Applications of Artificial Intelligence in Radiotherapy: Where We Are and Beyond

In recent decades, artificial intelligence (AI) tools have been applied in many medical fields, opening the possibility of finding novel solutions for managing very complex and multifactorial problems, such as those commonly encountered in radiotherapy (RT). We conducted a PubMed and Scopus search to identify the AI application field in RT limited to the last four years. In total, 1824 original papers were identified, and 921 were analyzed by considering the phase of the RT workflow according to the applied AI approaches. AI permits the processing of large quantities of information, data, and images stored in RT oncology information systems, a process that is not manageable for individuals or groups. AI allows the iterative application of complex tasks in large datasets (e.g., delineating normal tissues or finding optimal planning solutions) and might support the entire community working in the various sectors of RT, as summarized in this overview. AI-based tools are now on the roadmap for RT and have been applied to the entire workflow, mainly for segmentation, the generation of synthetic images, and outcome prediction. Several concerns were raised, including the need for harmonization while overcoming ethical, legal, and skill barriers.