FAIR-compliant clinical, radiomics and DICOM metadata of RIDER, interobserver, Lung1 and head-Neck1 TCIA collections

Assessing quality assurance of multi-leaf collimator using the structural similarity index

PURPOSE

This study aims to evaluate the viability of utilizing the Structural Similarity Index (SSI*) as an innovative imaging metric for quality assurance (QA) of the multi-leaf collimator (MLC). Additionally, we compared the results obtained through SSI* with those derived from a conventional Gamma index test for three types of Varian machines (Trilogy, Truebeam, and Edge) over a 12-week period of MLC QA in our clinic.

METHOD

To assess sensitivity to MLC positioning errors, we designed a 1 cm slit on the reference MLC, subsequently shifted by 0.5-5 mm on the target MLC. For evaluating sensitivity to output error, we irradiated five 25 cm × 25 cm open fields on the portal image with varying Monitor Units (MUs) of 96-100. We compared SSI* and Gamma index tests using three linear accelerator (LINAC) machines: Varian Trilogy, Truebeam, and Edge, with MLC leaf widths of 1, 0.5, and 0.25 mm. Weekly QA included VMAT and static field modes, with Picket fence test images acquired. Mechanical uncertainties related to the LINAC head, electronic portal imaging device (EPID), and MLC during gantry rotation and leaf motion were monitored.

RESULTS

The Gamma index test started detecting the MLC shift at a threshold of 4 mm, whereas the SSI* metric showed sensitivity to shifts as small as 2 mm. Moreover, the Gamma index test identified dose changes at 95MUs, indicating a 5% dose difference based on the distance to agreement (DTA)/dose difference (DD) criteria of 1 mm/3%. In contrast, the SSI* metric alerted to dose differences starting from 97MUs, corresponding to a 3% dose difference. The Gamma index test passed all measurements conducted on each machine. However, the SSI* metric rejected all measurements from the Edge and Trilogy machines and two from the Truebeam.

CONCLUSIONS

Our findings demonstrate that the SSI* exhibits greater sensitivity than the Gamma index test in detecting MLC positioning errors and dose changes between static and VMAT modes. The SSI* metric outperformed the Gamma index test regarding sensitivity across these parameters.

Comparing the performance of a deep learning-based lung gross tumour volume segmentation algorithm before and after transfer learning in a new hospital

Objectives

Radiation therapy for lung cancer requires a gross tumour volume (GTV) to be carefully outlined by a skilled radiation oncologist (RO) to accurately pinpoint high radiation dose to a malignant mass while simultaneously minimizing radiation damage to adjacent normal tissues. This is manually intensive and tedious however, it is feasible to train a deep learning (DL) neural network that could assist ROs to delineate the GTV. However, DL trained on large openly accessible data sets might not perform well when applied to a superficially similar task but in a different clinical setting. In this work, we tested the performance of DL automatic lung GTV segmentation model trained on open-access Dutch data when used on Indian patients from a large public tertiary hospital, and hypothesized that generic DL performance could be improved for a specific local clinical context, by means of modest transfer-learning on a small representative local subset.

Methods

X-ray computed tomography (CT) series in a public data set called "NSCLC-Radiomics" from The Cancer Imaging Archive was first used to train a DL-based lung GTV segmentation model (Model 1). Its performance was assessed using a different open access data set (Interobserver1) of Dutch subjects plus a private Indian data set from a local tertiary hospital (Test Set 2). Another Indian data set (Retrain Set 1) was used to fine-tune the former DL model using a transfer learning method. The Indian data sets were taken from CT of a hybrid scanner based in nuclear medicine, but the GTV was drawn by skilled Indian ROs. The final (after fine-tuning) model (Model 2) was then re-evaluated in "Interobserver1" and "Test Set 2." Dice similarity coefficient (DSC), precision, and recall were used as geometric segmentation performance metrics.

Results

Model 1 trained exclusively on Dutch scans showed a significant fall in performance when tested on "Test Set 2." However, the DSC of Model 2 recovered by 14 percentage points when evaluated in the same test set. Precision and recall showed a similar rebound of performance after transfer learning, in spite of using a comparatively small sample size. The performance of both models, before and after the fine-tuning, did not significantly change the segmentation performance in "Interobserver1."

Conclusions

A large public open-access data set was used to train a generic DL model for lung GTV segmentation, but this did not perform well initially in the Indian clinical context. Using transfer learning methods, it was feasible to efficiently and easily fine-tune the generic model using only a small number of local examples from the Indian hospital. This led to a recovery of some of the geometric segmentation performance, but the tuning did not appear to affect the performance of the model in another open-access data set.

Advances in knowledge

Caution is needed when using models trained on large volumes of international data in a local clinical setting, even when that training data set is of good quality. Minor differences in scan acquisition and clinician delineation preferences may result in an apparent drop in performance. However, DL models have the advantage of being efficiently "adapted" from a generic to a locally specific context, with only a small amount of fine-tuning by means of transfer learning on a small local institutional data set.

Differentiation between cerebral alveolar echinococcosis and brain metastases with radiomics combined machine learning approach

BACKGROUND

Cerebral alveolar echinococcosis (CAE) and brain metastases (BM) share similar in locations and imaging appearance. However, they require distinct treatment approaches, with CAE typically treated with chemotherapy and surgery, while BM is managed with radiotherapy and targeted therapy for the primary malignancy. Accurate diagnosis is crucial due to the divergent treatment strategies.

PURPOSE

This study aims to evaluate the effectiveness of radiomics and machine learning techniques based on magnetic resonance imaging (MRI) to differentiate between CAE and BM.

METHODS

We retrospectively analyzed MRI images of 130 patients (30 CAE and 100 BM) from Xinjiang Medical University First Affiliated Hospital and The First People's Hospital of Kashi Prefecture, between January 2014 and December 2022. The dataset was divided into training (91 cases) and testing (39 cases) sets. Three dimensional tumors were segmented by radiologists from contrast-enhanced T1WI images on open resources software 3D Slicer. Features were extracted on Pyradiomics, further feature reduction was carried out using univariate analysis, correlation analysis, and least absolute shrinkage and selection operator (LASSO). Finally, we built five machine learning models, support vector machine, logistic regression, linear discrimination analysis, k-nearest neighbors classifier, and Gaussian naïve bias and evaluated their performance via several metrics including sensitivity (recall), specificity, positive predictive value (precision), negative predictive value, accuracy and the area under the curve (AUC).

RESULTS

The area under curve (AUC) of support vector classifier (SVC), linear discrimination analysis (LDA), k-nearest neighbors (KNN), and gaussian naïve bias (NB) algorithms in training (testing) sets are 0.99 (0.94), 1.00 (0.87), 0.98 (0.92), 0.97 (0.97), and 0.98 (0.93), respectively. Nested cross-validation demonstrated the robustness and generalizability of the models. Additionally, the calibration plot and decision curve analysis demonstrated the practical usefulness of these models in clinical practice, with lower bias toward different subgroups during decision-making.

CONCLUSION

The combination of radiomics and machine learning approach based on contrast enhanced T1WI images could well distinguish CAE and BM. This approach holds promise in assisting doctors with accurate diagnosis and clinical decision-making.

Initiatives, Concepts, and Implementation Practices of the Findable, Accessible, Interoperable, and Reusable Data Principles in Health Data Stewardship: Scoping Review

BACKGROUND

Thorough data stewardship is a key enabler of comprehensive health research. Processes such as data collection, storage, access, sharing, and analytics require researchers to follow elaborate data management strategies properly and consistently. Studies have shown that findable, accessible, interoperable, and reusable (FAIR) data leads to improved data sharing in different scientific domains.

OBJECTIVE

This scoping review identifies and discusses concepts, approaches, implementation experiences, and lessons learned in FAIR initiatives in health research data.

METHODS

The Arksey and O'Malley stage-based methodological framework for scoping reviews was applied. PubMed, Web of Science, and Google Scholar were searched to access relevant publications. Articles written in English, published between 2014 and 2020, and addressing FAIR concepts or practices in the health domain were included. The 3 data sources were deduplicated using a reference management software. In total, 2 independent authors reviewed the eligibility of each article based on defined inclusion and exclusion criteria. A charting tool was used to extract information from the full-text papers. The results were reported using the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines.

RESULTS

A total of 2.18% (34/1561) of the screened articles were included in the final review. The authors reported FAIRification approaches, which include interpolation, inclusion of comprehensive data dictionaries, repository design, semantic interoperability, ontologies, data quality, linked data, and requirement gathering for FAIRification tools. Challenges and mitigation strategies associated with FAIRification, such as high setup costs, data politics, technical and administrative issues, privacy concerns, and difficulties encountered in sharing health data despite its sensitive nature were also reported. We found various workflows, tools, and infrastructures designed by different groups worldwide to facilitate the FAIRification of health research data. We also uncovered a wide range of problems and questions that researchers are trying to address by using the different workflows, tools, and infrastructures. Although the concept of FAIR data stewardship in the health research domain is relatively new, almost all continents have been reached by at least one network trying to achieve health data FAIRness. Documented outcomes of FAIRification efforts include peer-reviewed publications, improved data sharing, facilitated data reuse, return on investment, and new treatments. Successful FAIRification of data has informed the management and prognosis of various diseases such as cancer, cardiovascular diseases, and neurological diseases. Efforts to FAIRify data on a wider variety of diseases have been ongoing since the COVID-19 pandemic.

CONCLUSIONS

This work summarises projects, tools, and workflows for the FAIRification of health research data. The comprehensive review shows that implementing the FAIR concept in health data stewardship carries the promise of improved research data management and transparency in the era of big data and open research publishing.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/22505.

Multi-centre radiomics for prediction of recurrence following radical radiotherapy for head and neck cancers: Consequences of feature selection, machine learning classifiers and batch-effect harmonization

Background and purpose

Radiomics models trained with limited single institution data are often not reproducible and generalisable. We developed radiomics models that predict loco-regional recurrence within two years of radiotherapy with private and public datasets and their combinations, to simulate small and multi-institutional studies and study the responsiveness of the models to feature selection, machine learning algorithms, centre-effect harmonization and increased dataset sizes.

Materials and methods

562 patients histologically confirmed and treated for locally advanced head-and-neck cancer (LA-HNC) from two public and two private datasets; one private dataset exclusively reserved for validation. Clinical contours of primary tumours were not recontoured and were used for Pyradiomics based feature extraction. ComBat harmonization was applied, and LASSO-Logistic Regression (LR) and Support Vector Machine (SVM) models were built. 95% confidence interval (CI) of 1000 bootstrapped area-under-the-Receiver-operating-curves (AUC) provided predictive performance. Responsiveness of the models' performance to the choice of feature selection methods, ComBat harmonization, machine learning classifier, single and pooled data was evaluated.

Results

LASSO and SelectKBest selected 14 and 16 features, respectively; three were overlapping. Without ComBat, the LR and SVM models for three institutional data showed AUCs (CI) of 0.513 (0.481-0.559) and 0.632 (0.586-0.665), respectively. Performances following ComBat revealed AUCs of 0.559 (0.536-0.590) and 0.662 (0.606-0.690), respectively. Compared to single cohort AUCs (0.562-0.629), SVM models from pooled data performed significantly better at AUC = 0.680.

Conclusions

Multi-institutional retrospective data accentuates the existing variabilities that affect radiomics. Carefully designed prospective, multi-institutional studies and data sharing are necessary for clinically relevant head-and-neck cancer prognostication models.

Radiomics: a primer on high-throughput image phenotyping

Radiomics is a high-throughput approach to image phenotyping. It uses computer algorithms to extract and analyze a large number of quantitative features from radiological images. These radiomic features collectively describe unique patterns that can serve as digital fingerprints of disease. They may also capture imaging characteristics that are difficult or impossible to characterize by the human eye. The rapid development of this field is motivated by systems biology, facilitated by data analytics, and powered by artificial intelligence. Here, as part of Abdominal Radiology's special issue on Quantitative Imaging, we provide an introduction to the field of radiomics. The technique is formally introduced as an advanced application of data analytics, with illustrating examples in abdominal radiology. Artificial intelligence is then presented as the main driving force of radiomics, and common techniques are defined and briefly compared. The complete step-by-step process of radiomic phenotyping is then broken down into five key phases. Potential pitfalls of each phase are highlighted, and recommendations are provided to reduce sources of variation, non-reproducibility, and error associated with radiomics.

Unpaired Cross-Modality Educed Distillation (CMEDL) for Medical Image Segmentation

Accurate and robust segmentation of lung cancers from CT, even those located close to mediastinum, is needed to more accurately plan and deliver radiotherapy and to measure treatment response. Therefore, we developed a new cross-modality educed distillation (CMEDL) approach, using unpaired CT and MRI scans, whereby an informative teacher MRI network guides a student CT network to extract features that signal the difference between foreground and background. Our contribution eliminates two requirements of distillation methods: (i) paired image sets by using an image to image (I2I) translation and (ii) pre-training of the teacher network with a large training set by using concurrent training of all networks. Our framework uses an end-to-end trained unpaired I2I translation, teacher, and student segmentation networks. Architectural flexibility of our framework is demonstrated using 3 segmentation and 2 I2I networks. Networks were trained with 377 CT and 82 T2w MRI from different sets of patients, with independent validation (N = 209 tumors) and testing (N = 609 tumors) datasets. Network design, methods to combine MRI with CT information, distillation learning under informative (MRI to CT), weak (CT to MRI) and equal teacher (MRI to MRI), and ablation tests were performed. Accuracy was measured using Dice similarity (DSC), surface Dice (sDSC), and Hausdorff distance at the 95th percentile (HD95). The CMEDL approach was significantly (p < 0.001) more accurate (DSC of 0.77 vs. 0.73) than non-CMEDL methods with an informative teacher for CT lung tumor, with a weak teacher (DSC of 0.84 vs. 0.81) for MRI lung tumor, and with equal teacher (DSC of 0.90 vs. 0.88) for MRI multi-organ segmentation. CMEDL also reduced inter-rater lung tumor segmentation variabilities.

Radiomics for Predicting Lung Cancer Outcomes Following Radiotherapy: A Systematic Review

Lung cancer's radiomic phenotype may potentially inform clinical decision-making with respect to radical radiotherapy. At present there are no validated biomarkers available for the individualisation of radical radiotherapy in lung cancer and the mortality rate of this disease remains the highest of all other solid tumours. MEDLINE was searched using the terms 'radiomics' and 'lung cancer' according to the Preferred Reporting Items for Systematic Reviews and Met-Analyses (PRISMA) guidance. Radiomics studies were defined as those manuscripts describing the extraction and analysis of at least 10 quantifiable imaging features. Only those studies assessing disease control, survival or toxicity outcomes for patients with lung cancer following radical radiotherapy ± chemotherapy were included. Study titles and abstracts were reviewed by two independent reviewers. The Radiomics Quality Score was applied to the full text of included papers. Of 244 returned results, 44 studies met the eligibility criteria for inclusion. End points frequently reported were local (17%), regional (17%) and distant control (31%), overall survival (79%) and pulmonary toxicity (4%). Imaging features strongly associated with clinical outcomes include texture features belonging to the subclasses Gray level run length matrix, Gray level co-occurrence matrix and kurtosis. The median cohort size for model development was 100 (15-645); in the 11 studies with external validation in a separate independent population, the median cohort size was 84 (21-295). The median number of imaging features extracted was 184 (10-6538). The median Radiomics Quality Score was 11% (0-47). Patient-reported outcomes were not incorporated within any studies identified. No studies externally validated a radiomics signature in a registered prospective study. Imaging-derived indices attained through radiomic analyses could equip thoracic oncologists with biomarkers for treatment response, patterns of failure, normal tissue toxicity and survival in lung cancer. Based on routine scans, their non-invasive nature and cost-effectiveness are major advantages over conventional pathological assessment. Improved tools are required for the appraisal of radiomics studies, as significant barriers to clinical implementation remain, such as standardisation of input scan data, quality of reporting and external validation of signatures in randomised, interventional clinical trials.

Radiomics integration into a picture archiving and communication system

Radiomics is referred to as quantitative imaging of biomarkers used for clinical outcome prognosis or tumor characterization. In order to bridge radiomics and its clinical application, we aimed to build an integrated solution of radiomics extraction with an open-source Picture Archiving and Communication System (PACS). The integrated SQLite4Radiomics software was tested in three different imaging modalities and its performance was benchmarked in lung cancer open datasets RIDER and MMD with median extraction time of 10.7 (percentiles 25-75: 8.9-18.7) seconds per ROI in three different configurations.

A review in radiomics: Making personalized medicine a reality via routine imaging

Radiomics is the quantitative analysis of standard-of-care medical imaging; the information obtained can be applied within clinical decision support systems to create diagnostic, prognostic, and/or predictive models. Radiomics analysis can be performed by extracting hand-crafted radiomics features or via deep learning algorithms. Radiomics has evolved tremendously in the last decade, becoming a bridge between imaging and precision medicine. Radiomics exploits sophisticated image analysis tools coupled with statistical elaboration to extract the wealth of information hidden inside medical images, such as computed tomography (CT), magnetic resonance (MR), and/or Positron emission tomography (PET) scans, routinely performed in the everyday clinical practice. Many efforts have been devoted in recent years to the standardization and validation of radiomics approaches, to demonstrate their usefulness and robustness beyond any reasonable doubts. However, the booming of publications and commercial applications of radiomics approaches warrant caution and proper understanding of all the factors involved to avoid "scientific pollution" and overly enthusiastic claims by researchers and clinicians alike. For these reasons the present review aims to be a guidebook of sorts, describing the process of radiomics, its pitfalls, challenges, and opportunities, along with its ability to improve clinical decision-making, from oncology and respiratory medicine to pharmacological and genotyping studies.

Making radiotherapy more efficient with FAIR data

Given the rapid growth of artificial intelligence (AI) applications in radiotherapy and the related transformations toward the data-driven healthcare domain, this article summarizes the need and usage of the FAIR (Findable, Accessible, Interoperable, Reusable) data principles in radiotherapy. This work introduces the FAIR data concept, presents practical and relevant use cases and the future role of the different parties involved. The goal of this article is to provide guidance and potential applications of FAIR to various radiotherapy stakeholders, focusing on the central role of medical physicists.