Parameters Influencing PET Imaging Features: A Phantom Study with Irregular and Heterogeneous Synthetic Lesions

Artificial Intelligence for Response Assessment in Neuro Oncology (AI-RANO), part 2: recommendations for standardisation, validation, and good clinical practice

Technological advancements have enabled the extended investigation, development, and application of computational approaches in various domains, including health care. A burgeoning number of diagnostic, predictive, prognostic, and monitoring biomarkers are continuously being explored to improve clinical decision making in neuro-oncology. These advancements describe the increasing incorporation of artificial intelligence (AI) algorithms, including the use of radiomics. However, the broad applicability and clinical translation of AI are restricted by concerns about generalisability, reproducibility, scalability, and validation. This Policy Review intends to serve as the leading resource of recommendations for the standardisation and good clinical practice of AI approaches in health care, particularly in neuro-oncology. To this end, we investigate the repeatability, reproducibility, and stability of AI in response assessment in neuro-oncology in studies on factors affecting such computational approaches, and in publicly available open-source data and computational software tools facilitating these goals. The pathway for standardisation and validation of these approaches is discussed with the view of trustworthy AI enabling the next generation of clinical trials. We conclude with an outlook on the future of AI-enabled neuro-oncology.

Multicentric study on the reproducibility and robustness of PET-based radiomics features with a realistic activity painting phantom

Previously, we developed an "activity painting" tool for PET image simulation; however, it could simulate heterogeneous patterns only in the air. We aimed to improve this phantom technique to simulate arbitrary lesions in a radioactive background to perform relevant multi-center radiomic analysis. We conducted measurements moving a 22Na point source in a 20-liter background volume filled with 5 kBq/mL activity with an adequately controlled robotic system to prevent the surge of the water. Three different lesion patterns were "activity-painted" in five PET/CT cameras, resulting in 8 different reconstructions. We calculated 46 radiomic indeces (RI) for each lesion and imaging setting, applying absolute and relative discretization. Reproducibility and reliability were determined by the inter-setting coefficient of variation (CV) and the intraclass correlation coefficient (ICC). Hypothesis tests were used to compare RI between lesions. By simulating precisely the same lesions, we confirmed that the reconstructed voxel size and the spatial resolution of different PET cameras were critical for higher order RI. Considering conventional RIs, the SUVpeak and SUVmean proved the most reliable (CV<10%). CVs above 25% are more common for higher order RIs, but we also found that low CVs do not necessarily imply robust parameters but often rather insensitive RIs. Based on the hypothesis test, most RIs could clearly distinguish between the various lesions using absolute resampling. ICC analysis also revealed that most RIs were more reproducible with absolute discretization. The activity painting method in a real radioactive environment proved suitable for precisely detecting the radiomic differences derived from the different camera settings and texture characteristics. We also found that inter-setting CV is not an appropriate metric for analyzing RI parameters' reliability and robustness. Although multicentric cohorts are increasingly common in radiomics analysis, realistic texture phantoms can provide indispensable information on the sensitivity of an RI and how an individual RI parameter measures the texture.

PET radiomics in lung cancer: advances and translational challenges

Radiomics is an emerging field of medical imaging that aims at improving the accuracy of diagnosis, prognosis, treatment planning and monitoring non-invasively through the automated or semi-automated quantitative analysis of high-dimensional image features. Specifically in the field of nuclear medicine, radiomics utilizes imaging methods such as positron emission tomography (PET) and single photon emission computed tomography (SPECT) to evaluate biomarkers related to metabolism, blood flow, cellular activity and some biological pathways. Lung cancer ranks among the leading causes of cancer-related deaths globally, and radiomics analysis has shown great potential in guiding individualized therapy, assessing treatment response, and predicting clinical outcomes. In this review, we summarize the current state-of-the-art radiomics progress in lung cancer, highlighting the potential benefits and existing limitations of this approach. The radiomics workflow was introduced first including image acquisition, segmentation, feature extraction, and model building. Then the published literatures were described about radiomics-based prediction models for lung cancer diagnosis, differentiation, prognosis and efficacy evaluation. Finally, we discuss current challenges and provide insights into future directions and potential opportunities for integrating radiomics into routine clinical practice.

A heterogeneous phantom study for investigating the stability of PET images radiomic features with varying reconstruction settings

The purpose of this work was to assess the capability of radiomic features in distinguishing PET image regions with different uptake patterns. Furthermore, we assessed the stability of PET radiomic features with varying image reconstruction settings. An in-house phantom was designed and constructed, consisting of homogenous and heterogenous artificial phantom inserts. Four artificially constructed inserts were placed into a water filled phantom and filled with varying levels of radioactivity to simulate homogeneous and heterogeneous uptake patterns. The phantom was imaged for 80 min. PET images were reconstructed whilst varying reconstruction parameters. The parameters adjusted included, number of ordered subsets, number of iterations, use of time-of-flight and filter cut off. Regions of interest (ROI) were established by segmentation of the phantom inserts from the reconstructed images. In total seventy eight 3D radiomic features for each ROI with unique reconstructed parameters were extracted. The Friedman test was used to determine the statistical power of each radiomic feature in differentiating phantom inserts with different hetero/homogeneous configurations. The Coefficient of Variation (COV) of each feature, with respect to the reconstruction setting was used to determine feature stability. Forty three out of seventy eight radiomic features were found to be stable (COV ≤ 5%) against all reconstruction settings. To provide any utility, stable features are required to differentiate between regions with different hetro/homogeneity. Of the forty three stable features, fifteen (35%) features showed a statistically significant difference between the artificially constructed inserts. Such features included GLCM (Difference average, Difference entropy, Dissimilarity and Inverse difference), GLRL (Long run emphasis, Grey level non uniformity and Run percentage) and NGTDM (Complexity and Strength). The finding of this work suggests that radiomic features are capable of distinguishing between radioactive distribution patterns that demonstrate different levels of heterogeneity. Therefore, radiomic features could serve as an adjuvant diagnostic tool along with traditional imaging. However, the choice of the radiomic features needs to account for variability introduced when different reconstruction settings are used. Standardization of PET image reconstruction settings across sites performing radiomic analysis in multi-centre trials should be considered.

The Applications of Artificial Intelligence in Digestive System Neoplasms: A Review

Importance

Digestive system neoplasms (DSNs) are the leading cause of cancer-related mortality with a 5-year survival rate of less than 20%. Subjective evaluation of medical images including endoscopic images, whole slide images, computed tomography images, and magnetic resonance images plays a vital role in the clinical practice of DSNs, but with limited performance and increased workload of radiologists or pathologists. The application of artificial intelligence (AI) in medical image analysis holds promise to augment the visual interpretation of medical images, which could not only automate the complicated evaluation process but also convert medical images into quantitative imaging features that associated with tumor heterogeneity.

Highlights

We briefly introduce the methodology of AI for medical image analysis and then review its clinical applications including clinical auxiliary diagnosis, assessment of treatment response, and prognosis prediction on 4 typical DSNs including esophageal cancer, gastric cancer, colorectal cancer, and hepatocellular carcinoma.

Conclusion

AI technology has great potential in supporting the clinical diagnosis and treatment decision-making of DSNs. Several technical issues should be overcome before its application into clinical practice of DSNs.

Radiomics in clinical trials: perspectives on standardization

The term biomarker is used to describe a biological measure of the disease behavior. The existing imaging biomarkers are associated with the known tissue biological characteristics and follow a well-established roadmap to be implemented in routine clinical practice. Recently, a new quantitative imaging analysis approach named radiomics has emerged. It refers to the extraction of a large number of advanced imaging features with high-throughput computing. Extensive research has demonstrated its value in predicting disease behavior, progression, and response to therapeutic options. However, there are numerous challenges to establishing it as a clinically viable solution, including lack of reproducibility and transparency. The data-driven nature also does not offer insights into the underpinning biology of the observed relationships. As such, additional effort is needed to establish it as a qualified biomarker to inform clinical decisions. Here we review the technical difficulties encountered in the clinical applications of radiomics and current effort in addressing some of these challenges in clinical trial designs. By addressing these challenges, the true potential of radiomics can be unleashed.

A methodological framework for AI-assisted diagnosis of active aortitis using radiomic analysis of FDG PET-CT images: Initial analysis

BACKGROUND

The aim of this study was to explore the feasibility of assisted diagnosis of active (peri-)aortitis using radiomic imaging biomarkers derived from [18F]-Fluorodeoxyglucose Positron Emission Tomography-Computed Tomography (FDG PET-CT) images.

METHODS

The aorta was manually segmented on FDG PET-CT in 50 patients with aortitis and 25 controls. Radiomic features (RF) (n = 107), including SUV (Standardized Uptake Value) metrics, were extracted from the segmented data and harmonized using the ComBat technique. Individual RFs and groups of RFs (i.e., signatures) were used as input in Machine Learning classifiers. The diagnostic utility of these classifiers was evaluated with area under the receiver operating characteristic curve (AUC) and accuracy using the clinical diagnosis as the ground truth.

RESULTS

Several RFs had high accuracy, 84% to 86%, and AUC scores 0.83 to 0.97 when used individually. Radiomic signatures performed similarly, AUC 0.80 to 1.00.

CONCLUSION

A methodological framework for a radiomic-based approach to support diagnosis of aortitis was outlined. Selected RFs, individually or in combination, showed similar performance to the current standard of qualitative assessment in terms of AUC for identifying active aortitis. This framework could support development of a clinical decision-making tool for a more objective and standardized assessment of aortitis.

A multi-modality physical phantom for mimicking tumour heterogeneity patterns in PET/CT and PET/MRI

Background

Hybrid imaging (e.g., positron emission tomography [PET]/computed tomography [CT], PET/magnetic resonance imaging [MRI]) helps one to visualize and quantify morphological and physiological tumor characteristics in a single study. The noninvasive characterization of tumor heterogeneity is essential for grading, treatment planning, and following‐up oncological patients. However, conventional (CONV) image‐based parameters, such as tumor diameter, tumor volume, and radiotracer activity uptake, are insufficient to describe tumor heterogeneities. Here, radiomics shows promise for a better characterization of tumors. Nevertheless, the validation of such methods demands imaging objects capable of reflecting heterogeneities in multi‐modality imaging. We propose a phantom to simulate tumor heterogeneity repeatably in PET, CT, and MRI.

Methods

The phantom consists of three 50‐ml plastic tubes filled partially with acrylic spheres of S1: 1.6 mm, S2: 50%(1.6 mm)/50%(6.3 mm), or S3: 6.3‐mm diameter. The spheres were fixed to the bottom of each tube by a plastic grid, yielding one sphere free homogeneous region and one heterogeneous (S1, S2, or S3) region per tube. A 3‐tube phantom and its replica were filled with a fluorodeoxyglucose (18F) solution for test–retest measurements in a PET/CT Siemens TPTV and a PET/MR Siemens Biograph mMR system. A number of 42 radiomic features (10 first order and 32 texture features) were calculated for each phantom region and imaging modality. Radiomic features stability was evaluated through coefficients of variation (COV) across phantoms and scans for PET, CT, and MRI. Further, the Wilcoxon test was used to assess the capability of stable features to discriminate the simulated phantom regions.

Results

The different patterns (S1–S3) did present visible heterogeneity in all imaging modalities. However, only for CT and MRI, a clear visual difference was present between the different patterns. Across all phantom regions in PET, CT, and MR images, 10, 16, and 21 features out of 42 evaluated features in total had a COV of 10% or less. In particular, CONV, histogram, and gray‐level run length matrix features showed high repeatability for all the phantom regions and imaging modalities. Several of repeatable texture features allowed the image‐based discrimination of the different phantom regions (p < 0.05). However, depending on the feature, different pattern discrimination capabilities were found for the different imaging modalities.

Conclusion

The proposed phantom appears suitable for simulating heterogeneities in PET, CT, and MRI. We demonstrate that it is possible to select radiomic features for the readout of the phantom. Most of these features had been shown to be relevant in previous clinical studies.

A tri-modal tissue-equivalent anthropomorphic phantom for PET, CT and multi-parametric MRI radiomics

PURPOSE

Radiomics has emerged as an advanced image processing methodology to define quantitative imaging biomarkers for prognosis and prediction of treatment response and outcome. The development of quantitative imaging biomarkers requires careful analysis to define their accuracy, stability and reproducibility through phantom measurements. Few efforts were devoted to develop realistic anthropomorphic phantoms. In this work, we developed a multimodality image phantom suitable for PET, CT and multiparametric MRI imaging.

METHODS

A tissue-equivalent gel-based mixture was designed and tested for compatibility with different imaging modalities. Calibration measurements allowed to assess gel composition to simulate PET, CT and MRI contrasts of oncological lesions. The characterized gel mixture was used to create realistic synthetic lesions (e.g. lesions with irregular shape and non-uniform image contrast), to be inserted in a standard anthropomorphic phantom. In order to show phantom usefulness, issues related to accuracy, stability and reproducibility of radiomic biomarkers were addressed as proofs-of-concept.

RESULTS

The procedure for gel preparation was straightforward and the characterized gel mixture allowed to mime simultaneously oncological lesion contrast in CT, PET and MRI imaging. Proofs-of-concept studies suggested that phantom measurements can be customized for specific clinical situations and radiomic protocols.

CONCLUSIONS

We developed a strategy to manufacture an anthropomorphic, tissue-equivalent, multimodal phantom to be customized on specific radiomics protocols, for addressing specific methodological issues both in mono and multicentric studies.

Noise-Based Image Harmonization Significantly Increases Repeatability and Reproducibility of Radiomics Features in PET Images: A Phantom Study

For multicenter clinical studies, characterizing the robustness of image-derived radiomics features is essential. Features calculated on PET images have been shown to be very sensitive to image noise. The purpose of this work was to investigate the efficacy of a relatively simple harmonization strategy on feature robustness and agreement. A purpose-built texture pattern phantom was scanned on 10 different PET scanners in 7 institutions with various different image acquisition and reconstruction protocols. An image harmonization technique based on equalizing a contrast-to-noise ratio was employed to generate a "harmonized" alongside a "standard" dataset for a reproducibility study. In addition, a repeatability study was performed with images from a single PET scanner of variable image noise, varying the binning time of the reconstruction. Feature agreement was measured using the intraclass correlation coefficient (ICC). In the repeatability study, 81/93 features had a lower ICC on the images with the highest image noise as compared to the images with the lowest image noise. Using the harmonized dataset significantly improved the feature agreement for five of the six investigated feature classes over the standard dataset. For three feature classes, high feature agreement corresponded with higher sensitivity to the different patterns, suggesting a way to select suitable features for predictive models.

Synergistic impact of motion and acquisition/reconstruction parameters on 18 F-FDG PET radiomic features in non-small cell lung cancer: phantom and clinical studies

Objectives

This study is aimed at examining the synergistic impact of motion and acquisition/reconstruction parameters on ¹⁸F‐FDG PET image radiomic features in non‐small cell lung cancer (NSCLC) patients, and investigating the robustness of features performance in differentiating NSCLC histopathology subtypes.

Methods

An in‐house developed thoracic phantom incorporating lesions with different sizes was used with different reconstruction settings, including various reconstruction algorithms, number of subsets and iterations, full‐width at half‐maximum of post‐reconstruction smoothing filter and acquisition parameters, including injected activity and test–retest with and without motion simulation. To simulate motion, a special motor was manufactured to simulate respiratory motion based on a normal patient in two directions. The lesions were delineated semi‐automatically to extract 174 radiomic features. All radiomic features were categorized according to the coefficient of variation (COV) to select robust features. A cohort consisting of 40 NSCLC patients with adenocarcinoma (n = 20) and squamous cell carcinoma (n = 20) was retrospectively analyzed. Statistical analysis was performed to discriminate robust features in differentiating histopathology subtypes of NSCLC lesions.

Results

Overall, 29% of radiomic features showed a COV ≤5% against motion. Forty‐five percent and 76% of the features showed a COV ≤ 5% against the test–retest with and without motion in large lesions, respectively. Thirty‐three percent and 45% of the features showed a COV ≤ 5% against different reconstruction parameters with and without motion, respectively. For NSCLC histopathological subtype differentiation, statistical analysis showed that 31 features were significant (p‐value < 0.05). Two out of the 31 significant features, namely, the joint entropy of GLCM (AUC = 0.71, COV = 0.019) and median absolute deviation of intensity histogram (AUC = 0.7, COV = 0.046), were robust against the motion (same reconstruction setting).

Conclusions

Motion, acquisition, and reconstruction parameters significantly impact radiomic features, just as their synergies. Radiomic features with high predictive performance (statistically significant) in differentiating histopathological subtype of NSCLC may be eliminated due to non‐reproducibility.

HeLLePhant: A phantom mimicking non-small cell lung cancer for texture analysis in CT images

PURPOSE

Phantoms mimicking human tissue heterogeneity and intensity are required to establish radiomic features robustness in Computed Tomography (CT) images. We developed inserts with two different techniques for the radiomic study of Non-Small Cell Lung Cancer (NSCLC) lesions.

METHODS

We developed two insert prototypes: two 3D-printed made of glycol-modified polyethylene terephthalate (PET-G), and nine with sodium polyacrylate plus iodinated contrast medium. The inserts were put in a handcraft phantom (HeLLePhant). We also analysed four materials of a commercial homogeneous phantom (Catphan® 424) and collected 29 NSCLC patients for comparison. All the CT acquisitions were performed with the same clinical protocol and scanner at 120kVp. The HeLLePhant phantom was scanned ten times in fixed condition at 120kVp and 100kVp for repeatability investigation. We extracted 153 radiomic features using Pyradiomics. To compare the features between phantoms and patients, we computed how many phantom features fell in the range between 10th and 90th percentile of the corresponding patient values. We deemed repeatable the features with a coefficient of variation (CV) less than or equal to 0.10.

RESULTS

The best similarity with the patients was obtained with the polyacrylate inserts (55.6-90.2%), the worst with Catphan (15.7-19.0%). For the PET-G inserts 35.3% and 36.6% of the features match the patient range. We found high repeatability for all the inserts of the HeLLePhant phantom (74.3-100% at 120kVp, 75.7-97.9% at 100kVp), and observed a texture dependency in repeatability.

CONCLUSIONS

Our study shows a promising way to construct heterogeneous inserts mimicking a target tissue for radiomic studies.

Radiomics feature reliability assessed by intraclass correlation coefficient: a systematic review

Radiomics research is rapidly growing in recent years, but more concerns on radiomics reliability are also raised. This review attempts to update and overview the current status of radiomics reliability research in the ever expanding medical literature from the perspective of a single reliability metric of intraclass correlation coefficient (ICC). To conduct this systematic review, Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were followed. After literature search and selection, a total of 481 radiomics studies using CT, PET, or MRI, covering a wide range of subject and disease types, were included for review. In these highly heterogeneous studies, feature reliability to image segmentation was much more investigated than reliability to other factors, such as image acquisition, reconstruction, post-processing, and feature quantification. The reported ICCs also suggested high radiomics feature reliability to image segmentation. Image acquisition was found to introduce much more feature variability than image segmentation, in particular for MRI, based on the reported ICC values. Image post-processing and feature quantification yielded different levels of radiomics reliability and might be used to mitigate image acquisition-induced variability. Some common flaws and pitfalls in ICC use were identified, and suggestions on better ICC use were given. Due to the extremely high study heterogeneities and possible risks of bias, the degree of radiomics feature reliability that has been achieved could not yet be safely synthesized or derived in this review. More future researches on radiomics reliability are warranted.

Preselection of robust radiomic features does not improve outcome modelling in non-small cell lung cancer based on clinical routine FDG-PET imaging

Background

Radiomics is a promising tool for identifying imaging-based biomarkers. Radiomics-based models are often trained on single-institution datasets; however, multi-centre imaging datasets are preferred for external generalizability owing to the influence of inter-institutional scanning differences and acquisition settings. The study aim was to determine the value of preselection of robust radiomic features in routine clinical positron emission tomography (PET) images to predict clinical outcomes in locally advanced non-small cell lung cancer (NSCLC).

Methods

A total of 1404 primary tumour radiomic features were extracted from pre-treatment [¹⁸F]fluorodeoxyglucose (FDG)-PET scans of stage IIIA/N2 or IIIB NSCLC patients using a training cohort (n = 79; prospective Swiss multi-centre randomized phase III trial SAKK 16/00; 16 centres) and an internal validation cohort (n = 31; single centre). Robustness studies investigating delineation variation, attenuation correction and motion were performed (intraclass correlation coefficient threshold > 0.9). Two 12-/24-month event-free survival (EFS) and overall survival (OS) logistic regression models were trained using standardized imaging: (1) with robust features alone and (2) with all available features. Models were then validated using fivefold cross-validation, and validation on a separate single-centre dataset. Model performance was assessed using area under the receiver operating characteristic curve (AUC).

Results

Robustness studies identified 179 stable features (13%), with 25% stable features for 3D versus 4D acquisition, 31% for attenuation correction and 78% for delineation. Univariable analysis found no significant robust features predicting 12-/24-month EFS and 12-month OS (p value > 0.076). Prognostic models without robust preselection performed well for 12-month EFS in training (AUC = 0.73) and validation (AUC = 0.74). Patient stratification into two risk groups based on 12-month EFS was significant for training (p value = 0.02) and validation cohorts (p value = 0.03).

Conclusions

A PET-based radiomics model using a standardized, multi-centre dataset to predict EFS in locally advanced NSCLC was successfully established and validated with good performance. Prediction models with robust feature preselection were unsuccessful, indicating the need for a standardized imaging protocol.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13550-021-00809-3.

Repeatability of 18F-FDG PET Radiomic Features in Cervical Cancer

Knowledge of the intrinsic variability of radiomic features is essential to the proper interpretation of changes in these features over time. The primary aim of this study was to assess the test-retest repeatability of radiomic features extracted from 18F-FDG PET images of cervical tumors. The impact of different image preprocessing methods was also explored. Methods: Patients with cervical cancer underwent baseline and repeat 18F-FDG PET/CT imaging within 7 d. PET images were reconstructed using 2 methods: ordered-subset expectation maximization (PETOSEM) or ordered-subset expectation maximization with point-spread function (PETPSF). Tumors were segmented to produce whole-tumor volumes of interest (VOIWT) and 40% isocontours (VOI40). Voxels were either left at the default size or resampled to 3-mm isotropic voxels. SUV was discretized to a fixed number of bins (32, 64, or 128). Radiomic features were extracted from both VOIs, and repeatability was then assessed using the Lin concordance correlation coefficient (CCC). Results: Eleven patients were enrolled and completed the test-retest PET/CT imaging protocol. Shape, neighborhood gray-level difference matrix, and gray-level cooccurrence matrix features were repeatable, with a mean CCC value of 0.81. Radiomic features extracted from PETOSEM images showed significantly better repeatability than features extracted from PETPSF images (P < 0.001). Radiomic features extracted from VOI40 were more repeatable than features extracted from VOIWT (P < 0.001). For most features (78.4%), a change in bin number or voxel size resulted in less than a 10% change in feature value. All gray-level emphasis and gray-level run emphasis features showed poor repeatability (CCC values < 0.52) when extracted from VOIWT but were highly repeatable (mean CCC values > 0.96) when extracted from VOI40Conclusion: Shape, gray-level cooccurrence matrix, and neighborhood gray-level difference matrix radiomic features were consistently repeatable, whereas gray-level run length matrix and gray-level zone length matrix features were highly variable. Radiomic features extracted from VOI40 were more repeatable than features extracted from VOIWT Changes in voxel size or SUV discretization parameters typically resulted in relatively small differences in feature value, though several features were highly sensitive to these changes.

AI applications to medical images: From machine learning to deep learning

PURPOSE

Artificial intelligence (AI) models are playing an increasing role in biomedical research and healthcare services. This review focuses on challenges points to be clarified about how to develop AI applications as clinical decision support systems in the real-world context.

METHODS

A narrative review has been performed including a critical assessment of articles published between 1989 and 2021 that guided challenging sections.

RESULTS

We first illustrate the architectural characteristics of machine learning (ML)/radiomics and deep learning (DL) approaches. For ML/radiomics, the phases of feature selection and of training, validation, and testing are described. DL models are presented as multi-layered artificial/convolutional neural networks, allowing us to directly process images. The data curation section includes technical steps such as image labelling, image annotation (with segmentation as a crucial step in radiomics), data harmonization (enabling compensation for differences in imaging protocols that typically generate noise in non-AI imaging studies) and federated learning. Thereafter, we dedicate specific sections to: sample size calculation, considering multiple testing in AI approaches; procedures for data augmentation to work with limited and unbalanced datasets; and the interpretability of AI models (the so-called black box issue). Pros and cons for choosing ML versus DL to implement AI applications to medical imaging are finally presented in a synoptic way.

CONCLUSIONS

Biomedicine and healthcare systems are one of the most important fields for AI applications and medical imaging is probably the most suitable and promising domain. Clarification of specific challenging points facilitates the development of such systems and their translation to clinical practice.

Deep Learning-Based Methods for Prostate Segmentation in Magnetic Resonance Imaging

Magnetic Resonance Imaging-based prostate segmentation is an essential task for adaptive radiotherapy and for radiomics studies whose purpose is to identify associations between imaging features and patient outcomes. Because manual delineation is a time-consuming task, we present three deep-learning (DL) approaches, namely UNet, efficient neural network (ENet), and efficient residual factorized convNet (ERFNet), whose aim is to tackle the fully-automated, real-time, and 3D delineation process of the prostate gland on T2-weighted MRI. While UNet is used in many biomedical image delineation applications, ENet and ERFNet are mainly applied in self-driving cars to compensate for limited hardware availability while still achieving accurate segmentation. We apply these models to a limited set of 85 manual prostate segmentations using the k-fold validation strategy and the Tversky loss function and we compare their results. We find that ENet and UNet are more accurate than ERFNet, with ENet much faster than UNet. Specifically, ENet obtains a dice similarity coefficient of 90.89% and a segmentation time of about 6 s using central processing unit (CPU) hardware to simulate real clinical conditions where graphics processing unit (GPU) is not always available. In conclusion, ENet could be efficiently applied for prostate delineation even in small image training datasets with potential benefit for patient management personalization.

Radiomics in medical imaging-"how-to" guide and critical reflection

Radiomics is a quantitative approach to medical imaging, which aims at enhancing the existing data available to clinicians by means of advanced mathematical analysis. Through mathematical extraction of the spatial distribution of signal intensities and pixel interrelationships, radiomics quantifies textural information by using analysis methods from the field of artificial intelligence. Various studies from different fields in imaging have been published so far, highlighting the potential of radiomics to enhance clinical decision-making. However, the field faces several important challenges, which are mainly caused by the various technical factors influencing the extracted radiomic features.The aim of the present review is twofold: first, we present the typical workflow of a radiomics analysis and deliver a practical "how-to" guide for a typical radiomics analysis. Second, we discuss the current limitations of radiomics, suggest potential improvements, and summarize relevant literature on the subject.

Physical imaging phantoms for simulation of tumor heterogeneity in PET, CT, and MRI: An overview of existing designs

BACKGROUND

In oncology, lesion characterization is essential for tumor grading, treatment planning, and follow-up of cancer patients. Hybrid imaging systems, such as Single Photon Emission Computed Tomography (SPECT)/CT, Positron Emission Tomography (PET)/CT, or PET/magnetic resonance imaging (MRI), play an essential role for the noninvasive quantification of tumor characteristics. However, most of the existing approaches are challenged by intra- and intertumor heterogeneity. Novel quantitative imaging parameters that can be derived from textural feature analysis (as part of radiomics) are promising complements for improved characterization of tumor heterogeneity, thus, supporting clinically relevant implementations of personalized medicine concepts. Nevertheless, establishing new quantitative parameters for tumor characterization requires the use of standardized imaging objects to test the reliability of results prior to their implementation in patient studies.

METHODS

In this review, we summarize existing reports on heterogeneous phantoms with a focus on simulating tumor heterogeneity. We discuss the techniques, materials, advantages, and limitations of the existing phantoms for PET, CT, and MR imaging modalities.

CONCLUSIONS

Finally, we outline the future directions and requirements for the design of cross modality imaging phantoms.

Impact of contouring variability on oncological PET radiomics features in the lung

Radiomics features extracted from oncological PET images are currently under intense scrutiny within the context of risk stratification for a variety of cancers. However, the lack of robustness assessment poses problems for their application across institutions and for broader patient populations. The objective of the current study was to examine the extent to which radiomics parameters from oncological PET vary in response to manual contouring variability in lung cancer. Imaging data employed in the study consisted of 26 PET scans with lesions in the lung being created through the use of an anthropomorphic phantom in conjunction with Monte Carlo simulations. From each of the simulated lesions, 25 radiomics features related to the gray-level co-occurrence matrices (GLCOM), gray-level size zone matrices (GLSZM), and gray-level neighborhood difference matrices (GLNDM) were extracted from ground truth contour and from manual contours provided by 10 raters in regard to four intensity discretization schemes with number of gray levels of 32, 64, 128, and 256, respectively. The impact of interrater variability in tumor delineation upon the agreement between raters on radiomics features was examined via interclass correlation and leave-p-out assessment. Only weak and moderate correlations were found between segmentation accuracy as measured by the Dice coefficient and percent feature error from ground truth for the vast majority of the features being examined. GLNDM-based texture parameters emerged as the top performing category of radiomcs features in terms of robustness against contouring variability for discretization schemes engaging number of gray levels of 32, 64, and 128 while GLCOM-based parameters stood out for discretization scheme engaging 256 gray levels. How and to what extent interrater reliability of radiomics features vary in response to the number of raters were largely feature-dependent. It was concluded that impact of contouring variability on PET-based radiomics features is present to varying degrees and could be experienced as a barrier to convey PET-based radiomics research to clinical relevance.

CT radiomics and PET radiomics: ready for clinical implementation?

INTRODUCTION

Today, rapid technical and clinical developments result in an increasing number of treatment options for oncological diseases. Thus, decision support systems are needed to offer the right treatment to the right patient. Imaging biomarkers hold great promise in patient-individual treatment guidance. Routinely performed for diagnosis and staging, imaging datasets are expected to hold more information than used in the clinical practice. Radiomics describes the extraction of a large number of meaningful quantitative features from medical images, such as computed tomography (CT) and positron emission tomography (PET). Due to the non-invasive nature and ability to capture 3D image-based heterogeneity, radiomic features are potential surrogate markers of the cancer phenotype. Several radiomic studies are published per day, owing to encouraging results of many radiomics-based patient outcome models. Despite this comparably large number of studies, radiomics is mainly studied in proof of principle concept. Hence, a translation of radiomics from a hot topic research field into an essential clinical decision-making tool is lacking, but of high clinical interest.

EVIDENCE ACQUISITION

Herein, we present a literature review addressing the clinical evidence of CT and PET radiomics. An extensive literature review was conducted in PubMed, including papers on robustness and clinical applications.

EVIDENCE SYNTHESIS

We summarize image-modality related influences on the robustness of radiomic features and provide an overview of clinical evidence reported in the literature. Today, more evidence has been provided for CT imaging, however, PET imaging offers the promise of direct imaging of biological processes and functions. We provide a summary of future research directions, which needs to be addressed in order to successfully introduce radiomics into clinical medicine. In comparison to CT, more focus should be directed towards harmonization of PET acquisition and reconstruction protocols, which is important for transferable modelling.

CONCLUSIONS

Both CT and PET radiomics are promising pre-treatment and intra-treatment biomarkers for outcome prediction. Most studies are performed in retrospective setting, however their validation in prospective data collections is ongoing.

AI-based applications in hybrid imaging: how to build smart and truly multi-parametric decision models for radiomics

INTRODUCTION

The quantitative imaging features (radiomics) that can be obtained from the different modalities of current-generation hybrid imaging can give complementary information with regard to the tumour environment, as they measure different morphologic and functional imaging properties. These multi-parametric image descriptors can be combined with artificial intelligence applications into predictive models. It is now the time for hybrid PET/CT and PET/MRI to take the advantage offered by radiomics to assess the added clinical benefit of using multi-parametric models for the personalized diagnosis and prognosis of different disease phenotypes.

OBJECTIVE

The aim of the paper is to provide an overview of current challenges and available solutions to translate radiomics into hybrid PET-CT and PET-MRI imaging for a smart and truly multi-parametric decision model.

Radiomics in nuclear medicine: robustness, reproducibility, standardization, and how to avoid data analysis traps and replication crisis

Radiomics in nuclear medicine is rapidly expanding. Reproducibility of radiomics studies in multicentre settings is an important criterion for clinical translation. We therefore performed a meta-analysis to investigate reproducibility of radiomics biomarkers in PET imaging and to obtain quantitative information regarding their sensitivity to variations in various imaging and radiomics-related factors as well as their inherent sensitivity. Additionally, we identify and describe data analysis pitfalls that affect the reproducibility and generalizability of radiomics studies. After a systematic literature search, 42 studies were included in the qualitative synthesis, and data from 21 were used for the quantitative meta-analysis. Data concerning measurement agreement and reliability were collected for 21 of 38 different factors associated with image acquisition, reconstruction, segmentation and radiomics-specific processing steps. Variations in voxel size, segmentation and several reconstruction parameters strongly affected reproducibility, but the level of evidence remained weak. Based on the meta-analysis, we also assessed inherent sensitivity to variations of 110 PET image biomarkers. SUV_mean and SUV_max were found to be reliable, whereas image biomarkers based on the neighbourhood grey tone difference matrix and most biomarkers based on the size zone matrix were found to be highly sensitive to variations, and should be used with care in multicentre settings. Lastly, we identify 11 data analysis pitfalls. These pitfalls concern model validation and information leakage during model development, but also relate to reporting and the software used for data analysis. Avoiding such pitfalls is essential for minimizing bias in the results and to enable reproduction and validation of radiomics studies.

The Applications of Radiomics in Precision Diagnosis and Treatment of Oncology: Opportunities and Challenges

Medical imaging can assess the tumor and its environment in their entirety, which makes it suitable for monitoring the temporal and spatial characteristics of the tumor. Progress in computational methods, especially in artificial intelligence for medical image process and analysis, has converted these images into quantitative and minable data associated with clinical events in oncology management. This concept was first described as radiomics in 2012. Since then, computer scientists, radiologists, and oncologists have gravitated towards this new tool and exploited advanced methodologies to mine the information behind medical images. On the basis of a great quantity of radiographic images and novel computational technologies, researchers developed and validated radiomic models that may improve the accuracy of diagnoses and therapy response assessments. Here, we review the recent methodological developments in radiomics, including data acquisition, tumor segmentation, feature extraction, and modelling, as well as the rapidly developing deep learning technology. Moreover, we outline the main applications of radiomics in diagnosis, treatment planning and evaluations in the field of oncology with the aim of developing quantitative and personalized medicine. Finally, we discuss the challenges in the field of radiomics and the scope and clinical applicability of these methods.