Integrating radiomics into holomics for personalised oncology: from algorithms to bedside

Performance and efficiency of machine learning models in analyzing capillary serum protein electrophoresis

BACKGROUND AND OBJECTIVE

Serum protein electrophoresis (SPEP) plays a critical role in diagnosing diseases associated with M-proteins. However, its clinical application is limited by a heavy reliance on experienced experts.

METHODS

A dataset comprising 85,026 SPEP outcomes was utilized to develop artificial intelligence diagnostic models for the classification and localization of M-proteins. These models were trained and validated using three data features, and their performance was evaluated using comprehensive metrics, including sensitivity, positive predictive value (PPV), specificity, negative predictive value (NPV), F1 score, accuracy, area under the receiver operating characteristic curve (AUC), Matthews correlation coefficient (MCC), and Intersection over Union (IoU). The best-performing machine learning (ML) and deep learning (DL) models were further tested on a separate dataset of 1,079 samples. The localization ability of the DL model was compared against three clinical experts.

RESULTS

Among the four ML models, the extreme gradient boosting (XGB) model achieved the best performance, with MCC, AUC, F1 score, sensitivity, specificity, accuracy, PPV, and NPV of 0.847, 0.903, 0.875, 0.822, 0.985, 0.951, 0.934, and 0.955, respectively. Different feature extraction methods significantly influenced model performance. The DL models outperformed the ML models in comprehensive performance. The U-Net combined with Transformer model demonstrated localization ability comparable to that of clinical experts, achieving sensitivity, specificity, accuracy, PPV, NPV, F1 score, AUC, MCC, and IoU of 0.947, 0.984, 0.976, 0.938, 0.986, 0.942, 0.966, 0.927, and 0.877, respectively.

CONCLUSION

The U-Net combined with the Transformer model demonstrated expert-level performance in M-protein classification and localization, achieving an accuracy of 0.976 and an IoU of 0.877. This exceptional performance highlights the potential of this combined model for automating clinical SPEP workflows.

Exploring radiomic features of lateral cerebral ventricles in postmortem CT for postmortem interval estimation

The aim of this study is to investigate the potential of radiomic features extracted from postmortem computed tomography (PMCT) scans of the lateral cerebral ventricles (LCVs) to provide information on the time since death, or postmortem interval (PMI), a critical aspect of forensic medicine. Periodic PMCT scans, referred to as "sequential scans", were obtained from twelve corpses with known times of death, ranging from 5.5 to 273 h postmortem. Radiomics features were then extracted from the LCVs, and a mixed-effect model, specifically designed for sequential data, was employed to assess the association between feature values and PMI. Four model variants were fitted to the data to identify the best functional form to explain the relationship between the variables. Significant associations were observed for features, the most significant being the median Hounsfield Units (HU) within the LCVs (p < 9.47 × 10⁻⁹), LCVs surface area (p < 4.69 × 10⁻⁶), L-major axis (p < 2.17 × 10⁻⁵), L-minor axis (p < 1.30 × 10⁻⁴), and HU entropy (p < 4.16 × 10⁻⁴). Our findings align with previous studies, supporting a logarithmic model for PMI-related changes in LCV volume and mean HU intensity value. This study highlights the potential of PMCT-based radiomics as source of complementary information that could be integrated into existing methods for PMI estimation. Our results support the application of a quantitative imaging approach in forensic investigations.

Holomics and Artificial Intelligence-Driven Precision Oncology for Medullary Thyroid Carcinoma: Addressing Challenges of a Rare and Aggressive Disease

Background/Objective: Medullary thyroid carcinoma (MTC) is a rare yet aggressive form of thyroid cancer comprising a disproportionate share of thyroid cancer-related mortalities, despite its low prevalence. MTC differs from other differentiated thyroid malignancies due to its heterogeneous nature, presenting complexities in both hereditary and sporadic cases. Traditional management guidelines, which are designed primarily for papillary thyroid carcinoma (PTC), fall short in providing the individualized care required for patients with MTC. In recent years, the sheer volume of data generated from clinical evaluations, radiological imaging, pathological assessments, genetic mutations, and immunological profiles has made it humanly impossible for clinicians to simultaneously analyze and integrate these diverse data streams effectively. This data deluge necessitates the adoption of advanced technologies to assist in decision-making processes. Holomics, which is an integrated approach that combines various omics technologies, along with artificial intelligence (AI), emerges as a powerful solution to address these challenges. Methods: This article reviews how AI-driven precision oncology can enhance the diagnostic workup, staging, risk stratification, management, and follow-up care of patients with MTC by processing vast amounts of complex data quickly and accurately. Articles published in English language and indexed in Pubmed were searched. Results: AI algorithms can identify patterns and correlations that may not be apparent to human clinicians, thereby improving the precision of personalized treatment plans. Moreover, the implementation of AI in the management of MTC enables the collation and synthesis of clinical experiences from across the globe, facilitating a more comprehensive understanding of the disease and its treatment outcomes. Conclusions: The integration of holomics and AI in the management of patients with MTC represents a significant advancement in precision oncology. This innovative approach not only addresses the complexities of a rare and aggressive disease but also paves the way for global collaboration and equitable healthcare solutions, ultimately transforming the landscape of treatment and care of patients with MTC. By leveraging AI and holomics, we can strive toward making personalized healthcare accessible to every individual, regardless of their economic status, thereby improving overall survival rates and quality of life for MTC patients worldwide. This global approach aligns with the United Nations Sustainable Development Goal 3, which aims to ensure healthy lives and promote well-being at all ages.

Imaging biobanks: operational limits, medical-legal and ethical reflections

The extraordinary growth of health technologies has determined an increasing interest in biobanks that represent a unique wealth for research, experimentation, and validation of new therapies. "Human" biobanks are repositories of various types of human biological samples. Through years the paradigm has shifted from spontaneous collections of biological material all over the world to institutional, organized, and well-structured forms. Imaging biobanks represent a novel field and are defined by European Society of Radiology as: "organized databases of medical images, and associated imaging biomarkers shared among multiple researchers, linked to other biorepositories". Modern radiology and nuclear medicine can provide multiple imaging biomarkers, that express the phenotype related to certain diseases, especially in oncology. Imaging biobanks, not a mere catalogue of bioimages associated to clinical data, involve advanced computer technologies to implement the emergent field of radiomics and radiogenomics. Since Europe hosts most of the biobanks, juridical and ethical framework, with a specific referral to Italy, is analyzed. Linking imaging biobanks to traditional ones appears to be a crucial step that needs to be driven by medical imaging community under clear juridical and ethical guidelines.

Artificial Intelligence-Based Management of Adult Chronic Myeloid Leukemia: Where Are We and Where Are We Going?

Artificial intelligence (AI) is emerging as a discipline capable of providing significant added value in Medicine, in particular in radiomic, imaging analysis, big dataset analysis, and also for generating virtual cohort of patients. However, in coping with chronic myeloid leukemia (CML), considered an easily managed malignancy after the introduction of TKIs which strongly improved the life expectancy of patients, AI is still in its infancy. Noteworthy, the findings of initial trials are intriguing and encouraging, both in terms of performance and adaptability to different contexts in which AI can be applied. Indeed, the improvement of diagnosis and prognosis by leveraging biochemical, biomolecular, imaging, and clinical data can be crucial for the implementation of the personalized medicine paradigm or the streamlining of procedures and services. In this review, we present the state of the art of AI applications in the field of CML, describing the techniques and objectives, and with a general focus that goes beyond Machine Learning (ML), but instead embraces the wider AI field. The present scooping review spans on publications reported in Pubmed from 2003 to 2023, and resulting by searching "chronic myeloid leukemia" and "artificial intelligence". The time frame reflects the real literature production and was not restricted. We also take the opportunity for discussing the main pitfalls and key points to which AI must respond, especially considering the critical role of the 'human' factor, which remains key in this domain.

Thyroid Cancer Radiomics: Navigating Challenges in a Developing Landscape

In a review from 2021 by Cao et al [...].

Preoperative prediction of cervical cancer survival using a high-resolution MRI-based radiomics nomogram

BACKGROUND

Cervical cancer patients receiving radiotherapy and chemotherapy require accurate survival prediction methods. The objective of this study was to develop a prognostic analysis model based on a radiomics score to predict overall survival (OS) in cervical cancer patients.

METHODS

Predictive models were developed using data from 62 cervical cancer patients who underwent radical hysterectomy between June 2020 and June 2021. Radiological features were extracted from T2-weighted (T2W), T1-weighted (T1W), and diffusion-weighted (DW) magnetic resonance images prior to treatment. We obtained the radiomics score (rad-score) using least absolute shrinkage and selection operator (LASSO) regression and Cox's proportional hazard model. We divided the patients into low- and high-risk groups according to the critical rad-score value, and generated a nomogram incorporating radiological features. We evaluated the model's prediction performance using area under the receiver operating characteristic (ROC) curve (AUC) and classified the participants into high- and low-risk groups based on radiological characteristics.

RESULTS

The 62 patients were divided into high-risk (n = 43) and low-risk (n = 19) groups based on the rad-score. Four feature parameters were selected via dimensionality reduction, and the scores were calculated after modeling. The AUC values of ROC curves for prediction of 3- and 5-year OS using the model were 0.84 and 0.93, respectively.

CONCLUSION

Our nomogram incorporating a combination of radiological features demonstrated good performance in predicting cervical cancer OS. This study highlights the potential of radiomics analysis in improving survival prediction for cervical cancer patients. However, further studies on a larger scale and external validation cohorts are necessary to validate its potential clinical utility.

Response heterogeneity as a new biomarker of treatment response in patients with neuroendocrine tumors

Aim: The RAISE project aimed to find a surrogate end point to predict treatment response early in patients with enteropancreatic neuroendocrine tumors (NET). Response heterogeneity, defined as the coexistence of responding and non-responding lesions, has been proposed as a predictive marker for progression-free survival (PFS) in patients with NETs. Patients & methods: Computerized tomography scans were analyzed from patients with multiple lesions in CLARINET (NCT00353496; n = 148/204). Cox regression analyses evaluated association between response heterogeneity, estimated using the standard deviation of the longest diameter ratio of target lesions, and NET progression. Results: Greater response heterogeneity at a given visit was associated with earlier progression thereafter: week 12 hazard ratio (HR; 95% confidence interval): 1.48 (1.20-1.82); p < 0.001; n = 148; week 36: 1.72 (1.32-2.24); p < 0.001; n = 108. HRs controlled for sum of longest diameter ratio: week 12: 1.28 (1.04-1.59); p = 0.020 and week 36: 1.81 (1.20-2.72); p = 0.005. Conclusion: Response heterogeneity independently predicts PFS in patients with enteropancreatic NETs. Further validation is required.

Artificial Intelligence in Oncological Hybrid Imaging

BACKGROUND

 Artificial intelligence (AI) applications have become increasingly relevant across a broad spectrum of settings in medical imaging. Due to the large amount of imaging data that is generated in oncological hybrid imaging, AI applications are desirable for lesion detection and characterization in primary staging, therapy monitoring, and recurrence detection. Given the rapid developments in machine learning (ML) and deep learning (DL) methods, the role of AI will have significant impact on the imaging workflow and will eventually improve clinical decision making and outcomes.

METHODS AND RESULTS

 The first part of this narrative review discusses current research with an introduction to artificial intelligence in oncological hybrid imaging and key concepts in data science. The second part reviews relevant examples with a focus on applications in oncology as well as discussion of challenges and current limitations.

CONCLUSION

 AI applications have the potential to leverage the diagnostic data stream with high efficiency and depth to facilitate automated lesion detection, characterization, and therapy monitoring to ultimately improve quality and efficiency throughout the medical imaging workflow. The goal is to generate reproducible, structured, quantitative diagnostic data for evidence-based therapy guidance in oncology. However, significant challenges remain regarding application development, benchmarking, and clinical implementation.

KEY POINTS

  · Hybrid imaging generates a large amount of multimodality medical imaging data with high complexity and depth.. · Advanced tools are required to enable fast and cost-efficient processing along the whole radiology value chain.. · AI applications promise to facilitate the assessment of oncological disease in hybrid imaging with high quality and efficiency for lesion detection, characterization, and response assessment. The goal is to generate reproducible, structured, quantitative diagnostic data for evidence-based oncological therapy guidance.. · Selected applications in three oncological entities (lung, prostate, and neuroendocrine tumors) demonstrate how AI algorithms may impact imaging-based tasks in hybrid imaging and potentially guide clinical decision making..

The use of deep learning models to predict progression-free survival in patients with neuroendocrine tumors

Aim: The RAISE project assessed whether deep learning could improve early progression-free survival (PFS) prediction in patients with neuroendocrine tumors. Patients & methods: Deep learning models extracted features from CT scans from patients in CLARINET (NCT00353496) (n = 138/204). A Cox model assessed PFS prediction when combining deep learning with the sum of longest diameter ratio (SLDr) and logarithmically transformed CgA concentration (logCgA), versus SLDr and logCgA alone. Results: Deep learning models extracted features other than lesion shape to predict PFS at week 72. No increase in performance was achieved with deep learning versus SLDr and logCgA models alone. Conclusion: Deep learning models extracted relevant features to predict PFS, but did not improve early prediction based on SLDr and logCgA.

Sensitivity of standardised radiomics algorithms to mask generation across different software platforms

The field of radiomics continues to converge on a standardised approach to image processing and feature extraction. Conventional radiomics requires a segmentation. Certain features can be sensitive to small contour variations. The industry standard for medical image communication stores contours as coordinate points that must be converted to a binary mask before image processing can take place. This study investigates the impact that the process of converting contours to mask can have on radiomic features calculation. To this end we used a popular open dataset for radiomics standardisation and we compared the impact of masks generated by importing the dataset into 4 medical imaging software. We interfaced our previously standardised radiomics platform with these software using their published application programming interface to access image volume, masks and other data needed to calculate features. Additionally, we used super-sampling strategies to systematically evaluate the impact of contour data pre processing methods on radiomic features calculation. Finally, we evaluated the effect that using different mask generation approaches could have on patient clustering in a multi-center radiomics study. The study shows that even when working on the same dataset, mask and feature discrepancy occurs depending on the contour to mask conversion technique implemented in various medical imaging software. We show that this also affects patient clustering and potentially radiomic-based modelling in multi-centre studies where a mix of mask generation software is used. We provide recommendations to negate this issue and facilitate reproducible and reliable radiomics.

Prediction of pathological response after neoadjuvant chemotherapy using baseline FDG PET heterogeneity features in breast cancer

Complete pathological response to neoadjuvant systemic treatment (NAST) in some subtypes of breast cancer (BC) has been used as a surrogate of long-term outcome. The possibility of predicting BC pathological response to NAST based on the baseline 18F-Fluorodeoxyglucose positron emission tomography (FDG PET), without the need of an interim study, is a focus of recent discussion. This review summarises the characteristics and results of the available studies regarding the potential impact of heterogeneity features of the primary tumour burden on baseline FDG PET in predicting pathological response to NAST in BC patients. Literature search was conducted on PubMed database and relevant data from each selected study were collected. A total of 13 studies were eligible for inclusion, all of them published over the last 5 years. Eight out of 13 analysed studies indicated an association between FDG PET-based tumour uptake heterogeneity features and prediction of response to NAST. When features associated with predicting response to NAST were derived, these varied between studies. Therefore, definitive reproducible findings across series were difficult to establish. This lack of consensus may reflect the heterogeneity and low number of included series. The clinical relevance of this topic justifies further investigation about the predictive role of baseline FDG PET.

Artificial Intelligence in Oncological Hybrid Imaging

BACKGROUND

Artificial intelligence (AI) applications have become increasingly relevant across a broad spectrum of settings in medical imaging. Due to the large amount of imaging data that is generated in oncological hybrid imaging, AI applications are desirable for lesion detection and characterization in primary staging, therapy monitoring, and recurrence detection. Given the rapid developments in machine learning (ML) and deep learning (DL) methods, the role of AI will have significant impact on the imaging workflow and will eventually improve clinical decision making and outcomes.

METHODS AND RESULTS

The first part of this narrative review discusses current research with an introduction to artificial intelligence in oncological hybrid imaging and key concepts in data science. The second part reviews relevant examples with a focus on applications in oncology as well as discussion of challenges and current limitations.

CONCLUSION

AI applications have the potential to leverage the diagnostic data stream with high efficiency and depth to facilitate automated lesion detection, characterization, and therapy monitoring to ultimately improve quality and efficiency throughout the medical imaging workflow. The goal is to generate reproducible, structured, quantitative diagnostic data for evidence-based therapy guidance in oncology. However, significant challenges remain regarding application development, benchmarking, and clinical implementation.

KEY POINTS

· Hybrid imaging generates a large amount of multimodality medical imaging data with high complexity and depth.. · Advanced tools are required to enable fast and cost-efficient processing along the whole radiology value chain.. · AI applications promise to facilitate the assessment of oncological disease in hybrid imaging with high quality and efficiency for lesion detection, characterization, and response assessment. The goal is to generate reproducible, structured, quantitative diagnostic data for evidence-based oncological therapy guidance.. · Selected applications in three oncological entities (lung, prostate, and neuroendocrine tumors) demonstrate how AI algorithms may impact imaging-based tasks in hybrid imaging and potentially guide clinical decision making..

CITATION FORMAT

· Feuerecker B, Heimer M, Geyer T et al. Artificial Intelligence in Oncological Hybrid Imaging. Fortschr Röntgenstr 2023; 195: 105 - 114.

Current Role of Delta Radiomics in Head and Neck Oncology

The latest developments in the management of head and neck cancer show an increasing trend in the implementation of novel approaches using artificial intelligence for better patient stratification and treatment-related risk evaluation. Radiomics, or the extraction of data from various imaging modalities, is a tool often used to evaluate specific features related to the tumour or normal tissue that are not identifiable by the naked eye and which can add value to existing clinical data. Furthermore, the assessment of feature variations from one time point to another based on subsequent images, known as delta radiomics, was shown to have even higher value for treatment-outcome prediction or patient stratification into risk categories. The information gathered from delta radiomics can, further, be used for decision making regarding treatment adaptation or other interventions found to be beneficial to the patient. The aim of this work is to collate the existing studies on delta radiomics in head and neck cancer and evaluate its role in tumour response and normal-tissue toxicity predictions alike. Moreover, this work also highlights the role of holomics, which brings under the same umbrella clinical and radiomic features, for a more complex patient characterization and treatment optimisation.

NAVIGATOR: an Italian regional imaging biobank to promote precision medicine for oncologic patients

NAVIGATOR is an Italian regional project boosting precision medicine in oncology with the aim of making it more predictive, preventive, and personalised by advancing translational research based on quantitative imaging and integrative omics analyses. The project’s goal is to develop an open imaging biobank for the collection and preservation of a large amount of standardised imaging multimodal datasets, including computed tomography, magnetic resonance imaging, and positron emission tomography data, together with the corresponding patient-related and omics-related relevant information extracted from regional healthcare services using an adapted privacy-preserving model. The project is based on an open-source imaging biobank and an open-science oriented virtual research environment (VRE). Available integrative omics and multi-imaging data of three use cases (prostate cancer, rectal cancer, and gastric cancer) will be collected. All data confined in NAVIGATOR (i.e., standard and novel imaging biomarkers, non-imaging data, health agency data) will be used to create a digital patient model, to support the reliable prediction of the disease phenotype and risk stratification. The VRE that relies on a well-established infrastructure, called D4Science.org, will further provide a multiset infrastructure for processing the integrative omics data, extracting specific radiomic signatures, and for identification and testing of novel imaging biomarkers through big data analytics and artificial intelligence.

Value assessment of artificial intelligence in medical imaging: a scoping review

BACKGROUND

Artificial intelligence (AI) is seen as one of the major disrupting forces in the future healthcare system. However, the assessment of the value of these new technologies is still unclear, and no agreed international health technology assessment-based guideline exists. This study provides an overview of the available literature in the value assessment of AI in the field of medical imaging.

METHODS

We performed a systematic scoping review of published studies between January 2016 and September 2020 using 10 databases (Medline, Scopus, ProQuest, Google Scholar, and six related databases of grey literature). Information about the context (country, clinical area, and type of study) and mentioned domains with specific outcomes and items were extracted. An existing domain classification, from a European assessment framework, was used as a point of departure, and extracted data were grouped into domains and content analysis of data was performed covering predetermined themes.

RESULTS

Seventy-nine studies were included out of 5890 identified articles. An additional seven studies were identified by searching reference lists, and the analysis was performed on 86 included studies. Eleven domains were identified: (1) health problem and current use of technology, (2) technology aspects, (3) safety assessment, (4) clinical effectiveness, (5) economics, (6) ethical analysis, (7) organisational aspects, (8) patients and social aspects, (9) legal aspects, (10) development of AI algorithm, performance metrics and validation, and (11) other aspects. The frequency of mentioning a domain varied from 20 to 78% within the included papers. Only 15/86 studies were actual assessments of AI technologies. The majority of data were statements from reviews or papers voicing future needs or challenges of AI research, i.e. not actual outcomes of evaluations.

CONCLUSIONS

This review regarding value assessment of AI in medical imaging yielded 86 studies including 11 identified domains. The domain classification based on European assessment framework proved useful and current analysis added one new domain. Included studies had a broad range of essential domains about addressing AI technologies highlighting the importance of domains related to legal and ethical aspects.

Radiomic and Volumetric Measurements as Clinical Trial Endpoints—A Comprehensive Review

Simple Summary

The extraction of quantitative data from standard-of-care imaging modalities offers opportunities to improve the relevance and salience of imaging biomarkers used in drug development. This review aims to identify the challenges and opportunities for discovering new imaging-based biomarkers based on radiomic and volumetric assessment in the single-site solid tumor sites: breast cancer, rectal cancer, lung cancer and glioblastoma. Developing approaches to harmonize three essential areas: segmentation, validation and data sharing may expedite regulatory approval and adoption of novel cancer imaging biomarkers.

Abstract

Clinical trials for oncology drug development have long relied on surrogate outcome biomarkers that assess changes in tumor burden to accelerate drug registration (i.e., Response Evaluation Criteria in Solid Tumors version 1.1 (RECIST v1.1) criteria). Drug-induced reduction in tumor size represents an imperfect surrogate marker for drug activity and yet a radiologically determined objective response rate is a widely used endpoint for Phase 2 trials. With the addition of therapies targeting complex biological systems such as immune system and DNA damage repair pathways, incorporation of integrative response and outcome biomarkers may add more predictive value. We performed a review of the relevant literature in four representative tumor types (breast cancer, rectal cancer, lung cancer and glioblastoma) to assess the preparedness of volumetric and radiomics metrics as clinical trial endpoints. We identified three key areas—segmentation, validation and data sharing strategies—where concerted efforts are required to enable progress of volumetric- and radiomics-based clinical trial endpoints for wider clinical implementation.

Could 18-FDG PET-CT Radiomic Features Predict the Locoregional Progression-Free Survival in Inoperable or Unresectable Oesophageal Cancer?

Background: We evaluated the value of pre-treatment positron-emission tomography−computed tomography (PET-CT)-based radiomic features in predicting the locoregional progression-free survival (LR-PFS) of patients with inoperable or unresectable oesophageal cancer. Material and Methods: Forty-six patients were included and 230 radiomic parameters were extracted. After a principal component analysis (PCA), we identified the more robust radiomic parameters, and we used them to develop a heatmap. Finally, we correlated these radiomic features with LR-PFS. Results: The median follow-up time was 17 months. The two-year LR-PFS and PFS rates were 35.9% (95% CI: 18.9−53.3) and 21.6% (95%CI: 10.0−36.2), respectively. After the correlation analysis, we identified 55 radiomic parameters that were included in the heatmap. According to the results of the hierarchical clustering, we identified two groups of patients presenting statistically different median LR-PFSs (22.8 months vs. 9.9 months; HR = 2.64; 95% CI 0.97−7.15; p = 0.0573). We also identified two radiomic features (“F_rlm_rl_entr_per” and “F_rlm_2_5D_rl_entr”) significantly associated with LR-PFS. Patients expressing a “F_rlm_2_5D_rl_entr” of <3.3 had a better median LR- PFS (29.4 months vs. 8.2 months; p = 0.0343). Patients presenting a “F_rlm_rl_entr_per” of <4.7 had a better median LR-PFS (50.4 months vs. 9.9 months; p = 0.0132). Conclusion: We identified two radiomic signatures associated with a lower risk of locoregional relapse after CRT.

The Usefulness of Radiomics Methodology for Developing Descriptive and Prognostic Image-Based Phenotyping in the Aging Population: Results From a Small Feasibility Study

Background: Radiomics is an emerging field that translates medical images into quantitative data to enable phenotypic profiling of human disease. In this retrospective study, we asked whether it is possible to use image-based phenotyping to describe and determine prognostic factors in the aging population.

Methods: A radiomic frailty cohort with 101 patients was included in the analysis (65 ± 15 years, 55 men). A total of 44 texture features were extracted from the segmented muscle area of the ultrasound images of the anterior thigh. Univariate and multivariate analyses were performed to assess the image data sets and clinical data.

Results: Our results showed that the heterogeneity of muscle was associated with an increased incidence of hearing impairment, stroke, myocardial infarction, dementia/memory loss, and falls in the following two years. Regression analysis revealed a muscle radiomic model with 87.1% correct predictive value with good sensitivity and moderate specificity (p = 0.001).

Conclusion: It is possible to develop and identify image-based phenotypes in the elderly population. The muscle radiomic model needs to further be validated. Future studies correlated with biological data (genomics, transcriptomics, metabolomics, etc.) will give further insights into the biological basis and molecular processes of the developed radiomic model.

Radiomics and artificial intelligence in prostate cancer: new tools for molecular hybrid imaging and theragnostics

In prostate cancer (PCa), the use of new radiopharmaceuticals has improved the accuracy of diagnosis and staging, refined surveillance strategies, and introduced specific and personalized radioreceptor therapies. Nuclear medicine, therefore, holds great promise for improving the quality of life of PCa patients, through managing and processing a vast amount of molecular imaging data and beyond, using a multi-omics approach and improving patients’ risk-stratification for tailored medicine. Artificial intelligence (AI) and radiomics may allow clinicians to improve the overall efficiency and accuracy of using these “big data” in both the diagnostic and theragnostic field: from technical aspects (such as semi-automatization of tumor segmentation, image reconstruction, and interpretation) to clinical outcomes, improving a deeper understanding of the molecular environment of PCa, refining personalized treatment strategies, and increasing the ability to predict the outcome. This systematic review aims to describe the current literature on AI and radiomics applied to molecular imaging of prostate cancer.

What Genetics Can Do for Oncological Imaging: A Systematic Review of the Genetic Validation Data Used in Radiomics Studies

(1) Background: Radiogenomics is motivated by the concept that biomedical images contain information that reflects underlying pathophysiology. This review focused on papers that used genetics to validate their radiomics models and outcomes and assess their contribution to this emerging field. (2) Methods: All original research with the words radiomics and genomics in English and performed in humans up to 31 January 2022, were identified on Medline and Embase. The quality of the studies was assessed with Radiomic Quality Score (RQS) and the Cochrane recommendation for diagnostic accuracy study Quality Assessment 2. (3) Results: 45 studies were included in our systematic review, and more than 50% were published in the last two years. The studies had a mean RQS of 12, and the studied tumors were very diverse. Up to 83% investigated the prognosis as the main outcome, with the rest focusing on response to treatment and risk assessment. Most applied either transcriptomics (54%) and/or genetics (35%) for genetic validation. (4) Conclusions: There is enough evidence to state that new science has emerged, focusing on establishing an association between radiological features and genomic/molecular expression to explain underlying disease mechanisms and enhance prognostic, risk assessment, and treatment response radiomics models in cancer patients.

NSCLC Biomarkers to Predict Response to Immunotherapy with Checkpoint Inhibitors (ICI): From the Cells to In Vivo Images

Lung cancer remains the leading cause of cancer-related death, and it is usually diagnosed in advanced stages (stage III or IV). Recently, the availability of targeted strategies and of immunotherapy with checkpoint inhibitors (ICI) has favorably changed patient prognosis. Treatment outcome is closely related to tumor biology and interaction with the tumor immune microenvironment (TME). While the response in molecular targeted therapies relies on the presence of specific genetic alterations in tumor cells, accurate ICI biomarkers of response are lacking, and clinical outcome likely depends on multiple factors that are both host and tumor-related. This paper is an overview of the ongoing research on predictive factors both from in vitro/ex vivo analysis (ranging from conventional pathology to molecular biology) and in vivo analysis, where molecular imaging is showing an exponential growth and use due to technological advancements and to the new bioinformatics approaches applied to image analyses that allow the recovery of specific features in specific tumor subclones.

The Challenge of Choosing the Best Classification Method in Radiomic Analyses: Recommendations and Applications to Lung Cancer CT Images

Radiomics uses high-dimensional sets of imaging features to predict biological characteristics of tumors and clinical outcomes. The choice of the algorithm used to analyze radiomic features and perform predictions has a high impact on the results, thus the identification of adequate machine learning methods for radiomic applications is crucial. In this study we aim to identify suitable approaches of analysis for radiomic-based binary predictions, according to sample size, outcome balancing and the features-outcome association strength. Simulated data were obtained reproducing the correlation structure among 168 radiomic features extracted from Computed Tomography images of 270 Non-Small-Cell Lung Cancer (NSCLC) patients and the associated to lymph node status. Performances of six classifiers combined with six feature selection (FS) methods were assessed on the simulated data using AUC (Area Under the Receiver Operating Characteristics Curves), sensitivity, and specificity. For all the FS methods and regardless of the association strength, the tree-based classifiers Random Forest and Extreme Gradient Boosting obtained good performances (AUC ≥ 0.73), showing the best trade-off between sensitivity and specificity. On small samples, performances were generally lower than in large-medium samples and with larger variations. FS methods generally did not improve performances. Thus, in radiomic studies, we suggest evaluating the choice of FS and classifiers, considering specific sample size, balancing, and association strength.

Machine learning-based radiomic evaluation of treatment response prediction in glioblastoma

AIM

To investigate machine learning based models combining clinical, radiomic, and molecular information to distinguish between early true progression (tPD) and pseudoprogression (psPD) in patients with glioblastoma.

MATERIALS AND METHODS

A retrospective analysis was undertaken of 76 patients (46 tPD, 30 psPD) with early enhancing disease following chemoradiotherapy for glioblastoma. Outcome was determined on follow-up until 6 months post-chemoradiotherapy. Models comprised clinical characteristics, O⁶-methylguanine-DNA methyltransferase (MGMT) promoter methylation status, and 307 quantitative imaging features extracted from enhancing disease and perilesional oedema masks on early post-chemoradiotherapy contrast-enhanced T1-weighted imaging, T2-weighted imaging (T2WI), and apparent diffusion coefficient (ADC) maps. Feature selection was performed within bootstrapped cross-validated recursive feature elimination with a random forest algorithm. Naive Bayes five-fold cross-validation was used to validate the final model.

RESULTS

Top selected features included age, MGMT promoter methylation status, two shape-based features from the enhancing disease mask, three radiomic features from the enhancing disease mask on ADC, and one radiomic feature from the perilesional oedema mask on T2WI. The final model had an area under the receiver operating characteristics curve (AUC) of 0.80, sensitivity 78.2%, specificity 66.7%, and accuracy of 73.7%.

CONCLUSION

Incorporating a machine learning-based approach using quantitative radiomic features from standard-of-care magnetic resonance imaging (MRI), in combination with clinical characteristics and MGMT promoter methylation status has a complementary effect and improves model performance for early prediction of glioblastoma treatment response.

Machine intelligence for precision oncology

Despite various advances in cancer research, the incidence and mortality rates of malignant diseases have remained high. Accurate risk assessment, prevention, detection, and treatment of cancer tailored to the individual are major challenges in clinical oncology. Artificial intelligence (AI), a field of applied computer science, has shown promising potential of accelerating evolution of healthcare towards precision oncology. This article focuses on highlights of the application of data-driven machine learning (ML) and deep learning (DL) in translational research for cancer diagnosis, prognosis, treatment, and clinical outcomes. ML-based algorithms in radiological and histological images have been demonstrated to improve detection and diagnosis of cancer. DL-based prediction models in molecular or multi-omics datasets of cancer for biomarkers and targets enable drug discovery and treatment. ML approaches combining radiomics with genomics and other omics data enhance the power of AI in improving diagnosis, prognostication, and treatment of cancer. Ethical and regulatory issues involving patient confidentiality and data security impose certain limitations on practical implementation of ML in clinical oncology. However, the ultimate goal of application of AI in cancer research is to develop and implement multi-modal machine intelligence for improving clinical decision on individualized management of patients.

Breast Tumor Characterization Using [18F]FDG-PET/CT Imaging Combined with Data Preprocessing and Radiomics

Simple Summary

Breast cancer is the second most common diagnosed malignancy in women worldwide. In this study, we examine the feasibility of breast tumor characterization based on [¹⁸F]FDG-PET/CT images using machine learning (ML) approaches in combination with data-preprocessing techniques. ML prediction models for breast cancer detection and the identification of breast cancer receptor status, proliferation rate, and molecular subtypes were established and evaluated. Furthermore, the importance of most repeatable features was investigated. Results displayed high performance of malignant/benign tumor differentiation and triple negative tumor subtype ML models. We observed high repeatability of radiomic features for both high performing predictive models.

Abstract

Background: This study investigated the performance of ensemble learning holomic models for the detection of breast cancer, receptor status, proliferation rate, and molecular subtypes from [¹⁸F]FDG-PET/CT images with and without incorporating data pre-processing algorithms. Additionally, machine learning (ML) models were compared with conventional data analysis using standard uptake value lesion classification. Methods: A cohort of 170 patients with 173 breast cancer tumors (132 malignant, 38 benign) was examined with [¹⁸F]FDG-PET/CT. Breast tumors were segmented and radiomic features were extracted following the imaging biomarker standardization initiative (IBSI) guidelines combined with optimized feature extraction. Ensemble learning including five supervised ML algorithms was utilized in a 100-fold Monte Carlo (MC) cross-validation scheme. Data pre-processing methods were incorporated prior to machine learning, including outlier and borderline noisy sample detection, feature selection, and class imbalance correction. Feature importance in each model was assessed by calculating feature occurrence by the R-squared method across MC folds. Results: Cross validation demonstrated high performance of the cancer detection model (80% sensitivity, 78% specificity, 80% accuracy, 0.81 area under the curve (AUC)), and of the triple negative tumor identification model (85% sensitivity, 78% specificity, 82% accuracy, 0.82 AUC). The individual receptor status and luminal A/B subtype models yielded low performance (0.46–0.68 AUC). SUV_max model yielded 0.76 AUC in cancer detection and 0.70 AUC in predicting triple negative subtype. Conclusions: Predictive models based on [¹⁸F]FDG-PET/CT images in combination with advanced data pre-processing steps aid in breast cancer diagnosis and in ML-based prediction of the aggressive triple negative breast cancer subtype.

A Decision Support System Based on BI-RADS and Radiomic Classifiers to Reduce False Positive Breast Calcifications at Digital Breast Tomosynthesis: A Preliminary Study

Digital breast tomosynthesis (DBT) studies were introduced as a successful help for the detection of calcification, which can be a primary sign of cancer. Expert radiologists are able to detect suspicious calcifications in DBT, but a high number of calcifications with non-malignant diagnosis at biopsy have been reported (false positives, FP). In this study, a radiomic approach was developed and applied on DBT images with the aim to reduce the number of benign calcifications addressed to biopsy and to give the radiologists a helpful decision support system during their diagnostic activity. This allows personalizing patient management on the basis of personalized risk. For this purpose, 49 patients showing microcalcifications on DBT images were retrospectively included, classified by BI-RADS (Breast Imaging-Reporting and Data System) and analyzed. After segmentation of microcalcifications from DBT images, radiomic features were extracted. Features were then selected with respect to their stability within different segmentations and their repeatability in test–retest studies. Stable radiomic features were used to train, validate and test (nested 10-fold cross-validation) a preliminary machine learning radiomic classifier that, combined with BI-RADS classification, allowed a reduction in FP of a factor of 2 and an improvement in positive predictive value of 50%.

Impact of segmentation and discretization on radiomic features in 68Ga-DOTA-TOC PET/CT images of neuroendocrine tumor

OBJECTIVE

To identify the impact of segmentation methods and intensity discretization on radiomic features (RFs) extraction from 68Ga-DOTA-TOC PET images in patients with neuroendocrine tumors.

METHODS

Forty-nine patients were retrospectively analyzed. Tumor contouring was performed manually by four different operators and with a semi-automatic edge-based segmentation (SAEB) algorithm. Three SUVmax fixed thresholds (20, 30, 40%) were applied. Fifty-one RFs were extracted applying two different intensity rescale factors for gray-level discretization: one absolute (AR60 = SUV from 0 to 60) and one relative (RR = min-max of the VOI SUV). Dice similarity coefficient (DSC) was calculated to quantify segmentation agreement between different segmentation methods. The impact of segmentation and discretization on RFs was assessed by intra-class correlation coefficients (ICC) and the coefficient of variance (COVL). The RFs' correlation with volume and SUVmax was analyzed by calculating Pearson's correlation coefficients.

RESULTS

DSC mean value was 0.75 ± 0.11 (0.45-0.92) between SAEB and operators and 0.78 ± 0.09 (0.36-0.97), among the four manual segmentations. The study showed high robustness (ICC > 0.9): (a) in 64.7% of RFs for segmentation methods using AR60, improved by applying SUVmax threshold of 40% (86.5%); (b) in 50.9% of RFs for different SUVmax thresholds using AR60; and (c) in 37% of RFs for discretization settings using different segmentation methods. Several RFs were not correlated with volume and SUVmax.

CONCLUSIONS

RFs robustness to manual segmentation resulted higher in NET 68Ga-DOTA-TOC images compared to 18F-FDG PET/CT images. Forty percent SUVmax thresholds yield superior RFs stability among operators, however leading to a possible loss of biological information. SAEB segmentation appears to be an optimal alternative to manual segmentation, but further validations are needed. Finally, discretization settings highly impacted on RFs robustness and should always be stated.

Identification of robust and reproducible CT-texture metrics using a customized 3D-printed texture phantom

OBJECTIVE

The objective of this study was to evaluate the robustness and reproducibility of computed tomography-based texture analysis (CTTA) metrics extracted from CT images of a customized texture phantom built for assessing the association of texture metrics to three-dimensional (3D) printed progressively increasing textural heterogeneity.

MATERIALS AND METHODS

A custom-built 3D-printed texture phantom comprising of six texture patterns was used to evaluate the robustness and reproducibility of a radiomics panel under a variety of routine abdominal imaging protocols. The phantom was scanned on four CT scanners (Philips, Canon, GE, and Siemens) to assess reproducibility. The robustness assessment was conducted by imaging the texture phantom across different CT imaging parameters such as slice thickness, field of view (FOV), tube voltage, and tube current for each scanner. The texture panel comprised of 387 features belonging to 15 subgroups of texture extraction methods (e.g., Gray-level Co-occurrence Matrix: GLCM). Twelve unique image settings were tested on all the four scanners (e.g., FOV125). Interclass correlation two-way mixed with absolute agreement (ICC3) was used to assess the robustness and reproducibility of radiomic features. Linear regression was used to test the association between change in radiomic features and increased texture heterogeneity. Results were summarized in heat maps.

RESULTS

A total of 5612 (23.2%) of 24 090 features showed excellent robustness and reproducibility (ICC ≥ 0.9). Intensity, GLCM 3D, and gray-level run length matrix (GLRLM) 3D features showed best performance. Among imaging variables, changes in slice thickness affected all metrics more intensely compared to other imaging variables in reducing the ICC3. From the analysis of linear trend effect of the CTTA metrics, the top three metrics with high linear correlations across all scanners and scanning settings were from the GLRLM 2D/3D and discrete cosine transform (DCT) texture family.

CONCLUSION

The choice of scanner and imaging protocols affect texture metrics. Furthermore, not all CTTA metrics have a linear association with linearly varying texture patterns.

The Challenge of Evaluating Response to Peptide Receptor Radionuclide Therapy in Gastroenteropancreatic Neuroendocrine Tumors: The Present and the Future

The NETTER-1 study has proven peptide receptor radionuclide therapy (PRRT) to be one of the most effective therapeutic options for metastatic neuroendocrine tumors (NETs), improving progression-free survival and overall survival. However, PRRT response assessment is challenging and no consensus on methods and timing has yet been reached among experts in the field. This issue is owed to the suboptimal sensitivity and specificity of clinical biomarkers, limitations of morphological response criteria in slowly growing tumors and necrotic changes after therapy, a lack of standardized parameters and timing of functional imaging and the heterogeneity of PRRT protocols in the literature. The aim of this article is to review the most relevant current approaches for PRRT efficacy prediction and response assessment criteria in order to provide an overview of suitable tools for safe and efficacious PRRT.

Artificial intelligence and hybrid imaging: the best match for personalized medicine in oncology

Artificial intelligence (AI) refers to a field of computer science aimed to perform tasks typically requiring human intelligence. Currently, AI is recognized in the broader technology radar within the five key technologies which emerge for their wide-ranging applications and impact in communities, companies, business, and value chain framework alike. However, AI in medical imaging is at an early phase of development, and there are still hurdles to take related to reliability, user confidence, and adoption. The present narrative review aimed to provide an overview on AI-based approaches (distributed learning, statistical learning, computer-aided diagnosis and detection systems, fully automated image analysis tool, natural language processing) in oncological hybrid medical imaging with respect to clinical tasks (detection, contouring and segmentation, prediction of histology and tumor stage, prediction of mutational status and molecular therapies targets, prediction of treatment response, and outcome). Particularly, AI-based approaches have been briefly described according to their purpose and, finally lung cancer-being one of the most extensively malignancy studied by hybrid medical imaging-has been used as illustrative scenario. Finally, we discussed clinical challenges and open issues including ethics, validation strategies, effective data-sharing methods, regulatory hurdles, educational resources, and strategy to facilitate the interaction among different stakeholders. Some of the major changes in medical imaging will come from the application of AI to workflow and protocols, eventually resulting in improved patient management and quality of life. Overall, several time-consuming tasks could be automatized. Machine learning algorithms and neural networks will permit sophisticated analysis resulting not only in major improvements in disease characterization through imaging, but also in the integration of multiple-omics data (i.e., derived from pathology, genomic, proteomics, and demographics) for multi-dimensional disease featuring. Nevertheless, to accelerate the transition of the theory to practice a sustainable development plan considering the multi-dimensional interactions between professionals, technology, industry, markets, policy, culture, and civil society directed by a mindset which will allow talents to thrive is necessary.

Reinventing radiation therapy with machine learning and imaging bio-markers (radiomics): State-of-the-art, challenges and perspectives

Radiation therapy is a pivotal cancer treatment that has significantly progressed over the last decade due to numerous technological breakthroughs. Imaging is now playing a critical role on deployment of the clinical workflow, both for treatment planning and treatment delivery. Machine-learning analysis of predefined features extracted from medical images, i.e. radiomics, has emerged as a promising clinical tool for a wide range of clinical problems addressing drug development, clinical diagnosis, treatment selection and implementation as well as prognosis. Radiomics denotes a paradigm shift redefining medical images as a quantitative asset for data-driven precision medicine. The adoption of machine-learning in a clinical setting and in particular of radiomics features requires the selection of robust, representative and clinically interpretable biomarkers that are properly evaluated on a representative clinical data set. To be clinically relevant, radiomics must not only improve patients' management with great accuracy but also be reproducible and generalizable. Hence, this review explores the existing literature and exposes its potential technical caveats, such as the lack of quality control, standardization, sufficient sample size, type of data collection, and external validation. Based upon the analysis of 165 original research studies based on PET, CT-scan, and MRI, this review provides an overview of new concepts, and hypotheses generating findings that should be validated. In particular, it describes evolving research trends to enhance several clinical tasks such as prognostication, treatment planning, response assessment, prediction of recurrence/relapse, and prediction of toxicity. Perspectives regarding the implementation of an AI-based radiotherapy workflow are presented.