Comparison and Fusion of Machine Learning Algorithms for Prospective Validation of PET/CT Radiomic Features Prognostic Value in Stage II-III Non-Small Cell Lung Cancer

Machine Learning in Diagnosis and Prognosis of Lung Cancer by PET-CT

As a disease with high morbidity and high mortality, lung cancer has seriously harmed people's health. Therefore, early diagnosis and treatment are more important. PET/CT is usually used to obtain the early diagnosis, staging, and curative effect evaluation of tumors, especially lung cancer, due to the heterogeneity of tumors and the differences in artificial image interpretation and other reasons, it also fails to entirely reflect the real situation of tumors. Artificial intelligence (AI) has been applied to all aspects of life. Machine learning (ML) is one of the important ways to realize AI. With the help of the ML method used by PET/CT imaging technology, there are many studies in the diagnosis and treatment of lung cancer. This article summarizes the application progress of ML based on PET/CT in lung cancer, in order to better serve the clinical. In this study, we searched PubMed using machine learning, lung cancer, and PET/CT as keywords to find relevant articles in the past 5 years or more. We found that PET/CT-based ML approaches have achieved significant results in the detection, delineation, classification of pathology, molecular subtyping, staging, and response assessment with survival and prognosis of lung cancer, which can provide clinicians a powerful tool to support and assist in critical daily clinical decisions. However, ML has some shortcomings such as slightly poor repeatability and reliability.

Clinical application of 18F-fluorodeoxyglucose positron emission tomography/computed tomography radiomics-based machine learning analyses in the field of oncology

Machine learning (ML) analyses using 18F-fluorodeoxyglucose (18F-FDG) positron emission tomography (PET)/computed tomography (CT) radiomics features have been applied in the field of oncology. The current review aimed to summarize the current clinical articles about 18F-FDG PET/CT radiomics-based ML analyses to solve issues in classifying or constructing prediction models for several types of tumors. In these studies, lung and mediastinal tumors were the most commonly evaluated lesions, followed by lymphatic, abdominal, head and neck, breast, gynecological, and other types of tumors. Previous studies have commonly shown that 18F-FDG PET radiomics-based ML analysis has good performance in differentiating benign from malignant tumors, predicting tumor characteristics and stage, therapeutic response, and prognosis by examining significant differences in the area under the receiver operating characteristic curves, accuracies, or concordance indices (> 0.70). However, these studies have reported several ML algorithms. Moreover, different ML models have been applied for the same purpose. Thus, various procedures were used in 18F-FDG PET/CT radiomics-based ML analysis in oncology, and 18F-FDG PET/CT radiomics-based ML models, which are easy and universally applied in clinical practice, would be expected to be established.

AI/ML advances in non-small cell lung cancer biomarker discovery

Lung cancer is the leading cause of cancer deaths among both men and women, representing approximately 25% of cancer fatalities each year. The treatment landscape for non-small cell lung cancer (NSCLC) is rapidly evolving due to the progress made in biomarker-driven targeted therapies. While advancements in targeted treatments have improved survival rates for NSCLC patients with actionable biomarkers, long-term survival remains low, with an overall 5-year relative survival rate below 20%. Artificial intelligence/machine learning (AI/ML) algorithms have shown promise in biomarker discovery, yet NSCLC-specific studies capturing the clinical challenges targeted and emerging patterns identified using AI/ML approaches are lacking. Here, we employed a text-mining approach and identified 215 studies that reported potential biomarkers of NSCLC using AI/ML algorithms. We catalogued these studies with respect to BEST (Biomarkers, EndpointS, and other Tools) biomarker sub-types and summarized emerging patterns and trends in AI/ML-driven NSCLC biomarker discovery. We anticipate that our comprehensive review will contribute to the current understanding of AI/ML advances in NSCLC biomarker research and provide an important catalogue that may facilitate clinical adoption of AI/ML-derived biomarkers.

Methodological evaluation of original articles on radiomics and machine learning for outcome prediction based on positron emission tomography (PET)

AIM

Despite a vast number of articles on radiomics and machine learning in positron emission tomography (PET) imaging, clinical applicability remains limited, partly owing to poor methodological quality. We therefore systematically investigated the methodology described in publications on radiomics and machine learning for PET-based outcome prediction.

METHODS

A systematic search for original articles was run on PubMed. All articles were rated according to 17 criteria proposed by the authors. Criteria with >2 rating categories were binarized into "adequate" or "inadequate". The association between the number of "adequate" criteria per article and the date of publication was examined.

RESULTS

One hundred articles were identified (published between 07/2017 and 09/2023). The median proportion of articles per criterion that were rated "adequate" was 65% (range: 23-98%). Nineteen articles (19%) mentioned neither a test cohort nor cross-validation to separate training from testing. The median number of criteria with an "adequate" rating per article was 12.5 out of 17 (range, 4-17), and this did not increase with later dates of publication (Spearman's rho, 0.094; p = 0.35). In 22 articles (22%), less than half of the items were rated "adequate". Only 8% of articles published the source code, and 10% made the dataset openly available.

CONCLUSION

Among the articles investigated, methodological weaknesses have been identified, and the degree of compliance with recommendations on methodological quality and reporting shows potential for improvement. Better adherence to established guidelines could increase the clinical significance of radiomics and machine learning for PET-based outcome prediction and finally lead to the widespread use in routine clinical practice.

Nuclear medicine radiomics in digestive system tumors: Concept, applications, challenges, and future perspectives

Radiomics aims to develop novel biomarkers and provide relevant deeper subvisual information about pathology, immunophenotype, and tumor microenvironment. It uses automated or semiautomated quantitative analysis of high-dimensional images to improve characterization, diagnosis, and prognosis. Recent years have seen a rapid increase in radiomics applications in nuclear medicine, leading to some promising research results in digestive system oncology, which have been driven by big data analysis and the development of artificial intelligence. Although radiomics advances one step further toward the non-invasive precision medical analysis, it is still a step away from clinical application and faces many challenges. This review article summarizes the available literature on digestive system tumors regarding radiomics in nuclear medicine. First, we describe the workflow and steps involved in radiomics analysis. Subsequently, we discuss the progress in clinical application regarding the utilization of radiomics for distinguishing between various diseases and evaluating their prognosis, and demonstrate how radiomics advances this field. Finally, we offer our viewpoint on how the field can progress by addressing the challenges facing clinical implementation.

Artificial Intelligence in Oncological Hybrid Imaging

BACKGROUND

 Artificial intelligence (AI) applications have become increasingly relevant across a broad spectrum of settings in medical imaging. Due to the large amount of imaging data that is generated in oncological hybrid imaging, AI applications are desirable for lesion detection and characterization in primary staging, therapy monitoring, and recurrence detection. Given the rapid developments in machine learning (ML) and deep learning (DL) methods, the role of AI will have significant impact on the imaging workflow and will eventually improve clinical decision making and outcomes.

METHODS AND RESULTS

 The first part of this narrative review discusses current research with an introduction to artificial intelligence in oncological hybrid imaging and key concepts in data science. The second part reviews relevant examples with a focus on applications in oncology as well as discussion of challenges and current limitations.

CONCLUSION

 AI applications have the potential to leverage the diagnostic data stream with high efficiency and depth to facilitate automated lesion detection, characterization, and therapy monitoring to ultimately improve quality and efficiency throughout the medical imaging workflow. The goal is to generate reproducible, structured, quantitative diagnostic data for evidence-based therapy guidance in oncology. However, significant challenges remain regarding application development, benchmarking, and clinical implementation.

KEY POINTS

  · Hybrid imaging generates a large amount of multimodality medical imaging data with high complexity and depth.. · Advanced tools are required to enable fast and cost-efficient processing along the whole radiology value chain.. · AI applications promise to facilitate the assessment of oncological disease in hybrid imaging with high quality and efficiency for lesion detection, characterization, and response assessment. The goal is to generate reproducible, structured, quantitative diagnostic data for evidence-based oncological therapy guidance.. · Selected applications in three oncological entities (lung, prostate, and neuroendocrine tumors) demonstrate how AI algorithms may impact imaging-based tasks in hybrid imaging and potentially guide clinical decision making..

Radiomics and artificial intelligence for precision medicine in lung cancer treatment

Lung cancer is the leading cause of cancer-related deaths worldwide. It exhibits, at the mesoscopic scale, phenotypic characteristics that are generally indiscernible to the human eye but can be captured non-invasively on medical imaging as radiomic features, which can form a high dimensional data space amenable to machine learning. Radiomic features can be harnessed and used in an artificial intelligence paradigm to risk stratify patients, and predict for histological and molecular findings, and clinical outcome measures, thereby facilitating precision medicine for improving patient care. Compared to tissue sampling-driven approaches, radiomics-based methods are superior for being non-invasive, reproducible, cheaper, and less susceptible to intra-tumoral heterogeneity. This review focuses on the application of radiomics, combined with artificial intelligence, for delivering precision medicine in lung cancer treatment, with discussion centered on pioneering and groundbreaking works, and future research directions in the area.

The Efficacy of Pretreatment 18F-FDG PET-CT-Based Deep Learning Network Structure to Predict Survival in Nasopharyngeal Carcinoma

Background

Previous studies have shown that the 5-year survival rates of patients with nasopharyngeal carcinoma (NPC) were still not ideal despite great improvement in NPC treatments. To achieve individualized treatment of NPC, we have been looking for novel models to predict the prognosis of patients with NPC. The objective of this study was to use a novel deep learning network structural model to predict the prognosis of patients with NPC and to compare it with the traditional PET-CT model combining metabolic parameters and clinical factors.

Methods

A total of 173 patients were admitted to 2 institutions between July 2014 and April 2020 for the retrospective study; each received a PET-CT scan before treatment. The least absolute shrinkage and selection operator (LASSO) was employed to select some features, including SUVpeak-P, T3, age, stage II, MTV-P, N1, stage III and pathological type, which were associated with overall survival (OS) of patients. We constructed 2 survival prediction models: an improved optimized adaptive multimodal task (a 3D Coordinate Attention Convolutional Autoencoder and an uncertainty-based jointly Optimizing Cox Model, CACA-UOCM for short) and a clinical model. The predictive power of these models was assessed using the Harrell Consistency Index (C index). Overall survival of patients with NPC was compared by Kaplan-Meier and Log-rank tests.

Results

The results showed that CACA-UOCM model could estimate OS (C index, 0.779 for training, 0.774 for validation, and 0.819 for testing) and divide patients into low and high mortality risk groups, which were significantly associated with OS (P < .001). However, the C-index of the model based only on clinical variables was only 0.42.

Conclusions

The deep learning network model based on ¹⁸F-FDG PET/CT can serve as a reliable and powerful predictive tool for NPC and provide therapeutic strategies for individual treatment.

MRI-Based Radiomics Combined with Deep Learning for Distinguishing IDH-Mutant WHO Grade 4 Astrocytomas from IDH-Wild-Type Glioblastomas

This study aimed to investigate the potential of quantitative radiomic data extracted from conventional MR images in discriminating IDH-mutant grade 4 astrocytomas from IDH-wild-type glioblastomas (GBMs). A cohort of 57 treatment-naïve patients with IDH-mutant grade 4 astrocytomas (n = 23) and IDH-wild-type GBMs (n = 34) underwent anatomical imaging on a 3T MR system with standard parameters. Post-contrast T1-weighted and T2-FLAIR images were co-registered. A semi-automatic segmentation approach was used to generate regions of interest (ROIs) from different tissue components of neoplasms. A total of 1050 radiomic features were extracted from each image. The data were split randomly into training and testing sets. A deep learning-based data augmentation method (CTGAN) was implemented to synthesize 200 datasets from the training sets. A total of 18 classifiers were used to distinguish two genotypes of grade 4 astrocytomas. From generated data using 80% training set, the best discriminatory power was obtained from core tumor regions overlaid on post-contrast T1 using the K-best feature selection algorithm and a Gaussian naïve Bayes classifier (AUC = 0.93, accuracy = 0.92, sensitivity = 1, specificity = 0.86, PR_AUC = 0.92). Similarly, high diagnostic performances were obtained from original and generated data using 50% and 30% training sets. Our findings suggest that conventional MR imaging-based radiomic features combined with machine/deep learning methods may be valuable in discriminating IDH-mutant grade 4 astrocytomas from IDH-wild-type GBMs.

Artificial Intelligence in Oncological Hybrid Imaging

BACKGROUND

Artificial intelligence (AI) applications have become increasingly relevant across a broad spectrum of settings in medical imaging. Due to the large amount of imaging data that is generated in oncological hybrid imaging, AI applications are desirable for lesion detection and characterization in primary staging, therapy monitoring, and recurrence detection. Given the rapid developments in machine learning (ML) and deep learning (DL) methods, the role of AI will have significant impact on the imaging workflow and will eventually improve clinical decision making and outcomes.

METHODS AND RESULTS

The first part of this narrative review discusses current research with an introduction to artificial intelligence in oncological hybrid imaging and key concepts in data science. The second part reviews relevant examples with a focus on applications in oncology as well as discussion of challenges and current limitations.

CONCLUSION

AI applications have the potential to leverage the diagnostic data stream with high efficiency and depth to facilitate automated lesion detection, characterization, and therapy monitoring to ultimately improve quality and efficiency throughout the medical imaging workflow. The goal is to generate reproducible, structured, quantitative diagnostic data for evidence-based therapy guidance in oncology. However, significant challenges remain regarding application development, benchmarking, and clinical implementation.

KEY POINTS

· Hybrid imaging generates a large amount of multimodality medical imaging data with high complexity and depth.. · Advanced tools are required to enable fast and cost-efficient processing along the whole radiology value chain.. · AI applications promise to facilitate the assessment of oncological disease in hybrid imaging with high quality and efficiency for lesion detection, characterization, and response assessment. The goal is to generate reproducible, structured, quantitative diagnostic data for evidence-based oncological therapy guidance.. · Selected applications in three oncological entities (lung, prostate, and neuroendocrine tumors) demonstrate how AI algorithms may impact imaging-based tasks in hybrid imaging and potentially guide clinical decision making..

CITATION FORMAT

· Feuerecker B, Heimer M, Geyer T et al. Artificial Intelligence in Oncological Hybrid Imaging. Fortschr Röntgenstr 2023; 195: 105 - 114.

Research Progress of Respiratory Disease and Idiopathic Pulmonary Fibrosis Based on Artificial Intelligence

Machine Learning (ML) is an algorithm based on big data, which learns patterns from the previously observed data through classifying, predicting, and optimizing to accomplish specific tasks. In recent years, there has been rapid development in the field of ML in medicine, including lung imaging analysis, intensive medical monitoring, mechanical ventilation, and there is need for intubation etiology prediction evaluation, pulmonary function evaluation and prediction, obstructive sleep apnea, such as biological information monitoring and so on. ML can have good performance and is a great potential tool, especially in the imaging diagnosis of interstitial lung disease. Idiopathic pulmonary fibrosis (IPF) is a major problem in the treatment of respiratory diseases, due to the abnormal proliferation of fibroblasts, leading to lung tissue destruction. The diagnosis mainly depends on the early detection of imaging and early treatment, which can effectively prolong the life of patients. If the computer can be used to assist the examination results related to the effects of fibrosis, a timely diagnosis of such diseases will be of great value to both doctors and patients. We also previously proposed a machine learning algorithm model that can play a good clinical guiding role in early imaging prediction of idiopathic pulmonary fibrosis. At present, AI and machine learning have great potential and ability to transform many aspects of respiratory medicine and are the focus and hotspot of research. AI needs to become an invisible, seamless, and impartial auxiliary tool to help patients and doctors make better decisions in an efficient, effective, and acceptable way. The purpose of this paper is to review the current application of machine learning in various aspects of respiratory diseases, with the hope to provide some help and guidance for clinicians when applying algorithm models.

Joint EANM/SNMMI guideline on radiomics in nuclear medicine : Jointly supported by the EANM Physics Committee and the SNMMI Physics, Instrumentation and Data Sciences Council

PURPOSE

The purpose of this guideline is to provide comprehensive information on best practices for robust radiomics analyses for both hand-crafted and deep learning-based approaches.

METHODS

In a cooperative effort between the EANM and SNMMI, we agreed upon current best practices and recommendations for relevant aspects of radiomics analyses, including study design, quality assurance, data collection, impact of acquisition and reconstruction, detection and segmentation, feature standardization and implementation, as well as appropriate modelling schemes, model evaluation, and interpretation. We also offer an outlook for future perspectives.

CONCLUSION

Radiomics is a very quickly evolving field of research. The present guideline focused on established findings as well as recommendations based on the state of the art. Though this guideline recognizes both hand-crafted and deep learning-based radiomics approaches, it primarily focuses on the former as this field is more mature. This guideline will be updated once more studies and results have contributed to improved consensus regarding the application of deep learning methods for radiomics. Although methodological recommendations in the present document are valid for most medical image modalities, we focus here on nuclear medicine, and specific recommendations when necessary are made for PET/CT, PET/MR, and quantitative SPECT.

[18F]FDG-PET/CT radiomics and artificial intelligence in lung cancer: Technical aspects and potential clinical applications

Lung cancer is the second most common cancer and the leading cause of cancer-related death worldwide. Molecular imaging using [¹⁸F]fluorodeoxyglucose Positron Emission Tomography and/or Computed Tomography ([¹⁸F]FDG-PET/CT) plays an essential role in the diagnosis, evaluation of response to treatment, and prediction of outcomes. The images are evaluated using qualitative and conventional quantitative indices. However, there is far more information embedded in the images, which can be extracted by sophisticated algorithms. Recently, the concept of uncovering and analyzing the invisible data extracted from medical images, called radiomics, is gaining more attention. Currently, [¹⁸F]FDG-PET/CT radiomics is growingly evaluated in lung cancer to discover if it enhances the diagnostic performance or implication of [¹⁸F]FDG-PET/CT in the management of lung cancer. In this review, we provide a short overview of the technical aspects, as they are discussed in different articles of this special issue. We mainly focus on the diagnostic performance of the [¹⁸F]FDG-PET/CT-based radiomics and the role of artificial intelligence in non-small cell lung cancer, impacting the early detection, staging, prediction of tumor subtypes, biomarkers, and patient's outcomes.

Positron Emission Tomography/Magnetic Resonance Imaging Radiomics in Predicting Lung Adenocarcinoma and Squamous Cell Carcinoma

Objective

To investigate the diagnostic value of positron emission tomography (PET)/magnetic resonance imaging (MRI) radiomics in predicting the histological classification of lung adenocarcinoma and lung squamous cell carcinoma.

Methods

PET/MRI radiomics and clinical data were retrospectively collected from 61 patients with lung cancer. According to the pathological results of surgery or fiberscope, patients were divided into two groups, lung adenocarcinoma and squamous cell carcinoma group, which were set as positive for adenocarcinoma (40 cases) and negative for squamous cell carcinoma (21 cases). The radiomics characteristics most related to lung cancer classification were calculated and selected using radiomics software, and the two lung cancer groups were randomly assigned into a training set (70%) and a test set (30%). Maximum relevance and minimum redundancy (mRMR) and least absolute shrinkage and selection operator (LASSO) methods in the uAI Research Portal software (United Imaging Intelligence, China) were used to select the desired characteristics from 2600 features extracted from MRI and PET. Eight optimal features were finally retained through 5-fold cross-validation, and a PET/MRI fusion model was constructed. The predictive ability of this model was evaluated by the difference in area under the curve (AUC) obtained from the receiver operating characteristic (ROC) curve.

Results

AUC of PET/MRI model for the training group and test group were 0.886 (0.787-0.985) and 0.847 (0.648-1.000), respectively. PET/MRI radiomics features revealed different degrees of correlation with the classification of lung adenocarcinoma and squamous cell carcinoma, with significant differences.

Conclusion

The prediction model constructed based on PET/MRI radiomics features can predict the preoperative histological classification of lung adenocarcinoma and squamous cell carcinoma without seminality and repeatability. It can also provide an objective basis for accurate clinical diagnosis and individualized treatment, thus having important guiding significance for clinical treatment.

Accurate Tumor Delineation vs. Rough Volume of Interest Analysis for 18F-FDG PET/CT Radiomics-Based Prognostic Modeling inNon-Small Cell Lung Cancer

Background

The aim of this work was to investigate the ability of building prognostic models in non-small cell lung cancer (NSCLC) using radiomic features from positron emission tomography and computed tomography with 2-deoxy-2-[fluorine-18]fluoro-d-glucose (¹⁸F-FDG PET/CT) images based on a "rough" volume of interest (VOI) containing the tumor instead of its accurate delineation, which is a significant time-consuming bottleneck of radiomics analyses.

Methods

A cohort of 138 patients with stage II-III NSCLC treated with radiochemotherapy recruited retrospectively (n = 87) and prospectively (n = 51) was used. Two approaches were compared: firstly, the radiomic features were extracted from the delineated primary tumor volumes in both PET (using the automated fuzzy locally adaptive Bayesian, FLAB) and CT (using a semi-automated approach with 3D Slicer™) components. Both delineations were carried out within previously manually defined "rough" VOIs containing the tumor and the surrounding tissues, which were exploited for the second approach: the same features were extracted from this alternative VOI. Both sets for features were then combined with the clinical variables and processed through the same machine learning (ML) pipelines using the retrospectively recruited patients as the training set and the prospectively recruited patients as the testing set. Logistic regression (LR), random forest (RF), and support vector machine (SVM), as well as their consensus through averaging the output probabilities, were considered for feature selection and modeling for overall survival (OS) prediction as a binary classification (either median OS or 6 months OS). The resulting models were compared in terms of balanced accuracy, sensitivity, and specificity.

Results

Overall, better performance was achieved using the features from delineated tumor volumes. This was observed consistently across ML algorithms and for the two clinical endpoints. However, the loss of performance was not significant, especially when a consensus of the three ML algorithms was considered (0.89 vs. 0.88 and 0.78 vs. 0.77).

Conclusion

Our findings suggest that it is feasible to achieve similar levels of prognostic accuracy in radiomics-based modeling by relying on a faster and easier VOI definition, skipping a time-consuming tumor delineation step, thus facilitating automation of the whole radiomics workflow. The associated cost is a loss of performance in the resulting models, although this loss can be greatly mitigated when a consensus of several models is relied upon.

Effective early diagnosis for NSCLC: an algorithm

INTRODUCTION

Lung cancer still remains undiagnosed for most patients until the disease is inoperable.

AREAS COVERED

We performed search on PubMed with the keywords: EBUS, radial-EBUS, bronchoscopy, lung cancer, electromagnetic navigation, ct-biopsy, transthoracic biopsy. We present diagnostic equipment and imaging techniques such as positron emission tomography, endoscopical navigation systems, endobronchial ultrasound, radial-endobronchial ultrasound, transthoracic ultrasound biopsy, and computed tomography guided biopsies.

EXPERT OPINION

However, lack of early disease symptoms remains the most important issue and therefore we should direct our efforts to screening and early disease diagnosis. An algorithm is proposed for biopsy upon initial disease diagnosis.

A transfer learning approach to facilitate ComBat-based harmonization of multicentre radiomic features in new datasets

PURPOSE

To facilitate the demonstration of the prognostic value of radiomics, multicenter radiomics studies are needed. Pooling radiomic features of such data in a statistical analysis is however challenging, as they are sensitive to the variability in scanner models, acquisition protocols and reconstruction settings, which is often unavoidable in a multicentre retrospective analysis. A statistical harmonization strategy called ComBat was utilized in radiomics studies to deal with the "center-effect". The goal of the present work was to integrate a transfer learning (TL) technique within ComBat-and recently developed alternate versions of ComBat with improved flexibility (M-ComBat) and robustness (B-ComBat)-to allow the use of a previously determined harmonization transform to the radiomic feature values of new patients from an already known center.

MATERIAL AND METHODS

The proposed TL approach were incorporated in the four versions of ComBat (standard, B, M, and B-M ComBat). The proposed approach was evaluated using a dataset of 189 locally advanced cervical cancer patients from 3 centers, with magnetic resonance imaging (MRI) and positron emission tomography (PET) images, with the clinical endpoint of predicting local failure. The impact performance of the TL approach was evaluated by comparing the harmonization achieved using only parts of the data to the reference (harmonization achieved using all the available data). It was performed through three different machine learning pipelines.

RESULTS

The proposed TL technique was successful in harmonizing features of new patients from a known center in all versions of ComBat, leading to predictive models reaching similar performance as the ones developed using the features harmonized with all the data available.

CONCLUSION

The proposed TL approach enables applying a previously determined ComBat transform to new, previously unseen data.