3D Deep Learning from CT Scans Predicts Tumor Invasiveness of Subcentimeter Pulmonary Adenocarcinomas

Machine learning computational model to predict lung cancer using electronic medical records

BACKGROUND

Lung cancer (LC) screening using low-dose computed tomography (CT) is recommended according to standard risk criteria or personalized risk calculators. Machine learning (ML) models that can predict disease risk are an emerging method in medicine for identifying hidden associations that are personally unique.

MATERIALS AND METHODS

Using the tree-based pipeline optimization tool (TPOT), we developed an ML-based model, which is an ensemble of the Random Forest and XGboost models, based on known risk factors for LC, as part of a larger trial for ML prediction using electronic medical records and chest CT. We used data from patients with LC vs. controls (1:2) of patients aged ≥ 35 years. We developed a model for all LC patients as well as for patients with and without a smoking background. We included age, gender, body mass index (BMI), smoking history, socioeconomic status (SES), history of chronic obstructive pulmonary disease (COPD)/emphysema/chronic bronchitis (CB), interstitial lung disease (ILD)/pulmonary fibrosis (PF), and family history of LC.

RESULTS

Of the 4076 patients, 1428 (35 %) were in the LC group and 2648 (65 %) were in the control group. For the entire study population, our model achieved an accuracy of 71.2 %, with a sensitivity of 69 % and a positive predictive value (PPV) of 74 %. Higher accuracy was achieved for the two subgroups. An accuracy of 74.8 % (sensitivity 72 %, PPV 76 %) and 73.0 % (sensitivity 76 %, PPV 72 %) was achieved for the smoking and never-smoking cohorts, respectively. For the entire population and smoker cohort, COPD/emphysema/CB were the most important contributors, followed by BMI and age, while in the never-smoking cohort, BMI, age and SES were the most important contributors.

CONCLUSION

Known risk factors for LC could be used in ML models to modestly predict LC. Further studies are needed to confirm these results in new patients and to improve them.

Deep learning in pulmonary nodule detection and segmentation: a systematic review

OBJECTIVES

The accurate detection and precise segmentation of lung nodules on computed tomography are key prerequisites for early diagnosis and appropriate treatment of lung cancer. This study was designed to compare detection and segmentation methods for pulmonary nodules using deep-learning techniques to fill methodological gaps and biases in the existing literature.

METHODS

This study utilized a systematic review with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, searching PubMed, Embase, Web of Science Core Collection, and the Cochrane Library databases up to May 10, 2023. The Quality Assessment of Diagnostic Accuracy Studies 2 criteria was used to assess the risk of bias and was adjusted with the Checklist for Artificial Intelligence in Medical Imaging. The study analyzed and extracted model performance, data sources, and task-focus information.

RESULTS

After screening, we included nine studies meeting our inclusion criteria. These studies were published between 2019 and 2023 and predominantly used public datasets, with the Lung Image Database Consortium Image Collection and Image Database Resource Initiative and Lung Nodule Analysis 2016 being the most common. The studies focused on detection, segmentation, and other tasks, primarily utilizing Convolutional Neural Networks for model development. Performance evaluation covered multiple metrics, including sensitivity and the Dice coefficient.

CONCLUSIONS

This study highlights the potential power of deep learning in lung nodule detection and segmentation. It underscores the importance of standardized data processing, code and data sharing, the value of external test datasets, and the need to balance model complexity and efficiency in future research.

CLINICAL RELEVANCE STATEMENT

Deep learning demonstrates significant promise in autonomously detecting and segmenting pulmonary nodules. Future research should address methodological shortcomings and variability to enhance its clinical utility.

KEY POINTS

Deep learning shows potential in the detection and segmentation of pulmonary nodules. There are methodological gaps and biases present in the existing literature. Factors such as external validation and transparency affect the clinical application.

Evaluating surgical expertise with AI-based automated instrument recognition for robotic distal gastrectomy

Introduction

Complexities of robotic distal gastrectomy (RDG) give reason to assess physician's surgical skill. Varying levels in surgical skill affect patient outcomes. We aim to investigate how a novel artificial intelligence (AI) model can be used to evaluate surgical skill in RDG by recognizing surgical instruments.

Methods

Fifty-five consecutive robotic surgical videos of RDG for gastric cancer were analyzed. We used Deeplab, a multi-stage temporal convolutional network, and it trained on 1234 manually annotated images. The model was then tested on 149 annotated images for accuracy. Deep learning metrics such as Intersection over Union (IoU) and accuracy were assessed, and the comparison between experienced and non-experienced surgeons based on usage of instruments during infrapyloric lymph node dissection was performed.

Results

We annotated 540 Cadiere forceps, 898 Fenestrated bipolars, 359 Suction tubes, 307 Maryland bipolars, 688 Harmonic scalpels, 400 Staplers, and 59 Large clips. The average IoU and accuracy were 0.82 ± 0.12 and 87.2 ± 11.9% respectively. Moreover, the percentage of each instrument's usage to overall infrapyloric lymphadenectomy duration predicted by AI were compared. The use of Stapler and Large clip were significantly shorter in the experienced group compared to the non-experienced group.

Conclusions

This study is the first to report that surgical skill can be successfully and accurately determined by an AI model for RDG. Our AI gives us a way to recognize and automatically generate instance segmentation of the surgical instruments present in this procedure. Use of this technology allows unbiased, more accessible RDG surgical skill.

Deep learning for malignancy risk estimation of incidental sub-centimeter pulmonary nodules on CT images

OBJECTIVES

To establish deep learning models for malignancy risk estimation of sub-centimeter pulmonary nodules incidentally detected by chest CT and managed in clinical settings.

MATERIALS AND METHODS

Four deep learning models were trained using CT images of sub-centimeter pulmonary nodules from West China Hospital, internally tested, and externally validated on three cohorts. The four models respectively learned 3D deep features from the baseline whole lung region, baseline image patch where the nodule located, baseline nodule box, and baseline plus follow-up nodule boxes. All regions of interest were automatically segmented except that the nodule boxes were additionally manually checked. The performance of models was compared with each other and that of three respiratory clinicians.

RESULTS

There were 1822 nodules (981 malignant) in the training set, 806 (416 malignant) in the testing set, and 357 (253 malignant) totally in the external sets. The area under the curve (AUC) in the testing set was 0.754, 0.855, 0.928, and 0.942, respectively, for models derived from baseline whole lung, image patch, nodule box, and the baseline plus follow-up nodule boxes. When baseline models externally validated (follow-up images not available), the nodule-box model outperformed the other two with AUC being 0.808, 0.848, and 0.939 respectively in the three external datasets. The resident, junior, and senior clinicians achieved an accuracy of 67.0%, 82.5%, and 90.0%, respectively, in the testing set. The follow-up model performed comparably to the senior clinician.

CONCLUSION

The deep learning algorithms solely mining nodule information can efficiently predict malignancy of incidental sub-centimeter pulmonary nodules.

CLINICAL RELEVANCE STATEMENT

The established models may be valuable for supporting clinicians in routine clinical practice, potentially reducing the number of unnecessary examinations and also delays in diagnosis.

KEY POINTS

• According to different regions of interest, four deep learning models were developed and compared to evaluate the malignancy of sub-centimeter pulmonary nodules by CT images. • The models derived from baseline nodule box or baseline plus follow-up nodule boxes demonstrated sufficient diagnostic accuracy (86.4% and 90.4% in the testing set), outperforming the respiratory resident (67.0%) and junior clinician (82.5%). • The proposed deep learning methods may aid clinicians in optimizing follow-up recommendations for sub-centimeter pulmonary nodules and may lead to fewer unnecessary diagnostic interventions.

Res-TransNet: A Hybrid deep Learning Network for Predicting Pathological Subtypes of lung Adenocarcinoma in CT Images

This study aims to develop a CT-based hybrid deep learning network to predict pathological subtypes of early-stage lung adenocarcinoma by integrating residual network (ResNet) with Vision Transformer (ViT). A total of 1411 pathologically confirmed ground-glass nodules (GGNs) retrospectively collected from two centers were used as internal and external validation sets for model development. 3D ResNet and ViT were applied to investigate two deep learning frameworks to classify three subtypes of lung adenocarcinoma namely invasive adenocarcinoma (IAC), minimally invasive adenocarcinoma and adenocarcinoma in situ, respectively. To further improve the model performance, four Res-TransNet based models were proposed by integrating ResNet and ViT with different ensemble learning strategies. Two classification tasks involving predicting IAC from Non-IAC (Task1) and classifying three subtypes (Task2) were designed and conducted in this study. For Task 1, the optimal Res-TransNet model yielded area under the receiver operating characteristic curve (AUC) values of 0.986 and 0.933 on internal and external validation sets, which were significantly higher than that of ResNet and ViT models (p < 0.05). For Task 2, the optimal fusion model generated the accuracy and weighted F1 score of 68.3% and 66.1% on the external validation set. The experimental results demonstrate that Res-TransNet can significantly increase the classification performance compared with the two basic models and have the potential to assist radiologists in precision diagnosis.

A Self-supervised Learning-Based Fine-Grained Classification Model for Distinguishing Malignant From Benign Subcentimeter Solid Pulmonary Nodules

RATIONALE AND OBJECTIVES

Diagnosing subcentimeter solid pulmonary nodules (SSPNs) remains challenging in clinical practice. Deep learning may perform better than conventional methods in differentiating benign and malignant pulmonary nodules. This study aimed to develop and validate a model for differentiating malignant and benign SSPNs using CT images.

MATERIALS AND METHODS

This retrospective study included consecutive patients with SSPNs detected between January 2015 and October 2021 as an internal dataset. Malignancy was confirmed pathologically; benignity was confirmed pathologically or via follow-up evaluations. The SSPNs were segmented manually. A self-supervision pre-training-based fine-grained network was developed for predicting SSPN malignancy. The pre-trained model was established using data from the National Lung Screening Trial, Lung Nodule Analysis 2016, and a database of 5478 pulmonary nodules from the previous study, with subsequent fine-tuning using the internal dataset. The model's efficacy was investigated using an external cohort from another center, and its accuracy, sensitivity, specificity, and area under the receiver operating characteristic curve (AUC) were determined.

RESULTS

Overall, 1276 patients (mean age, 56 ± 10 years; 497 males) with 1389 SSPNs (mean diameter, 7.5 ± 2.0 mm; 625 benign) were enrolled. The internal dataset was specifically enriched for malignancy. The model's performance in the internal testing set (316 SSPNs) was: AUC, 0.964 (95% confidence interval (95%CI): 0.942-0.986); accuracy, 0.934; sensitivity, 0.965; and specificity, 0.908. The model's performance in the external test set (202 SSPNs) was: AUC, 0.945 (95% CI: 0.910-0.979); accuracy, 0.911; sensitivity, 0.977; and specificity, 0.860.

CONCLUSION

This deep learning model was robust and exhibited good performance in predicting the malignancy of SSPNs, which could help optimize patient management.

Implementation of Artificial Intelligence in Personalized Prognostic Assessment of Lung Cancer: A Narrative Review

Artificial Intelligence (AI) has revolutionized the management of non-small-cell lung cancer (NSCLC) by enhancing different aspects, including staging, prognosis assessment, treatment prediction, response evaluation, recurrence/prognosis prediction, and personalized prognostic assessment. AI algorithms may accurately classify NSCLC stages using machine learning techniques and deep imaging data analysis. This could potentially improve precision and efficiency in staging, facilitating personalized treatment decisions. Furthermore, there are data suggesting the potential application of AI-based models in predicting prognosis in terms of survival rates and disease progression by integrating clinical, imaging and molecular data. In the present narrative review, we will analyze the preliminary studies reporting on how AI algorithms could predict responses to various treatment modalities, such as surgery, radiotherapy, chemotherapy, targeted therapy, and immunotherapy. There is robust evidence suggesting that AI also plays a crucial role in predicting the likelihood of tumor recurrence after surgery and the pattern of failure, which has significant implications for tailoring adjuvant treatments. The successful implementation of AI in personalized prognostic assessment requires the integration of different data sources, including clinical, molecular, and imaging data. Machine learning (ML) and deep learning (DL) techniques enable AI models to analyze these data and generate personalized prognostic predictions, allowing for a precise and individualized approach to patient care. However, challenges relating to data quality, interpretability, and the ability of AI models to generalize need to be addressed. Collaboration among clinicians, data scientists, and regulators is critical for the responsible implementation of AI and for maximizing its benefits in providing a more personalized prognostic assessment. Continued research, validation, and collaboration are essential to fully exploit the potential of AI in NSCLC management and improve patient outcomes. Herein, we have summarized the state of the art of applications of AI in lung cancer for predicting staging, prognosis, and pattern of recurrence after treatment in order to provide to the readers a large comprehensive overview of this challenging issue.

Predicting Invasiveness of Lung Adenocarcinoma at Chest CT with Deep Learning Ternary Classification Models

Background Preoperative discrimination of preinvasive, minimally invasive, and invasive adenocarcinoma at CT informs clinical management decisions but may be challenging for classifying pure ground-glass nodules (pGGNs). Deep learning (DL) may improve ternary classification. Purpose To determine whether a strategy that includes an adjudication approach can enhance the performance of DL ternary classification models in predicting the invasiveness of adenocarcinoma at chest CT and maintain performance in classifying pGGNs. Materials and Methods In this retrospective study, six ternary models for classifying preinvasive, minimally invasive, and invasive adenocarcinoma were developed using a multicenter data set of lung nodules. The DL-based models were progressively modified through framework optimization, joint learning, and an adjudication strategy (simulating a multireader approach to resolving discordant nodule classifications), integrating two binary classification models with a ternary classification model to resolve discordant classifications sequentially. The six ternary models were then tested on an external data set of pGGNs imaged between December 2019 and January 2021. Diagnostic performance including accuracy, specificity, and sensitivity was assessed. The χ2 test was used to compare model performance in different subgroups stratified by clinical confounders. Results A total of 4929 nodules from 4483 patients (mean age, 50.1 years ± 9.5 [SD]; 2806 female) were divided into training (n = 3384), validation (n = 579), and internal (n = 966) test sets. A total of 361 pGGNs from 281 patients (mean age, 55.2 years ± 11.1 [SD]; 186 female) formed the external test set. The proposed strategy improved DL model performance in external testing (P < .001). For classifying minimally invasive adenocarcinoma, the accuracy was 85% and 79%, sensitivity was 75% and 63%, and specificity was 89% and 85% for the model with adjudication (model 6) and the model without (model 3), respectively. Model 6 showed a relatively narrow range (maximum minus minimum) across diagnostic indexes (accuracy, 1.7%; sensitivity, 7.3%; specificity, 0.9%) compared with the other models (accuracy, 0.6%-10.8%; sensitivity, 14%-39.1%; specificity, 5.5%-17.9%). Conclusion Combining framework optimization, joint learning, and an adjudication approach improved DL classification of adenocarcinoma invasiveness at chest CT. Published under a CC BY 4.0 license. Supplemental material is available for this article. See also the editorial by Sohn and Fields in this issue.

A novel image deep learning-based sub-centimeter pulmonary nodule management algorithm to expedite resection of the malignant and avoid over-diagnosis of the benign

OBJECTIVES

With the popularization of chest computed tomography (CT) screening, there are more sub-centimeter (≤ 1 cm) pulmonary nodules (SCPNs) requiring further diagnostic workup. This area represents an important opportunity to optimize the SCPN management algorithm avoiding "one-size fits all" approach. One critical problem is how to learn the discriminative multi-view characteristics and the unique context of each SCPN.

METHODS

Here, we propose a multi-view coupled self-attention module (MVCS) to capture the global spatial context of the CT image through modeling the association order of space and dimension. Compared with existing self-attention methods, MVCS uses less memory consumption and computational complexity, unearths dimension correlations that previous methods have not found, and is easy to integrate with other frameworks.

RESULTS

In total, a public dataset LUNA16 from LIDC-IDRI, 1319 SCPNs from 1069 patients presenting to a major referral center, and 160 SCPNs from 137 patients from three other major centers were analyzed to pre-train, train, and validate the model. Experimental results showed that performance outperforms the state-of-the-art models in terms of accuracy and stability and is comparable to that of human experts in classifying precancerous lesions and invasive adenocarcinoma. We also provide a fusion MVCS network (MVCSN) by combining the CT image with the clinical characteristics and radiographic features of patients.

CONCLUSION

This tool may ultimately aid in expediting resection of the malignant SCPNs and avoid over-diagnosis of the benign ones, resulting in improved management outcomes.

CLINICAL RELEVANCE STATEMENT

In the diagnosis of sub-centimeter lung adenocarcinoma, fusion MVCSN can help doctors improve work efficiency and guide their treatment decisions to a certain extent.

KEY POINTS

• Advances in computed tomography (CT) not only increase the number of nodules detected, but also the nodules that are identified are smaller, such as sub-centimeter pulmonary nodules (SCPNs). • We propose a multi-view coupled self-attention module (MVCS), which could model spatial and dimensional correlations sequentially for learning global spatial contexts, which is better than other attention mechanisms. • MVCS uses fewer huge memory consumption and computational complexity than the existing self-attention methods when dealing with 3D medical image data. Additionally, it reaches promising accuracy for SCPNs' malignancy evaluation and has lower training cost than other models.

Multimodal fusion of liquid biopsy and CT enhances differential diagnosis of early-stage lung adenocarcinoma

This research explores the potential of multimodal fusion for the differential diagnosis of early-stage lung adenocarcinoma (LUAD) (tumor sizes < 2 cm). It combines liquid biopsy biomarkers, specifically extracellular vesicle long RNA (evlRNA) and the computed tomography (CT) attributes. The fusion model achieves an impressive area under receiver operating characteristic curve (AUC) of 91.9% for the four-classification of adenocarcinoma, along with a benign-malignant AUC of 94.8% (sensitivity: 89.1%, specificity: 94.3%). These outcomes outperform the diagnostic capabilities of the single-modal models and human experts. A comprehensive SHapley Additive exPlanations (SHAP) is provided to offer deep insights into model predictions. Our findings reveal the complementary interplay between evlRNA and image-based characteristics, underscoring the significance of integrating diverse modalities in diagnosing early-stage LUAD.

Deep representation learning of tissue metabolome and computed tomography annotates NSCLC classification and prognosis

The rich chemical information from tissue metabolomics provides a powerful means to elaborate tissue physiology or tumor characteristics at cellular and tumor microenvironment levels. However, the process of obtaining such information requires invasive biopsies, is costly, and can delay clinical patient management. Conversely, computed tomography (CT) is a clinical standard of care but does not intuitively harbor histological or prognostic information. Furthermore, the ability to embed metabolome information into CT to subsequently use the learned representation for classification or prognosis has yet to be described. This study develops a deep learning-based framework -- tissue-metabolomic-radiomic-CT (TMR-CT) by combining 48 paired CT images and tumor/normal tissue metabolite intensities to generate ten image embeddings to infer metabolite-derived representation from CT alone. In clinical NSCLC settings, we ascertain whether TMR-CT results in an enhanced feature generation model solving histology classification/prognosis tasks in an unseen international CT dataset of 742 patients. TMR-CT non-invasively determines histological classes - adenocarcinoma/squamous cell carcinoma with an F1-score = 0.78 and further asserts patients' prognosis with a c-index = 0.72, surpassing the performance of radiomics models and deep learning on single modality CT feature extraction. Additionally, our work shows the potential to generate informative biology-inspired CT-led features to explore connections between hard-to-obtain tissue metabolic profiles and routine lesion-derived image data.

Exploring the current and prospective role of artificial intelligence in disease diagnosis

Artificial intelligence (AI) refers to the simulation of human intelligence processes by machines, especially computer systems, providing assistance in a variety of patient care and health systems. The aim of this review is to contribute valuable insights to the ongoing discourse on the transformative potential of AI in healthcare, providing a nuanced understanding of its current applications, future possibilities, and associated challenges. The authors conducted a literature search on the current role of AI in disease diagnosis and its possible future applications using PubMed, Google Scholar, and ResearchGate within 10 years. Our investigation revealed that AI, encompassing machine-learning and deep-learning techniques, has become integral to healthcare, facilitating immediate access to evidence-based guidelines, the latest medical literature, and tools for generating differential diagnoses. However, our research also acknowledges the limitations of current AI methodologies in disease diagnosis and explores uncertainties and obstacles associated with the complete integration of AI into clinical practice. This review has highlighted the critical significance of integrating AI into the medical healthcare framework and meticulously examined the evolutionary trajectory of healthcare-oriented AI from its inception, delving into the current state of development and projecting the extent of reliance on AI in the future. The authors have found that central to this study is the exploration of how the strategic integration of AI can accelerate the diagnostic process, heighten diagnostic accuracy, and enhance overall operational efficiency, concurrently relieving the burdens faced by healthcare practitioners.

CT radiomics for predicting the prognosis of patients with stage II rectal cancer during the three-year period after surgery, chemotherapy and radiotherapy

Objective

Pre-treatment enhanced CT image data were used to train and build models to predict the efficacy of non-small cell lung cancer after conventional radiotherapy and chemotherapy using two classification algorithms, Logistic Regression (LR) and Gaussian Naive Baye (GNB).

Methods

In this study, we used pre-treatment enhanced CT image data for region of interest (ROI) sketching and feature extraction. We utilized the least absolute shrinkage and selection operator (LASSO) mutual confidence method for feature screening. We pre-screened logistic regression (LR) and Gaussian naive Bayes (GNB) classification algorithms and trained and modeled the screened features. We plotted 5-fold and 10-fold cross-validated receiver operating characteristic (ROC) curves to calculate the area under the curve (AUC). We performed DeLong's test for validation and plotted calibration curves and decision curves to assess model performance.

Results

A total of 102 patients were included in this study, and after a comparative analysis of the two models, LR had only slightly lower specificity than GNB, and higher sensitivity, accuracy, AUC value, precision, and F1 value than GNB (training set accuracy: 0.787, AUC value: 0.851; test set accuracy: 0.772, AUC value: 0.849), and the LR model has better performance in both the decision curve and the calibration curve.

Conclusion

CT can be used for efficacy prediction after radiotherapy and chemotherapy in NSCLC patients. LR is more suitable for predicting whether NSCLC prognosis is in remission without considering the computing speed.

Lung-PNet: An Automated Deep Learning Model for the Diagnosis of Invasive Adenocarcinoma in Pure Ground-Glass Nodules on Chest CT

BACKGROUND. Pure ground-glass nodules (pGGNs) on chest CT representing invasive adenocarcinoma (IAC) warrant lobectomy with lymph node resection. For pGGNs representing other entities, close follow-up or sublobar resection without node dissection may be appropriate. OBJECTIVE. The purpose of this study was to develop and validate an automated deep learning model for differentiation of pGGNs on chest CT representing IAC from those representing atypical adenomatous hyperplasia (AAH), adenocarcinoma in situ (AIS), and minimally invasive adenocarcinoma (MIA). METHODS. This retrospective study included 402 patients (283 women, 119 men; mean age, 53.2 years) with a total of 448 pGGNs on noncontrast chest CT that were resected from January 2019 to June 2022 and were histologically diagnosed as AAH (n = 29), AIS (n = 83), MIA (n = 235), or IAC (n = 101). Lung-PNet, a 3D deep learning model, was developed for automatic segmentation and classification (probability of IAC vs other entities) of pGGNs on CT. Nodules resected from January 2019 to December 2021 were randomly allocated to training (n = 327) and internal test (n = 82) sets. Nodules resected from January 2022 to June 2022 formed a holdout test set (n = 39). Segmentation performance was assessed with Dice coefficients with radiologists' manual segmentations as reference. Classification performance was assessed by ROC AUC and precision-recall AUC (PR AUC) and compared with that of four readers (three radiologists, one surgeon). The code used is publicly available (https://github.com/XiaodongZhang-PKUFH/Lung-PNet.git). RESULTS. In the holdout test set, Dice coefficients for segmentation of IACs and of other lesions were 0.860 and 0.838, and ROC AUC and PR AUC for classification as IAC were 0.911 and 0.842. At threshold probability of 50.0% or greater for prediction of IAC, Lung-PNet had sensitivity, specificity, accuracy, and F1 score of 50.0%, 92.0%, 76.9%, and 60.9% in the holdout test set. In the holdout test set, accuracy and F1 score (p values vs Lung-PNet) for individual readers were as follows: reader 1, 51.3% (p = .02) and 48.6% (p = .008); reader 2, 79.5% (p = .75) and 75.0% (p = .10); reader 3, 66.7% (p = .35) and 68.3% (p < .001); reader 4, 71.8% (p = .48) and 42.1% (p = .18). CONCLUSION. Lung-PNet had robust performance for segmenting and classifying (IAC vs other entities) pGGNs on chest CT. CLINICAL IMPACT. This automated deep learning tool may help guide selection of surgical strategies for pGGN management.

Combined model integrating deep learning, radiomics, and clinical data to classify lung nodules at chest CT

OBJECTIVES

The study aimed to develop a combined model that integrates deep learning (DL), radiomics, and clinical data to classify lung nodules into benign or malignant categories, and to further classify lung nodules into different pathological subtypes and Lung Imaging Reporting and Data System (Lung-RADS) scores.

MATERIALS AND METHODS

The proposed model was trained, validated, and tested using three datasets: one public dataset, the Lung Nodule Analysis 2016 (LUNA16) Grand challenge dataset (n = 1004), and two private datasets, the Lung Nodule Received Operation (LNOP) dataset (n = 1027) and the Lung Nodule in Health Examination (LNHE) dataset (n = 1525). The proposed model used a stacked ensemble model by employing a machine learning (ML) approach with an AutoGluon-Tabular classifier. The input variables were modified 3D convolutional neural network (CNN) features, radiomics features, and clinical features. Three classification tasks were performed: Task 1: Classification of lung nodules into benign or malignant in the LUNA16 dataset; Task 2: Classification of lung nodules into different pathological subtypes; and Task 3: Classification of Lung-RADS score. Classification performance was determined based on accuracy, recall, precision, and F1-score. Ten-fold cross-validation was applied to each task.

RESULTS

The proposed model achieved high accuracy in classifying lung nodules into benign or malignant categories in LUNA 16 with an accuracy of 92.8%, as well as in classifying lung nodules into different pathological subtypes with an F1-score of 75.5% and Lung-RADS scores with an F1-score of 80.4%.

CONCLUSION

Our proposed model provides an accurate classification of lung nodules based on the benign/malignant, different pathological subtypes, and Lung-RADS system.

An artificial intelligence-assisted diagnostic system for the prediction of benignity and malignancy of pulmonary nodules and its practical value for patients with different clinical characteristics

Objectives

This study aimed to explore the value of an artificial intelligence (AI)-assisted diagnostic system in the prediction of pulmonary nodules.

Methods

The AI system was able to make predictions of benign or malignant nodules. 260 cases of solitary pulmonary nodules (SPNs) were divided into 173 malignant cases and 87 benign cases based on the surgical pathological diagnosis. A stratified data analysis was applied to compare the diagnostic effectiveness of the AI system to distinguish between the subgroups with different clinical characteristics.

Results

The accuracy of AI system in judging benignity and malignancy of the nodules was 75.77% (p < 0.05). We created an ROC curve by calculating the true positive rate (TPR) and the false positive rate (FPR) at different threshold values, and the AUC was 0.755. Results of the stratified analysis were as follows. (1) By nodule position: the AUC was 0.677, 0.758, 0.744, 0.982, and 0.725, respectively, for the nodules in the left upper lobe, left lower lobe, right upper lobe, right middle lobe, and right lower lobe. (2) By nodule size: the AUC was 0.778, 0.771, and 0.686, respectively, for the nodules measuring 5-10, 10-20, and 20-30 mm in diameter. (3) The predictive accuracy was higher for the subsolid pulmonary nodules than for the solid ones (80.54 vs. 66.67%).

Conclusion

The AI system can be applied to assist in the prediction of benign and malignant pulmonary nodules. It can provide a valuable reference, especially for the diagnosis of subsolid nodules and small nodules measuring 5-10 mm in diameter.

Deep learning-based solid component measuring enabled interpretable prediction of tumor invasiveness for lung adenocarcinoma

BACKGROUND

The nature of the solid component of subsolid nodules (SSNs) can indicate tumor pathological invasiveness. However, preoperative solid component assessment still lacks a reference standard.

METHODS

In this retrospective study, an AI algorithm was proposed for measuring the solid components ratio in SSNs, which was used to assess the diameter ratio (1D), area ratio (2D), and volume ratio (3D). The radiologist measured each SSN's consolidation to tumor ratio (CTR) twice, four weeks apart. The area under the receiver-operating characteristic (ROC) curve (AUC) was calculated for each method used to discriminate an Invasive Adenocarcinoma (IA) from a non-IA. The AUC and the time cost of each measurement were compared. Furthermore, we examined the consistency of measurements made by the radiologist on two separate occasions.

RESULTS

A total of 379 patients (the primary dataset n = 278, the validation dataset n = 101) were included. In the primary dataset, compared to the manual approach (AUC: 0.697), the AI algorithm (AUC: 0.811) had better predictive performance (P =.0027) in measuring solid components ratio in 3D. Algorithm measurement in 3D had an AUC no inferior to 1D (AUC: 0.806) and 2D (AUC: 0.796). In the validation dataset, the AI 3D method also achieved superior diagnostic performance compared to the radiologist (AUC: 0.803 vs 0.682, P =.046). The two measurements of the CTR in the primary dataset, taken 4 weeks apart, have 7.9 % cases in poor consistency. The measurement time cost by the radiologist is about 60 times that of the AI algorithm (P <.001).

CONCLUSION

The 3D measurement of solid components using AI, is an effective and objective approach to predict the pathological invasiveness of SSNs. It can be a preoperative interpretable indicator of pathological invasiveness in patients with lung adenocarcinoma.

Prognostic impact of deep learning-based quantification in clinical stage 0-I lung adenocarcinoma

OBJECTIVES

To evaluate the performance of automatic deep learning (DL) algorithm for size, mass, and volume measurements in predicting prognosis of lung adenocarcinoma (LUAD) and compared with manual measurements.

METHODS

A total of 542 patients with clinical stage 0-I peripheral LUAD and with preoperative CT data of 1-mm slice thickness were included. Maximal solid size on axial image (MSSA) was evaluated by two chest radiologists. MSSA, volume of solid component (SV), and mass of solid component (SM) were evaluated by DL. Consolidation-to-tumor ratios (CTRs) were calculated. For ground glass nodules (GGNs), solid parts were extracted with different density level thresholds. The prognosis prediction efficacy of DL was compared with that of manual measurements. Multivariate Cox proportional hazards model was used to find independent risk factors.

RESULTS

The prognosis prediction efficacy of T-staging (TS) measured by radiologists was inferior to that of DL. For GGNs, MSSA-based CTR measured by radiologists (RMSSA%) could not stratify RFS and OS risk, whereas measured by DL using 0HU (2D-AIMSSA0HU%) could by using different cutoffs. SM and SV measured by DL using 0 HU (AISM0HU% and AISV0HU%) could effectively stratify the survival risk regardless of different cutoffs and were superior to 2D-AIMSSA0HU%. AISM0HU% and AISV0HU% were independent risk factors.

CONCLUSION

DL algorithm can replace human for more accurate T-staging of LUAD. For GGNs, 2D-AIMSSA0HU% could predict prognosis rather than RMSSA%. The prediction efficacy of AISM0HU% and AISV0HU% was more accurate than of 2D-AIMSSA0HU% and both were independent risk factors.

CLINICAL RELEVANCE STATEMENT

Deep learning algorithm could replace human for size measurements and could better stratify prognosis than manual measurements in patients with lung adenocarcinoma.

KEY POINTS

• Deep learning (DL) algorithm could replace human for size measurements and could better stratify prognosis than manual measurements in patients with lung adenocarcinoma (LUAD). • For GGNs, maximal solid size on axial image (MSSA)-based consolidation-to-tumor ratio (CTR) measured by DL using 0 HU could stratify survival risk than that measured by radiologists. • The prediction efficacy of mass- and volume-based CTRs measured by DL using 0 HU was more accurate than of MSSA-based CTR and both were independent risk factors.

A pairwise radiomics algorithm-lesion pair relation estimation model for distinguishing multiple primary lung cancer from intrapulmonary metastasis

Background

Distinguishing multiple primary lung cancer (MPLC) from intrapulmonary metastasis (IPM) is critical for their disparate treatment strategy and prognosis. This study aimed to establish a non-invasive model to make the differentiation pre-operatively.

Methods

We retrospectively studied 168 patients with multiple lung cancers (307 pairs of lesions) including 118 cases for modeling and internal validation, and 50 cases for independent external validation. Radiomic features on computed tomography (CT) were extracted to calculate the absolute deviation of paired lesions. Features were then selected by correlation coefficients and random forest classifier 5-fold cross-validation, based on which the lesion pair relation estimation (PRE) model was developed. A major voting strategy was used to decide diagnosis for cases with multiple pairs of lesions. Cases from another institute were included as the external validation set for the PRE model to compete with two experienced clinicians.

Results

Seven radiomic features were selected for the PRE model construction. With major voting strategy, the mean area under receiver operating characteristic curve (AUC), accuracy, sensitivity, and specificity of the training versus internal validation versus external validation cohort to distinguish MPLC were 0.983 versus 0.844 versus 0.793, 0.942 versus 0.846 versus 0.760, 0.905 versus 0.728 versus 0.727, and 0.962 versus 0.910 versus 0.769, respectively. AUCs of the two clinicians were 0.619 and 0.580.

Conclusions

The CT radiomic feature-based lesion PRE model is potentially an accurate diagnostic tool for the differentiation of MPLC and IPM, which could help with clinical decision making.

Opportunities and challenges of 5G network technology toward precision medicine

Moving away from traditional "one-size-fits-all" treatment to precision-based medicine has tremendously improved disease prognosis, accuracy of diagnosis, disease progression prediction, and targeted-treatment. The current cutting-edge of 5G network technology is enabling a growing trend in precision medicine to extend its utility and value to the smart healthcare system. The 5G network technology will bring together big data, artificial intelligence, and machine learning to provide essential levels of connectivity to enable a new health ecosystem toward precision medicine. In the 5G-enabled health ecosystem, its applications involve predictive and preventative measurements which enable advances in patient personalization. This review aims to discuss the opportunities, challenges, and prospects posed to 5G network technology in moving forward to deliver personalized treatments and patient-centric care via a precision medicine approach.

Artificial Intelligence and Lung Cancer: Impact on Improving Patient Outcomes

Lung cancer remains one of the leading causes of cancer-related deaths worldwide, emphasizing the need for improved diagnostic and treatment approaches. In recent years, the emergence of artificial intelligence (AI) has sparked considerable interest in its potential role in lung cancer. This review aims to provide an overview of the current state of AI applications in lung cancer screening, diagnosis, and treatment. AI algorithms like machine learning, deep learning, and radiomics have shown remarkable capabilities in the detection and characterization of lung nodules, thereby aiding in accurate lung cancer screening and diagnosis. These systems can analyze various imaging modalities, such as low-dose CT scans, PET-CT imaging, and even chest radiographs, accurately identifying suspicious nodules and facilitating timely intervention. AI models have exhibited promise in utilizing biomarkers and tumor markers as supplementary screening tools, effectively enhancing the specificity and accuracy of early detection. These models can accurately distinguish between benign and malignant lung nodules, assisting radiologists in making more accurate and informed diagnostic decisions. Additionally, AI algorithms hold the potential to integrate multiple imaging modalities and clinical data, providing a more comprehensive diagnostic assessment. By utilizing high-quality data, including patient demographics, clinical history, and genetic profiles, AI models can predict treatment responses and guide the selection of optimal therapies. Notably, these models have shown considerable success in predicting the likelihood of response and recurrence following targeted therapies and optimizing radiation therapy for lung cancer patients. Implementing these AI tools in clinical practice can aid in the early diagnosis and timely management of lung cancer and potentially improve outcomes, including the mortality and morbidity of the patients.

A deep-learning model using enhanced chest CT images to predict PD-L1 expression in non-small-cell lung cancer patients

AIM

To develop a deep-learning model using contrast-enhanced chest computed tomography (CT) images to predict programmed death-ligand 1 (PD-L1) expression in patients with non-small-cell lung cancer (NSCLC).

MATERIALS AND METHODS

Preoperative enhanced chest CT images and immunohistochemistry results for PD-L1 expression (<1% and ≥1% were defined as negative and positive, respectively) were collected retrospectively from 125 NSCLC patients to train and validate a deep-learning radiomics model (DLRM) for the prediction of PD-L1 expression in tumours. The DLRM was developed by combining the deep-learning signature (DLS) obtained from a convolutional neural network and clinicopathological factors. The indexes of the area under the curve (AUC), integrated discrimination improvement (IDI), and decision curve analysis (DCA) were used to evaluate the efficiency of the DLRM.

RESULTS

DLS and tumour stage were identified as independent predictors of PD-L1 expression by the DLRM. The AUCs of the DLRM were 0.804 (95% confidence interval: 0.697-0.911) and 0.804 (95% confidence interval: 0.679-0.929) in the training and validation cohorts, respectively. IDI analysis showed the DLRM had better diagnostic accuracy than DLS (0.0028 [p<0.05]) in the validation cohort. Additionally, DCA revealed that the DLRM had more net benefit than the DLS for clinical utility.

CONCLUSION

The proposed DLRM using enhanced chest CT images could function as a non-invasive diagnostic tool to differentiate PD-L1 expression in NSCLC patients.

Invasiveness assessment by artificial intelligence against intraoperative frozen section for pulmonary nodules ≤ 3 cm

PURPOSE

To investigate the performance of an artificial intelligence (AI) algorithm for assessing the malignancy and invasiveness of pulmonary nodules in a multicenter cohort.

METHODS

A previously developed deep learning system based on a 3D convolutional neural network was used to predict tumor malignancy and invasiveness. Dataset of pulmonary nodules no more than 3 cm was integrated with CT images and pathologic information. Receiver operating characteristic curve analysis was used to evaluate the performance of the system.

RESULTS

A total of 466 resected pulmonary nodules were included in this study. The areas under the curves (AUCs) of the deep learning system in the prediction of malignancy as compared with pathological reports were 0.80, 0.80, and 0.75 for all, subcentimeter, and solid nodules, respectively. Additionally, the AUC in the AI-assisted prediction of invasive adenocarcinoma (IA) among subsolid lesions (n = 184) was 0.88. Most malignancies that were misdiagnosed by the AI system as benign diseases with a diameter measuring greater than 1 cm (26/250, 10.4%) presented as solid nodules (19/26, 73.1%) on CT. In an exploratory analysis involving nodules underwent intraoperative pathologic examination, the concordance rate in identifying IA between the AI model and frozen section examination was 0.69, with a sensitivity of 0.50 and specificity of 0.97.

CONCLUSION

The deep learning system can discriminate malignant diseases for pulmonary nodules measuring no more than 3 cm. The AI model has a high positive predictive value for invasive adenocarcinoma with respect to intraoperative frozen section examination, which might help determine the individualized surgical strategy.

Leveraging 2D Deep Learning ImageNet-trained models for Native 3D Medical Image Analysis

Convolutional neural networks (CNNs) have shown promising performance in various 2D computer vision tasks due to availability of large amounts of 2D training data. Contrarily, medical imaging deals with 3D data and usually lacks the equivalent extent and diversity of data, for developing AI models. Transfer learning provides the means to use models trained for one application as a starting point to another application. In this work, we leverage 2D pre-trained models as a starting point in 3D medical applications by exploring the concept of Axial-Coronal-Sagittal (ACS) convolutions. We have incorporated ACS as an alternative of native 3D convolutions in the Generally Nuanced Deep Learning Framework (GaNDLF), providing various well-established and state-of-the-art network architectures with the availability of pre-trained encoders from 2D data. Results of our experimental evaluation on 3D MRI data of brain tumor patients for i) tumor segmentation and ii) radiogenomic classification, show model size reduction by ~22% and improvement in validation accuracy by ~33%. Our findings support the advantage of ACS convolutions in pre-trained 2D CNNs over 3D CNN without pre-training, for 3D segmentation and classification tasks, democratizing existing models trained in datasets of unprecedented size and showing promise in the field of healthcare.

An ensemble deep learning model for risk stratification of invasive lung adenocarcinoma using thin-slice CT

Lung cancer screening using computed tomography (CT) has increased the detection rate of small pulmonary nodules and early-stage lung adenocarcinoma. It would be clinically meaningful to accurate assessment of the nodule histology by CT scans with advanced deep learning algorithms. However, recent studies mainly focus on predicting benign and malignant nodules, lacking of model for the risk stratification of invasive adenocarcinoma. We propose an ensemble multi-view 3D convolutional neural network (EMV-3D-CNN) model to study the risk stratification of lung adenocarcinoma. We include 1075 lung nodules (≤30 mm and ≥4 mm) with preoperative thin-section CT scans and definite pathology confirmed by surgery. Our model achieves a state-of-art performance of 91.3% and 92.9% AUC for diagnosis of benign/malignant and pre-invasive/invasive nodules, respectively. Importantly, our model outperforms senior doctors in risk stratification of invasive adenocarcinoma with 77.6% accuracy [i.e., Grades 1, 2, 3]). It provides detailed predictive histological information for the surgical management of pulmonary nodules. Finally, for user-friendly access, the proposed model is implemented as a web-based system ( https://seeyourlung.com.cn ).

China lung cancer screening (CLUS) version 2.0 with new techniques implemented: Artificial intelligence, circulating molecular biomarkers and autofluorescence bronchoscopy

OBJECTIVE

The present study, CLUS version 2.0, was conducted to evaluate the performance of new techniques in improving the implementation of lung cancer screening and to validate the efficacy of LDCT in reducing lung cancer-specific mortality in a high-risk Chinese population.

METHODS

From July 2018 to February 2019, high-risk participants from six screening centers in Shanghai were enrolled in our study. Artificial intelligence, circulating molecular biomarkers and autofluorescencebronchoscopy were applied during screening.

RESULTS

A total of 5087 eligible high-risk participants were enrolled in the study; 4490 individuals were invited, and 4395 participants (97.9%) finally underwent LDCT detection. Positive screening results were observed in 857 (19.5%) participants. Solid nodules represented 53.6% of all positive results, while multiple nodules were the most common location type (26.8%). Up to December 2020, 77 participants received lung resection or biopsy, including 70 lung cancers, 2 mediastinal tumors, 1 tracheobronchial tumor, 1 malignant pleural mesothelioma and 3 benign nodules. Lung cancer patients accounted for 1.6% of all the screened participants, and 91.4% were in the early stage (stage 0-1).

CONCLUSIONS

LDCT screening can detect a high proportion of early-stage lung cancer patients in a Chinese high-risk population. The utilization of new techniques would be conducive to improving the implementation of LDCT screening.

Deep learning predicts malignancy and metastasis of solid pulmonary nodules from CT scans

In the clinic, it is difficult to distinguish the malignancy and aggressiveness of solid pulmonary nodules (PNs). Incorrect assessments may lead to delayed diagnosis and an increased risk of complications. We developed and validated a deep learning-based model for the prediction of malignancy as well as local or distant metastasis in solid PNs based on CT images of primary lesions during initial diagnosis. In this study, we reviewed the data from multiple patients with solid PNs at our institution from 1 January 2019 to 30 April 2022. The patients were divided into three groups: benign, Ia-stage lung cancer, and T1-stage lung cancer with metastasis. Each cohort was further split into training and testing groups. The deep learning system predicted the malignancy and metastasis status of solid PNs based on CT images, and then we compared the malignancy prediction results among four different levels of clinicians. Experiments confirmed that human-computer collaboration can further enhance diagnostic accuracy. We made a held-out testing set of 134 cases, with 689 cases in total. Our convolutional neural network model reached an area under the ROC (AUC) of 80.37% for malignancy prediction and an AUC of 86.44% for metastasis prediction. In observer studies involving four clinicians, the proposed deep learning method outperformed a junior respiratory clinician and a 5-year respiratory clinician by considerable margins; it was on par with a senior respiratory clinician and was only slightly inferior to a senior radiologist. Our human-computer collaboration experiment showed that by simply adding binary human diagnosis into model prediction probabilities, model AUC scores improved to 81.80-88.70% when combined with three out of four clinicians. In summary, the deep learning method can accurately diagnose the malignancy of solid PNs, improve its performance when collaborating with human experts, predict local or distant metastasis in patients with T1-stage lung cancer, and facilitate the application of precision medicine.

Artificial intelligence-assisted selection and efficacy prediction of antineoplastic strategies for precision cancer therapy

The rapid development of artificial intelligence (AI) technologies in the context of the vast amount of collectable data obtained from high-throughput sequencing has led to an unprecedented understanding of cancer and accelerated the advent of a new era of clinical oncology with a tone of precision treatment and personalized medicine. However, the gains achieved by a variety of AI models in clinical oncology practice are far from what one would expect, and in particular, there are still many uncertainties in the selection of clinical treatment options that pose significant challenges to the application of AI in clinical oncology. In this review, we summarize emerging approaches, relevant datasets and open-source software of AI and show how to integrate them to address problems from clinical oncology and cancer research. We focus on the principles and procedures for identifying different antitumor strategies with the assistance of AI, including targeted cancer therapy, conventional cancer therapy, and cancer immunotherapy. In addition, we also highlight the current challenges and directions of AI in clinical oncology translation. Overall, we hope this article will provide researchers and clinicians with a deeper understanding of the role and implications of AI in precision cancer therapy, and help AI move more quickly into accepted cancer guidelines.

Improving the efficiency of identifying malignant pulmonary nodules before surgery via a combination of artificial intelligence CT image recognition and serum autoantibodies

OBJECTIVE

To construct a new pulmonary nodule diagnostic model with high diagnostic efficiency, non-invasive and simple to measure.

METHODS

This study included 424 patients with radioactive pulmonary nodules who underwent preoperative 7-autoantibody (7-AAB) panel testing, CT-based AI diagnosis, and pathological diagnosis by surgical resection. The patients were randomly divided into a training set (n = 212) and a validation set (n = 212). The nomogram was developed through forward stepwise logistic regression based on the predictive factors identified by univariate and multivariate analyses in the training set and was verified internally in the verification set.

RESULTS

A diagnostic nomogram was constructed based on the statistically significant variables of age as well as CT-based AI diagnostic, 7-AAB panel, and CEA test results. In the validation set, the sensitivity, specificity, positive predictive value, and AUC were 82.29%, 90.48%, 97.24%, and 0.899 (95%[CI], 0.851-0.936), respectively. The nomogram showed significantly higher sensitivity than the 7-AAB panel test result (82.29% vs. 35.88%, p < 0.001) and CEA (82.29% vs. 18.82%, p < 0.001); it also had a significantly higher specificity than AI diagnosis (90.48% vs. 69.04%, p = 0.022). For lesions with a diameter of ≤ 2 cm, the specificity of the Nomogram was higher than that of the AI diagnostic system (90.00% vs. 67.50%, p = 0.022).

CONCLUSIONS

Based on the combination of a 7-AAB panel, an AI diagnostic system, and other clinical features, our Nomogram demonstrated good diagnostic performance in distinguishing lung nodules, especially those with ≤ 2 cm diameters.

KEY POINTS

• A novel diagnostic model of lung nodules was constructed by combining high-specific tumor markers with a high-sensitivity artificial intelligence diagnostic system. • The diagnostic model has good diagnostic performance in distinguishing malignant and benign pulmonary nodules, especially for nodules smaller than 2 cm. • The diagnostic model can assist the clinical decision-making of pulmonary nodules, with the advantages of high diagnostic efficiency, noninvasive, and simple measurement.

A dual-transformation with contrastive learning framework for lymph node metastasis prediction in pancreatic cancer

Pancreatic cancer is a malignant tumor, and its high recurrence rate after surgery is related to the lymph node metastasis status. In clinical practice, a preoperative imaging prediction method is necessary for prognosis assessment and treatment decision; however, there are two major challenges: insufficient data and difficulty in discriminative feature extraction. This paper proposed a deep learning model to predict lymph node metastasis in pancreatic cancer using multiphase CT, where a dual-transformation with contrastive learning framework is developed to overcome the challenges in fine-grained prediction with small sample sizes. Specifically, we designed a novel dynamic surface projection method to transform 3D data into 2D images for effectively using the 3D information, preserving the spatial correlation of the original texture information and reducing computational resources. Then, this dynamic surface projection was combined with the spiral transformation to establish a dual-transformation method for enhancing the diversity and complementarity of the dataset. A dual-transformation-based data augmentation method was also developed to produce numerous 2D-transformed images to alleviate the effect of insufficient samples. Finally, the dual-transformation-guided contrastive learning scheme based on intra-space-transformation consistency and inter-class specificity was designed to mine additional supervised information, thereby extracting more discriminative features. Extensive experiments have shown the promising performance of the proposed model for predicting lymph node metastasis in pancreatic cancer. Our dual-transformation with contrastive learning scheme was further confirmed on an external public dataset, representing a potential paradigm for the fine-grained classification of oncological images with small sample sizes. The code will be released at https://github.com/SJTUBME-QianLab/Dual-transformation.

Evaluation of surgical complexity by automated surgical process recognition in robotic distal gastrectomy using artificial intelligence

BACKGROUND

Although radical gastrectomy with lymph node dissection is the standard treatment for gastric cancer, the complication rate remains high. Thus, estimation of surgical complexity is required for safety. We aim to investigate the association between the surgical process and complexity, such as a risk of complications in robotic distal gastrectomy (RDG), to establish an artificial intelligence (AI)-based automated surgical phase recognition by analyzing robotic surgical videos, and to investigate the predictability of surgical complexity by AI.

METHOD

This study assessed clinical data and robotic surgical videos for 56 patients who underwent RDG for gastric cancer. We investigated (1) the relationship between surgical complexity and perioperative factors (patient characteristics, surgical process); (2) AI training for automated phase recognition and model performance was assessed by comparing predictions to the surgeon-annotated reference; (3) AI model predictability for surgical complexity was calculated by the area under the curve.

RESULT

Surgical complexity score comprised extended total surgical duration, bleeding, and complications and was strongly associated with the intraoperative surgical process, especially in the beginning phases (area under the curve 0.913). We established an AI model that can recognize surgical phases from video with 87% accuracy; AI can determine intraoperative surgical complexity by calculating the duration of beginning phases from phases 1-3 (area under the curve 0.859).

CONCLUSION

Surgical complexity, as a surrogate of short-term outcomes, can be predicted by the surgical process, especially in the extended duration of beginning phases. Surgical complexity can also be evaluated with automation using our artificial intelligence-based model.

Radiomics-Based Machine Learning for Predicting the Injury Time of Rib Fractures in Gemstone Spectral Imaging Scans

This retrospective study aimed to predict the injury time of rib fractures in distinguishing fresh (30 days) or old (90 days) rib fractures. We enrolled 111 patients with chest trauma who had been scanned for rib fractures at our hospital between January 2018 and December 2018 using gemstone spectral imaging (GSI). The volume of interest of each broken end of the rib fractures was segmented using calcium-based material decomposition images derived from the GSI scans. The training and testing sets were randomly assigned in a 7:3 ratio. All cases were divided into groups distinguishing the injury time at 30 and 90 days. We constructed radiomics-based models to predict the injury time of rib fractures. The model performance was assessed by the area under the curve (AUC) obtained by the receiver operating characteristic analysis. We included 54 patients with 259 rib fracture segmentations (34 men; mean age, 52 years ± 12.02; and range, 19-72 years). Nine features were excluded by the least absolute shrinkage and selection operator logistic regression to build the radiomics signature. For distinguishing the injury time at 30 days, the Support Vector Machine (SVM) model and human-model collaboration resulted in an accuracy and AUC of 0.85 and 0.871 and 0.91 and 0.912, respectively, and 0.81 and 0.804 and 0.83 and 0.85, respectively, at 90 days in the testing set. The radiomics-based model displayed good accuracy in differentiating between the injury time of rib fractures at 30 and 90 days, and the human-model collaboration generated more accurate outcomes, which may help to add value to clinical practice and distinguish artificial injury in forensic medicine.

3D deep learning versus the current methods for predicting tumor invasiveness of lung adenocarcinoma based on high-resolution computed tomography images

Background

Different pathological subtypes of lung adenocarcinoma lead to different treatment decisions and prognoses, and it is clinically important to distinguish invasive lung adenocarcinoma from preinvasive adenocarcinoma (adenocarcinoma in situ and minimally invasive adenocarcinoma). This study aims to investigate the performance of the deep learning approach based on high-resolution computed tomography (HRCT) images in the classification of tumor invasiveness and compare it with the performances of currently available approaches.

Methods

In this study, we used a deep learning approach based on 3D conventional networks to automatically predict the invasiveness of pulmonary nodules. A total of 901 early-stage non-small cell lung cancer patients who underwent surgical treatment at Shanghai Chest Hospital between November 2015 and March 2017 were retrospectively included and randomly assigned to a training set (n=814) or testing set 1 (n=87). We subsequently included 116 patients who underwent surgical treatment and intraoperative frozen section between April 2019 and January 2020 to form testing set 2. We compared the performance of our deep learning approach in predicting tumor invasiveness with that of intraoperative frozen section analysis and human experts (radiologists and surgeons).

Results

The deep learning approach yielded an area under the receiver operating characteristic curve (AUC) of 0.946 for distinguishing preinvasive adenocarcinoma from invasive lung adenocarcinoma in the testing set 1, which is significantly higher than the AUCs of human experts (P<0.05). In testing set 2, the deep learning approach distinguished invasive adenocarcinoma from preinvasive adenocarcinoma with an AUC of 0.862, which is higher than that of frozen section analysis (0.755, P=0.043), senior thoracic surgeons (0.720, P=0.006), radiologists (0.766, P>0.05) and junior thoracic surgeons (0.768, P>0.05).

Conclusions

We developed a deep learning model that achieved comparable performance to intraoperative frozen section analysis in determining tumor invasiveness. The proposed method may contribute to clinical decisions related to the extent of surgical resection.

Fusion of CT images and clinical variables based on deep learning for predicting invasiveness risk of stage I lung adenocarcinoma

PURPOSE

To develop a novel multimodal data fusion model by incorporating computed tomography (CT) images and clinical variables based on deep learning for predicting the invasiveness risk of stage I lung adenocarcinoma that manifests as ground-glass nodules (GGNs), and compare the diagnostic performance of it with that of radiologists.

METHODS

A total of 1946 patients with solitary and histopathologically confirmed GGNs with maximum diameter less than 3 cm were retrospectively enrolled. The training dataset containing 1704 GGNs was augmented by resampling, scaling, random cropping, etc., to generate new training data. A multimodal data fusion model based on residual learning architecture and two multilayer perceptron with attention mechanism combining CT images with patient general data and serum tumor markers was built. The distance-based confidence scores (DCS) were calculated and compared among multimodal data models with different combinations. An observer study was conducted and the prediction performance of the fusion algorithms was compared with that of the two radiologists by an independent testing dataset with 242 GGNs.

RESULTS

Among the whole GGNs, 606 GGNs are confirmed as invasive adenocarcinoma (IA) and 1340 are non-IA. The proposed novel multimodal data fusion model combining CT images, patient general data and serum tumor markers achieved the highest accuracy (88.5%), Area under a ROC curve (AUC) (0.957), F1 (81.5%), F1_weighted (81.9%) and Matthews correlation coefficient (MCC) (73.2%) for classifying between IA and non-IA GGNs, which was even better than the senior radiologist's performance (accuracy, 86.1%). In addition, the DCSs for multimodal data suggested that CT image had a stronger influence (0.9540) quantitatively than general data (0.6726) or tumor marker (0.6971).

CONCLUSION

This study demonstrated that the feasibility of integrating different types of data including CT images and clinical variables, and the multimodal data fusion model yielded higher performance for distinguishing IA from non-IA GGNs. This article is protected by copyright. All rights reserved.

ViSTA: A Novel Network Improving Lung Adenocarcinoma Invasiveness Prediction from Follow-Up CT Series

Simple Summary

Assessing follow-up computed tomography(CT) series is of great importance in clinical practice for lung nodule diagnosis. Deep learning is a thriving data mining method in medical imaging and has obtained surprising results. However, previous studies mostly focused on the analysis of single static time points instead of the entire follow-up series and required regular intervals between CT examinations. In the current study, we propose a new deep learning framework, named ViSTA, that can better evaluate tumor invasiveness using irregularly serial follow-up CT images to avoid aggressive procedures or delay diagnosis in clinical practice. ViSTA provides a new solution for irregularly sampled data. ViSTA delivers superior performance compared with other static or serial deep learning models. The proposed ViSTA framework is capable of improving performance close to the human level in the prediction of invasiveness of lung adenocarcinoma while being transferrable to other tasks analyzing serial medical data.

Abstract

To investigate the value of the deep learning method in predicting the invasiveness of early lung adenocarcinoma based on irregularly sampled follow-up computed tomography (CT) scans. In total, 351 nodules were enrolled in the study. A new deep learning network based on temporal attention, named Visual Simple Temporal Attention (ViSTA), was proposed to process irregularly sampled follow-up CT scans. We conducted substantial experiments to investigate the supplemental value in predicting the invasiveness using serial CTs. A test set composed of 69 lung nodules was reviewed by three radiologists. The performance of the model and radiologists were compared and analyzed. We also performed a visual investigation to explore the inherent growth pattern of the early adenocarcinomas. Among counterpart models, ViSTA showed the best performance (AUC: 86.4% vs. 60.6%, 75.9%, 66.9%, 73.9%, 76.5%, 78.3%). ViSTA also outperformed the model based on Volume Doubling Time (AUC: 60.6%). ViSTA scored higher than two junior radiologists (accuracy of 81.2% vs. 75.4% and 71.0%) and came close to the senior radiologist (85.5%). Our proposed model using irregularly sampled follow-up CT scans achieved promising accuracy in evaluating the invasiveness of the early stage lung adenocarcinoma. Its performance is comparable with senior experts and better than junior experts and traditional deep learning models. With further validation, it can potentially be applied in clinical practice.

Preoperative CECT-based Radiomic Signature for Predicting the Response of Transarterial Chemoembolization (TACE) Therapy in Hepatocellular Carcinoma

PURPOSE

To evaluate the efficiency of radiomics signatures in predicting the response of transarterial chemoembolization (TACE) therapy based on preoperative contrast-enhanced computed tomography (CECT).

MATERIALS

This study consisted of 111 patients with intermediate-stage hepatocellular carcinoma who underwent CECT at both the arterial phase (AP) and venous phase (VP) before and after TACE. According to mRECIST 1.1, patients were divided into an objective-response group (n = 38) and a non-response group (n = 73). Among them, 79 patients were assigned as the training dataset, and the remaining 32 cases were assigned as the test dataset.

METHODS

Radiomics features were extracted from CECT images. Two feature ranking methods and three classifiers were used to find the best single-phase radiomics signatures for both AP and VP on the training set. Meanwhile, multi-phase radiomics signatures were built upon integration of images from two CECT phases by decision-level fusion and feature-level fusion. Finally, multivariable logistic regression was used to develop a nomogram by combining radiomics signatures and clinic-radiologic characteristics. The prediction performance was evaluated by AUC on the test dataset.

RESULTS

The multi-phase radiomics signature (AUC = 0.883) performed better in predicting TACE therapy response compared to the best single-phase radiomics signature (AUC = 0.861). The nomogram (AUC = 0.913) showed better performance than any radiomics signatures.

CONCLUSION

The radiomics signatures and nomogram were developed and validated for predicting responses to TACE therapy, and the radiomics model may play a positive role in identifying patients who may benefit from TACE therapy in clinical practice.

Predicting the Severity of Neurological Impairment Caused by Ischemic Stroke Using Deep Learning Based on Diffusion-Weighted Images

Purpose: To develop a preliminary deep learning model that uses diffusion-weighted imaging (DWI) images to classify the severity of neurological impairment caused by ischemic stroke. Materials and Methods: This retrospective study included 851 ischemic stroke patients (711 patients in the training set and 140 patients in the test set). The patients’ NIHSS scores, which reflect the severity of neurological impairment, were reviewed upon admission and on Day 7 of hospitalization and were classified into two stages (stage 1 for NIHSS < 5 and stage 2 for NIHSS ≥ 5). A 3D-CNN was trained to predict the stage of NIHSS based on different preprocessed DWI images. The performance in predicting the severity of anterior and posterior circulation stroke was also investigated. The AUC, specificity, and sensitivity were calculated to evaluate the performance of the model. Results: Our proposed model obtained better performance in predicting the NIHSS stage on Day 7 of hospitalization than that at admission (best AUC 0.895 vs. 0.846). Model D trained with DWI images (normalized with z-score and resized to 256 × 256 × 64 voxels) achieved the best AUC of 0.846 in predicting the NIHSS stage at admission. Model E rained with DWI images (normalized with maximum−minimum and resized to 128 × 128 × 32 voxels) achieved the best AUC of 0.895 in predicting the NIHSS stage on Day 7 of hospitalization. Our model also showed promising performance in predicting the NIHSS stage on Day 7 of hospitalization for anterior and posterior circulation stroke, with the best AUCs of 0.905 and 0.903, respectively. Conclusions: Our proposed 3D-CNN model can effectively predict the neurological severity of IS using DWI images and performs better in predicting the NIHSS stage on Day 7 of hospitalization. The model also obtained promising performance in subgroup analysis, which can potentially help clinical decision making.

Deep Learning Analysis Using 18F-FDG PET/CT to Predict Occult Lymph Node Metastasis in Patients With Clinical N0 Lung Adenocarcinoma

Introduction

The aim of this work was to determine the feasibility of using a deep learning approach to predict occult lymph node metastasis (OLM) based on preoperative FDG-PET/CT images in patients with clinical node-negative (cN0) lung adenocarcinoma.

Materials and Methods

Dataset 1 (for training and internal validation) included 376 consecutive patients with cN0 lung adenocarcinoma from our hospital between May 2012 and May 2021. Dataset 2 (for prospective test) used 58 consecutive patients with cN0 lung adenocarcinoma from June 2021 to February 2022 at the same center. Three deep learning models: PET alone, CT alone, and combined model, were developed for the prediction of OLM. The performance of the models was evaluated on internal validation and prospective test in terms of accuracy, sensitivity, specificity, and areas under the receiver operating characteristic curve (AUCs).

Results

The combined model incorporating PET and CT showed the best performance, achieved an AUC of 0.81 [95% confidence interval (CI): 0.61, 1.00] in the prediction of OLM in internal validation set (n = 60) and an AUC of 0.87 (95% CI: 0.75, 0.99) in the prospective test set (n = 58). The model achieved 87.50% sensitivity, 80.00% specificity, and 81.00% accuracy in the internal validation set and achieved 75.00% sensitivity, 88.46% specificity, and 86.60% accuracy in the prospective test set.

Conclusion

This study presented a deep learning approach to enable the prediction of occult nodal involvement based on the PET/CT images before surgery in cN0 lung adenocarcinoma, which would help clinicians select patients who would be suitable for sublobar resection.

Artificial intelligence in clinical applications for lung cancer: diagnosis, treatment and prognosis

Artificial Intelligence (AI) is a branch of computer science that includes research in robotics, language recognition, image recognition, natural language processing, and expert systems. AI is poised to change medical practice, and oncology is not an exception to this trend. As the matter of fact, lung cancer has the highest morbidity and mortality worldwide. The leading cause is the complexity of associating early pulmonary nodules with neoplastic changes and numerous factors leading to strenuous treatment choice and poor prognosis. AI can effectively enhance the diagnostic efficiency of lung cancer while providing optimal treatment and evaluating prognosis, thereby reducing mortality. This review seeks to provide an overview of AI relevant to all the fields of lung cancer. We define the core concepts of AI and cover the basics of the functioning of natural language processing, image recognition, human-computer interaction and machine learning. We also discuss the most recent breakthroughs in AI technologies and their clinical application regarding diagnosis, treatment, and prognosis in lung cancer. Finally, we highlight the future challenges of AI in lung cancer and its impact on medical practice.

Automated Surgical-Phase Recognition for Robot-Assisted Minimally Invasive Esophagectomy Using Artificial Intelligence

BACKGROUND

Although a number of robot-assisted minimally invasive esophagectomy (RAMIE) procedures have been performed due to three-dimensional field of view, image stabilization, and flexible joint function, both the surgeons and surgical teams require proficiency. This study aimed to establish an artificial intelligence (AI)-based automated surgical-phase recognition system for RAMIE by analyzing robotic surgical videos.

METHODS

This study enrolled 31 patients who underwent RAMIE. The videos were annotated into the following nine surgical phases: preparation, lower mediastinal dissection, upper mediastinal dissection, azygos vein division, subcarinal lymph node dissection (LND), right recurrent laryngeal nerve (RLN) LND, left RLN LND, esophageal transection, and post-dissection to completion of surgery to train the AI for automated phase recognition. An additional phase ("no step") was used to indicate video sequences upon removal of the camera from the thoracic cavity. All the patients were divided into two groups, namely, early period (20 patients) and late period (11 patients), after which the relationship between the surgical-phase duration and the surgical periods was assessed.

RESULTS

Fourfold cross validation was applied to evaluate the performance of the current model. The AI had an accuracy of 84%. The preparation (p = 0.012), post-dissection to completion of surgery (p = 0.003), and "no step" (p < 0.001) phases predicted by the AI were significantly shorter in the late period than in the early period.

CONCLUSIONS

A highly accurate automated surgical-phase recognition system for RAMIE was established using deep learning. Specific phase durations were significantly associated with the surgical period at the authors' institution.

3D convolutional neural network model from contrast-enhanced CT to predict spread through air spaces in non-small cell lung cancer

PURPOSE

The purpose of this study was to compare the efficacy of five non-invasive models, including three-dimensional (3D) convolutional neural network (CNN) model, to predict the spread through air spaces (STAS) status of non-small cell lung cancer (NSCLC), and to obtain the best prediction model to provide a basis for clinical surgery planning.

MATERIALS AND METHODS

A total of 203 patients (112 men, 91 women; mean age, 60 years; age range 22-80 years) with NSCLC were retrospectively included. Of these, 153 were used for training cohort and 50 for validation cohort. According to the image biomarker standardization initiative reference manual, the image processing and feature extraction were standardized using PyRadiomics. The logistic regression classifier was used to build the model. Five models (clinicopathological/CT model, conventional radiomics model, computer vision (CV) model, 3D CNN model and combined model) were constructed to predict STAS by NSCLC. Area under the receiver operating characteristic curves (AUC) were used to validate the capability of the five models to predict STAS.

RESULTS

For predicting STAS, the 3D CNN model was superior to the clinicopathological/CT model, conventional radiomics model, CV model and combined model and achieved satisfactory discrimination performance, with an AUC of 0.93 (95% CI: 0.70-0.82) in the training cohort and 0.80 (95% CI: 0.65-0.86) in the validation cohort. Decision curve analysis indicated that, when the probability of the threshold was over 10%, the 3D CNN model was beneficial for predicting STAS status compared to either treating all or treating none of the patients within certain ranges of risk threshold CONCLUSION: The 3D CNN model can be used for the preoperative prediction of STAS in patients with NSCLC, and was superior to the other four models in predicting patients' risk of developing STAS.

BFENet: A two-stream interaction CNN method for multi-label ophthalmic diseases classification with bilateral fundus images

BACKGROUND AND OBJECTIVE

Early fundus screening and timely treatment of ophthalmology diseases can effectively prevent blindness. Previous studies just focus on fundus images of single eye without utilizing the useful relevant information of the left and right eyes. While clinical ophthalmologists usually use binocular fundus images to help ocular disease diagnosis. Besides, previous works usually target only one ocular diseases at a time. Considering the importance of patient-level bilateral eye diagnosis and multi-label ophthalmic diseases classification, we propose a bilateral feature enhancement network (BFENet) to address the above two problems.

METHODS

We propose a two-stream interactive CNN architecture for multi-label ophthalmic diseases classification with bilateral fundus images. Firstly, we design a feature enhancement module, which makes use of the interaction between bilateral fundus images to strengthen the extracted feature information. Specifically, attention mechanism is used to learn the interdependence between local and global information in the designed interactive architecture for two-stream, which leads to the reweighting of these features, and recover more details. In order to capture more disease characteristics, we further design a novel multiscale module, which enriches the feature maps by superimposing feature information of different resolutions images extracted through dilated convolution.

RESULTS

In the off-site set, the Kappa, F₁, AUC and Final score are 0.535, 0.892, 0.912 and 0.780, respectively. In the on-site set, the Kappa, F₁, AUC and Final score are 0.513, 0.886, 0.903 and 0.767 respectively. Comparing with existing methods, BFENet achieves the best classification performance.

CONCLUSIONS

Comprehensive experiments are conducted to demonstrate the effectiveness of this proposed model. Besides, our method can be extended to similar tasks where the correlation between different images is important.

A narrative review of deep learning applications in lung cancer research: from screening to prognostication

Background and Objective

Deep learning (DL) algorithms have been developed for various tasks, including lung nodule detection on chest radiographs or lung cancer computed tomography screening, potential candidate selection in lung cancer screening, malignancy prediction for indeterminate pulmonary nodules, lung cancer staging, treatment response prediction, prognostication, and prediction of genetic mutations in lung cancer. Furthermore, these DL algorithms have been applied in various clinical settings in order for them to be generalized in real-world clinical practice. Multiple DL algorithms have been corroborated to be on par with experts or current clinical prediction models for several specific tasks. However, no article has yet comprehensively reviewed DL algorithms dedicated to lung cancer research. This narrative review presents an overview of the literature dealing with DL techniques applied in lung cancer research and briefly summarizes the results according to the DL algorithms’ clinical use cases.

Methods

we performed a narrative review by searching the Embase and OVID-MEDLINE databases for articles published in English from October, 2016 until September, 2021 and reviewing the bibliographies of key references to identify important literature related to DL in lung cancer research. The background, development, results, and clinical implications of each DL algorithm are briefly discussed. Lastly, we end this review article by highlighting future directions in lung cancer research using DL techniques.

Key Content and Findings

DL algorithms have been introduced to show comparable or higher performance than human experts in various clinical settings. Specifically, they have been actively applied to detect lung nodules in chest radiographs or computed tomography (CT) examinations, optimize candidate selection for lung cancer screening (LCS), predict the malignancy of lung nodules, stage lung cancer, and predict treatment response, patients’ prognoses, and genetic mutations in lung cancers.

Conclusions

DL algorithms have corroborated their potential value for various tasks, ranging from lung cancer screening to prognostication of lung cancer patients. Future research is warranted for the clinical application of these algorithms in daily clinical practice and verification of their real-world clinical usefulness.

DeepLN: A Multi-Task AI Tool to Predict the Imaging Characteristics, Malignancy and Pathological Subtypes in CT-Detected Pulmonary Nodules

Objectives

Distinction of malignant pulmonary nodules from the benign ones based on computed tomography (CT) images can be time-consuming but significant in routine clinical management. The advent of artificial intelligence (AI) has provided an opportunity to improve the accuracy of cancer risk prediction.

Methods

A total of 8950 detected pulmonary nodules with complete pathological results were retrospectively enrolled. The different radiological manifestations were identified mainly as various nodules densities and morphological features. Then, these nodules were classified into benign and malignant groups, both of which were subdivided into finer specific pathological types. Here, we proposed a deep convolutional neural network for the assessment of lung nodules named DeepLN to identify the radiological features and predict the pathologic subtypes of pulmonary nodules.

Results

In terms of density, the area under the receiver operating characteristic curves (AUCs) of DeepLN were 0.9707 (95% confidence interval, CI: 0.9645-0.9765), 0.7789 (95%CI: 0.7569-0.7995), and 0.8950 (95%CI: 0.8822-0.9088) for the pure-ground glass opacity (pGGO), mixed-ground glass opacity (mGGO) and solid nodules. As for the morphological features, the AUCs were 0.8347 (95%CI: 0.8193-0.8499) and 0.9074 (95%CI: 0.8834-0.9314) for spiculation and lung cavity respectively. For the identification of malignant nodules, our DeepLN algorithm achieved an AUC of 0.8503 (95%CI: 0.8319-0.8681) in the test set. Pertaining to predicting the pathological subtypes in the test set, the multi-task AUCs were 0.8841 (95%CI: 0.8567-0.9083) for benign tumors, 0.8265 (95%CI: 0.8004-0.8499) for inflammation, and 0.8022 (95%CI: 0.7616-0.8445) for other benign ones, while AUCs were 0.8675 (95%CI: 0.8525-0.8813) for lung adenocarcinoma (LUAD), 0.8792 (95%CI: 0.8640-0.8950) for squamous cell carcinoma (LUSC), 0.7404 (95%CI: 0.7031-0.7782) for other malignant ones respectively in the malignant group.

Conclusions

The DeepLN based on deep learning algorithm represented a competitive performance to predict the imaging characteristics, malignancy and pathologic subtypes on the basis of non-invasive CT images, and thus had great possibility to be utilized in the routine clinical workflow.

Automatic surgical phase recognition in laparoscopic inguinal hernia repair with artificial intelligence

BACKGROUND

Because of the complexity of the intra-abdominal anatomy in the posterior approach, a longer learning curve has been observed in laparoscopic transabdominal preperitoneal (TAPP) inguinal hernia repair. Consequently, automatic tools using artificial intelligence (AI) to monitor TAPP procedures and assess learning curves are required. The primary objective of this study was to establish a deep learning-based automated surgical phase recognition system for TAPP. A secondary objective was to investigate the relationship between surgical skills and phase duration.

METHODS

This study enrolled 119 patients who underwent the TAPP procedure. The surgical videos were annotated (delineated in time) and split into seven surgical phases (preparation, peritoneal flap incision, peritoneal flap dissection, hernia dissection, mesh deployment, mesh fixation, peritoneal flap closure, and additional closure). An AI model was trained to automatically recognize surgical phases from videos. The relationship between phase duration and surgical skills were also evaluated.

RESULTS

A fourfold cross-validation was used to assess the performance of the AI model. The accuracy was 88.81 and 85.82%, in unilateral and bilateral cases, respectively. In unilateral hernia cases, the duration of peritoneal incision (p = 0.003) and hernia dissection (p = 0.014) detected via AI were significantly shorter for experts than for trainees.

CONCLUSION

An automated surgical phase recognition system was established for TAPP using deep learning with a high accuracy. Our AI-based system can be useful for the automatic monitoring of surgery progress, improving OR efficiency, evaluating surgical skills and video-based surgical education. Specific phase durations detected via the AI model were significantly associated with the surgeons' learning curve.

[Clinical Study of Artificial Intelligence-assisted Diagnosis System in Predicting the Invasive Subtypes of Early-stage Lung Adenocarcinoma Appearing as Pulmonary Nodules]

BACKGROUND

Lung cancer is the cancer with the highest mortality at home and abroad at present. The detection of lung nodules is a key step to reducing the mortality of lung cancer. Artificial intelligence-assisted diagnosis system presents as the state of the art in the area of nodule detection, differentiation between benign and malignant and diagnosis of invasive subtypes, however, a validation with clinical data is necessary for further application. Therefore, the aim of this study is to evaluate the effectiveness of artificial intelligence-assisted diagnosis system in predicting the invasive subtypes of early‑stage lung adenocarcinoma appearing as pulmonary nodules.

METHODS

Clinical data of 223 patients with early-stage lung adenocarcinoma appearing as pulmonary nodules admitted to the Lanzhou University Second Hospital from January 1st, 2016 to December 31th, 2021 were retrospectively analyzed, which were divided into invasive adenocarcinoma group (n=170) and non-invasive adenocarcinoma group (n=53), and the non-invasive adenocarcinoma group was subdivided into minimally invasive adenocarcinoma group (n=31) and preinvasive lesions group (n=22). The malignant probability and imaging characteristics of each group were compared to analyze their predictive ability for the invasive subtypes of early-stage lung adenocarcinoma. The concordance between qualitative diagnostic results of artificial intelligence-assisted diagnosis of the invasive subtypes of early-stage lung adenocarcinoma and postoperative pathology was then analyzed.

RESULTS

In different invasive subtypes of early-stage lung adenocarcinoma, the mean CT value of pulmonary nodules (P<0.001), diameter (P<0.001), volume (P<0.001), malignant probability (P<0.001), pleural retraction sign (P<0.001), lobulation (P<0.001), spiculation (P<0.001) were significantly different. At the same time, it was also found that with the increased invasiveness of different invasive subtypes of early-stage lung adenocarcinoma, the proportion of dominant signs of each group gradually increased. On the issue of binary classification, the sensitivity, specificity, and area under the curve (AUC) values of the artificial intelligence-assisted diagnosis system for the qualitative diagnosis of invasive subtypes of early-stage lung adenocarcinoma were 81.76%, 92.45% and 0.871 respectively. On the issue of three classification, the accuracy, recall rate, F1 score, and AUC values of the artificial intelligence-assisted diagnosis system for the qualitative diagnosis of invasive subtypes of early-stage lung adenocarcinoma were 83.86%, 85.03%, 76.46% and 0.879 respectively.

CONCLUSIONS

Artificial intelligence-assisted diagnosis system could predict the invasive subtypes of early‑stage lung adenocarcinoma appearing as pulmonary nodules, and has a certain predictive value. With the optimization of algorithms and the improvement of data, it may provide guidance for individualized treatment of patients.

[Chinese Experts Consensus on Artificial Intelligence Assisted Management for Pulmonary Nodule (2022 Version)]

Low-dose computed tomography (CT) for lung cancer screening has been proven to reduce lung cancer deaths in the screening group compared with the control group. The increasing number of pulmonary nodules being detected by CT scans significantly increase the workload of the radiologists for scan interpretation. Artificial intelligence (AI) has the potential to increase the efficiency of pulmonary nodule discrimination and has been tested in preliminary studies for nodule management. As more and more artificial AI products are commercialized, the consensus statement has been organized in a collaborative effort by Thoracic Surgery Committee, Department of Simulated Medicine, Wu Jieping Medical Foundation to aid clinicians in the application of AI-assisted management for pulmonary nodules.
.

How AI Can Help in the Diagnostic Dilemma of Pulmonary Nodules

Simple Summary

Pulmonary nodules are considered a sign of bronchogenic carcinoma, detecting them early will reduce their progression and can save lives. Lung cancer is the second most common type of cancer in both men and women. This manuscript discusses the current applications of artificial intelligence (AI) in lung segmentation as well as pulmonary nodule segmentation and classification using computed tomography (CT) scans, published in the last two decades, in addition to the limitations and future prospects in the field of AI.

Abstract

Pulmonary nodules are the precursors of bronchogenic carcinoma, its early detection facilitates early treatment which save a lot of lives. Unfortunately, pulmonary nodule detection and classification are liable to subjective variations with high rate of missing small cancerous lesions which opens the way for implementation of artificial intelligence (AI) and computer aided diagnosis (CAD) systems. The field of deep learning and neural networks is expanding every day with new models designed to overcome diagnostic problems and provide more applicable and simply used models. We aim in this review to briefly discuss the current applications of AI in lung segmentation, pulmonary nodule detection and classification.