A Combination of Shape and Texture Features for Classification of Pulmonary Nodules in Lung CT Images

Enhanced lung cancer detection: Integrating improved random walker segmentation with artificial neural network and random forest classifier

Background

Medical image segmentation is a vital yet difficult job because of the multimodality of the acquired images. It is difficult to locate the polluted area before it spreads.

Methods

This research makes use of several machine learning tools, including an artificial neural network as well as a random forest classifier, to increase the system's reliability of pulmonary nodule classification. Anisotropic diffusion filtering is initially used to remove noise from a picture. After that, a modified random walk method is used to get the region of interest inside the lung parenchyma. Finally, the features corresponding to the consistency of the picture segments are extracted using texture-based feature extraction for pulmonary nodules. The final stage is to identify and classify the pulmonary nodules using a classifier algorithm.

Results

The studies employ cross-validation to demonstrate the validity of the diagnosis framework. In this instance, the proposed method is tested using CT scan information provided by the Lung Image Database Consortium. A random forest classifier showed 99.6 percent accuracy rate for detecting lung cancer, compared to a artificial neural network's 94.8 percent accuracy rate.

Conclusions

Due to this, current research is now primarily concerned with identifying lung nodules and classifying them as benign or malignant. The diagnostic potential of machine learning as well as image processing approaches are enormous for the categorization of lung cancer.

Effective lung nodule detection using deep CNN with dual attention mechanisms

Novel methods are required to enhance lung cancer detection, which has overtaken other cancer-related causes of death as the major cause of cancer-related mortality. Radiologists have long-standing methods for locating lung nodules in patients with lung cancer, such as computed tomography (CT) scans. Radiologists must manually review a significant amount of CT scan pictures, which makes the process time-consuming and prone to human error. Computer-aided diagnosis (CAD) systems have been created to help radiologists with their evaluations in order to overcome these difficulties. These systems make use of cutting-edge deep learning architectures. These CAD systems are designed to improve lung nodule diagnosis efficiency and accuracy. In this study, a bespoke convolutional neural network (CNN) with a dual attention mechanism was created, which was especially crafted to concentrate on the most important elements in images of lung nodules. The CNN model extracts informative features from the images, while the attention module incorporates both channel attention and spatial attention mechanisms to selectively highlight significant features. After the attention module, global average pooling is applied to summarize the spatial information. To evaluate the performance of the proposed model, extensive experiments were conducted using benchmark dataset of lung nodules. The results of these experiments demonstrated that our model surpasses recent models and achieves state-of-the-art accuracy in lung nodule detection and classification tasks.

ADGAN: Attribute-Driven Generative Adversarial Network for Synthesis and Multiclass Classification of Pulmonary Nodules

Lung cancer is the leading cause of cancer-related deaths worldwide. According to the American Cancer Society, early diagnosis of pulmonary nodules in computed tomography (CT) scans can improve the five-year survival rate up to 70% with proper treatment planning. In this article, we propose an attribute-driven Generative Adversarial Network (ADGAN) for synthesis and multiclass classification of Pulmonary Nodules. A self-attention U-Net (SaUN) architecture is proposed to improve the generation mechanism of the network. The generator is designed with two modules, namely, self-attention attribute module (SaAM) and a self-attention spatial module (SaSM). SaAM generates a nodule image based on given attributes whereas SaSM specifies the nodule region of the input image to be altered. A reconstruction loss along with an attention localization loss (AL) is used to produce an attention map prioritizing the nodule regions. To avoid resemblance between a generated image and a real image, we further introduce an adversarial loss containing a regularization term based on KL divergence. The discriminator part of the proposed model is designed to achieve the multiclass nodule classification task. Our proposed approach is validated over two challenging publicly available datasets, namely LIDC-IDRI and LUNGX. Exhaustive experimentation on these two datasets clearly indicate that we have achieved promising classification accuracy as compared to other state-of-the-art methods.

Pulmonary Nodule Classification Using a Multiview Residual Selective Kernel Network

Lung cancer is one of the leading causes of death worldwide and early detection is crucial to reduce the mortality. A reliable computer-aided diagnosis (CAD) system can help facilitate early detection of malignant nodules. Although existing methods provide adequate classification accuracy, there is still room for further improvement. This study is dedicated to investigating a new CAD scheme for predicting the malignant likelihood of lung nodules in computed tomography (CT) images in light of a deep learning strategy. Conceived from the residual learning and selective kernel, we investigated an efficient residual selective kernel (RSK) block to handle the diversity of lung nodules with various shapes and obscure structures. Founded on this RSK block, we established a multiview RSK network (MRSKNet), to which three anatomical planes in the axial, coronal, and sagittal directions were fed. To reinforce the classification efficiency, seven handcrafted texture features with a filter-like computation strategy were explored, among which the homogeneity (HOM) feature maps are combined with the corresponding intensity CT images for concatenation input, leading to an improved network architecture. Evaluated on the public benchmark Lung Image Database Consortium and Image Database Resource Initiative (LIDC-IDRI) challenge database with ten-fold cross validation of binary classification, our experimental results indicated high area under receiver operating characteristic (AUC) and accuracy scores. A better compromise between recall and specificity was struck using the suggested concatenation strategy comparing to many state-of-the-art approaches. The proposed pulmonary nodule classification framework exhibited great efficacy and achieved a higher AUC of 0.9711. The association of handcrafted texture features with deep learning models is promising in advancing the classification performance. The developed pulmonary nodule CAD network architecture is of potential in facilitating the diagnosis of lung cancer for further image processing applications.

Attention-guided deep neural network with a multichannel architecture for lung nodule classification

Detecting and accurately identifying malignant lung nodules in chest CT scans in a timely manner is crucial for effective lung cancer treatment. This study introduces a deep learning model featuring a multi-channel attention mechanism, specifically designed for the precise diagnosis of malignant lung nodules. To start, we standardized the voxel size of CT images and generated three RGB images of varying scales for each lung nodule, viewed from three different angles. Subsequently, we applied three attention submodels to extract class-specific characteristics from these RGB images. Finally, the nodule features were consolidated in the model's final layer to make the ultimate predictions. Through the utilization of an attention mechanism, we could dynamically pinpoint the exact location of lung nodules in the images without the need for prior segmentation. This proposed approach enhances the accuracy and efficiency of lung nodule classification. We evaluated and tested our model using a dataset of 1018 CT scans sourced from the Lung Image Database Consortium and Image Database Resource Initiative (LIDC-IDRI). The experimental results demonstrate that our model achieved a lung nodule classification accuracy of 90.11 %, with an area under the receiver operator curve (AUC) score of 95.66 %. Impressively, our method achieved this high level of performance while utilizing only 29.09 % of the time needed by the mainstream model.

Collaborative Multi-Metadata Fusion to Improve the Classification of Lumbar Disc Herniation

Computed tomography (CT) images are the most commonly used radiographic imaging modality for detecting and diagnosing lumbar diseases. Despite many outstanding advances, computer-aided diagnosis (CAD) of lumbar disc disease remains challenging due to the complexity of pathological abnormalities and poor discrimination between different lesions. Therefore, we propose a Collaborative Multi-Metadata Fusion classification network (CMMF-Net) to address these challenges. The network consists of a feature selection model and a classification model. We propose a novel Multi-scale Feature Fusion (MFF) module that can improve the edge learning ability of the network region of interest (ROI) by fusing features of different scales and dimensions. We also propose a new loss function to improve the convergence of the network to the internal and external edges of the intervertebral disc. Subsequently, we use the ROI bounding box from the feature selection model to crop the original image and calculate the distance features matrix. We then concatenate the cropped CT images, multiscale fusion features, and distance feature matrices and input them into the classification network. Next, the model outputs the classification results and the class activation map (CAM). Finally, the CAM of the original image size is returned to the feature selection network during the upsampling process to achieve collaborative model training. Extensive experiments demonstrate the effectiveness of our method. The model achieved 91.32% accuracy in the lumbar spine disease classification task. In the labelled lumbar disc segmentation task, the Dice coefficient reaches 94.39%. The classification accuracy in the Lung Image Database Consortium and Image Database Resource Initiative (LIDC-IDRI) reaches 91.82%.

Classification of lung cancer computed tomography images using a 3-dimensional deep convolutional neural network with multi-layer filter

Lung cancer creates pulmonary nodules in the patient's lung, which may be diagnosed early on using computer-aided diagnostics. A novel automated pulmonary nodule diagnosis technique using three-dimensional deep convolutional neural networks and multi-layered filter has been presented in this paper. For the suggested automated diagnosis of lung nodule, volumetric computed tomographic images are employed. The proposed approach generates three-dimensional feature layers, which retain the temporal links between adjacent slices of computed tomographic images. The use of several activation functions at different levels of the proposed network results in increased feature extraction and efficient classification. The suggested approach divides lung volumetric computed tomography pictures into malignant and benign categories. The suggested technique's performance is evaluated using three commonly used datasets in the domain: LUNA 16, LIDC-IDRI, and TCIA. The proposed method outperforms the state-of-the-art in terms of accuracy, sensitivity, specificity, F-1 score, false-positive rate, false-negative rate, and error rate.

A proposed methodology for detecting the malignant potential of pulmonary nodules in sarcoma using computed tomographic imaging and artificial intelligence-based models

The presence of lung metastases in patients with primary malignancies is an important criterion for treatment management and prognostication. Computed tomography (CT) of the chest is the preferred method to detect lung metastasis. However, CT has limited efficacy in differentiating metastatic nodules from benign nodules (e.g., granulomas due to tuberculosis) especially at early stages (<5 mm). There is also a significant subjectivity associated in making this distinction, leading to frequent CT follow-ups and additional radiation exposure along with financial and emotional burden to the patients and family. Even 18F-fluoro-deoxyglucose positron emission technology-computed tomography (18F-FDG PET-CT) is not always confirmatory for this clinical problem. While pathological biopsy is the gold standard to demonstrate malignancy, invasive sampling of small lung nodules is often not clinically feasible. Currently, there is no non-invasive imaging technique that can reliably characterize lung metastases. The lung is one of the favored sites of metastasis in sarcomas. Hence, patients with sarcomas, especially from tuberculosis prevalent developing countries, can provide an ideal platform to develop a model to differentiate lung metastases from benign nodules. To overcome the lack of optimal specificity of CT scan in detecting pulmonary metastasis, a novel artificial intelligence (AI)-based protocol is proposed utilizing a combination of radiological and clinical biomarkers to identify lung nodules and characterize it as benign or metastasis. This protocol includes a retrospective cohort of nearly 2,000-2,250 sample nodules (from at least 450 patients) for training and testing and an ambispective cohort of nearly 500 nodules (from 100 patients; 50 patients each from the retrospective and prospective cohort) for validation. Ground-truth annotation of lung nodules will be performed using an in-house-built segmentation tool. Ground-truth labeling of lung nodules (metastatic/benign) will be performed based on histopathological results or baseline and/or follow-up radiological findings along with clinical outcome of the patient. Optimal methods for data handling and statistical analysis are included to develop a robust protocol for early detection and classification of pulmonary metastasis at baseline and at follow-up and identification of associated potential clinical and radiological markers.

Deep-Learning Model of ResNet Combined with CBAM for Malignant-Benign Pulmonary Nodules Classification on Computed Tomography Images

Background and Objectives: Lung cancer remains a leading cause of cancer mortality worldwide. Accurately classifying benign pulmonary nodules and malignant ones is crucial for early diagnosis and improved patient outcomes. The purpose of this study is to explore the deep-learning model of ResNet combined with a convolutional block attention module (CBAM) for the differentiation between benign and malignant lung cancer, based on computed tomography (CT) images, morphological features, and clinical information. Methods and materials: In this study, 8241 CT slices containing pulmonary nodules were retrospectively included. A random sample comprising 20% (n = 1647) of the images was used as the test set, and the remaining data were used as the training set. ResNet combined CBAM (ResNet-CBAM) was used to establish classifiers on the basis of images, morphological features, and clinical information. Nonsubsampled dual-tree complex contourlet transform (NSDTCT) combined with SVM classifier (NSDTCT-SVM) was used as a comparative model. Results: The AUC and the accuracy of the CBAM-ResNet model were 0.940 and 0.867, respectively, in test set when there were only images as inputs. By combining the morphological features and clinical information, CBAM-ResNet shows better performance (AUC: 0.957, accuracy: 0.898). In comparison, a radiomic analysis using NSDTCT-SVM achieved AUC and accuracy values of 0.807 and 0.779, respectively. Conclusions: Our findings demonstrate that deep-learning models, combined with additional information, can enhance the classification performance of pulmonary nodules. This model can assist clinicians in accurately diagnosing pulmonary nodules in clinical practice.

MS-Net: Learning to assess the malignant status of a lung nodule by a radiologist and her peers

BACKGROUND

Automatically assessing the malignant status of lung nodules based on CTscan images can help reduce the workload of radiologists while improving their diagnostic accuracy.

PURPOSE

Despite remarkable progress in the automatic diagnosis of pulmonary nodules by deep learning technologies, two significant problems remain outstanding. First, end-to-end deep learning solutions tend to neglect the empirical (semantic) features accumulated by radiologists and only rely on automatic features discovered by neural networks to provide the final diagnostic results, leading to questionable reliability, and interpretability. Second, inconsistent diagnosis between radiologists, a widely acknowledged phenomenon in clinical settings, is rarely examined and quantitatively explored by existing machine learning approaches. This paper solves these problems.

METHODS

We propose a novel deep neural network called MS-Net, which comprises two sequential modules: A feature derivation and initial diagnosis module (FDID), followed by a diagnosis refinement module (DR). Specifically, to take advantage of accumulated empirical features and discovered automatic features, the FDID model of MS-Net first derives a range of perceptible features and provides two initial diagnoses for lung nodules; then, these results are fed to the subsequent DR module to refine the diagnoses further. In addition, to fully consider the individual and panel diagnosis opinions, we propose a new loss function called collaborative loss, which can collaboratively optimize the individual and her peers' opinions to provide a more accurate diagnosis.

RESULTS

We evaluate the performance of the proposed MS-Net on the Lung Image Database Consortium image collection (LIDC-IDRI). It achieves 92.4% of accuracy, 92.9% of sensitivity, and 92.0% of specificity when panel labels are the ground truth, which is superior to other state-of-the-art diagnosis models. As a byproduct, the MS-Net can automatically derive a range of semantic features of lung nodules, increasing the interpretability of the final diagnoses.

CONCLUSIONS

The proposed MS-Net can provide an automatic and accurate diagnosis of lung nodules, meeting the need for a reliable computer-aided diagnosis system in clinical practice.

A Series-Based Deep Learning Approach to Lung Nodule Image Classification

Although many studies have shown that deep learning approaches yield better results than traditional methods based on manual features, CADs methods still have several limitations. These are due to the diversity in imaging modalities and clinical pathologies. This diversity creates difficulties because of variation and similarities between classes. In this context, the new approach from our study is a hybrid method that performs classifications using both medical image analysis and radial scanning series features. Hence, the areas of interest obtained from images are subjected to a radial scan, with their centers as poles, in order to obtain series. A U-shape convolutional neural network model is then used for the 4D data classification problem. We therefore present a novel approach to the classification of 4D data obtained from lung nodule images. With radial scanning, the eigenvalue of nodule images is captured, and a powerful classification is performed. According to our results, an accuracy of 92.84% was obtained and much more efficient classification scores resulted as compared to recent classifiers.

Inheritance and innovation of the diagnosis of peripheral pulmonary lesions

As the leading cause of cancer-related deaths worldwide, early detection and diagnosis are crucial to reduce the mortality of lung cancer. To date, the diagnosis of the peripheral pulmonary lesions (PPLs) remains a major unmet clinical need. The urgency of diagnosing PPLs has driven a series of development of the advanced bronchoscopy-guided techniques in the past decades, such as radial probe-endobronchial ultrasonography (RP-EBUS), virtual bronchoscopy navigation (VBN), electromagnetic navigation bronchoscopy (ENB), bronchoscopic transparenchymal nodule access (BTPNA), and robotic-assisted bronchoscopy. However, these techniques also have their own limitations. In this review, we would like to introduce the development of diagnostic techniques for PPLs, with a special focus on biopsy approaches and advanced guided bronchoscopy techniques by discussing their advantages, limitations, and future prospects.

Diagnose Like a Radiologist: Hybrid Neuro-Probabilistic Reasoning for Attribute-Based Medical Image Diagnosis

During clinical practice, radiologists often use attributes, e.g., morphological and appearance characteristics of a lesion, to aid disease diagnosis. Effectively modeling attributes as well as all relationships involving attributes could boost the generalization ability and verifiability of medical image diagnosis algorithms. In this paper, we introduce a hybrid neuro-probabilistic reasoning algorithm for verifiable attribute-based medical image diagnosis. There are two parallel branches in our hybrid algorithm, a Bayesian network branch performing probabilistic causal relationship reasoning and a graph convolutional network branch performing more generic relational modeling and reasoning using a feature representation. Tight coupling between these two branches is achieved via a cross-network attention mechanism and the fusion of their classification results. We have successfully applied our hybrid reasoning algorithm to two challenging medical image diagnosis tasks. On the LIDC-IDRI benchmark dataset for benign-malignant classification of pulmonary nodules in CT images, our method achieves a new state-of-the-art accuracy of 95.36% and an AUC of 96.54%. Our method also achieves a 3.24% accuracy improvement on an in-house chest X-ray image dataset for tuberculosis diagnosis. Our ablation study indicates that our hybrid algorithm achieves a much better generalization performance than a pure neural network architecture under very limited training data.

A brain-like classification method for computed tomography images based on adaptive feature matching dual-source domain heterogeneous transfer learning

Transfer learning can improve the robustness of deep learning in the case of small samples. However, when the semantic difference between the source domain data and the target domain data is large, transfer learning easily introduces redundant features and leads to negative transfer. According the mechanism of the human brain focusing on effective features while ignoring redundant features in recognition tasks, a brain-like classification method based on adaptive feature matching dual-source domain heterogeneous transfer learning is proposed for the preoperative aided diagnosis of lung granuloma and lung adenocarcinoma for patients with solitary pulmonary solid nodule in the case of small samples. The method includes two parts: (1) feature extraction and (2) feature classification. In the feature extraction part, first, By simulating the feature selection mechanism of the human brain in the process of drawing inferences about other cases from one instance, an adaptive selected-based dual-source domain feature matching network is proposed to determine the matching weight of each pair of feature maps and each pair of convolution layers between the two source networks and the target network, respectively. These two weights can, respectively, adaptive select the features in the source network that are conducive to the learning of the target task, and the destination of feature transfer to improve the robustness of the target network. Meanwhile, a target network based on diverse branch block is proposed, which made the target network have different receptive fields and complex paths to further improve the feature expression ability of the target network. Second, the convolution kernel of the target network is used as the feature extractor to extract features. In the feature classification part, an ensemble classifier based on sparse Bayesian extreme learning machine is proposed that can automatically decide how to combine the output of base classifiers to improve the classification performance. Finally, the experimental results (the AUCs were 0.9542 and 0.9356, respectively) on the data of two center data show that this method can provide a better diagnostic reference for doctors.

An Automatic Random Walker Algorithm for Segmentation of Ground Glass Opacity Pulmonary Nodules

Automatic and accurate segmentation of ground glass opacity (GGO) nodules still remains challenging due to inhomogeneous interiors, irregular shapes, and blurred boundaries from different patients. Despite successful applications in the image processing domains, the random walk has some limitations for segmentation of GGO pulmonary nodules. In this paper, an improved random walker method is proposed for the segmentation of GGO nodules. To calculate a new affinity matrix, intensity, spatial, and texture features are incorporated. It strengthens discriminative power between two adjacent nodes on the graph. To address the problem of robustness in seed acquisition, the geodesic distance is introduced and a novel local search strategy is presented to automatically acquire reliable seeds. For segmentation, a label constraint term is introduced to the energy function of original random walker, which alleviates the accumulation of errors caused by the initial seeds acquisition. Massive experiments conducted on Lung Images Dataset Consortium (LIDC) demonstrate that the proposed method achieves visually satisfactory results without user interactions. Both qualitative and quantitative evaluations also demonstrate that the proposed method obtains better performance compared with conventional random walker method and state-of-the-art segmentation methods in terms of the overlap score and F-measure.

Form Factors as Potential Imaging Biomarkers to Differentiate Benign vs. Malignant Lung Lesions on CT Scans

Indeterminate lung nodules detected on CT scans are common findings in clinical practice. Their correct assessment is critical, as early diagnosis of malignancy is crucial to maximise the treatment outcome. In this work, we evaluated the role of form factors as imaging biomarkers to differentiate benign vs. malignant lung lesions on CT scans. We tested a total of three conventional imaging features, six form factors, and two shape features for significant differences between benign and malignant lung lesions on CT scans. The study population consisted of 192 lung nodules from two independent datasets, containing 109 (38 benign, 71 malignant) and 83 (42 benign, 41 malignant) lung lesions, respectively. The standard of reference was either histological evaluation or stability on radiological followup. The statistical significance was determined via the Mann-Whitney U nonparametric test, and the ability of the form factors to discriminate a benign vs. a malignant lesion was assessed through multivariate prediction models based on Support Vector Machines. The univariate analysis returned four form factors (Angelidakis compactness and flatness, Kong flatness, and maximum projection sphericity) that were significantly different between the benign and malignant group in both datasets. In particular, we found that the benign lesions were on average flatter than the malignant ones; conversely, the malignant ones were on average more compact (isotropic) than the benign ones. The multivariate prediction models showed that adding form factors to conventional imaging features improved the prediction accuracy by up to 14.5 pp. We conclude that form factors evaluated on lung nodules on CT scans can improve the differential diagnosis between benign and malignant lesions.

Learning From Ambiguous Labels for Lung Nodule Malignancy Prediction

Lung nodule malignancy prediction is an essential step in the early diagnosis of lung cancer. Besides the difficulties commonly discussed, the challenges of this task also come from the ambiguous labels provided by annotators, since deep learning models have in some cases been found to reproduce or amplify human biases. In this paper, we propose a multi-view 'divide-and-rule' (MV-DAR) model to learn from both reliable and ambiguous annotations for lung nodule malignancy prediction on chest CT scans. According to the consistency and reliability of their annotations, we divide nodules into three sets: a consistent and reliable set (CR-Set), an inconsistent set (IC-Set), and a low reliable set (LR-Set). The nodule in IC-Set is annotated by multiple radiologists inconsistently, and the nodule in LR-Set is annotated by only one radiologist. Although ambiguous, inconsistent labels tell which label(s) is consistently excluded by all annotators, and the unreliable labels of a cohort of nodules are largely correct from the statistical point of view. Hence, both IC-Set and LR-Set can be used to facilitate the training of MV-DAR. Our MV-DAR contains three DAR models to characterize a lung nodule from three orthographic views and is trained following a two-stage procedure. Each DAR consists of three networks with the same architecture, including a prediction network (Prd-Net), a counterfactual network (CF-Net), and a low reliable network (LR-Net), which are trained on CR-Set, IC-Set, and LR-Set respectively in the pretraining phase. In the fine-tuning phase, the image representation ability learned by CF-Net and LR-Net is transferred to Prd-Net by negative-attention module (NA-Module) and consistent-attention module (CA-Module), aiming to boost the prediction ability of Prd-Net. The MV-DAR model has been evaluated on the LIDC-IDRI dataset and LUNGx dataset. Our results indicate not only the effectiveness of the MV-DAR in learning from ambiguous labels but also its superiority over present noisy label-learning models in lung nodule malignancy prediction.

Application of Recurrent Neural Network Algorithm in Intelligent Detection of Clinical Ultrasound Images of Human Lungs

Lung ultrasound has great application value in the differential diagnosis of pulmonary exudative lesions. It has good sensitivity and specificity for the diagnosis of various pulmonary diseases in neonates and children. It is believed that it can replace chest CT examination. It is routinely used for the diagnosis of pulmonary diseases in emergency critical care medicine. However, the interpretation of the impact of ultrasound on the human lungs relies heavily on experienced physicians, which greatly restricts the interpretation efficiency of the impact of ultrasound. In order to improve the efficiency of monitoring and interpretation of the impact of ultrasound, this paper proposes an intelligent detection algorithm for human lung clinical ultrasound images based on recurrent neural network. Transfer learning is used to replace the fully connected layer of the VGG16 model and improve the loss function, so that the same the Euclidean distance between category images can be reduced, and the Euclidean distance between different categories of images can be increased, enhancing the resolution of the entire model, thereby achieving better image feature extraction results. The experimental results show that the algorithm proposed in this paper can surpass the doctor's level in the identification of various lung diseases.

The value of AI in the Diagnosis, Treatment, and Prognosis of Malignant Lung Cancer

Malignant tumors is a serious public health threat. Among them, lung cancer, which has the highest fatality rate globally, has significantly endangered human health. With the development of artificial intelligence (AI) and its integration with medicine, AI research in malignant lung tumors has become critical. This article reviews the value of CAD, computer neural network deep learning, radiomics, molecular biomarkers, and digital pathology for the diagnosis, treatment, and prognosis of malignant lung tumors.

Lung cancer diagnosis using deep attention based multiple instance learning and radiomics

Background

Early diagnosis of lung cancer is a key intervention for the treatment of lung cancer in which computer‐aided diagnosis (CAD) can play a crucial role. Most published CAD methods perform lung cancer diagnosis by classifying each lung nodule in isolation. However, this does not reflect clinical practice, where clinicians diagnose a patient based on a set of images of nodules, instead of looking at one nodule at a time. Besides, the low interpretability of the output provided by these methods presents an important barrier for their adoption.

Method

In this article, we treat lung cancer diagnosis as a multiple instance learning (MIL) problem, which better reflects the diagnosis process in the clinical setting and provides higher interpretability of the output. We selected radiomics as the source of input features and deep attention‐based MIL as the classification algorithm. The attention mechanism provides higher interpretability by estimating the importance of each instance in the set for the final diagnosis. To improve the model's performance in a small imbalanced dataset, we propose a new bag simulation method for MIL.

Results and conclusion

The results show that our method can achieve a mean accuracy of 0.807 with a standard error of the mean (SEM) of 0.069, a recall of 0.870 (SEM 0.061), a positive predictive value of 0.928 (SEM 0.078), a negative predictive value of 0.591 (SEM 0.155), and an area under the curve (AUC) of 0.842 (SEM 0.074), outperforming other MIL methods. Additional experiments show that the proposed oversampling strategy significantly improves the model's performance. In addition, experiments show that our method provides a good indication of the importance of each nodule in determining the diagnosis, which combined with the well‐defined radiomic features, to make the results more interpretable and acceptable for doctors and patients.

A Novel Hybridized Feature Extraction Approach for Lung Nodule Classification Based on Transfer Learning Technique

Purpose

In the field of medical diagnosis, deep learning-based computer-aided detection of diseases will reduce the burden of physicians in the diagnosis of diseases especially in the case of lung cancer nodule classification.

Materials and Methods

A hybridized model which integrates deep features from Residual Neural Network using transfer learning and handcrafted features from the histogram of oriented gradients feature descriptor is proposed to classify the lung nodules as benign or malignant. The intrinsic convolutional neural network (CNN) features have been incorporated and they can resolve the drawbacks of handcrafted features that do not completely reflect the specific characteristics of a nodule. In the meantime, they also reduce the need for a large-scale annotated dataset for CNNs. For classifying malignant nodules and benign nodules, radial basis function support vector machine is used. The proposed hybridized model is evaluated on the LIDC-IDRI dataset.

Results

It has achieved an accuracy of 97.53%, sensitivity of 98.62%, specificity of 96.88%, precision of 95.04%, F1 score of 0.9679, false-positive rate of 3.117%, and false-negative rate of 1.38% and has been compared with other state of the art techniques.

Conclusions

The performance of the proposed hybridized feature-based classification technique is better than the deep features-based classification technique in lung nodule classification.

Classification of lung nodules based on the DCA-Xception network

BACKGROUND

Developing deep learning networks to classify between benign and malignant lung nodules usually requires many samples. Due to the precious nature of medical samples, it is difficult to obtain many samples.

OBJECTIVE

To investigate and test a DCA-Xception network combined with a new data enhancement method to improve performance of lung nodule classification.

METHODS

First, the Wasserstein Generative Adversarial Network (WGAN) with conditions and five data enhancement methods such as flipping, rotating, and adding Gaussian noise are used to extend the samples to solve the problems of unbalanced sample classification and the insufficient samples. Then, a DCA-Xception network is designed to classify lung nodules. Using this network, information around the target is obtained by introducing an adaptive dual-channel feature extraction module, and the network learns features more accurately by introducing a convolutional attention module. The network is trained and validated using 274 lung nodules (154 benign and 120 malignant) and tested using 52 lung nodules (23 benign and 29 malignant).

RESULTS

The experiments show that the network has an accuracy of 83.46% and an AUC of 0.929. The features extracted using this network achieve an accuracy of 85.24% on the K-nearest neighbor and random forest classifiers.

CONCLUSION

This study demonstrates that the DCA-Xception network yields higher performance in classification of lung nodules than the performance using the classical classification networks as well as pre-trained networks.

Analysis of the Clinical Characteristics of Tuberculosis Patients based on Multi-Constrained Computed Tomography (CT) Image Segmentation Algorithm

Objective:

We used U-shaped convolutional neural network (U_Net) multi-constraint image segmentation method to compare the diagnosis and imaging characteristics of tuberculosis and tuberculosis with lung cancer patients with Computed Tomography (CT).

Methods:

We selected 160 patients with tuberculosis from the severity scoring (SVR) task is provided by ImageCLEF Tuberculosis 2019. According to the type of diagnosed disease, they were divided into tuberculosis combined with lung cancer group and others group, all patients were given chest CT scan, and the clinical manifestations, CT characteristics, and initial suspected diagnosis and missed diagnosis of different tumor diameters were observed and compared between the two groups. The research continued for a year in the office, mainly relying on a computer with GPU to carry out graphics analysis.

Results:

There were more patients with hemoptysis and hoarseness in pulmonary tuberculosis combined with lung cancer group than in the pulmonary others group (P<0.05), and the other symptoms were not significantly different (P>0.05). Tuberculosis combined with lung cancer group had fewer signs of calcification, streak shadow, speckle shadow, and cavitation than others group; however, tuberculosis combined with lung cancer group had more patients with mass shadow, lobular sign, spines sign, burr sign and vacuole sign than others group.

Conclusion:

The symptoms of hemoptysis and hoarseness in pulmonary tuberculosis patients need to consider whether the disease has progressed and the possibility of lung cancer lesions. CT imaging of pulmonary tuberculosis patients with lung cancer usually shows mass shadows, lobular signs, spines signs, burr signs, and vacuoles signs. It can be used as the basis for its diagnosis. Simultaneously, the U-Net-based segmentation method can effectively segment the lung parenchymal region, and the algorithm is better than traditional algorithms.

Role of 18F-FDG PET/CT Radiomics Features in the Differential Diagnosis of Solitary Pulmonary Nodules: Diagnostic Accuracy and Comparison between Two Different PET/CT Scanners

The aim of this retrospective study was to investigate the ability of 18 fluorine-fluorodeoxyglucose positron emission tomography/CT (¹⁸F-FDG-PET/CT) metrics and radiomics features (RFs) in predicting the final diagnosis of solitary pulmonary nodules (SPN). We retrospectively recruited 202 patients who underwent a ¹⁸F-FDG-PET/CT before any treatment in two PET scanners. After volumetric segmentation of each lung nodule, 8 PET metrics and 42 RFs were extracted. All the features were tested for significant differences between the two PET scanners. The performances of all features in predicting the nature of SPN were analyzed by testing three classes of final logistic regression predictive models: two were built/trained through exploiting the separate data from the two scanners, and the other joined the data together. One hundred and twenty-seven patients had a final diagnosis of malignancy, while 64 were of a benign nature. Comparing the two PET scanners, we found that all metabolic features and most of RFs were significantly different, despite the cross correlation being quite similar. For scanner 1, a combination between grey level co-occurrence matrix (GLCM), histogram, and grey-level zone length matrix (GLZLM) related features presented the best performances to predict the diagnosis; for scanner 2, it was GLCM and histogram-related features and metabolic tumour volume (MTV); and for scanner 1 + 2, it was histogram features, standardized uptake value (SUV) metrics, and MTV. RFs had a significant role in predicting the diagnosis of SPN, but their accuracies were directly related to the scanner.

A systematic review and meta-analysis of diagnostic performance and physicians' perceptions of artificial intelligence (AI)-assisted CT diagnostic technology for the classification of pulmonary nodules

Background

Lung cancer was the second most commonly diagnosed cancer and the leading cause of cancer death in 2020. Although artificial intelligence (AI)-assisted diagnostic technologies have shown promise and has been used in clinical practice in recent years, no products related to AI-assisted CT diagnostic technologies for the classification of pulmonary nodules have been approved by the National Medical Products Administration in China. The objective of this article was to systematically review the diagnostic performance of AI-assisted CT diagnostic technology for the classification of pulmonary nodules as benign or malignant and to analyze physicians’ perceptions of this technology in China.

Methods

All relevant studies from 6 literature databases were searched and screened according to the inclusion and exclusion criteria. Data were extracted and the study quality was assessed by two reviewers. The study heterogeneity and publication bias were estimated. A questionnaire survey on the perceptions of physicians was conducted in 9 public tertiary hospitals in China. A meta-analysis, meta-regression and univariate logistic model were used in the systematic review and to explore the association of physicians’ perceptions with their rate of support for the clinical application of the technology.

Results

Twenty-seven studies with 5,727 pulmonary nodules were finally included in the meta-analysis. We found that the quality of the included studies was generally acceptable and that the pooled sensitivity and specificity of AI-assisted CT diagnostic technology for the classification of pulmonary nodules as benign or malignant were 0.90 and 0.89, respectively. The pooled diagnostic odds ratio (DOR) was 70.33. The majority of the surveyed physicians in China perceived “reduced workload for radiologists” and “improved diagnostic efficiency” as the important benefits of this technology. In addition, diagnostic accuracy (including misdiagnosis) and practical experience were significantly associated with whether physicians supported its clinical application.

Conclusions

In the context of lung cancer diagnosis, AI-assisted CT diagnostic technology for the classification of pulmonary nodules as benign or malignant has good diagnostic performance, but its specificity needs to be improved.

Multiview framework using a 3D residual network for pulmonary micronodule malignancy risk classification

BACKGROUND

Pulmonary micronodules account for 80% of all lung nodules. Generally, pulmonary micronodules in the early stages can be detected on thoracic computed tomography (CT) scans. Early diagnosis is crucial for improving the patient's survival rate.

OBJECTIVE

This paper aims to estimate the malignancy risk of pulmonary micronodules and potentially improve the survival rate.

METHODS

We extract 3D features of the CT images to obtain richer characteristics. Because superior performance can be achieved by having deep layers, we apply a 3D residual network (3D-ResNet) to classify the pulmonary micronodule. We construct a framework by using three parallel ResNets whose inputs are CT images in different regions of interest, i.e., the multiview of the image. To further evaluate the applicability of the framework, we make a five-category classification and achieve good performance.

RESULTS

By fusing different characteristics from three views, we achieve the area under the receiver operating characteristic curve (AUC) of 0.9681. Based on the results of the experiments, our 3D-ResNet has a better performance than 3D-VGG and 3D-Inception in terms of precision (the increase rates are 13.7% and 7.4%), AUC (the increase rates are 15.8% and 5.3%), and accuracy (the increase rates are 14.3% and 4.5%). Meanwhile, the recall performance is close to that of the 3D-Inception network.

CONCLUSION

Overall, the framework we propose has applicability and feasibility in pulmonary micronodule classification.

Application of Radiomics and Artificial Intelligence for Lung Cancer Precision Medicine

Medical imaging is the standard-of-care for early detection, diagnosis, treatment planning, monitoring, and image-guided interventions of lung cancer patients. Most medical images are stored digitally in a standardized Digital Imaging and Communications in Medicine format that can be readily accessed and used for qualitative and quantitative analysis. Over the several last decades, medical images have been shown to contain complementary and interchangeable data orthogonal to other sources such as pathology, hematology, genomics, and/or proteomics. As such, "radiomics" has emerged as a field of research that involves the process of converting standard-of-care images into quantitative image-based data that can be merged with other data sources and subsequently analyzed using conventional biostatistics or artificial intelligence (AI) methods. As radiomic features capture biological and pathophysiological information, these quantitative radiomic features have shown to provide rapid and accurate noninvasive biomarkers for lung cancer risk prediction, diagnostics, prognosis, treatment response monitoring, and tumor biology. In this review, radiomics and emerging AI methods in lung cancer research are highlighted and discussed including advantages, challenges, and pitfalls.

Classification of Benign and Malignant Pulmonary Nodules Using a Regularized Extreme Learning Machine

An L1/L2-norm-bound extreme learning machine classification algorithm is proposed to improve the accuracy of distinguishing between benign and malignant pulmonary nodules. In this algorithm, features extracted from the segmented lung nodule using the histogram of oriented gradients method are used as inputs. L1-norm can promote sparsity in the weights of the output layer, and L2-norm can smooth output weights. The combination of the L1 norm and L2 norm can simplify the complexity of the network and prevent overfitting to improve classification accuracy. For each newly tested lung nodule, the algorithm outputs a class label of either benign or malignant. The accuracy, sensitivity, and specificity reached 94.12%, 93%, and 95% respectively over the lung image database consortium and image database resource initiative dataset. Compared with other algorithms, the average values of the three metrics increased by 6.5%, 7.94%, and 4.32%, respectively. An accuracy score of 95.83% can be achieved over a set of 120 urinary sediment images. Therefore, this algorithm has a good classification effect of pulmonary nodules.

Value of Quantitative CTTA in Differentiating Malignant From Benign Bosniak III Renal Lesions on CT Images

OBJECTIVE

The aim of this study was to investigate whether computed tomography texture analysis can differentiate malignant from benign Bosniak III renal lesions on computed tomography (CT) images.

METHODS

This retrospective case-control study included 45 patients/lesions (22 benign and 23 malignant lesions) with Bosniak III renal lesions who underwent CT examination. Axial image slices in the unenhanced phase, corticomedullary phase, and nephrographic phase were selected and delineated manually. Computed tomography texture analysis was performed on each lesion during these 3 phases. Histogram-based, gray-level co-occurrence matrix, and gray-level run-length matrix features were extracted using open-source software and analyzed. In addition, receiver operating characteristic curve was constructed, and the area under the receiver operating characteristic curve (AUC) of each feature was constructed.

RESULTS

Of the 33 extracted features, 16 features showed significant differences (P < 0.05). Eight features were significantly different between the 2 groups after Holm-Bonferroni correction, including 3 histogram-based, 4 gray-level co-occurrence matrix, and 1 gray-level run-length matrix features (P < 0.01). The texture features resulted in the highest AUC of 0.769 ± 0.074. Renal cell carcinomas were labeled with a higher degree of lesion gray-level disorder and lower lesion homogeneity, and a model incorporating the 3 most discriminative features resulted in an AUC of 0.846 ± 0.058.

CONCLUSIONS

The results of this study showed that CT texture features were related to malignancy in Bosniak III renal lesions. Computed tomography texture analysis might help in differentiating malignant from benign Bosniak III renal lesions on CT images.

The Effects of Perinodular Features on Solid Lung Nodule Classification

Lung cancer is the most lethal malignant neoplasm worldwide, with an annual estimated rate of 1.8 million deaths. Computed tomography has been widely used to diagnose and detect lung cancer, but its diagnosis remains an intricate and challenging work, even for experienced radiologists. Computer-aided diagnosis tools and radiomics tools have provided support to the radiologist's decision, acting as a second opinion. The main focus of these tools has been to analyze the intranodular zone; nevertheless, recent works indicate that the interaction between the nodule and its surroundings (perinodular zone) could be relevant to the diagnosis process. However, only a few works have investigated the importance of specific attributes of the perinodular zone and have shown how important they are in the classification of lung nodules. In this context, the purpose of this work is to evaluate the impact of using the perinodular zone on the characterization of lung lesions. Motivated by reproducible research, we used a large public dataset of solid lung nodule images and extracted fine-tuned radiomic attributes from the perinodular and intranodular zones. Our best-evaluated model obtained an average AUC of 0.916, an accuracy of 84.26%, a sensitivity of 84.45%, and specificity of 83.84%. The combination of attributes from the perinodular and intranodular zones in the image characterization resulted in an improvement in all the metrics analyzed when compared to intranodular-only characterization. Therefore, our results highlighted the importance of using the perinodular zone in the solid pulmonary nodules classification process.

Automated Spleen Injury Detection Using 3D Active Contours and Machine Learning

The spleen is one of the most frequently injured organs in blunt abdominal trauma. Computed tomography (CT) is the imaging modality of choice to assess patients with blunt spleen trauma, which may include lacerations, subcapsular or parenchymal hematomas, active hemorrhage, and vascular injuries. While computer-assisted diagnosis systems exist for other conditions assessed using CT scans, the current method to detect spleen injuries involves the manual review of scans by radiologists, which is a time-consuming and repetitive process. In this study, we propose an automated spleen injury detection method using machine learning. CT scans from patients experiencing traumatic injuries were collected from Michigan Medicine and the Crash Injury Research Engineering Network (CIREN) dataset. Ninety-nine scans of healthy and lacerated spleens were split into disjoint training and test sets, with random forest (RF), naive Bayes, SVM, k-nearest neighbors (k-NN) ensemble, and subspace discriminant ensemble models trained via 5-fold cross validation. Of these models, random forest performed the best, achieving an Area Under the receiver operating characteristic Curve (AUC) of 0.91 and an F1 score of 0.80 on the test set. These results suggest that an automated, quantitative assessment of traumatic spleen injury has the potential to enable faster triage and improve patient outcomes.

Overview of Computer Aided Detection and Computer Aided Diagnosis Systems for Lung Nodule Detection in Computed Tomography

BACKGROUND

Lung cancer has become a major cause of cancer-related deaths. Detection of potentially malignant lung nodules is essential for the early diagnosis and clinical management of lung cancer. In clinical practice, the interpretation of Computed Tomography (CT) images is challenging for radiologists due to a large number of cases. There is a high rate of false positives in the manual findings. Computer aided detection system (CAD) and computer aided diagnosis systems (CADx) enhance the radiologists in accurately delineating the lung nodules.

OBJECTIVES

The objective is to analyze CAD and CADx systems for lung nodule detection. It is necessary to review the various techniques followed in CAD and CADx systems proposed and implemented by various research persons. This study aims at analyzing the recent application of various concepts in computer science to each stage of CAD and CADx.

METHODS

This review paper is special in its own kind because it analyses the various techniques proposed by different eminent researchers in noise removal, contrast enhancement, thorax removal, lung segmentation, bone suppression, segmentation of trachea, classification of nodule and nonnodule and final classification of benign and malignant nodules.

RESULTS

A comparison of the performance of different techniques implemented by various researchers for the classification of nodule and non-nodule has been tabulated in the paper.

CONCLUSION

The findings of this review paper will definitely prove to be useful to the research community working on automation of lung nodule detection.

Prediction of liver regeneration in recipients after living-donor liver transplantation in using preoperative CT texture analysis and clinical features

PURPOSE

The aim of the study is to predict the rate of liver regeneration in recipients after living-donor liver transplantation using preoperative CT texture and shape analysis of the future graft.

METHODS

102 donor-recipient pairs who underwent living-donor liver transplantation using right lobe grafts were retrospectively included. We semi-automatically segmented the future graft from preoperative CT. The volume of the future graft (LV_pre) was measured, and texture and shape analyses were performed. The graft liver was segmented from postoperative follow-up CT and the volume of the graft (LV_post) was measured. The regeneration index was defined by the following equation: [(LV_post-LV_pre)/LV_pre] × 100(%). We performed a stepwise, multivariate linear regression analysis to investigate the association between clinical, texture and shape parameters and the RI and to make the best-fit predictive model.

RESULTS

The mean regeneration index was 47.5 ± 38.6%. In univariate analysis, the volume of the future graft, energy, effective diameter, surface area, sphericity, roundness_m, compactness1, and grey-level co-occurrence matrix contrast as well as several clinical parameters were significantly associated with the regeneration index (p < 0.05). The best-fit predictive model for the regeneration index made by multivariate analysis was as follows: Regeneration index (%) = 127.020-0.367 × effective diameter - 1.827 × roundness_m + 47.371 × recipient body surface area (m²) + 12.041 × log(recipient white blood cell count) (× 10³/μL)+ 18.034 (if the donor was female).

CONCLUSION

The effective diameter and roundness_m of the future graft were associated with liver regeneration. Preoperative CT texture analysis of future grafts can be useful for predicting liver regeneration in recipients after living-donor liver transplantation.

Machine-learning-based multiple abnormality prediction with large-scale chest computed tomography volumes

Machine learning models for radiology benefit from large-scale data sets with high quality labels for abnormalities. We curated and analyzed a chest computed tomography (CT) data set of 36,316 volumes from 19,993 unique patients. This is the largest multiply-annotated volumetric medical imaging data set reported. To annotate this data set, we developed a rule-based method for automatically extracting abnormality labels from free-text radiology reports with an average F-score of 0.976 (min 0.941, max 1.0). We also developed a model for multi-organ, multi-disease classification of chest CT volumes that uses a deep convolutional neural network (CNN). This model reached a classification performance of AUROC >0.90 for 18 abnormalities, with an average AUROC of 0.773 for all 83 abnormalities, demonstrating the feasibility of learning from unfiltered whole volume CT data. We show that training on more labels improves performance significantly: for a subset of 9 labels - nodule, opacity, atelectasis, pleural effusion, consolidation, mass, pericardial effusion, cardiomegaly, and pneumothorax - the model's average AUROC increased by 10% when the number of training labels was increased from 9 to all 83. All code for volume preprocessing, automated label extraction, and the volume abnormality prediction model is publicly available. The 36,316 CT volumes and labels will also be made publicly available pending institutional approval.

Value of Shape and Texture Features from 18F-FDG PET/CT to Discriminate between Benign and Malignant Solitary Pulmonary Nodules: An Experimental Evaluation

In this paper, we investigate the role of shape and texture features from 18F-FDG PET/CT to discriminate between benign and malignant solitary pulmonary nodules. To this end, we retrospectively evaluated cross-sectional data from 111 patients (64 males, 47 females, age = 67.5 ± 11.0) all with histologically confirmed benign (n=39) or malignant (n=72) solitary pulmonary nodules. Eighteen three-dimensional imaging features, including conventional, texture, and shape features from PET and CT were tested for significant differences (Wilcoxon-Mann-Withney) between the benign and malignant groups. Prediction models based on different feature sets and three classification strategies (Classification Tree, k-Nearest Neighbours, and Naïve Bayes) were also evaluated to assess the potential benefit of shape and texture features compared with conventional imaging features alone. Eight features from CT and 15 from PET were significantly different between the benign and malignant groups. Adding shape and texture features increased the performance of both the CT-based and PET-based prediction models with overall accuracy gain being 3.4-11.2 pp and 2.2-10.2 pp, respectively. In conclusion, we found that shape and texture features from 18F-FDG PET/CT can lead to a better discrimination between benign and malignant lung nodules by increasing the accuracy of the prediction models by an appreciable margin.

Combining multi-scale feature fusion with multi-attribute grading, a CNN model for benign and malignant classification of pulmonary nodules

Lung cancer has the highest mortality rate of all cancers, and early detection can improve survival rates. In the recent years, low-dose CT has been widely used to detect lung cancer. However, the diagnosis is limited by the subjective experience of doctors. Therefore, the main purpose of this study is to use convolutional neural network to realize the benign and malignant classification of pulmonary nodules in CT images. We collected 1004 cases of pulmonary nodules from LIDC-IDRI dataset, among which 554 cases were benign and 450 cases were malignant. According to the doctors' annotates on the center coordinates of the nodules, two 3D CT image patches of pulmonary nodules with different scales were extracted. In this study, our work focuses on two aspects. Firstly, we constructed a multi-stream multi-task network (MSMT), which combined multi-scale feature with multi-attribute classification for the first time, and applied it to the classification of benign and malignant pulmonary nodules. Secondly, we proposed a new loss function to balance the relationship between different attributes. The final experimental results showed that our model was effective compared with the same type of study. The area under ROC curve, accuracy, sensitivity, and specificity were 0.979, 93.92%, 92.60%, and 96.25%, respectively.

Radiomic Texture and Shape Descriptors of the Rectal Environment on Post-Chemoradiation T2-Weighted MRI are Associated with Pathologic Tumor Stage Regression in Rectal Cancers: A Retrospective, Multi-Institution Study

(1) Background: The relatively poor expert restaging accuracy of MRI in rectal cancer after neoadjuvant chemoradiation may be due to the difficulties in visual assessment of residual tumor on post-treatment MRI. In order to capture underlying tissue alterations and morphologic changes in rectal structures occurring due to the treatment, we hypothesized that radiomics texture and shape descriptors of the rectal environment (e.g., wall, lumen) on post-chemoradiation T2-weighted (T2w) MRI may be associated with tumor regression after neoadjuvant chemoradiation therapy (nCRT). (2) Methods: A total of 94 rectal cancer patients were retrospectively identified from three collaborating institutions, for whom a 1.5 or 3T T2w MRI was available after nCRT and prior to surgical resection. The rectal wall and the lumen were annotated by an expert radiologist on all MRIs, based on which 191 texture descriptors and 198 shape descriptors were extracted for each patient. (3) Results: Top-ranked features associated with pathologic tumor-stage regression were identified via cross-validation on a discovery set (n = 52, 1 institution) and evaluated via discriminant analysis in hold-out validation (n = 42, 2 institutions). The best performing features for distinguishing low (ypT0-2) and high (ypT3-4) pathologic tumor stages after nCRT comprised directional gradient texture expression and morphologic shape differences in the entire rectal wall and lumen. Not only were these radiomic features found to be resilient to variations in magnetic field strength and expert segmentations, a quadratic discriminant model combining them yielded consistent performance across multiple institutions (hold-out AUC of 0.73). (4) Conclusions: Radiomic texture and shape descriptors of the rectal wall from post-treatment T2w MRIs may be associated with low and high pathologic tumor stage after neoadjuvant chemoradiation therapy and generalized across variations between scanners and institutions.

Non-invasive evaluation for benign and malignant subcentimeter pulmonary ground-glass nodules (≤1 cm) based on CT texture analysis

OBJECTIVES

To investigate potential diagnostic model for predicting benign or malignant status of subcentimeter pulmonary ground-glass nodules (SPGGNs) (≤1 cm) based on CT texture analysis.

METHODS

A total of 89 SPGGNs from 89 patients were included; 51 patients were diagnosed with adenocarcinoma, and 38 were diagnosed with inflamed or infected benign SPGGNs. Analysis Kit software was used to manually delineate the volume of interest of lesions and extract a total of 396 quantitative texture parameters. The statistical analysis was performed using R software. The SPGGNs were randomly divided into a training set (n = 59) and a validation set (n = 30). All pre-normalized (Z-score) feature values were subjected to dimension reduction using the LASSO algorithm,and the most useful features in the training set were selected. The selected imaging features were then combined into a Rad-score, which was further assessed by ROC curve analysis in the training and validation sets.

RESULTS

Four characteristic parameters (ClusterShade_AllDirection_offset4_SD, ShortRunEmphasis_angle45_offset1, Maximum3DDiameter, SurfaceVolumeRatio) were further selected by LASSO (p < 0.05). As a cluster of imaging biomarkers, the above four parameters were used to form the Rad-score. The AUC for differentiating between benign and malignant SPGGNs in the training set was 0.792 (95% CI: 0.671, 0.913), and the sensitivity and specificity were 86.10 and 65.20%, respectively. The AUC in the validation set was 72.9% (95% CI: 0.545, 0.913), and the sensitivity and specificity were 86.70 and 60%, respectively.

CONCLUSION

The present diagnostic model based on the cluster of imaging biomarkers can preferably distinguish benign and malignant SPGGNs (≤1 cm).

ADVANCES IN KNOWLEDGE

Texture analysis based on CT images provide a new and credible technique for accurate identification of subcentimeter pulmonary ground-glass nodules.

Contour-based lung shape analysis in order to tuberculosis detection: modeling and feature description

Statistical shape analysis of lung is a reliable alternative method for diagnosing pulmonary diseases such as tuberculosis (TB). The 2D contour-based lung shape analysis is investigated and developed using Fourier descriptors (FDs). The proposed 2D lung shape analysis is carried out in threefold: (1) represent the normal and the abnormal (i.e. pulmonary tuberculosis (PTB)) lung shape models using Fourier descriptors modeling (FDM) framework from chest X-ray (CXR) images, (2) estimate and compare the 2D inter-patient lung shape variations for the normal and abnormal lungs by applying principal component analysis (PCA) techniques, and (3) describe the optimal type of contour-based feature vectors to train a classifier in order to detect TB using one publicly available dataset-namely the Montgomery dataset. Since almost all of the previous works in lung shape analysis are content-based analysis, we proposed contour-based lung shape analysis for statistical modeling and feature description of PTB cases. The results show that the proposed approach is able to explain more than 95% of total variations in both of the normal and PTB cases using only 6 and 7 principal component modes for the right and the left lungs, respectively. In case of PTB detection, using 138 lung cases (80 normal and 58 PTB cases), we achieved the accuracy (ACC) and the area under the curve (AUC) of 82.03% and 88.75%, respectively. In comparison with existing state-of-art studies in the same dataset, the proposed approach is a very promising supplement for diagnosis of PTB disease. The method is robust and valuable for application in 2D automatic segmentation, classification, and atlas registration. Moreover, the approach could be used for any kind of pulmonary diseases. Graphical abstract Contour-based lung shape analysis in order to detect tuberculosis: modeling and feature description.

Ensemble classification for predicting the malignancy level of pulmonary nodules on chest computed tomography images

Early identification and classification of pulmonary nodules are essential for improving the survival rates of individuals with lung cancer and are considered to be key requirements for computer-assisted diagnosis. To address this topic, the present study proposed a method for predicting the malignant phenotype of pulmonary nodules based on weighted voting rules. This method used the pulmonary nodule regions of interest as the input data and extracted the features of the pulmonary nodules using the Denoising Auto Encoder, ResNet-18. Moreover, the software also modifies texture and shape features to assess the malignant phenotype of the pulmonary nodules. Based on their classification accuracy (Acc), the different classifiers were assigned to different weights. Finally, an integrated classifier was obtained to score the malignant phenotype of the pulmonary nodules. The present study included training and testing experiments conducted by extracting the corresponding lung nodule image data from the Lung Image Database Consortium-Image Database Resource Initiative. The results of the present study indicated a final classification Acc of 93.10±2.4%, demonstrating the feasibility and effectiveness of the proposed method. This method includes the powerful feature extraction ability of deep learning combined with the ability to use traditional features in image representation.

A knowledge-driven feature learning and integration method for breast cancer diagnosis on multi-sequence MRI

BACKGROUND

The classification of benign versus malignant breast lesions on multi-sequence Magnetic Resonance Imaging (MRI) is a challenging task since breast lesions are heterogeneous and complex. Recently, deep learning methods have been used for breast lesion diagnosis with raw image input. However, without the guidance of domain knowledge, these data-driven methods cannot ensure that the features extracted from images are comprehensive for breast cancer diagnosis. Specifically, these features are difficult to relate to clinically relevant phenomena.

PURPOSE

Inspired by the cognition process of radiologists, we propose a Knowledge-driven Feature Learning and Integration (KFLI) framework, to discriminate between benign and malignant breast lesions using Multi-sequences MRI.

METHODS

Starting from sequence division based on characteristics, we use domain knowledge to guide the feature learning process so that the feature vectors of sub-sequence are constrained to lie in characteristic-related semantic space. Then, different deep networks are designed to extract various sub-sequence features. Furthermore, a weighting module is employed for the integration of the features extracted from different sub-sequence images adaptively.

RESULTS

The KFLI is a domain knowledge and deep network ensemble, which can extract sufficient and effective features from each sub-sequence for a comprehensive diagnosis of breast cancer. Experiments on 100 MRI studies have demonstrated that the KFLI achieves sensitivity, specificity, and accuracy of 84.6%, 85.7% and 85.0%, respectively, which outperforms other state-of-the-art algorithms.

Classification and retrieval of thoracic diseases using patch-based visual words: a study on chest x-rays

This research work explores the Content-Based Medical Image Retrieval system (CBMIR) to categorization and retrieval of different types of common thoracic diseases such as Atelectasis, cardiomegaly, Effusion, Infiltration etc, based on local patch representation of 'Bag of Visual Words' approach, when performing patch-based image representation, the selected patch size has significant impact on image categorization and retrieval process. It is a challenging task in selecting the appropriate patch size to the current experimental dataset. Chest Xray8 medical image database is used, to analyze the impact of different patch size to categorize and retrieval of eight common thorax diseases. 1000 frontal view x-ray images is obtained (100 images from each category and 200 images combination of more than one disease) from the database. Different sizes of image patches (16 × 16 and 32 × 32) and different codebook sizes (500, 1000, 1500, 2000) created to identify best precision and recall values. From the excremental result, 32 × 32 patch size and 1500 codebook size gives the good precision and recall value using Radial Basis Function SVM kernel.

PET/CT Radiomics in Lung Cancer: An Overview

Quantitative extraction of imaging features from medical scans (‘radiomics’) has attracted a lot of research attention in the last few years. The literature has consistently emphasized the potential use of radiomics for computer-assisted diagnosis, as well as for predicting survival and response to treatment. Radiomics is appealing in that it enables full-field analysis of the lesion, provides nearly real-time results, and is non-invasive. Still, a lot of studies suffer from a series of drawbacks such as lack of standardization and repeatability. Such limitations, along with the unmet demand for large enough image datasets for training the algorithms, are major hurdles that still limit the application of radiomics on a large scale. In this paper, we review the current developments, potential applications, limitations, and perspectives of PET/CT radiomics with specific focus on the management of patients with lung cancer.

Multi-Task Deep Model With Margin Ranking Loss for Lung Nodule Analysis

Lung cancer is the leading cause of cancer deaths worldwide and early diagnosis of lung nodule is of great importance for therapeutic treatment and saving lives. Automated lung nodule analysis requires both accurate lung nodule benign-malignant classification and attribute score regression. However, this is quite challenging due to the considerable difficulty of lung nodule heterogeneity modeling and the limited discrimination capability on ambiguous cases. To solve these challenges, we propose a Multi-Task deep model with Margin Ranking loss (referred as MTMR-Net) for automated lung nodule analysis. Compared to existing methods which consider these two tasks separately, the relatedness between lung nodule classification and attribute score regression is explicitly explored in a cause-and-effect manner within our multi-task deep model, which can contribute to the performance gains of both tasks. The results of different tasks can be yielded simultaneously for assisting the radiologists in diagnosis interpretation. Furthermore, a Siamese network with a margin ranking loss is elaborately designed to enhance the discrimination capability on ambiguous nodule cases. To further explore the internal relationship between two tasks and validate the effectiveness of the proposed model, we use the recursive feature elimination method to iteratively rank the most malignancy-related features. We validate the efficacy of our method MTMR-Net on the public benchmark LIDC-IDRI dataset. Extensive experiments show that the diagnosis results with internal relationship explicitly explored in our model has met some similar patterns in clinical usage and also demonstrate that our approach can achieve competitive classification performance and more accurate scoring on attributes over the state-of-the-arts. Codes are publicly available at: https://github.com/CaptainWilliam/MTMR-NET.