1
|
Martin SS, Kolaneci D, Wichmann JL, Lenga L, Leithner D, Vogl TJ, Jacobi V. Development and evaluation of a computer-based decision support system for diffuse lung diseases at high-resolution computed tomography. Acta Radiol 2022; 63:328-335. [PMID: 33657848 DOI: 10.1177/0284185121995799] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND High-resolution computed tomography (HRCT) is essential in narrowing the possible differential diagnoses of diffuse and interstitial lung diseases. PURPOSE To investigate the value of a novel computer-based decision support system (CDSS) for facilitating diagnosis of diffuse lung diseases at HRCT. MATERIAL AND METHODS A CDSS was developed that includes about 100 different illustrations of the most common HRCT signs and patterns and describes the corresponding pathologies in detail. The logical set-up of the software facilitates a structured evaluation. By selecting one or more CT patterns, the program generates a ranked list of the most likely differential diagnoses. Three independent and blinded radiology residents initially evaluated 40 cases with different lung diseases alone; after at least 12 weeks, observers re-evaluated all cases using the CDSS. RESULTS In 40 patients, a total of 113 HRCT patterns were evaluated. The percentage of correctly classified patterns was higher with CDSS (96.8%) compared to assessment without CDSS (90.3%; P < 0.01). Moreover, the percentage of correct diagnosis (81.7% vs. 64.2%) and differential diagnoses (89.2% vs. 38.3%) were superior with CDSS compared to evaluation without CDSS (both P < 0.01). CONCLUSION Addition of a CDSS using a structured approach providing explanations of typical HRCT patterns and graphical illustrations significantly improved the performance of trainees in characterizing and correctly identifying diffuse lung diseases.
Collapse
Affiliation(s)
- Simon S Martin
- Department of Diagnostic and Interventional Radiology, University Hospital Frankfurt, Frankfurt, Germany
| | - Delina Kolaneci
- Department of Diagnostic and Interventional Radiology, University Hospital Frankfurt, Frankfurt, Germany
| | - Julian L Wichmann
- Department of Diagnostic and Interventional Radiology, University Hospital Frankfurt, Frankfurt, Germany
| | - Lukas Lenga
- Department of Diagnostic and Interventional Radiology, University Hospital Frankfurt, Frankfurt, Germany
| | - Doris Leithner
- Department of Diagnostic and Interventional Radiology, University Hospital Frankfurt, Frankfurt, Germany
| | - Thomas J Vogl
- Department of Diagnostic and Interventional Radiology, University Hospital Frankfurt, Frankfurt, Germany
| | - Volkmar Jacobi
- Department of Diagnostic and Interventional Radiology, University Hospital Frankfurt, Frankfurt, Germany
| |
Collapse
|
2
|
Aliboni L, Dias OM, Pennati F, Baldi BG, Sawamura MVY, Chate RC, Carvalho CRR, de Albuquerque ALP, Aliverti A. Quantitative CT Analysis in Chronic Hypersensitivity Pneumonitis: A Convolutional Neural Network Approach. Acad Radiol 2022; 29 Suppl 2:S31-S40. [PMID: 33168391 DOI: 10.1016/j.acra.2020.10.009] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2020] [Revised: 10/01/2020] [Accepted: 10/04/2020] [Indexed: 11/01/2022]
Abstract
RATIONALE AND OBJECTIVES Chronic hypersensitivity pneumonitis (cHP) is a heterogeneous condition, where both small airway involvement and fibrosis may simultaneously occur. Computer-aided analysis of CT lung imaging is increasingly used to improve tissue characterization in interstitial lung diseases (ILD), quantifying disease extension, and progression. We aimed to quantify via a convolutional neural network (CNN) method the extent of different pathological classes in cHP, and to determine their correlation to pulmonary function tests (PFTs) and mosaic attenuation pattern. MATERIALS AND METHODS The extension of six textural features, including consolidation (C), ground glass opacity (GGO), fibrosis (F), low attenuation areas (LAA), reticulation (R) and healthy regions (H), was quantified in 27 cHP patients (age: 56 ± 11.5 years, forced vital capacity [FVC]% = 57 ± 17) acquired at full-inspiration via HRCT. Each class extent was correlated to PFTs and to mosaic attenuation pattern. RESULTS H showed a positive correlation with FVC%, FEV1% (forced expiratory volume), total lung capacity%, and diffusion of carbon monoxide (DLCO)% (r = 0.74, r = 0.78, r = 0.73, and r = 0.60, respectively, p < 0.001). GGO, R and C negatively correlated with FVC% and FEV1% with the highest correlations found for R (r = -0.44, and r = -0.46 respectively, p < 0.05); F negatively correlated with DLCO% (r = -0.42, p < 0.05). Patients with mosaic attenuation pattern had significantly more H (p = 0.04) and lower R (p = 0.02) and C (p = 0.0009) areas, and more preserved lung function indices (higher FVC%; p = 0.04 and DLCO%; p = 0.05), but did not show more air trapping in lung function tests. CONCLUSION CNN quantification of pathological tissue extent in cHP improves its characterization and shows correlation with PFTs. LAA can be overestimated by visual, qualitative CT assessment and mosaic attenuation pattern areas in cHP represents patchy ILD rather than small-airways disease.
Collapse
|
3
|
Two-Stage Hybrid Approach of Deep Learning Networks for Interstitial Lung Disease Classification. BIOMED RESEARCH INTERNATIONAL 2022; 2022:7340902. [PMID: 35155680 PMCID: PMC8826206 DOI: 10.1155/2022/7340902] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/02/2021] [Revised: 01/14/2022] [Accepted: 01/21/2022] [Indexed: 11/18/2022]
Abstract
High-resolution computed tomography (HRCT) images in interstitial lung disease (ILD) screening can help improve healthcare quality. However, most of the earlier ILD classification work involves time-consuming manual identification of the region of interest (ROI) from the lung HRCT image before applying the deep learning classification algorithm. This paper has developed a two-stage hybrid approach of deep learning networks for ILD classification. A conditional generative adversarial network (c-GAN) has segmented the lung part from the HRCT images at the first stage. The c-GAN with multiscale feature extraction module has been used for accurate lung segmentation from the HRCT images with lung abnormalities. At the second stage, a pretrained ResNet50 has been used to extract the features from the segmented lung image for classification into six ILD classes using the support vector machine classifier. The proposed two-stage algorithm takes a whole HRCT as input eliminating the need for extracting the ROI and classifies the given HRCT image into an ILD class. The performance of the proposed two-stage deep learning network-based ILD classifier has improved considerably due to the stage-wise improvement of deep learning algorithm performance.
Collapse
|
4
|
Junior CP, Cavallieri GV, da Silva FA, Fernandes GL, Nai GA, Salge AKM, Puhle JG, de Resende E Silva DT, Pereira DR, de Azevedo Mello F, Favareto APA, Rossi RC. Digital image processing: a useful tool in the analysis of lung injuries caused by chronic inhalation of agricultural herbicides. ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH INTERNATIONAL 2021; 28:57918-57924. [PMID: 34097223 PMCID: PMC8183328 DOI: 10.1007/s11356-021-14692-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/11/2021] [Accepted: 05/31/2021] [Indexed: 06/12/2023]
Abstract
The herbicide 2,4-dichlorophenoxyacetic acid (2,4-D) is widely used in agriculture to control various weeds. The objective of this study was to use the digital image processing method to identify alveolar lesions in the lungs of rats submitted to chronic 2,4-dichlorophenoxyacetic acid (2,4-D) inhalation exposure. We used forty adult male Wistar rats. The rats were divided into four groups: control group (CG), low concentration group (LCG), medium concentration group (MCG), and high concentration group (HCG). In a 6-month exposure period, we used two boxes connected to ultrasonic nebulizers for herbicide spraying. After this period, the rats were euthanized for the collection and study of lung tissue. For each image, counts of injuries and blisters were performed automatically using a methodology based on digital image processing techniques. For analysis of the results, an electronic database (Excel®) was created. We used the Pearson method for correlation analysis; values of p <0.05 were considered significant. In the evaluation of healthy alveoli, we recorded positive and significant correlations between analysis from a pathologist and computational analysis. In the evaluation of injured alveoli, we recorded a positive but non-significant correlation between analysis from a pathologist and computational analysis. These results show the effectiveness of digital image processing when evaluating alveolar integrity.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | | | | | | | - Ana Paula Alves Favareto
- Environmental and Regional Development, Oeste Paulista University, Presidente Prudente, SP, Brazil
| | - Renata Calciolari Rossi
- Environmental and Regional Development, Oeste Paulista University, Km 572, SP-270 - Bairro Limoeiro, Pres. Prudente, SP, 19026-310, Brazil.
| |
Collapse
|
5
|
Pennati F, Aliboni L, Antoniazza A, Beretta D, Dias O, Baldi BG, Sawamura M, Chate RC, De Carvalho CRR, Albuquerque A, Aliverti A. Texture-based classification of lung disease patterns in chronic hypersensitivity pneumonitis and comparison to clinical outcomes. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:3427-3430. [PMID: 34891976 DOI: 10.1109/embc46164.2021.9630247] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Computer-aided detection algorithms applied to CT lung imaging have the potential to objectively quantify pulmonary pathology. We aim to develop an automatic classification method based on textural features able to classify healthy and pathological patterns on CT lung images and to quantify the extent of each disease pattern in a group of patients with chronic hypersensitivity pneumonitis (cHP), in comparison to pulmonary function tests (PFTs).27 cHP patients were scanned via high resolution CT (HRCT) at full-inspiration. Regions of interest (ROIs) were extracted and labeled as normal (NOR), ground glass opacity (GGO), reticulation (RET), consolidation (C), honeycombing (HB) and air trapping (AT). For each ROI, statistical, morphological and fractal parameters were computed. For automatic classification, we compared two classification methods (Bayesian and Support Vector Machine) and three ROI sizes. The classifier was therefore applied to the overall CT images and the extent of each class was calculated and compared to PFTs. Better classification accuracy was found for the Bayesian classifier and the 16x16 ROI size: 92.1±2.7%. The extent of GGO, HB and NOR significantly correlated with forced vital capacity (FVC) and the extent of NOR with carbon monoxide diffusing capacity (DLCO).Clinical Relevance- Texture analysis can differentiate and objectively quantify pathological classes in the lung parenchyma and may represent a quantitative diagnostic tool in cHP.
Collapse
|
6
|
Abstract
The interest in artificial intelligence (AI) has ballooned within radiology in the past few years primarily due to notable successes of deep learning. With the advances brought by deep learning, AI has the potential to recognize and localize complex patterns from different radiological imaging modalities, many of which even achieve comparable performance to human decision-making in recent applications. In this chapter, we review several AI applications in radiology for different anatomies: chest, abdomen, pelvis, as well as general lesion detection/identification that is not limited to specific anatomies. For each anatomy site, we focus on introducing the tasks of detection, segmentation, and classification with an emphasis on describing the technology development pathway with the aim of providing the reader with an understanding of what AI can do in radiology and what still needs to be done for AI to better fit in radiology. Combining with our own research experience of AI in medicine, we elaborate how AI can enrich knowledge discovery, understanding, and decision-making in radiology, rather than replacing the radiologist.
Collapse
|
7
|
Hwang EJ, Park CM. Clinical Implementation of Deep Learning in Thoracic Radiology: Potential Applications and Challenges. Korean J Radiol 2020; 21:511-525. [PMID: 32323497 PMCID: PMC7183830 DOI: 10.3348/kjr.2019.0821] [Citation(s) in RCA: 39] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2019] [Accepted: 01/31/2020] [Indexed: 12/25/2022] Open
Abstract
Chest X-ray radiography and computed tomography, the two mainstay modalities in thoracic radiology, are under active investigation with deep learning technology, which has shown promising performance in various tasks, including detection, classification, segmentation, and image synthesis, outperforming conventional methods and suggesting its potential for clinical implementation. However, the implementation of deep learning in daily clinical practice is in its infancy and facing several challenges, such as its limited ability to explain the output results, uncertain benefits regarding patient outcomes, and incomplete integration in daily workflow. In this review article, we will introduce the potential clinical applications of deep learning technology in thoracic radiology and discuss several challenges for its implementation in daily clinical practice.
Collapse
Affiliation(s)
- Eui Jin Hwang
- Department of Radiology, Seoul National University College of Medicine, Seoul, Korea
| | - Chang Min Park
- Department of Radiology, Seoul National University College of Medicine, Seoul, Korea.
| |
Collapse
|
8
|
Choudhary P, Hazra A. Chest disease radiography in twofold: using convolutional neural networks and transfer learning. EVOLVING SYSTEMS 2019. [DOI: 10.1007/s12530-019-09316-2] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
9
|
Artificial intelligence in diagnosis of obstructive lung disease: current status and future potential. Curr Opin Pulm Med 2019; 24:117-123. [PMID: 29251699 DOI: 10.1097/mcp.0000000000000459] [Citation(s) in RCA: 51] [Impact Index Per Article: 10.2] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Abstract
PURPOSE OF REVIEW The application of artificial intelligence in the diagnosis of obstructive lung diseases is an exciting phenomenon. Artificial intelligence algorithms work by finding patterns in data obtained from diagnostic tests, which can be used to predict clinical outcomes or to detect obstructive phenotypes. The purpose of this review is to describe the latest trends and to discuss the future potential of artificial intelligence in the diagnosis of obstructive lung diseases. RECENT FINDINGS Machine learning has been successfully used in automated interpretation of pulmonary function tests for differential diagnosis of obstructive lung diseases. Deep learning models such as convolutional neural network are state-of-the art for obstructive pattern recognition in computed tomography. Machine learning has also been applied in other diagnostic approaches such as forced oscillation test, breath analysis, lung sound analysis and telemedicine with promising results in small-scale studies. SUMMARY Overall, the application of artificial intelligence has produced encouraging results in the diagnosis of obstructive lung diseases. However, large-scale studies are still required to validate current findings and to boost its adoption by the medical community.
Collapse
|
10
|
Content-based retrieval for lung nodule diagnosis using learned distance metric. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2018; 2017:3910-3913. [PMID: 29060752 DOI: 10.1109/embc.2017.8037711] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Similarity metric of the lung nodules can be useful in differentiating between benign and malignant lung nodule lesions on computed tomography (CT). Unlike previous computerized schemes, which focus on the features extracting, we concentrate on similarity metric of the lung nodules. In this study, we first assemble a lung nodule dataset which is from LIDC-IDRI lung CT images. This dataset includes 746 lung nodules in which 375 domain radiologists identified malignant nodules and 371 domain radiologists-identified benign nodules. Each nodule is represented by a vector of 26 texture features. We then propose a content-based image retrieval (CBIR) scheme to classify between benign and malignant lung nodules with a learned Mahalanobis distance metric. The Mahalanobis distance metric as a similarity metric can preserve semantic relevance and visual similarity of lung nodules. The CBIR approach uses this Mahalanobis distance to search for most similar reference nodules for each queried nodule. The majority of votes are then computed to predict the likelihood of the queried nodule depicting a malignant lesion. For the classification accuracy, the area under the ROC curve (AUC) can achieve as 0.942±0.008. The recall and precision of benign nodules are 0.860 and 0.889, respectively. The recall and precision of malignant nodules are 0.893 and 0.866, respectively.
Collapse
|
11
|
Larsen TC, Gopalakrishnan V, Yao J, Nguyen CP, Chen MY, Moss J, Wen H. Optimization of a secondary VOI protocol for lung imaging in a clinical CT scanner. J Appl Clin Med Phys 2018; 19:271-280. [PMID: 29785839 PMCID: PMC6036356 DOI: 10.1002/acm2.12354] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2017] [Revised: 04/02/2018] [Accepted: 04/10/2018] [Indexed: 11/10/2022] Open
Abstract
We present a solution to meet an unmet clinical need of an in-situ "close look" at a pulmonary nodule or at the margins of a pulmonary cyst revealed by a primary (screening) chest CT while the patient is still in the scanner. We first evaluated options available on current whole-body CT scanners for high resolution screening scans, including ROI reconstruction of the primary scan data and HRCT, but found them to have insufficient SNR in lung tissue or discontinuous slice coverage. Within the capabilities of current clinical CT systems, we opted for the solution of a secondary, volume-of-interest (VOI) protocol where the radiation dose is focused into a short-beam axial scan at the z position of interest, combined with a small-FOV reconstruction at the xy position of interest. The objective of this work was to design a VOI protocol that is optimized for targeted lung imaging in a clinical whole-body CT system. Using a chest phantom containing a lung-mimicking foam insert with a simulated cyst, we identified the appropriate scan mode and optimized both the scan and recon parameters. The VOI protocol yielded 3.2 times the texture amplitude-to-noise ratio in the lung-mimicking foam when compared to the standard chest CT, and 8.4 times the texture difference between the lung mimicking and reference foams. It improved details of the wall of the simulated cyst and better resolution in a line-pair insert. The Effective Dose of the secondary VOI protocol was 42% on average and up to 100% in the worst-case scenario of VOI positioning relative to the standard chest CT. The optimized protocol will be used to obtain detailed CT textures of pulmonary lesions, which are biomarkers for the type and stage of lung diseases.
Collapse
Affiliation(s)
- Thomas C Larsen
- National Heart, Lung and Blood Institute, National Institutes of Health, Bethesda, MD, USA
| | - Vissagan Gopalakrishnan
- National Heart, Lung and Blood Institute, National Institutes of Health, Bethesda, MD, USA.,Rush Medical College, Chicago, IL, USA
| | - Jianhua Yao
- Department of Radiology, Hatfield Clinical Center, National Institutes of Health, Bethesda, MD, USA
| | - Catherine P Nguyen
- National Heart, Lung and Blood Institute, National Institutes of Health, Bethesda, MD, USA
| | - Marcus Y Chen
- National Heart, Lung and Blood Institute, National Institutes of Health, Bethesda, MD, USA
| | - Joel Moss
- National Heart, Lung and Blood Institute, National Institutes of Health, Bethesda, MD, USA
| | - Han Wen
- National Heart, Lung and Blood Institute, National Institutes of Health, Bethesda, MD, USA
| |
Collapse
|
12
|
Computerized Classification of Pneumoconiosis on Digital Chest Radiography Artificial Neural Network with Three Stages. J Digit Imaging 2018; 30:413-426. [PMID: 28108817 DOI: 10.1007/s10278-017-9942-0] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022] Open
Abstract
It is difficult for radiologists to classify pneumoconiosis from category 0 to category 3 on chest radiographs. Therefore, we have developed a computer-aided diagnosis (CAD) system based on a three-stage artificial neural network (ANN) method for classification based on four texture features. The image database consists of 36 chest radiographs classified as category 0 to category 3. Regions of interest (ROIs) with a matrix size of 32 × 32 were selected from chest radiographs. We obtained a gray-level histogram, histogram of gray-level difference, gray-level run-length matrix (GLRLM) feature image, and gray-level co-occurrence matrix (GLCOM) feature image in each ROI. For ROI-based classification, the first ANN was trained with each texture feature. Next, the second ANN was trained with output patterns obtained from the first ANN. Finally, we obtained a case-based classification for distinguishing among four categories with the third ANN method. We determined the performance of the third ANN by receiver operating characteristic (ROC) analysis. The areas under the ROC curve (AUC) of the highest category (severe pneumoconiosis) case and the lowest category (early pneumoconiosis) case were 0.89 ± 0.09 and 0.84 ± 0.12, respectively. The three-stage ANN with four texture features showed the highest performance for classification among the four categories. Our CAD system would be useful for assisting radiologists in classification of pneumoconiosis from category 0 to category 3.
Collapse
|
13
|
Anthimopoulos M, Christodoulidis S, Ebner L, Geiser T, Christe A, Mougiakakou S. Semantic Segmentation of Pathological Lung Tissue With Dilated Fully Convolutional Networks. IEEE J Biomed Health Inform 2018; 23:714-722. [PMID: 29993791 DOI: 10.1109/jbhi.2018.2818620] [Citation(s) in RCA: 53] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Early and accurate diagnosis of interstitial lung diseases (ILDs) is crucial for making treatment decisions, but can be challenging even for experienced radiologists. The diagnostic procedure is based on the detection and recognition of the different ILD pathologies in thoracic CT scans, yet their manifestation often appears similar. In this study, we propose the use of a deep purely convolutional neural network for the semantic segmentation of ILD patterns, as the basic component of a computer aided diagnosis system for ILDs. The proposed CNN, which consists of convolutional layers with dilated filters, takes as input a lung CT image of arbitrary size and outputs the corresponding label map. We trained and tested the network on a data set of 172 sparsely annotated CT scans, within a cross-validation scheme. The training was performed in an end-to-end and semisupervised fashion, utilizing both labeled and nonlabeled image regions. The experimental results show significant performance improvement with respect to the state of the art.
Collapse
|
14
|
Content-based image retrieval for Lung Nodule Classification Using Texture Features and Learned Distance Metric. J Med Syst 2017; 42:13. [PMID: 29185058 DOI: 10.1007/s10916-017-0874-5] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2017] [Accepted: 11/22/2017] [Indexed: 10/18/2022]
Abstract
Similarity measurement of lung nodules is a critical component in content-based image retrieval (CBIR), which can be useful in differentiating between benign and malignant lung nodules on computer tomography (CT). This paper proposes a new two-step CBIR scheme (TSCBIR) for computer-aided diagnosis of lung nodules. Two similarity metrics, semantic relevance and visual similarity, are introduced to measure the similarity of different nodules. The first step is to search for K most similar reference ROIs for each queried ROI with the semantic relevance metric. The second step is to weight each retrieved ROI based on its visual similarity to the queried ROI. The probability is computed to predict the likelihood of the queried ROI depicting a malignant lesion. In order to verify the feasibility of the proposed algorithm, a lung nodule dataset including 366 nodule regions of interest (ROIs) is assembled from LIDC-IDRI lung images on CT scans. Three groups of texture features are implemented to represent a nodule ROI. Our experimental results on the assembled lung nodule dataset show good performance improvement over existing popular classifiers.
Collapse
|
15
|
Han S, Kang HK, Jeong JY, Park MH, Kim W, Bang WC, Seong YK. A deep learning framework for supporting the classification of breast lesions in ultrasound images. Phys Med Biol 2017; 62:7714-7728. [PMID: 28753132 DOI: 10.1088/1361-6560/aa82ec] [Citation(s) in RCA: 177] [Impact Index Per Article: 25.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
In this research, we exploited the deep learning framework to differentiate the distinctive types of lesions and nodules in breast acquired with ultrasound imaging. A biopsy-proven benchmarking dataset was built from 5151 patients cases containing a total of 7408 ultrasound breast images, representative of semi-automatically segmented lesions associated with masses. The dataset comprised 4254 benign and 3154 malignant lesions. The developed method includes histogram equalization, image cropping and margin augmentation. The GoogLeNet convolutionary neural network was trained to the database to differentiate benign and malignant tumors. The networks were trained on the data with augmentation and the data without augmentation. Both of them showed an area under the curve of over 0.9. The networks showed an accuracy of about 0.9 (90%), a sensitivity of 0.86 and a specificity of 0.96. Although target regions of interest (ROIs) were selected by radiologists, meaning that radiologists still have to point out the location of the ROI, the classification of malignant lesions showed promising results. If this method is used by radiologists in clinical situations it can classify malignant lesions in a short time and support the diagnosis of radiologists in discriminating malignant lesions. Therefore, the proposed method can work in tandem with human radiologists to improve performance, which is a fundamental purpose of computer-aided diagnosis.
Collapse
Affiliation(s)
- Seokmin Han
- Korea National University of Transportation, Uiwang-si, Kyunggi-do, Republic of Korea
| | | | | | | | | | | | | |
Collapse
|
16
|
Wei G, Ma H, Qian W, Qiu M. Similarity measurement of lung masses for medical image retrieval using kernel based semisupervised distance metric. Med Phys 2017; 43:6259. [PMID: 27908158 DOI: 10.1118/1.4966030] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
PURPOSE To develop a new algorithm to measure the similarity between the query lung mass and reference lung mass data set for content-based medical image retrieval (CBMIR). METHODS A lung mass data set including 746 mass regions of interest (ROIs) was assembled. Among them, 375 ROIs depicted malignant lesions and 371 depicted benign lesions. Each mass ROI is represented by a vector of 26 texture features. A kernel function was employed to map the original data in input space to a feature space. In this space, a semisupervised distance metric was learned, which used differential scatter discriminant criterion to represent the semantic relevance, and the regularization term to represent the visual similarity. The learned distance metric can measure the similarity of the query mass and reference mass data set. The clustering accuracy is used to configure the parameters. The retrieval accuracy and classification accuracy are used as the performance assessment index. RESULTS After configuring the parameters, a mean clustering accuracy of 0.87 can be achieved. For retrieval accuracy, our algorithm achieves better performance than other state-of-the-art retrieval algorithms when applying a leave-one-out validation method to the testing data set. For classification accuracy, the area under the ROC curve of our algorithm can be achieved as 0.941 ± 0.006. The running times of 346 query images with the proposed algorithm are 5.399 and 6.0 s, respectively. CONCLUSIONS The study results demonstrated the proposed algorithm outperforms the compared algorithms, when taking the semantic relevant and visual similarity into account in kernel space. The algorithm can be used in a CBMIR system for a query mass to retrieve similarity masses, which can help doctors make better decisions.
Collapse
Affiliation(s)
- Guohui Wei
- Sino-Dutch Biomedical and Information Engineering School, Northeastern University, Shenyang 110819, China
| | - He Ma
- Sino-Dutch Biomedical and Information Engineering School, Northeastern University, Shenyang 110819, China and Key Laboratory of Medical Image Computing, Ministry of Education, Northeastern University, Shenyang 110819, China
| | - Wei Qian
- Sino-Dutch Biomedical and Information Engineering School, Northeastern University, Shenyang 110819, China and College of Engineering, University of Texas at El Paso, El Paso, Texas 79968
| | - Min Qiu
- Affiliated Hospital of Jining Medical University, Jining 272029, China
| |
Collapse
|
17
|
van Ginneken B. Fifty years of computer analysis in chest imaging: rule-based, machine learning, deep learning. Radiol Phys Technol 2017; 10:23-32. [PMID: 28211015 PMCID: PMC5337239 DOI: 10.1007/s12194-017-0394-5] [Citation(s) in RCA: 71] [Impact Index Per Article: 10.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2017] [Accepted: 02/08/2017] [Indexed: 02/06/2023]
Abstract
Half a century ago, the term "computer-aided diagnosis" (CAD) was introduced in the scientific literature. Pulmonary imaging, with chest radiography and computed tomography, has always been one of the focus areas in this field. In this study, I describe how machine learning became the dominant technology for tackling CAD in the lungs, generally producing better results than do classical rule-based approaches, and how the field is now rapidly changing: in the last few years, we have seen how even better results can be obtained with deep learning. The key differences among rule-based processing, machine learning, and deep learning are summarized and illustrated for various applications of CAD in the chest.
Collapse
Affiliation(s)
- Bram van Ginneken
- Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen, The Netherlands.
| |
Collapse
|
18
|
Ma L, Liu X, Fei B. Learning with distribution of optimized features for recognizing common CT imaging signs of lung diseases. Phys Med Biol 2016; 62:612-632. [PMID: 28033116 DOI: 10.1088/1361-6560/62/2/612] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/01/2023]
Abstract
Common CT imaging signs of lung diseases (CISLs) are defined as the imaging signs that frequently appear in lung CT images from patients. CISLs play important roles in the diagnosis of lung diseases. This paper proposes a novel learning method, namely learning with distribution of optimized feature (DOF), to effectively recognize the characteristics of CISLs. We improve the classification performance by learning the optimized features under different distributions. Specifically, we adopt the minimum spanning tree algorithm to capture the relationship between features and discriminant ability of features for selecting the most important features. To overcome the problem of various distributions in one CISL, we propose a hierarchical learning method. First, we use an unsupervised learning method to cluster samples into groups based on their distribution. Second, in each group, we use a supervised learning method to train a model based on their categories of CISLs. Finally, we obtain multiple classification decisions from multiple trained models and use majority voting to achieve the final decision. The proposed approach has been implemented on a set of 511 samples captured from human lung CT images and achieves a classification accuracy of 91.96%. The proposed DOF method is effective and can provide a useful tool for computer-aided diagnosis of lung diseases on CT images.
Collapse
Affiliation(s)
- Ling Ma
- Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, GA, USA. School of Computer Science, Beijing Institute of Technology, Beijing, People's Republic of China
| | | | | |
Collapse
|
19
|
Christodoulidis S, Anthimopoulos M, Ebner L, Christe A, Mougiakakou S. Multisource Transfer Learning With Convolutional Neural Networks for Lung Pattern Analysis. IEEE J Biomed Health Inform 2016; 21:76-84. [PMID: 28114048 DOI: 10.1109/jbhi.2016.2636929] [Citation(s) in RCA: 169] [Impact Index Per Article: 21.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Early diagnosis of interstitial lung diseases is crucial for their treatment, but even experienced physicians find it difficult, as their clinical manifestations are similar. In order to assist with the diagnosis, computer-aided diagnosis systems have been developed. These commonly rely on a fixed scale classifier that scans CT images, recognizes textural lung patterns, and generates a map of pathologies. In a previous study, we proposed a method for classifying lung tissue patterns using a deep convolutional neural network (CNN), with an architecture designed for the specific problem. In this study, we present an improved method for training the proposed network by transferring knowledge from the similar domain of general texture classification. Six publicly available texture databases are used to pretrain networks with the proposed architecture, which are then fine-tuned on the lung tissue data. The resulting CNNs are combined in an ensemble and their fused knowledge is compressed back to a network with the original architecture. The proposed approach resulted in an absolute increase of about 2% in the performance of the proposed CNN. The results demonstrate the potential of transfer learning in the field of medical image analysis, indicate the textural nature of the problem and show that the method used for training a network can be as important as designing its architecture.
Collapse
|
20
|
Anthimopoulos M, Christodoulidis S, Ebner L, Christe A, Mougiakakou S. Lung Pattern Classification for Interstitial Lung Diseases Using a Deep Convolutional Neural Network. IEEE TRANSACTIONS ON MEDICAL IMAGING 2016; 35:1207-1216. [PMID: 26955021 DOI: 10.1109/tmi.2016.2535865] [Citation(s) in RCA: 472] [Impact Index Per Article: 59.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/02/2023]
Abstract
Automated tissue characterization is one of the most crucial components of a computer aided diagnosis (CAD) system for interstitial lung diseases (ILDs). Although much research has been conducted in this field, the problem remains challenging. Deep learning techniques have recently achieved impressive results in a variety of computer vision problems, raising expectations that they might be applied in other domains, such as medical image analysis. In this paper, we propose and evaluate a convolutional neural network (CNN), designed for the classification of ILD patterns. The proposed network consists of 5 convolutional layers with 2 × 2 kernels and LeakyReLU activations, followed by average pooling with size equal to the size of the final feature maps and three dense layers. The last dense layer has 7 outputs, equivalent to the classes considered: healthy, ground glass opacity (GGO), micronodules, consolidation, reticulation, honeycombing and a combination of GGO/reticulation. To train and evaluate the CNN, we used a dataset of 14696 image patches, derived by 120 CT scans from different scanners and hospitals. To the best of our knowledge, this is the first deep CNN designed for the specific problem. A comparative analysis proved the effectiveness of the proposed CNN against previous methods in a challenging dataset. The classification performance ( ~ 85.5%) demonstrated the potential of CNNs in analyzing lung patterns. Future work includes, extending the CNN to three-dimensional data provided by CT volume scans and integrating the proposed method into a CAD system that aims to provide differential diagnosis for ILDs as a supportive tool for radiologists.
Collapse
|
21
|
Computer-Aided Diagnosis with Deep Learning Architecture: Applications to Breast Lesions in US Images and Pulmonary Nodules in CT Scans. Sci Rep 2016; 6:24454. [PMID: 27079888 PMCID: PMC4832199 DOI: 10.1038/srep24454] [Citation(s) in RCA: 294] [Impact Index Per Article: 36.8] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2015] [Accepted: 03/30/2016] [Indexed: 01/02/2023] Open
Abstract
This paper performs a comprehensive study on the deep-learning-based computer-aided diagnosis (CADx) for the differential diagnosis of benign and malignant nodules/lesions by avoiding the potential errors caused by inaccurate image processing results (e.g., boundary segmentation), as well as the classification bias resulting from a less robust feature set, as involved in most conventional CADx algorithms. Specifically, the stacked denoising auto-encoder (SDAE) is exploited on the two CADx applications for the differentiation of breast ultrasound lesions and lung CT nodules. The SDAE architecture is well equipped with the automatic feature exploration mechanism and noise tolerance advantage, and hence may be suitable to deal with the intrinsically noisy property of medical image data from various imaging modalities. To show the outperformance of SDAE-based CADx over the conventional scheme, two latest conventional CADx algorithms are implemented for comparison. 10 times of 10-fold cross-validations are conducted to illustrate the efficacy of the SDAE-based CADx algorithm. The experimental results show the significant performance boost by the SDAE-based CADx algorithm over the two conventional methods, suggesting that deep learning techniques can potentially change the design paradigm of the CADx systems without the need of explicit design and selection of problem-oriented features.
Collapse
|
22
|
Enhanced Classification of Interstitial Lung Disease Patterns in HRCT Images Using Differential Lacunarity. BIOMED RESEARCH INTERNATIONAL 2015; 2015:672520. [PMID: 26798638 PMCID: PMC4700165 DOI: 10.1155/2015/672520] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/11/2015] [Accepted: 11/18/2015] [Indexed: 11/17/2022]
Abstract
The analysis and interpretation of high-resolution computed tomography (HRCT) images of the chest in the presence of interstitial lung disease (ILD) is a time-consuming task which requires experience. In this paper, a computer-aided diagnosis (CAD) scheme is proposed to assist radiologists in the differentiation of lung patterns associated with ILD and healthy lung parenchyma. Regions of interest were described by a set of texture attributes extracted using differential lacunarity (DLac) and classical methods of statistical texture analysis. The proposed strategy to compute DLac allowed a multiscale texture analysis, while maintaining sensitivity to small details. Support Vector Machines were employed to distinguish between lung patterns. Training and model selection were performed over a stratified 10-fold cross-validation (CV). Dimensional reduction was made based on stepwise regression (F-test, p value < 0.01) during CV. An accuracy of 95.8 ± 2.2% in the differentiation of normal lung pattern from ILD patterns and an overall accuracy of 94.5 ± 2.1% in a multiclass scenario revealed the potential of the proposed CAD in clinical practice. Experimental results showed that the performance of the CAD was improved by combining multiscale DLac with classical statistical texture analysis.
Collapse
|
23
|
Anthimopoulos M, Christodoulidis S, Christe A, Mougiakakou S. Classification of interstitial lung disease patterns using local DCT features and random forest. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2015; 2014:6040-3. [PMID: 25571374 DOI: 10.1109/embc.2014.6945006] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Over the last decade, a plethora of computer-aided diagnosis (CAD) systems have been proposed aiming to improve the accuracy of the physicians in the diagnosis of interstitial lung diseases (ILD). In this study, we propose a scheme for the classification of HRCT image patches with ILD abnormalities as a basic component towards the quantification of the various ILD patterns in the lung. The feature extraction method relies on local spectral analysis using a DCT-based filter bank. After convolving the image with the filter bank, q-quantiles are computed for describing the distribution of local frequencies that characterize image texture. Then, the gray-level histogram values of the original image are added forming the final feature vector. The classification of the already described patches is done by a random forest (RF) classifier. The experimental results prove the superior performance and efficiency of the proposed approach compared against the state-of-the-art.
Collapse
|
24
|
Han F, Wang H, Zhang G, Han H, Song B, Li L, Moore W, Lu H, Zhao H, Liang Z. Texture feature analysis for computer-aided diagnosis on pulmonary nodules. J Digit Imaging 2015; 28:99-115. [PMID: 25117512 DOI: 10.1007/s10278-014-9718-8] [Citation(s) in RCA: 115] [Impact Index Per Article: 12.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022] Open
Abstract
Differentiation of malignant and benign pulmonary nodules is of paramount clinical importance. Texture features of pulmonary nodules in CT images reflect a powerful character of the malignancy in addition to the geometry-related measures. This study first compared three well-known types of two-dimensional (2D) texture features (Haralick, Gabor, and local binary patterns or local binary pattern features) on CADx of lung nodules using the largest public database founded by Lung Image Database Consortium and Image Database Resource Initiative and then investigated extension from 2D to three-dimensional (3D) space. Quantitative comparison measures were made by the well-established support vector machine (SVM) classifier, the area under the receiver operating characteristic curves (AUC) and the p values from hypothesis t tests. While the three feature types showed about 90% differentiation rate, the Haralick features achieved the highest AUC value of 92.70% at an adequate image slice thickness, where a thinner or thicker thickness will deteriorate the performance due to excessive image noise or loss of axial details. Gain was observed when calculating 2D features on all image slices as compared to the single largest slice. The 3D extension revealed potential gain when an optimal number of directions can be found. All the observations from this systematic investigation study on the three feature types can lead to the conclusions that the Haralick feature type is a better choice, the use of the full 3D data is beneficial, and an adequate tradeoff between image thickness and noise is desired for an optimal CADx performance. These conclusions provide a guideline for further research on lung nodule differentiation using CT imaging.
Collapse
Affiliation(s)
- Fangfang Han
- Department of Radiology, State University of New York, Stony Brook, NY, 11794, USA
| | | | | | | | | | | | | | | | | | | |
Collapse
|
25
|
Zulueta-Coarasa T, Kurugol S, Ross JC, Washko GG, San José Estépar R. Emphysema classification based on embedded probabilistic PCA. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2015; 2013:3969-72. [PMID: 24110601 DOI: 10.1109/embc.2013.6610414] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
In this article we investigate the suitability of a manifold learning technique to classify different types of emphysema based on embedded Probabilistic PCA (PPCA). Our approach finds the most discriminant linear space for each emphysema pattern against the remaining patterns where lung CT image patches can be embedded. In this embedded space, we train a PPCA model for each pattern. The main novelty of our technique is that it is possible to compute the class membership posterior probability for each emphysema pattern rather than a hard assignment as it is typically done by other approaches. We tested our algorithm with six emphysema patterns using a data set of 1337 CT training patches. Using a 10-fold cross validation experiment, an average recall rate of 69% is achieved when the posterior probability is greater than 75%. A quantitative comparison with a texture-based approach based on Local Binary Patterns and with an approach based on local intensity distributions shows that our method is competitive. The analysis of full lungs using our approach shows a good visual agreement with the underlying emphysema types and a smooth spatial relation.
Collapse
|
26
|
Kang D, Dey D, Slomka PJ, Arsanjani R, Nakazato R, Ko H, Berman DS, Li D, Kuo CCJ. Structured learning algorithm for detection of nonobstructive and obstructive coronary plaque lesions from computed tomography angiography. J Med Imaging (Bellingham) 2015; 2:014003. [PMID: 26158081 DOI: 10.1117/1.jmi.2.1.014003] [Citation(s) in RCA: 51] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2014] [Accepted: 02/11/2015] [Indexed: 12/28/2022] Open
Abstract
Visual identification of coronary arterial lesion from three-dimensional coronary computed tomography angiography (CTA) remains challenging. We aimed to develop a robust automated algorithm for computer detection of coronary artery lesions by machine learning techniques. A structured learning technique is proposed to detect all coronary arterial lesions with stenosis [Formula: see text]. Our algorithm consists of two stages: (1) two independent base decisions indicating the existence of lesions in each arterial segment and (b) the final decision made by combining the base decisions. One of the base decisions is the support vector machine (SVM) based learning algorithm, which divides each artery into small volume patches and integrates several quantitative geometric and shape features for arterial lesions in each small volume patch by SVM algorithm. The other base decision is the formula-based analytic method. The final decision in the first stage applies SVM-based decision fusion to combine the two base decisions in the second stage. The proposed algorithm was applied to 42 CTA patient datasets, acquired with dual-source CT, where 21 datasets had 45 lesions with stenosis [Formula: see text]. Visual identification of lesions with stenosis [Formula: see text] by three expert readers, using consensus reading, was considered as a reference standard. Our method performed with high sensitivity (93%), specificity (95%), and accuracy (94%), with receiver operator characteristic area under the curve of 0.94. The proposed algorithm shows promising results in the automated detection of obstructive and nonobstructive lesions from CTA.
Collapse
Affiliation(s)
- Dongwoo Kang
- University of Southern California , Department of Electrical Engineering, Los Angeles, California 90089, United States
| | - Damini Dey
- Cedars-Sinai Medical Center , Biomedical Imaging Research Institute, Department of Biomedical Sciences, Los Angeles, California 90048, United States
| | - Piotr J Slomka
- Cedars-Sinai Medical Center , Departments of Imaging and Medicine, and Cedars-Sinai Heart Institute, Los Angeles, California 90048, United States
| | - Reza Arsanjani
- Cedars-Sinai Medical Center , Departments of Imaging and Medicine, and Cedars-Sinai Heart Institute, Los Angeles, California 90048, United States
| | - Ryo Nakazato
- Cedars-Sinai Medical Center , Departments of Imaging and Medicine, and Cedars-Sinai Heart Institute, Los Angeles, California 90048, United States
| | - Hyunsuk Ko
- University of Southern California , Department of Electrical Engineering, Los Angeles, California 90089, United States
| | - Daniel S Berman
- Cedars-Sinai Medical Center , Departments of Imaging and Medicine, and Cedars-Sinai Heart Institute, Los Angeles, California 90048, United States
| | - Debiao Li
- Cedars-Sinai Medical Center , Biomedical Imaging Research Institute, Department of Biomedical Sciences, Los Angeles, California 90048, United States
| | - C-C Jay Kuo
- University of Southern California , Department of Electrical Engineering, Los Angeles, California 90089, United States
| |
Collapse
|
27
|
Liu X, Ma L, Song L, Zhao Y, Zhao X, Zhou C. Recognizing Common CT Imaging Signs of Lung Diseases Through a New Feature Selection Method Based on Fisher Criterion and Genetic Optimization. IEEE J Biomed Health Inform 2015; 19:635-47. [DOI: 10.1109/jbhi.2014.2327811] [Citation(s) in RCA: 33] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
28
|
A new classifier fusion method based on historical and on-line classification reliability for recognizing common CT imaging signs of lung diseases. Comput Med Imaging Graph 2015; 40:39-48. [DOI: 10.1016/j.compmedimag.2014.10.001] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2014] [Revised: 09/03/2014] [Accepted: 10/03/2014] [Indexed: 11/20/2022]
|
29
|
Yoon SH, Goo JM, Jung J, Hong H, Park EA, Lee CH, Lee Y, Jin KN, Choo JY, Lee NK. Computer-aided classification of visual ventilation patterns in patients with chronic obstructive pulmonary disease at two-phase xenon-enhanced CT. Korean J Radiol 2014; 15:386-96. [PMID: 24843245 PMCID: PMC4023059 DOI: 10.3348/kjr.2014.15.3.386] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2013] [Accepted: 01/24/2014] [Indexed: 11/15/2022] Open
Abstract
Objective To evaluate the technical feasibility, performance, and interobserver agreement of a computer-aided classification (CAC) system for regional ventilation at two-phase xenon-enhanced CT in patients with chronic obstructive pulmonary disease (COPD). Materials and Methods Thirty-eight patients with COPD underwent two-phase xenon ventilation CT with resulting wash-in (WI) and wash-out (WO) xenon images. The regional ventilation in structural abnormalities was visually categorized into four patterns by consensus of two experienced radiologists who compared the xenon attenuation of structural abnormalities with that of adjacent normal parenchyma in the WI and WO images, and it served as the reference. Two series of image datasets of structural abnormalities were randomly extracted for optimization and validation. The proportion of agreement on a per-lesion basis and receiver operating characteristics on a per-pixel basis between CAC and reference were analyzed for optimization. Thereafter, six readers independently categorized the regional ventilation in structural abnormalities in the validation set without and with a CAC map. Interobserver agreement was also compared between assessments without and with CAC maps using multirater κ statistics. Results Computer-aided classification maps were successfully generated in 31 patients (81.5%). The proportion of agreement and the average area under the curve of optimized CAC maps were 94% (75/80) and 0.994, respectively. Multirater κ value was improved from moderate (κ = 0.59; 95% confidence interval [CI], 0.56-0.62) at the initial assessment to excellent (κ = 0.82; 95% CI, 0.79-0.85) with the CAC map. Conclusion Our proposed CAC system demonstrated the potential for regional ventilation pattern analysis and enhanced interobserver agreement on visual classification of regional ventilation.
Collapse
Affiliation(s)
- Soon Ho Yoon
- Department of Radiology, Seoul National University College of Medicine, and Institute of Radiation Medicine, Seoul National University Medical Research Center, Seoul 110-744, Korea
| | - Jin Mo Goo
- Department of Radiology, Seoul National University College of Medicine, and Institute of Radiation Medicine, Seoul National University Medical Research Center, Seoul 110-744, Korea. ; Cancer Research Institute, Seoul National University College of Medicine, Seoul 110-744, Korea
| | - Julip Jung
- Department of Multimedia Engineering, Seoul Women's University, Seoul 139-774, Korea
| | - Helen Hong
- Department of Multimedia Engineering, Seoul Women's University, Seoul 139-774, Korea
| | - Eun Ah Park
- Department of Radiology, Seoul National University College of Medicine, and Institute of Radiation Medicine, Seoul National University Medical Research Center, Seoul 110-744, Korea
| | - Chang Hyun Lee
- Department of Radiology, Seoul National University College of Medicine, and Institute of Radiation Medicine, Seoul National University Medical Research Center, Seoul 110-744, Korea
| | - Youkyung Lee
- Department of Radiology, Seoul National University College of Medicine, and Institute of Radiation Medicine, Seoul National University Medical Research Center, Seoul 110-744, Korea. ; Department of Radiology, SMG-SNU Boramae Medical Center, Seoul 156-707, Korea
| | - Kwang Nam Jin
- Department of Radiology, Seoul National University College of Medicine, and Institute of Radiation Medicine, Seoul National University Medical Research Center, Seoul 110-744, Korea. ; Department of Radiology, SMG-SNU Boramae Medical Center, Seoul 156-707, Korea
| | - Ji Yung Choo
- Department of Radiology, Seoul National University College of Medicine, and Institute of Radiation Medicine, Seoul National University Medical Research Center, Seoul 110-744, Korea
| | - Nyoung Keun Lee
- Department of Radiology, Seoul National University College of Medicine, and Institute of Radiation Medicine, Seoul National University Medical Research Center, Seoul 110-744, Korea
| |
Collapse
|
30
|
Okumura E, Kawashita I, Ishida T. Development of CAD based on ANN analysis of power spectra for pneumoconiosis in chest radiographs: effect of three new enhancement methods. Radiol Phys Technol 2014; 7:217-27. [PMID: 24414539 PMCID: PMC4098051 DOI: 10.1007/s12194-013-0255-9] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2013] [Revised: 12/21/2013] [Accepted: 12/24/2013] [Indexed: 11/25/2022]
Abstract
We have been developing a computer-aided detection (CAD) scheme for pneumoconiosis based on a rule-based plus artificial neural network (ANN) analysis of power spectra. In this study, we have developed three enhancement methods for the abnormal patterns to reduce false-positive and false-negative values. The image database consisted of 2 normal and 15 abnormal chest radiographs. The International Labour Organization standard chest radiographs with pneumoconiosis were categorized as subcategory, size, and shape of pneumoconiosis. Regions of interest (ROIs) with a matrix size of 32 × 32 were selected from normal and abnormal lungs. Three new enhanced methods were obtained by window function, top-hat transformation, and gray-level co-occurrence matrix analysis. We calculated the power spectrum (PS) of all ROIs by Fourier transform. For the classification between normal and abnormal ROIs, we applied a combined analysis using the ruled-based plus the ANN method. To evaluate the overall performance of this CAD scheme, we employed ROC analysis for distinguishing between normal and abnormal ROIs. On the chest radiographs of the highest categories (severe pneumoconiosis) and the lowest categories (early pneumoconiosis), this CAD scheme achieved area under the curve (AUC) values of 0.93 ± 0.02 and 0.72 ± 0.03. The combined rule-based plus ANN method with the three new enhanced methods obtained the highest classification performance for distinguishing between abnormal and normal ROIs. Our CAD system based on the three new enhanced methods would be useful in assisting radiologists in the classification of pneumoconiosis.
Collapse
Affiliation(s)
- Eiichiro Okumura
- Department of Medical Radiological Technology, Kagoshima Medical Technology College, 5417-1, Hirakawa, Kagoshima, 891-0133, Japan,
| | | | | |
Collapse
|
31
|
Kang D, Slomka PJ, Nakazato R, Arsanjani R, Cheng VY, Min JK, Li D, Berman DS, Kuo CCJ, Dey D. Automated knowledge-based detection of nonobstructive and obstructive arterial lesions from coronary CT angiography. Med Phys 2013; 40:041912. [PMID: 23556906 DOI: 10.1118/1.4794480] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022] Open
Abstract
PURPOSE Visual analysis of three-dimensional (3D) coronary computed tomography angiography (CCTA) remains challenging due to large number of image slices and tortuous character of the vessels. The authors aimed to develop a robust, automated algorithm for unsupervised computer detection of coronary artery lesions. METHODS The authors' knowledge-based algorithm consists of centerline extraction, vessel classification, vessel linearization, lumen segmentation with scan-specific lumen attenuation ranges, and lesion location detection. Presence and location of lesions are identified using a multi-pass algorithm which considers expected or "normal" vessel tapering and luminal stenosis from the segmented vessel. Expected luminal diameter is derived from the scan by automated piecewise least squares line fitting over proximal and mid segments (67%) of the coronary artery considering the locations of the small branches attached to the main coronary arteries. RESULTS The authors applied this algorithm to 42 CCTA patient datasets, acquired with dual-source CT, where 21 datasets had 45 lesions with stenosis ≥ 25%. The reference standard was provided by visual and quantitative identification of lesions with any stenosis ≥ 25% by three expert readers using consensus reading. The authors algorithm identified 42 lesions (93%) confirmed by the expert readers. There were 46 additional lesions detected; 23 out of 39 (59%) of these were less-stenosed lesions. When the artery was divided into 15 coronary segments according to standard cardiology reporting guidelines, per-segment basis, sensitivity was 93% and per-segment specificity was 81% using 10-fold cross-validation. CONCLUSIONS The authors' algorithm shows promising results in the detection of both obstructive and nonobstructive CCTA lesions.
Collapse
Affiliation(s)
- Dongwoo Kang
- Department of Electrical Engineering, University of Southern California, Los Angeles, California 90089, USA
| | | | | | | | | | | | | | | | | | | |
Collapse
|
32
|
Automated texture-based quantification of centrilobular nodularity and centrilobular emphysema in chest CT images. Acad Radiol 2012; 19:1241-51. [PMID: 22958719 DOI: 10.1016/j.acra.2012.04.020] [Citation(s) in RCA: 35] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2012] [Revised: 03/20/2012] [Accepted: 04/23/2012] [Indexed: 11/23/2022]
Abstract
RATIONALE AND OBJECTIVES Characterization of smoking-related lung disease typically consists of visual assessment of chest computed tomographic (CT) images for the presence and extent of emphysema and centrilobular nodularity (CN). Quantitative analysis of emphysema and CN may improve the accuracy, reproducibility, and efficiency of chest CT scoring. The purpose of this study was to develop a fully automated texture-based system for the detection and quantification of centrilobular emphysema (CLE) and CN in chest CT images. MATERIALS AND METHODS A novel approach was used to prepare regions of interest (ROIs) within the lung parenchyma for representation by texture features associated with the gray-level run-length and gray-level gap-length methods. These texture features were used to train a multiple logistic regression classifier to discriminate between normal lung tissue, CN or "smoker's lung," and CLE. This classifier was trained and evaluated on 24 and 71 chest CT scans, respectively. RESULTS During training, the classifier correctly classified 89% of ROIs depicting normal lung tissue, 74% of ROIs depicting CN, and 95% of ROIs manifesting CLE. When the performance of the classifier in quantifying extent of CN and CLE was evaluated on 71 chest CT scans, 65% of ROIs in smokers without CLE were classified as CN, compared to 31% in nonsmokers (P < .001) and 28% in smokers with CLE (P < .001). CONCLUSIONS The texture-based framework described herein facilitates successful discrimination among normal lung tissue, CN, and CLE and can be used for the automated quantification of smoking-related lung disease.
Collapse
|
33
|
Caban JJ, Yao J, Mollura DJ. Enhancing image analytic tools by fusing quantitative physiological values with image features. J Digit Imaging 2012; 25:550-7. [PMID: 22246203 PMCID: PMC3389092 DOI: 10.1007/s10278-011-9449-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022] Open
Abstract
Computer-aided diagnosis systems (CADs) can quantify the severity of diseases by analyzing a set of images and employing prior statistical models. In general, CADs have proven to be effective at providing quantitative measurements of the extent of a particular disease, thus helping physicians to better monitor the progression of cancer, infectious diseases, and other health conditions. Electronic Health Records frequently include a large amount of clinical data and medical history that can provide critical information about the underlying condition of a patient. We hypothesize that the fusion of image and clinical-physiological features can be used to enhance the accuracy of automatic image classification models. In particular, this paper shows how image analytic tools can move beyond classical image interpretation models to broader systems where image and physiological measurements are fused and used to create more generic detection models. To test our hypothesis, a CAD system capable of quantifying the severity of patients with pulmonary fibrosis has been developed. Results show that CAD systems augmented with multimodal physiological values are more robust and accurate at determining the severity of the disease.
Collapse
Affiliation(s)
- Jesus J Caban
- National Intrepid Center of Excellence, Naval Medical Center, Building 51, 8901 Wisconsin Ave, Bethesda, MD 20889, USA.
| | | | | |
Collapse
|
34
|
Washko GR, Parraga G, Coxson HO. Quantitative pulmonary imaging using computed tomography and magnetic resonance imaging. Respirology 2012; 17:432-44. [PMID: 22142490 DOI: 10.1111/j.1440-1843.2011.02117.x] [Citation(s) in RCA: 42] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
Measurements of lung function, including spirometry and body plethesmography, are easy to perform and are the current clinical standard for assessing disease severity. However, these lung functional techniques do not adequately explain the observed variability in clinical manifestations of disease and offer little insight into the relationship of lung structure and function. Lung imaging and the image-based assessment of lung disease has matured to the extent that it is common for clinical, epidemiologic and genetic investigation to have a component dedicated to image analysis. There are several exciting imaging modalities currently being used for the non-invasive study of lung anatomy and function. In this review, we will focus on two of them; X-ray computed tomography and magnetic resonance imaging. Following a brief introduction of each method, we detail some of the most recent work being done to characterize smoking-related lung disease and the clinical applications of such knowledge.
Collapse
Affiliation(s)
- George R Washko
- Department of Medicine, Division of Pulmonary and Critical Care Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA
| | | | | |
Collapse
|
35
|
Abstract
Chronic obstructive pulmonary disease is a heterogeneous condition of the lungs and body. Techniques in chest imaging and quantitative image analysis provide novel in vivo insight into the disease and potentially examine divergent responses to therapy. This article reviews the strengths and limitations of the leading imaging techniques: computed tomography, magnetic resonance imaging, positron emission tomography, and optical coherence tomography. Following an explanation of the technique, each section details some of the useful information obtained with these examinations. Future clinical care and investigation will likely include some combination of these imaging modalities and more standard assessments of disease severity.
Collapse
Affiliation(s)
- George R Washko
- Division of Pulmonary and Critical Care Medicine, Department of Medicine, Brigham and Women's Hospital, Boston, MA 02115, USA.
| |
Collapse
|
36
|
Depeursinge A, Van de Ville D, Platon A, Geissbuhler A, Poletti PA, Müller H. Near-affine-invariant texture learning for lung tissue analysis using isotropic wavelet frames. ACTA ACUST UNITED AC 2012; 16:665-75. [PMID: 22588617 DOI: 10.1109/titb.2012.2198829] [Citation(s) in RCA: 66] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
We propose near-affine-invariant texture descriptors derived from isotropic wavelet frames for the characterization of lung tissue patterns in high-resolution computed tomography (HRCT) imaging. Affine invariance is desirable to enable learning of nondeterministic textures without a priori localizations, orientations, or sizes. When combined with complementary gray-level histograms, the proposed method allows a global classification accuracy of 76.9% with balanced precision among five classes of lung tissue using a leave-one-patient-out cross validation, in accordance with clinical practice.
Collapse
Affiliation(s)
- Adrien Depeursinge
- MedGIFT Group, Business Information Systems, University of Applied Sciences Western Switzerland, Sierre 3960, Switzerland.
| | | | | | | | | | | |
Collapse
|
37
|
Sørensen L, Nielsen M, Lo P, Ashraf H, Pedersen JH, de Bruijne M. Texture-based analysis of COPD: a data-driven approach. IEEE TRANSACTIONS ON MEDICAL IMAGING 2012; 31:70-78. [PMID: 21859615 DOI: 10.1109/tmi.2011.2164931] [Citation(s) in RCA: 41] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/31/2023]
Abstract
This study presents a fully automatic, data-driven approach for texture-based quantitative analysis of chronic obstructive pulmonary disease (COPD) in pulmonary computed tomography (CT) images. The approach uses supervised learning where the class labels are, in contrast to previous work, based on measured lung function instead of on manually annotated regions of interest (ROIs). A quantitative measure of COPD is obtained by fusing COPD probabilities computed in ROIs within the lung fields where the individual ROI probabilities are computed using a k nearest neighbor (kNN ) classifier. The distance between two ROIs in the kNN classifier is computed as the textural dissimilarity between the ROIs, where the ROI texture is described by histograms of filter responses from a multi-scale, rotation invariant Gaussian filter bank. The method was trained on 400 images from a lung cancer screening trial and subsequently applied to classify 200 independent images from the same screening trial. The texture-based measure was significantly better at discriminating between subjects with and without COPD than were the two most common quantitative measures of COPD in the literature, which are based on density. The proposed measure achieved an area under the receiver operating characteristic curve (AUC) of 0.713 whereas the best performing density measure achieved an AUC of 0.598. Further, the proposed measure is as reproducible as the density measures, and there were indications that it correlates better with lung function and is less influenced by inspiration level.
Collapse
Affiliation(s)
- Lauge Sørensen
- The Image Group, Department of Computer Science, University of Copenhagen, DK-2100 Copenhagen, Denmark.
| | | | | | | | | | | |
Collapse
|
38
|
Tan M, Deklerck R, Jansen B, Bister M, Cornelis J. A novel computer-aided lung nodule detection system for CT images. Med Phys 2011; 38:5630-45. [PMID: 21992380 DOI: 10.1118/1.3633941] [Citation(s) in RCA: 158] [Impact Index Per Article: 12.2] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
PURPOSE The paper presents a complete computer-aided detection (CAD) system for the detection of lung nodules in computed tomography images. A new mixed feature selection and classification methodology is applied for the first time on a difficult medical image analysis problem. METHODS The CAD system was trained and tested on images from the publicly available Lung Image Database Consortium (LIDC) on the National Cancer Institute website. The detection stage of the system consists of a nodule segmentation method based on nodule and vessel enhancement filters and a computed divergence feature to locate the centers of the nodule clusters. In the subsequent classification stage, invariant features, defined on a gauge coordinates system, are used to differentiate between real nodules and some forms of blood vessels that are easily generating false positive detections. The performance of the novel feature-selective classifier based on genetic algorithms and artificial neural networks (ANNs) is compared with that of two other established classifiers, namely, support vector machines (SVMs) and fixed-topology neural networks. A set of 235 randomly selected cases from the LIDC database was used to train the CAD system. The system has been tested on 125 independent cases from the LIDC database. RESULTS The overall performance of the fixed-topology ANN classifier slightly exceeds that of the other classifiers, provided the number of internal ANN nodes is chosen well. Making educated guesses about the number of internal ANN nodes is not needed in the new feature-selective classifier, and therefore this classifier remains interesting due to its flexibility and adaptability to the complexity of the classification problem to be solved. Our fixed-topology ANN classifier with 11 hidden nodes reaches a detection sensitivity of 87.5% with an average of four false positives per scan, for nodules with diameter greater than or equal to 3 mm. Analysis of the false positive items reveals that a considerable proportion (18%) of them are smaller nodules, less than 3 mm in diameter. CONCLUSIONS A complete CAD system incorporating novel features is presented, and its performance with three separate classifiers is compared and analyzed. The overall performance of our CAD system equipped with any of the three classifiers is well with respect to other methods described in literature.
Collapse
Affiliation(s)
- Maxine Tan
- Department of Electronics and Informatics , Vrije Universiteit Brussel, Brussel, Belgium
| | | | | | | | | |
Collapse
|
39
|
Bağcı U, Bray M, Caban J, Yao J, Mollura DJ. Computer-assisted detection of infectious lung diseases: a review. Comput Med Imaging Graph 2011; 36:72-84. [PMID: 21723090 DOI: 10.1016/j.compmedimag.2011.06.002] [Citation(s) in RCA: 41] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2011] [Revised: 05/11/2011] [Accepted: 06/01/2011] [Indexed: 02/05/2023]
Abstract
Respiratory tract infections are a leading cause of death and disability worldwide. Although radiology serves as a primary diagnostic method for assessing respiratory tract infections, visual analysis of chest radiographs and computed tomography (CT) scans is restricted by low specificity for causal infectious organisms and a limited capacity to assess severity and predict patient outcomes. These limitations suggest that computer-assisted detection (CAD) could make a valuable contribution to the management of respiratory tract infections by assisting in the early recognition of pulmonary parenchymal lesions, providing quantitative measures of disease severity and assessing the response to therapy. In this paper, we review the most common radiographic and CT features of respiratory tract infections, discuss the challenges of defining and measuring these disorders with CAD, and propose some strategies to address these challenges.
Collapse
Affiliation(s)
- Ulaş Bağcı
- Center for Infectious Disease Imaging, Department of Radiology and Imaging Sciences, National Institutes of Health (NIH), Bethesda, MD 20892, USA.
| | | | | | | | | |
Collapse
|
40
|
Case-based lung image categorization and retrieval for interstitial lung diseases: clinical workflows. Int J Comput Assist Radiol Surg 2011; 7:97-110. [PMID: 21629982 DOI: 10.1007/s11548-011-0618-9] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2011] [Accepted: 05/09/2011] [Indexed: 10/18/2022]
Abstract
PURPOSE Clinical workflows and user interfaces of image-based computer-aided diagnosis (CAD) for interstitial lung diseases in high-resolution computed tomography are introduced and discussed. METHODS Three use cases are implemented to assist students, radiologists, and physicians in the diagnosis workup of interstitial lung diseases. RESULTS In a first step, the proposed system shows a three-dimensional map of categorized lung tissue patterns with quantification of the diseases based on texture analysis of the lung parenchyma. Then, based on the proportions of abnormal and normal lung tissue as well as clinical data of the patients, retrieval of similar cases is enabled using a multimodal distance aggregating content-based image retrieval (CBIR) and text-based information search. The global system leads to a hybrid detection-CBIR-based CAD, where detection-based and CBIR-based CAD show to be complementary both on the user's side and on the algorithmic side. CONCLUSIONS The proposed approach is in accordance with the classical workflow of clinicians searching for similar cases in textbooks and personal collections. The developed system enables objective and customizable inter-case similarity assessment, and the performance measures obtained with a leave-one-patient-out cross-validation (LOPO CV) are representative of a clinical usage of the system.
Collapse
|
41
|
Huber MB, Nagarajan MB, Leinsinger G, Eibel R, Ray LA, Wismüller A. Performance of topological texture features to classify fibrotic interstitial lung disease patterns. Med Phys 2011; 38:2035-44. [DOI: 10.1118/1.3566070] [Citation(s) in RCA: 41] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
|
42
|
Korfiatis PD, Kalogeropoulou C, Karahaliou AN, Kazantzi AD, Costaridou LI. Vessel Tree Segmentation in Presence of Interstitial Lung Disease in MDCT. ACTA ACUST UNITED AC 2011; 15:214-20. [DOI: 10.1109/titb.2011.2112668] [Citation(s) in RCA: 40] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
43
|
Xu R, Hirano Y, Tachibana R, Kido S. Classification of diffuse lung disease patterns on high-resolution computed tomography by a bag of words approach. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2011; 14:183-90. [PMID: 22003698 DOI: 10.1007/978-3-642-23626-6_23] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
Abstract
Visual inspection of diffuse lung disease (DLD) patterns on high-resolution computed tomography (HRCT) is difficult because of their high complexity. We proposed a bag of words based method on the classification of these textural patters in order to improve the detection and diagnosis of DLD for radiologists. Six kinds of typical pulmonary patterns were considered in this work. They were consolidation, ground-glass opacity, honeycombing, emphysema, nodular and normal tissue. Because they were characterized by both CT values and shapes, we proposed a set of statistical measure based local features calculated from both CT values and the eigen-values of Hessian matrices. The proposed method could achieve the recognition rate of 95.85%, which was higher comparing with one global feature based method and two other CT values based bag of words methods.
Collapse
Affiliation(s)
- Rui Xu
- Applied Medical Engineering Science, Graduate School of Medicine, Yamaguchi University, Ube, Japan.
| | | | | | | |
Collapse
|
44
|
Depeursinge A, Foncubierta-Rodriguez A, Van de Ville D, Müller H. Lung Texture Classification Using Locally–Oriented Riesz Components. LECTURE NOTES IN COMPUTER SCIENCE 2011. [DOI: 10.1007/978-3-642-23626-6_29] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
|
45
|
Chen H, Xu Y, Ma Y, Ma B. Neural network ensemble-based computer-aided diagnosis for differentiation of lung nodules on CT images: clinical evaluation. Acad Radiol 2010; 17:595-602. [PMID: 20167513 DOI: 10.1016/j.acra.2009.12.009] [Citation(s) in RCA: 34] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2009] [Revised: 12/09/2009] [Accepted: 12/09/2009] [Indexed: 10/19/2022]
Abstract
RATIONALE AND OBJECTIVES To evaluate the diagnostic performance of a neural network ensemble-based computer-aided diagnosis (CAD) scheme for classifying lung nodules on thin-section computed tomography (CT). MATERIALS AND METHODS Thirty-two CT images that depicted 19 malignant nodules and 13 benign nodules were used. One of three possible classifications (probably benign, uncertain, and probably malignant) for each nodule was determined by using a neural network ensemble-based CAD scheme. The images were presented to three senior radiologists (each with more than 10 years of thoracic radiology experience) who were asked to determine the classification for each nodule blindly. The radiologists made their diagnostic decisions solely based on images and excluded any external data. The performance of the CAD scheme and of the radiologists was evaluated with receiver operating characteristic (ROC) analysis and agreement analysis. RESULTS Areas under the ROC curve (Az values) for the CAD scheme and the radiologist group were 0.79 and 0.82, respectively, and the partial areas under the ROC curves at a range of sensitivity values greater than or equal to 90% were 0.051 and 0.020 (P = .203), respectively. The weighted Kappa coefficients between the CAD scheme and each radiologist were 0.657, 0.431, and 0.606, respectively. For the diagnosis of the 11 small nodules (with diameters not greater than 10 mm), areas under the ROC curves of the CAD scheme and the radiologist group were 0.915 and 0.683 (P = .227), respectively. CONCLUSIONS The diagnostic performance of the neural network ensemble-based CAD scheme is similar to that of senior radiologists for classifying lung nodules on thin-section CT. Furthermore, the CAD scheme has certain advantages in diagnosing small lung nodules.
Collapse
|
46
|
Random forest based lung nodule classification aided by clustering. Comput Med Imaging Graph 2010; 34:535-42. [PMID: 20430583 DOI: 10.1016/j.compmedimag.2010.03.006] [Citation(s) in RCA: 52] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2009] [Revised: 11/20/2009] [Accepted: 03/23/2010] [Indexed: 01/15/2023]
Abstract
An automated lung nodule detection system can help spot lung abnormalities in CT lung images. Lung nodule detection can be achieved using template-based, segmentation-based, and classification-based methods. The existing systems that include a classification component in their structures have demonstrated better performances than their counterparts. Ensemble learners combine decisions of multiple classifiers to form an integrated output. To improve the performance of automated lung nodule detection, an ensemble classification aided by clustering (CAC) method is proposed. The method takes advantage of the random forest algorithm and offers a structure for a hybrid random forest based lung nodule classification aided by clustering. Several experiments are carried out involving the proposed method as well as two other existing methods. The parameters of the classifiers are varied to identify the best performing classifiers. The experiments are conducted using lung scans of 32 patients including 5721 images within which nodule locations are marked by expert radiologists. Overall, the best sensitivity of 98.33% and specificity of 97.11% have been recorded for proposed system. Also, a high receiver operating characteristic (ROC) A(z) of 0.9786 has been achieved.
Collapse
|
47
|
Sørensen L, Shaker SB, de Bruijne M. Quantitative analysis of pulmonary emphysema using local binary patterns. IEEE TRANSACTIONS ON MEDICAL IMAGING 2010; 29:559-569. [PMID: 20129855 DOI: 10.1109/tmi.2009.2038575] [Citation(s) in RCA: 131] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/28/2023]
Abstract
We aim at improving quantitative measures of emphysema in computed tomography (CT) images of the lungs. Current standard measures, such as the relative area of emphysema (RA), rely on a single intensity threshold on individual pixels, thus ignoring any interrelations between pixels. Texture analysis allows for a much richer representation that also takes the local structure around pixels into account. This paper presents a texture classification-based system for emphysema quantification in CT images. Measures of emphysema severity are obtained by fusing pixel posterior probabilities output by a classifier. Local binary patterns (LBP) are used as texture features, and joint LBP and intensity histograms are used for characterizing regions of interest (ROIs). Classification is then performed using a k nearest neighbor classifier with a histogram dissimilarity measure as distance. A 95.2% classification accuracy was achieved on a set of 168 manually annotated ROIs, comprising the three classes: normal tissue, centrilobular emphysema, and paraseptal emphysema. The measured emphysema severity was in good agreement with a pulmonary function test (PFT) achieving correlation coefficients of up to |r| = 0.79 in 39 subjects. The results were compared to RA and to a Gaussian filter bank, and the texture-based measures correlated significantly better with PFT than did RA.
Collapse
Affiliation(s)
- Lauge Sørensen
- Image Group, Department of Computer Science, University of Copenhagen, DK-2110 Copenhagen, Denmark.
| | | | | |
Collapse
|
48
|
Arzhaeva Y, Prokop M, Murphy K, van Rikxoort EM, de Jong PA, Gietema HA, Viergever MA, van Ginneken B. Automated estimation of progression of interstitial lung disease in CT images. Med Phys 2009; 37:63-73. [DOI: 10.1118/1.3264662] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
|
49
|
Korfiatis PD, Karahaliou AN, Kazantzi AD, Kalogeropoulou C, Costaridou LI. Texture-based identification and characterization of interstitial pneumonia patterns in lung multidetector CT. ACTA ACUST UNITED AC 2009; 14:675-80. [PMID: 19906596 DOI: 10.1109/titb.2009.2036166] [Citation(s) in RCA: 60] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Identification and characterization of diffuse parenchyma lung disease (DPLD) patterns challenges computer-aided schemes in computed tomography (CT) lung analysis. In this study, an automated scheme for volumetric quantification of interstitial pneumonia (IP) patterns, a subset of DPLD, is presented, utilizing a multidetector CT (MDCT) dataset. Initially, lung-field segmentation is achieved by 3-D automated gray-level thresholding combined with an edge-highlighting wavelet preprocessing step, followed by a texture-based border refinement step. The vessel tree volume is identified and removed from lung field, resulting in lung parenchyma (LP) volume. Following, identification and characterization of IP patterns is formulated as a three-class pattern classification of LP into normal, ground glass, and reticular patterns, by means of k-nearest neighbor voxel classification, exploiting 3-D cooccurrence features. Performance of the proposed scheme in indentifying and characterizing ground glass and reticular patterns was evaluated by means of volume overlap (ground glass: 0.734 +/- 0.057, reticular: 0.815 +/- 0.037), true-positive fraction (ground glass: 0.638 +/- 0.055, reticular: 0.942 +/- 0.023) and false-positive fraction (ground glass: 0.361 +/- 0.027, reticular: 0.147 +/- 0.032) on five MDCT scans.
Collapse
Affiliation(s)
- Panayiotis D Korfiatis
- Department of Medical Physics, School of Medicine, University of Patras, Patras 26500, Grecce.
| | | | | | | | | |
Collapse
|
50
|
Wang J, Li F, Doi K, Li Q. Computerized detection of diffuse lung disease in MDCT: the usefulness of statistical texture features. Phys Med Biol 2009; 54:6881-99. [PMID: 19864701 DOI: 10.1088/0031-9155/54/22/009] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Accurate detection of diffuse lung disease is an important step for computerized diagnosis and quantification of this disease. It is also a difficult clinical task for radiologists. We developed a computerized scheme to assist radiologists in the detection of diffuse lung disease in multi-detector computed tomography (CT). Two radiologists selected 31 normal and 37 abnormal CT scans with ground glass opacity, reticular, honeycombing and nodular disease patterns based on clinical reports. The abnormal cases in our database must contain at least an abnormal area with a severity of moderate or severe level that was subjectively rated by the radiologists. Because statistical texture features may lack the power to distinguish a nodular pattern from a normal pattern, the abnormal cases that contain only a nodular pattern were excluded. The areas that included specific abnormal patterns in the selected CT images were then delineated as reference standards by an expert chest radiologist. The lungs were first segmented in each slice by use of a thresholding technique, and then divided into contiguous volumes of interest (VOIs) with a 64 x 64 x 64 matrix size. For each VOI, we determined and employed statistical texture features, such as run-length and co-occurrence matrix features, to distinguish abnormal from normal lung parenchyma. In particular, we developed new run-length texture features with clear physical meanings to considerably improve the accuracy of our detection scheme. A quadratic classifier was employed for distinguishing between normal and abnormal VOIs by the use of a leave-one-case-out validation scheme. A rule-based criterion was employed to further determine whether a case was normal or abnormal. We investigated the impact of new and conventional texture features, VOI size and the dimensionality for regions of interest on detecting diffuse lung disease. When we employed new texture features for 3D VOIs of 64 x 64 x 64 voxels, our system achieved the highest performance level: a sensitivity of 86% and a specificity of 90% for the detection of abnormal VOIs, and a sensitivity of 89% and a specificity of 90% for the detection of abnormal cases. Our computerized scheme would be useful for assisting radiologists in the diagnosis of diffuse lung disease.
Collapse
Affiliation(s)
- Jiahui Wang
- Department of Radiology, Duke University, 2424 Erwin Road, Suite 302, Durham, NC 27705, USA
| | | | | | | |
Collapse
|