1
|
Shape-Based Breast Lesion Classification Using Digital Tomosynthesis Images: The Role of Explainable Artificial Intelligence. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12126230] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
Computer-aided diagnosis (CAD) systems can help radiologists in numerous medical tasks including classification and staging of the various diseases. The 3D tomosynthesis imaging technique adds value to the CAD systems in diagnosis and classification of the breast lesions. Several convolutional neural network (CNN) architectures have been proposed to classify the lesion shapes to the respective classes using a similar imaging method. However, not only is the black box nature of these CNN models questionable in the healthcare domain, but so is the morphological-based cancer classification, concerning the clinicians. As a result, this study proposes both a mathematically and visually explainable deep-learning-driven multiclass shape-based classification framework for the tomosynthesis breast lesion images. In this study, authors exploit eight pretrained CNN architectures for the classification task on the previously extracted regions of interests images containing the lesions. Additionally, the study also unleashes the black box nature of the deep learning models using two well-known perceptive explainable artificial intelligence (XAI) algorithms including Grad-CAM and LIME. Moreover, two mathematical-structure-based interpretability techniques, i.e., t-SNE and UMAP, are employed to investigate the pretrained models’ behavior towards multiclass feature clustering. The experimental results of the classification task validate the applicability of the proposed framework by yielding the mean area under the curve of 98.2%. The explanability study validates the applicability of all employed methods, mainly emphasizing the pros and cons of both Grad-CAM and LIME methods that can provide useful insights towards explainable CAD systems.
Collapse
|
2
|
A Machine Learning and Radiomics Approach in Lung Cancer for Predicting Histological Subtype. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12125829] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
Lung cancer is one of the deadliest diseases worldwide. Computed Tomography (CT) images are a powerful tool for investigating the structure and texture of lung nodules. For a long time, trained radiologists have performed the grading and staging of cancer severity by relying on radiographic images. Recently, radiomics has been changing the traditional workflow for lung cancer staging by providing the technical and methodological means to analytically quantify lesions so that more accurate predictions could be performed while reducing the time required from each specialist to perform such tasks. In this work, we implemented a pipeline for identifying a radiomic signature composed of a reduced number of features to discriminate between adenocarcinomas and other cancer types. In addition, we also investigated the reproducibility of this radiomic study analysing the performances of the classification models on external validation data. In detail, we first considered two publicly available datasets, namely D1 and D2, composed of n = 262 and n = 89 samples, respectively. Ten significant features, according to univariate AUC evaluated on D1, were retained. Mann–Whitney U tests recognised three of these features to have a statistically different distribution, with a p-value < 0.05. Then, we collected n = 51 CT images from patients with lung nodules at the Azienda Ospedaliero—Universitaria “Policlinico Riuniti” in Foggia. Resident radiologists manually annotated the lung lesions in images to allow the subsequent analysis of the malignancy regions. We designed a pipeline for feature extraction from the Volumes of Interest in order to generate a third dataset, i.e., D3. Several experiments have been performed showing that the selected radiomic signature not only allowed the discrimination of lung adenocarcinoma from other cancer types independently from the input dataset used for training the models, but also allowed reaching good classification performances also on external validation data; in fact, the radiomic signature computed on D1 and evaluated on the local cohort allowed reaching an AUC of 0.70 (p<0.001) for the task of predicting the histological subtype.
Collapse
|
3
|
Pepe A, Trotta GF, Mohr-Ziak P, Gsaxner C, Wallner J, Bevilacqua V, Egger J. A Marker-Less Registration Approach for Mixed Reality-Aided Maxillofacial Surgery: a Pilot Evaluation. J Digit Imaging 2021; 32:1008-1018. [PMID: 31485953 DOI: 10.1007/s10278-019-00272-6] [Citation(s) in RCA: 35] [Impact Index Per Article: 11.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022] Open
Abstract
As of common routine in tumor resections, surgeons rely on local examinations of the removed tissues and on the swiftly made microscopy findings of the pathologist, which are based on intraoperatively taken tissue probes. This approach may imply an extended duration of the operation, increased effort for the medical staff, and longer occupancy of the operating room (OR). Mixed reality technologies, and particularly augmented reality, have already been applied in surgical scenarios with positive initial outcomes. Nonetheless, these methods have used manual or marker-based registration. In this work, we design an application for a marker-less registration of PET-CT information for a patient. The algorithm combines facial landmarks extracted from an RGB video stream, and the so-called Spatial-Mapping API provided by the HMD Microsoft HoloLens. The accuracy of the system is compared with a marker-based approach, and the opinions of field specialists have been collected during a demonstration. A survey based on the standard ISO-9241/110 has been designed for this purpose. The measurements show an average positioning error along the three axes of (x, y, z) = (3.3 ± 2.3, - 4.5 ± 2.9, - 9.3 ± 6.1) mm. Compared with the marker-based approach, this shows an increment of the positioning error of approx. 3 mm along two dimensions (x, y), which might be due to the absence of explicit markers. The application has been positively evaluated by the specialists; they have shown interest in continued further work and contributed to the development process with constructive criticism.
Collapse
Affiliation(s)
- Antonio Pepe
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Austria. .,Computer Algorithms for Medicine Laboratory, Graz, Austria.
| | - Gianpaolo Francesco Trotta
- Computer Algorithms for Medicine Laboratory, Graz, Austria.,Department of Mechanics, Mathematics and Management, Polytechnic University of Bari, Via Orabona, 4, Bari, Italy
| | - Peter Mohr-Ziak
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Austria.,VRVis-Zentrum für Virtual Reality und Visualisierung Forschungs-GmbH, Donau-City-Straße 11, 1220, Vienna, Austria
| | - Christina Gsaxner
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Austria.,Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Jürgen Wallner
- Computer Algorithms for Medicine Laboratory, Graz, Austria.,Department of Oral & Maxillofacial Surgery, Medical University of Graz, Auenbruggerplatz 5/1, 8036, Graz, Styria, Austria
| | - Vitoantonio Bevilacqua
- Department of Electrical and Information Engineering, Polytechnic University of Bari, Via Orabona, 4, Bari, Italy
| | - Jan Egger
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Austria.,Computer Algorithms for Medicine Laboratory, Graz, Austria.,Department of Oral & Maxillofacial Surgery, Medical University of Graz, Auenbruggerplatz 5/1, 8036, Graz, Styria, Austria
| |
Collapse
|
4
|
Asadzadeh S, Khosroshahi HT, Abedi B, Ghasemi Y, Meshgini S. Renal structural image processing techniques: a systematic review. Ren Fail 2019; 41:57-68. [PMID: 30747036 PMCID: PMC6374953 DOI: 10.1080/0886022x.2019.1572016] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Background and objective: Renal disease, such as nephritis and nephropathy, is very harmful to human health. Accordingly, how to achieve early diagnosis and enhance treatment for kidney disorders would be the important lesion. Nevertheless, the clues from the clinical data, such as biochemistry examination, serological examination, and radiological studies are quite indirect and limited. It is no doubt that pathological examination of kidney will supply the direct evidence. There is a requirement for greater understanding of image processing techniques for renal diagnosis to optimize treatment and patient care. Methods: This study aims to systematically review the literature on publications that has been used image processing methods on pathological microscopic image for renal diagnosis. Results: Nine included studies revealed image analysis techniques for the diagnosis of renal abnormalities on pathological microscopic image, renal image studies are clustered as follows: Glomeruli Segmentation and analysis of the Glomerular basement membrane (55/55%), Blood vessels and tubules classification and detection (22/22%) and The Grading of renal cell carcinomas (22/22%). Conclusions: A medical image analysis method should provide an auto-adaptive and no external-human action dependency. In addition, since medical systems should have special characteristics such as high accuracy and reliability then clinical validation is highly recommended. New high-quality studies based on Moore neighborhood contour tracking method for glomeruli segmentation and using powerful texture analysis techniques such as the local binary pattern are recommended.
Collapse
Affiliation(s)
- Shiva Asadzadeh
- a Department of Electrical and Computer Engineering , Tabriz University , Tabriz , Iran
| | | | - Behzad Abedi
- c Medical Bioengineering Department, School of Advanced Medical Sciences , Tabriz University of Medical Sciences , Tabriz , Iran
| | - Yaghoob Ghasemi
- d Department of Medical Biotechnology, Faculty of Advanced Medical Sciences , Tabriz University of Medical Sciences , Tabriz , Iran
| | - Saeed Meshgini
- e Department of Electrical Engineering , University of Tabriz , Tabriz , Iran
| |
Collapse
|
5
|
Bevilacqua V, Pietroleonardo N, Triggiani V, Brunetti A, Di Palma AM, Rossini M, Gesualdo L. An innovative neural network framework to classify blood vessels and tubules based on Haralick features evaluated in histological images of kidney biopsy. Neurocomputing 2017. [DOI: 10.1016/j.neucom.2016.09.091] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|