1
|
Veeramani N, Jayaraman P, Krishankumar R, Ravichandran KS, Gandomi AH. DDCNN-F: double decker convolutional neural network 'F' feature fusion as a medical image classification framework. Sci Rep 2024; 14:676. [PMID: 38182607 PMCID: PMC10770172 DOI: 10.1038/s41598-023-49721-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2023] [Accepted: 12/11/2023] [Indexed: 01/07/2024] Open
Abstract
Melanoma is a severe skin cancer that involves abnormal cell development. This study aims to provide a new feature fusion framework for melanoma classification that includes a novel 'F' Flag feature for early detection. This novel 'F' indicator efficiently distinguishes benign skin lesions from malignant ones known as melanoma. The article proposes an architecture that is built in a Double Decker Convolutional Neural Network called DDCNN future fusion. The network's deck one, known as a Convolutional Neural Network (CNN), finds difficult-to-classify hairy images using a confidence factor termed the intra-class variance score. These hirsute image samples are combined to form a Baseline Separated Channel (BSC). By eliminating hair and using data augmentation techniques, the BSC is ready for analysis. The network's second deck trains the pre-processed BSC and generates bottleneck features. The bottleneck features are merged with features generated from the ABCDE clinical bio indicators to promote classification accuracy. Different types of classifiers are fed to the resulting hybrid fused features with the novel 'F' Flag feature. The proposed system was trained using the ISIC 2019 and ISIC 2020 datasets to assess its performance. The empirical findings expose that the DDCNN feature fusion strategy for exposing malignant melanoma achieved a specificity of 98.4%, accuracy of 93.75%, precision of 98.56%, and Area Under Curve (AUC) value of 0.98. This study proposes a novel approach that can accurately identify and diagnose fatal skin cancer and outperform other state-of-the-art techniques, which is attributed to the DDCNN 'F' Feature fusion framework. Also, this research ascertained improvements in several classifiers when utilising the 'F' indicator, resulting in the highest specificity of + 7.34%.
Collapse
Affiliation(s)
- Nirmala Veeramani
- School of Computing, SASTRA Deemed to Be University, Thanjavur, India
| | | | - Raghunathan Krishankumar
- Information Technology Systems and Analytics Area, Indian Institute of Management Bodh Gaya, Bodh Gaya, Bihar, 824234, India
| | | | - Amir H Gandomi
- Faculty of Engineering and Information Technology, University of Technology Sydney, Ultimo, NSW, Australia.
- University Research and Innovation Center (EKIK), Obuda University, Buddapest, Hungary.
| |
Collapse
|
2
|
Bakasa W, Viriri S. VGG16 Feature Extractor with Extreme Gradient Boost Classifier for Pancreas Cancer Prediction. J Imaging 2023; 9:138. [PMID: 37504815 PMCID: PMC10381878 DOI: 10.3390/jimaging9070138] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Revised: 06/19/2023] [Accepted: 07/04/2023] [Indexed: 07/29/2023] Open
Abstract
The prognosis of patients with pancreatic ductal adenocarcinoma (PDAC) is greatly improved by an early and accurate diagnosis. Several studies have created automated methods to forecast PDAC development utilising various medical imaging modalities. These papers give a general overview of the classification, segmentation, or grading of many cancer types utilising conventional machine learning techniques and hand-engineered characteristics, including pancreatic cancer. This study uses cutting-edge deep learning techniques to identify PDAC utilising computerised tomography (CT) medical imaging modalities. This work suggests that the hybrid model VGG16-XGBoost (VGG16-backbone feature extractor and Extreme Gradient Boosting-classifier) for PDAC images. According to studies, the proposed hybrid model performs better, obtaining an accuracy of 0.97 and a weighted F1 score of 0.97 for the dataset under study. The experimental validation of the VGG16-XGBoost model uses the Cancer Imaging Archive (TCIA) public access dataset, which has pancreas CT images. The results of this study can be extremely helpful for PDAC diagnosis from computerised tomography (CT) pancreas images, categorising them into five different tumours (T), node (N), and metastases (M) (TNM) staging system class labels, which are T0, T1, T2, T3, and T4.
Collapse
Affiliation(s)
- Wilson Bakasa
- School of Mathematics, Statistics and Computer Science, University of KwaZulu-Natal, Durban 4041, South Africa
| | - Serestina Viriri
- School of Mathematics, Statistics and Computer Science, University of KwaZulu-Natal, Durban 4041, South Africa
| |
Collapse
|
3
|
Abstract
Early prediction of delayed healing for venous leg ulcers could improve management outcomes by enabling earlier initiation of adjuvant therapies. In this paper, we propose a framework for computerised prediction of healing for venous leg ulcers assessed in home settings using thermal images of the 0 week. Wound data of 56 older participants over 12 weeks were used for the study. Thermal images of the wounds were collected in their homes and labelled as healed or unhealed at the 12th week follow up. Textural information of the thermal images at week 0 was extracted. Thermal images of unhealed wounds had a higher variation of grey tones distribution. We demonstrated that the first three principal components of the textural features from one timepoint can be used as an input to a Bayesian neural network to discriminate between healed and unhealed wounds. Using the optimal Bayesian neural network, the classification results showed 78.57% sensitivity and 60.00% specificity. This non-contact method, incorporating machine learning, can provide a computerised prediction of this delay in the first assessment (week 0) in participants' homes compared to the current method that is able to do this in 3rd week and requires contact digital planimetry.
Collapse
|
4
|
Aldhyani THH, Verma A, Al-Adhaileh MH, Koundal D. Multi-Class Skin Lesion Classification Using a Lightweight Dynamic Kernel Deep-Learning-Based Convolutional Neural Network. Diagnostics (Basel) 2022; 12:diagnostics12092048. [PMID: 36140447 PMCID: PMC9497471 DOI: 10.3390/diagnostics12092048] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2022] [Revised: 08/20/2022] [Accepted: 08/22/2022] [Indexed: 11/16/2022] Open
Abstract
Skin is the primary protective layer of the internal organs of the body. Nowadays, due to increasing pollution and multiple other factors, various types of skin diseases are growing globally. With variable shapes and multiple types, the classification of skin lesions is a challenging task. Motivated by this spreading deformity in society, a lightweight and efficient model is proposed for the highly accurate classification of skin lesions. Dynamic-sized kernels are used in layers to obtain the best results, resulting in very few trainable parameters. Further, both ReLU and leakyReLU activation functions are purposefully used in the proposed model. The model accurately classified all of the classes of the HAM10000 dataset. The model achieved an overall accuracy of 97.85%, which is much better than multiple state-of-the-art heavy models. Further, our work is compared with some popular state-of-the-art and recent existing models.
Collapse
Affiliation(s)
- Theyazn H. H. Aldhyani
- Applied College in Abqaiq, King Faisal University, P.O. Box 400, Al-Ahsa 31982, Saudi Arabia
- Correspondence:
| | - Amit Verma
- School of Computer Science, University of Petroleum & Energy Studies, Dehradun 248007, India
| | - Mosleh Hmoud Al-Adhaileh
- Deanship of E-Learning and Distance Education, King Faisal University, P.O. Box 4000, Al-Ahsa 31982, Saudi Arabia
| | - Deepika Koundal
- School of Computer Science, University of Petroleum & Energy Studies, Dehradun 248007, India
| |
Collapse
|
5
|
MESSADI MAHAMMED, MAHMOUDI SA, BESSAID ABDELHAFID. ANALYSIS OF SPECIFIC PARAMETERS FOR SKIN TUMOR CLASSIFICATION. J MECH MED BIOL 2022. [DOI: 10.1142/s0219519422500178] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
During the last years, computer vision-based diagnosis systems have been widely used in several hospitals and dermatology clinics, aiming mostly at the early detection of malignant melanoma tumor, which is among the most frequent types of skin cancer, versus other types of nonmalignant cutaneous diseases. They grow in melanocytes, the cells responsible for pigmentation. This type of cancer is increasing rapidly and its related mortality rate is increasing more modestly, and inversely proportional to the tumor’s thickness. The mortality rate can be decreased by earlier detection of suspicious lesions and better prevention. In this work, we are interested in extracting all specific attributes which can be used for computer-aided diagnosis of melanoma. In the first step of the proposed work, we applied the Dull Razor [Lee T et al., Dullrazor: A software approach to hair removal from images, Cancer Control Research, British Columbia Cancer Agency, Vancouver, Canada, Vol. 21, No. 6, pp. 533–543, 1997] technique to images to reduce the influence of small structures, hairs, bubbles, light reflection. In the second step, a new fuzzy level set algorithm is proposed in order to facilitate the medical image segmentation task. It is able to directly evolve from the initial segmentation proposed that uses a spatial fuzzy clustering approach. The controlling parameters of the level set evolution are also estimated from the results of the fuzzy clustering step. This step is essential to characterize the shape of the lesion and also to locate the tumor to be analyzed. In this paper, we have also treated the necessity to extract all the specific attributes used to develop a characterization methodology that enables specialists to take the best possible diagnosis. For this purpose, our proposal relies largely on visual observation of the tumor while dealing with some characteristics as color, texture or form. The method used in this paper is called ABCD. It requires calculating four factors: Asymmetry ([Formula: see text], Border ([Formula: see text], Color ([Formula: see text], and Diversity ([Formula: see text]. Finally, these parameters are used to construct a classification module based on artificial neural network for the recognition of malignant melanoma.
Collapse
Affiliation(s)
- MAHAMMED MESSADI
- Biomedical Engineering Laboratory, Department of Electrical and Electronics, Technology Faculty, Abou Bekr Belkaid, Tlemcen University 13000, Laboratory of Biomedical Engineering, Faculty of Technology, University of Tlemcen 13000, Algeria
| | - SAïD MAHMOUDI
- Computer Science Department, Faculty of Engineering, rue de Houdain 9, Mons B-7000, Belgium
| | - ABDELHAFID BESSAID
- Biomedical Engineering Laboratory, Department of Electrical and Electronics, Technology Faculty, Abou Bekr Belkaid, Tlemcen University 13000, Laboratory of Biomedical Engineering, Faculty of Technology, University of Tlemcen 13000, Algeria
| |
Collapse
|
6
|
Assessing Robustness of Morphological Characteristics of Arbitrary Grayscale Images. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12042037] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/10/2022]
Abstract
In our previous work, we introduced an empirical model (EM) of arbitrary binary images and three morphological characteristics: disorder of layer structure (DStr), disorder of layer size (DSize), and pattern complexity (PCom). The basic concept of the EM is that forms of lines play no role as a morphological factor in any narrow area of an arbitrary binary image; instead, the basic factor is the type of line connectivity, i.e., isotropic/anisotropic connections. The goal of the present work is to justify the possibility of making the EM applicable for the processing of grayscale arbitrary images. One of the possible ways to reach this goal is to assess the influence of image binarization on the robustness of DStr and DSize. Images that exhibit high and low edge gradient are used for this experimental study. The robustness of DStr and DSize against the binarization procedure is described in absolute (deviation from average) and relative (Pearson’s coefficient correlation) terms. Images with low edge gradient are converted into binary contour maps by applying the watershed algorithm, and DStr and DSize are then calculated for these maps. The robustness of DStr and DSize were assessed against the image threshold for images with high edge gradient and against the grid size of contour maps and Gaussian blur smoothing for images with low edge gradient. Experiments with grayscale arbitrary patterns, such as the surface of Earth and Mars, tidal sand ripples, turbulent flow, a melanoma, and cloud images, are presented to illustrate the spectrum of problems that may be possible to solve by applying the EM. The majority of our experiments show a high level of robustness for DStr and DSize.
Collapse
|
7
|
Popescu D, El-Khatib M, El-Khatib H, Ichim L. New Trends in Melanoma Detection Using Neural Networks: A Systematic Review. SENSORS (BASEL, SWITZERLAND) 2022; 22:496. [PMID: 35062458 PMCID: PMC8778535 DOI: 10.3390/s22020496] [Citation(s) in RCA: 21] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/22/2021] [Revised: 12/28/2021] [Accepted: 01/05/2022] [Indexed: 12/29/2022]
Abstract
Due to its increasing incidence, skin cancer, and especially melanoma, is a serious health disease today. The high mortality rate associated with melanoma makes it necessary to detect the early stages to be treated urgently and properly. This is the reason why many researchers in this domain wanted to obtain accurate computer-aided diagnosis systems to assist in the early detection and diagnosis of such diseases. The paper presents a systematic review of recent advances in an area of increased interest for cancer prediction, with a focus on a comparative perspective of melanoma detection using artificial intelligence, especially neural network-based systems. Such structures can be considered intelligent support systems for dermatologists. Theoretical and applied contributions were investigated in the new development trends of multiple neural network architecture, based on decision fusion. The most representative articles covering the area of melanoma detection based on neural networks, published in journals and impact conferences, were investigated between 2015 and 2021, focusing on the interval 2018-2021 as new trends. Additionally presented are the main databases and trends in their use in teaching neural networks to detect melanomas. Finally, a research agenda was highlighted to advance the field towards the new trends.
Collapse
Affiliation(s)
- Dan Popescu
- Faculty of Automatic Control and Computers, University Politehnica of Bucharest, 060042 Bucharest, Romania; (M.E.-K.); (H.E.-K.); (L.I.)
| | | | | | | |
Collapse
|
8
|
Zhang Y, Gorriz JM, Dong Z. Deep Learning in Medical Image Analysis. J Imaging 2021; 7:74. [PMID: 34460524 PMCID: PMC8321330 DOI: 10.3390/jimaging7040074] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2021] [Accepted: 04/16/2021] [Indexed: 11/19/2022] Open
Abstract
Over recent years, deep learning (DL) has established itself as a powerful tool across a broad spectrum of domains in imaging-e [...].
Collapse
Affiliation(s)
- Yudong Zhang
- School of Informatics, University of Leicester, Leicester LE1 7RH, UK
| | - Juan Manuel Gorriz
- Department of Signal Theory, Telematics and Communications, University of Granada, 18071 Granada, Spain;
| | - Zhengchao Dong
- Molecular Imaging and Neuropathology Division, Columbia University and New York State Psychiatric Institute, New York, NY 10032, USA;
| |
Collapse
|
9
|
Srinivasu PN, SivaSai JG, Ijaz MF, Bhoi AK, Kim W, Kang JJ. Classification of Skin Disease Using Deep Learning Neural Networks with MobileNet V2 and LSTM. SENSORS (BASEL, SWITZERLAND) 2021; 21:2852. [PMID: 33919583 PMCID: PMC8074091 DOI: 10.3390/s21082852] [Citation(s) in RCA: 148] [Impact Index Per Article: 49.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/13/2021] [Revised: 04/08/2021] [Accepted: 04/16/2021] [Indexed: 12/18/2022]
Abstract
Deep learning models are efficient in learning the features that assist in understanding complex patterns precisely. This study proposed a computerized process of classifying skin disease through deep learning based MobileNet V2 and Long Short Term Memory (LSTM). The MobileNet V2 model proved to be efficient with a better accuracy that can work on lightweight computational devices. The proposed model is efficient in maintaining stateful information for precise predictions. A grey-level co-occurrence matrix is used for assessing the progress of diseased growth. The performance has been compared against other state-of-the-art models such as Fine-Tuned Neural Networks (FTNN), Convolutional Neural Network (CNN), Very Deep Convolutional Networks for Large-Scale Image Recognition developed by Visual Geometry Group (VGG), and convolutional neural network architecture that expanded with few changes. The HAM10000 dataset is used and the proposed method has outperformed other methods with more than 85% accuracy. Its robustness in recognizing the affected region much faster with almost 2× lesser computations than the conventional MobileNet model results in minimal computational efforts. Furthermore, a mobile application is designed for instant and proper action. It helps the patient and dermatologists identify the type of disease from the affected region's image at the initial stage of the skin disease. These findings suggest that the proposed system can help general practitioners efficiently and effectively diagnose skin conditions, thereby reducing further complications and morbidity.
Collapse
Affiliation(s)
- Parvathaneni Naga Srinivasu
- Department of Computer Science and Engineering, Gitam Institute of Technology, GITAM Deemed to be University, Rushikonda, Visakhapatnam 530045, India;
| | | | - Muhammad Fazal Ijaz
- Department of Intelligent Mechatronics Engineering, Sejong University, Seoul 05006, Korea;
| | - Akash Kumar Bhoi
- Department of Electrical and Electronics Engineering, Sikkim Manipal Institute of Technology, Sikkim Manipal University, Majitar 737136, India;
| | - Wonjoon Kim
- Division of Future Convergence (HCI Science Major), Dongduk Women’s University, Seoul 02748, Korea
| | - James Jin Kang
- School of Science, Edith Cowan University, Joondalup 6027, Australia
| |
Collapse
|
10
|
Alves AFF, Souza SA, Ruiz RL, Reis TA, Ximenes AMG, Hasimoto EN, Lima RPS, Miranda JRA, Pina DR. Combining machine learning and texture analysis to differentiate mediastinal lymph nodes in lung cancer patients. Phys Eng Sci Med 2021; 44:387-394. [PMID: 33730292 PMCID: PMC7967117 DOI: 10.1007/s13246-021-00988-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2020] [Accepted: 03/03/2021] [Indexed: 11/30/2022]
Abstract
Evaluate whether texture analysis associated with machine learning approaches could differentiate between malignant and benign lymph nodes. A total 18 patients with lung cancer were selected, with 39 lymph nodes, being 15 malignant and 24 benign. Retrospective computed tomography scans were utilized both with and without contrast medium. The great differential of this work was the use of 15 textures from mediastinal lymph nodes, with five different physicians as operators. First and second order statistical textures such as gray level run length and co-occurrence matrix were extracted and applied to three different machine learning classifiers. The best machine learning classifier demonstrated a variability of less than 5% among operators. The support vector machine (SVM) classifier presented 95% of the area under the ROC curve (AUC) and 89% of sensitivity for sequences without contrast medium. SVM classifier presented 93% of AUC and 86% of sensitivity for sequences with contrast medium. Texture analysis and machine learning may be helpful in the differentiation between malign and benign lymph nodes. This study can aid the physician in diagnosis and staging of lymph nodes and potentially reduce the number of invasive analysis to histopathological confirmation.
Collapse
Affiliation(s)
- Allan F F Alves
- Medical School, Sao Paulo State University Julio de Mesquita Filho, Botucatu, Brazil
| | - Sérgio A Souza
- Institute of Bioscience, Sao Paulo State University Julio de Mesquita Filho, Botucatu, Brazil
| | - Raul L Ruiz
- Medical School, Sao Paulo State University Julio de Mesquita Filho, Botucatu, Brazil
| | - Tarcísio A Reis
- Medical School, Sao Paulo State University Julio de Mesquita Filho, Botucatu, Brazil
| | - Agláia M G Ximenes
- Medical School, Sao Paulo State University Julio de Mesquita Filho, Botucatu, Brazil
| | - Erica N Hasimoto
- Medical School, Sao Paulo State University Julio de Mesquita Filho, Botucatu, Brazil
| | - Rodrigo P S Lima
- Medical School, Sao Paulo State University Julio de Mesquita Filho, Botucatu, Brazil
| | - José Ricardo A Miranda
- Institute of Bioscience, Sao Paulo State University Julio de Mesquita Filho, Botucatu, Brazil
| | - Diana R Pina
- Medical School, Sao Paulo State University Julio de Mesquita Filho, Botucatu, Brazil.
| |
Collapse
|