1
|
Hermosilla P, Soto R, Vega E, Suazo C, Ponce J. Skin Cancer Detection and Classification Using Neural Network Algorithms: A Systematic Review. Diagnostics (Basel) 2024; 14:454. [PMID: 38396492 PMCID: PMC10888121 DOI: 10.3390/diagnostics14040454] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2023] [Revised: 02/07/2024] [Accepted: 02/10/2024] [Indexed: 02/25/2024] Open
Abstract
In recent years, there has been growing interest in the use of computer-assisted technology for early detection of skin cancer through the analysis of dermatoscopic images. However, the accuracy illustrated behind the state-of-the-art approaches depends on several factors, such as the quality of the images and the interpretation of the results by medical experts. This systematic review aims to critically assess the efficacy and challenges of this research field in order to explain the usability and limitations and highlight potential future lines of work for the scientific and clinical community. In this study, the analysis was carried out over 45 contemporary studies extracted from databases such as Web of Science and Scopus. Several computer vision techniques related to image and video processing for early skin cancer diagnosis were identified. In this context, the focus behind the process included the algorithms employed, result accuracy, and validation metrics. Thus, the results yielded significant advancements in cancer detection using deep learning and machine learning algorithms. Lastly, this review establishes a foundation for future research, highlighting potential contributions and opportunities to improve the effectiveness of skin cancer detection through machine learning.
Collapse
Affiliation(s)
- Pamela Hermosilla
- Escuela de Ingeniería Informática, Pontificia Universidad Católica de Valparaíso, Avenida Brasil 2241, Valparaíso 2362807, Chile (E.V.); (C.S.); (J.P.)
| | | | | | | | | |
Collapse
|
2
|
Kavitha P, Ayyappan G, Jayagopal P, Mathivanan SK, Mallik S, Al-Rasheed A, Alqahtani MS, Soufiene BO. Detection for melanoma skin cancer through ACCF, BPPF, and CLF techniques with machine learning approach. BMC Bioinformatics 2023; 24:458. [PMID: 38053030 DOI: 10.1186/s12859-023-05584-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2023] [Accepted: 11/27/2023] [Indexed: 12/07/2023] Open
Abstract
Intense sun exposure is a major risk factor for the development of melanoma, an abnormal proliferation of skin cells. Yet, this more prevalent type of skin cancer can also develop in less-exposed areas, such as those that are shaded. Melanoma is the sixth most common type of skin cancer. In recent years, computer-based methods for imaging and analyzing biological systems have made considerable strides. This work investigates the use of advanced machine learning methods, specifically ensemble models with Auto Correlogram Methods, Binary Pyramid Pattern Filter, and Color Layout Filter, to enhance the detection accuracy of Melanoma skin cancer. These results suggest that the Color Layout Filter model of the Attribute Selection Classifier provides the best overall performance. Statistics for ROC, PRC, Kappa, F-Measure, and Matthews Correlation Coefficient were as follows: 90.96% accuracy, 0.91 precision, 0.91 recall, 0.95 ROC, 0.87 PRC, 0.87 Kappa, 0.91 F-Measure, and 0.82 Matthews Correlation Coefficient. In addition, its margins of error are the smallest. The research found that the Attribute Selection Classifier performed well when used in conjunction with the Color Layout Filter to improve image quality.
Collapse
Affiliation(s)
- P Kavitha
- Department of Artificial Intelligence and Data Science, Panimalar Engineering College, Chennai, India
| | - G Ayyappan
- Department of Information Technology, Prince Shri Venkateshwara Padmavathy Engineering College, Chennai, India
| | - Prabhu Jayagopal
- School of Computer Science Engineering and Information Systems, Vellore Institute of Technology, Vellore, Tamil Nadu, 632014, India
| | - Sandeep Kumar Mathivanan
- School of Computing Science and Engineering, Galgotias University, Greater Noida, Uttar Pradesh, 203201, India
| | - Saurav Mallik
- Department of Environmental Health, Harvard T H Chan School of Public Health, Boston, MA, 02115, USA
- Department of Pharmacology and Toxicology, The University of Arizona, Tucson, AZ, 85721, USA
| | - Amal Al-Rasheed
- Department of Information Systems, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, P.O. Box 84428, 11671, Riyadh, Saudi Arabia
| | - Mohammed S Alqahtani
- Radiological Sciences Department, College of Applied Medical Sciences, King Khalid University, 61421, Abha, Saudi Arabia
- BioImaging Unit, Space Research Centre, University of Leicester, Michael Atiyah Building, Leicester, LE1 7RH, UK
| | - Ben Othman Soufiene
- PRINCE Laboratory Research, ISITcom, Hammam Sousse, University of Sousse, Sousse, Tunisia.
| |
Collapse
|
3
|
Patel RH, Foltz EA, Witkowski A, Ludzik J. Analysis of Artificial Intelligence-Based Approaches Applied to Non-Invasive Imaging for Early Detection of Melanoma: A Systematic Review. Cancers (Basel) 2023; 15:4694. [PMID: 37835388 PMCID: PMC10571810 DOI: 10.3390/cancers15194694] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Revised: 09/05/2023] [Accepted: 09/19/2023] [Indexed: 10/15/2023] Open
Abstract
BACKGROUND Melanoma, the deadliest form of skin cancer, poses a significant public health challenge worldwide. Early detection is crucial for improved patient outcomes. Non-invasive skin imaging techniques allow for improved diagnostic accuracy; however, their use is often limited due to the need for skilled practitioners trained to interpret images in a standardized fashion. Recent innovations in artificial intelligence (AI)-based techniques for skin lesion image interpretation show potential for the use of AI in the early detection of melanoma. OBJECTIVE The aim of this study was to evaluate the current state of AI-based techniques used in combination with non-invasive diagnostic imaging modalities including reflectance confocal microscopy (RCM), optical coherence tomography (OCT), and dermoscopy. We also aimed to determine whether the application of AI-based techniques can lead to improved diagnostic accuracy of melanoma. METHODS A systematic search was conducted via the Medline/PubMed, Cochrane, and Embase databases for eligible publications between 2018 and 2022. Screening methods adhered to the 2020 version of the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Included studies utilized AI-based algorithms for melanoma detection and directly addressed the review objectives. RESULTS We retrieved 40 papers amongst the three databases. All studies directly comparing the performance of AI-based techniques with dermatologists reported the superior or equivalent performance of AI-based techniques in improving the detection of melanoma. In studies directly comparing algorithm performance on dermoscopy images to dermatologists, AI-based algorithms achieved a higher ROC (>80%) in the detection of melanoma. In these comparative studies using dermoscopic images, the mean algorithm sensitivity was 83.01% and the mean algorithm specificity was 85.58%. Studies evaluating machine learning in conjunction with OCT boasted accuracy of 95%, while studies evaluating RCM reported a mean accuracy rate of 82.72%. CONCLUSIONS Our results demonstrate the robust potential of AI-based techniques to improve diagnostic accuracy and patient outcomes through the early identification of melanoma. Further studies are needed to assess the generalizability of these AI-based techniques across different populations and skin types, improve standardization in image processing, and further compare the performance of AI-based techniques with board-certified dermatologists to evaluate clinical applicability.
Collapse
Affiliation(s)
- Raj H. Patel
- Edward Via College of Osteopathic Medicine, VCOM-Louisiana, 4408 Bon Aire Dr, Monroe, LA 71203, USA
- Department of Dermatology, Oregon Health & Science University, Portland, OR 97239, USA (A.W.); (J.L.)
| | - Emilie A. Foltz
- Department of Dermatology, Oregon Health & Science University, Portland, OR 97239, USA (A.W.); (J.L.)
- Elson S. Floyd College of Medicine, Washington State University, Spokane, WA 99202, USA
| | - Alexander Witkowski
- Department of Dermatology, Oregon Health & Science University, Portland, OR 97239, USA (A.W.); (J.L.)
| | - Joanna Ludzik
- Department of Dermatology, Oregon Health & Science University, Portland, OR 97239, USA (A.W.); (J.L.)
| |
Collapse
|
4
|
Hussain M, Khan MA, Damaševičius R, Alasiry A, Marzougui M, Alhaisoni M, Masood A. SkinNet-INIO: Multiclass Skin Lesion Localization and Classification Using Fusion-Assisted Deep Neural Networks and Improved Nature-Inspired Optimization Algorithm. Diagnostics (Basel) 2023; 13:2869. [PMID: 37761236 PMCID: PMC10527569 DOI: 10.3390/diagnostics13182869] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2023] [Revised: 08/30/2023] [Accepted: 09/01/2023] [Indexed: 09/29/2023] Open
Abstract
Background: Using artificial intelligence (AI) with the concept of a deep learning-based automated computer-aided diagnosis (CAD) system has shown improved performance for skin lesion classification. Although deep convolutional neural networks (DCNNs) have significantly improved many image classification tasks, it is still difficult to accurately classify skin lesions because of a lack of training data, inter-class similarity, intra-class variation, and the inability to concentrate on semantically significant lesion parts. Innovations: To address these issues, we proposed an automated deep learning and best feature selection framework for multiclass skin lesion classification in dermoscopy images. The proposed framework performs a preprocessing step at the initial step for contrast enhancement using a new technique that is based on dark channel haze and top-bottom filtering. Three pre-trained deep learning models are fine-tuned in the next step and trained using the transfer learning concept. In the fine-tuning process, we added and removed a few additional layers to lessen the parameters and later selected the hyperparameters using a genetic algorithm (GA) instead of manual assignment. The purpose of hyperparameter selection using GA is to improve the learning performance. After that, the deeper layer is selected for each network and deep features are extracted. The extracted deep features are fused using a novel serial correlation-based approach. This technique reduces the feature vector length to the serial-based approach, but there is little redundant information. We proposed an improved anti-Lion optimization algorithm for the best feature selection to address this issue. The selected features are finally classified using machine learning algorithms. Main Results: The experimental process was conducted using two publicly available datasets, ISIC2018 and ISIC2019. Employing these datasets, we obtained an accuracy of 96.1 and 99.9%, respectively. Comparison was also conducted with state-of-the-art techniques and shows the proposed framework improved accuracy. Conclusions: The proposed framework successfully enhances the contrast of the cancer region. Moreover, the selection of hyperparameters using the automated techniques improved the learning process of the proposed framework. The proposed fusion and improved version of the selection process maintains the best accuracy and shorten the computational time.
Collapse
Affiliation(s)
| | - Muhammad Attique Khan
- Department of Computer Science and Mathematics, Lebanese American University, Beirut 13-5053, Lebanon
- Department of Computer Science, HITEC University, Taxila 47080, Pakistan
| | - Robertas Damaševičius
- Center of Excellence Forest 4.0, Faculty of Informatics, Kaunas University of Technology, 51368 Kaunas, Lithuania;
| | - Areej Alasiry
- College of Computer Science, King Khalid University, Abha 61413, Saudi Arabia; (A.A.); (M.M.)
| | - Mehrez Marzougui
- College of Computer Science, King Khalid University, Abha 61413, Saudi Arabia; (A.A.); (M.M.)
| | - Majed Alhaisoni
- Computer Sciences Department, College of Computer and Information Sciences, Princess Nourah Bint Abdulrahman University, Riyadh 11564, Saudi Arabia;
| | - Anum Masood
- Department of Circulation and Medical Imaging, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology (NTNU), 7034 Trondheim, Norway
| |
Collapse
|
5
|
Elshahawy M, Elnemr A, Oproescu M, Schiopu AG, Elgarayhi A, Elmogy MM, Sallah M. Early Melanoma Detection Based on a Hybrid YOLOv5 and ResNet Technique. Diagnostics (Basel) 2023; 13:2804. [PMID: 37685342 PMCID: PMC10486497 DOI: 10.3390/diagnostics13172804] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Revised: 08/11/2023] [Accepted: 08/22/2023] [Indexed: 09/10/2023] Open
Abstract
Skin cancer, specifically melanoma, is a serious health issue that arises from the melanocytes, the cells that produce melanin, the pigment responsible for skin color. With skin cancer on the rise, the timely identification of skin lesions is crucial for effective treatment. However, the similarity between some skin lesions can result in misclassification, which is a significant problem. It is important to note that benign skin lesions are more prevalent than malignant ones, which can lead to overly cautious algorithms and incorrect results. As a solution, researchers are developing computer-assisted diagnostic tools to detect malignant tumors early. First, a new model based on the combination of "you only look once" (YOLOv5) and "ResNet50" is proposed for melanoma detection with its degree using humans against a machine with 10,000 training images (HAM10000). Second, feature maps integrate gradient change, which allows rapid inference, boosts precision, and reduces the number of hyperparameters in the model, making it smaller. Finally, the current YOLOv5 model is changed to obtain the desired outcomes by adding new classes for dermatoscopic images of typical lesions with pigmented skin. The proposed approach improves melanoma detection with a real-time speed of 0.4 MS of non-maximum suppression (NMS) per image. The performance metrics average is 99.0%, 98.6%, 98.8%, 99.5, 98.3%, and 98.7% for the precision, recall, dice similarity coefficient (DSC), accuracy, mean average precision (MAP) from 0.0 to 0.5, and MAP from 0.5 to 0.95, respectively. Compared to current melanoma detection approaches, the provided approach is more efficient in using deep features.
Collapse
Affiliation(s)
- Manar Elshahawy
- Information Technology Department, Faculty of Computers and Information, Mansoura University, Mansoura 35516, Egypt;
| | - Ahmed Elnemr
- Applied Mathematical Physics Research Group, Physics Department, Faculty of Science, Mansoura University, Mansoura 35516, Egypt; (A.E.); (A.E.)
| | - Mihai Oproescu
- Faculty of Electronics, Communication, and Computer Science, University of Pitesti, 110040 Pitesti, Romania
| | - Adriana-Gabriela Schiopu
- Department of Manufacturing and Industrial Management, Faculty of Mechanics and Technology, University of Pitesti, 110040 Pitesti, Romania;
| | - Ahmed Elgarayhi
- Applied Mathematical Physics Research Group, Physics Department, Faculty of Science, Mansoura University, Mansoura 35516, Egypt; (A.E.); (A.E.)
| | - Mohammed M. Elmogy
- Information Technology Department, Faculty of Computers and Information, Mansoura University, Mansoura 35516, Egypt;
| | - Mohammed Sallah
- Department of Physics, College of Sciences, University of Bisha, P.O. Box 344, Bisha 61922, Saudi Arabia;
| |
Collapse
|
6
|
Riazi Esfahani P, Mazboudi P, Reddy AJ, Farasat VP, Guirgus ME, Tak N, Min M, Arakji GH, Patel R. Leveraging Machine Learning for Accurate Detection and Diagnosis of Melanoma and Nevi: An Interdisciplinary Study in Dermatology. Cureus 2023; 15:e44120. [PMID: 37750114 PMCID: PMC10518209 DOI: 10.7759/cureus.44120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/24/2023] [Indexed: 09/27/2023] Open
Abstract
This study explores the application of machine learning and deep learning algorithms to facilitate the accurate diagnosis of melanoma, a type of malignant skin cancer, and benign nevi. Leveraging a dataset of 793 dermatological images from the Kaggle online platform (Google LLC, Mountain View, California, United States), we developed a model that can accurately differentiate between these lesions based on their distinctive features. The dataset was divided into training (80%), validation (10%), and testing (10%) sets to optimize model performance and ensure its generalizability. Our findings demonstrate the potential of machine learning algorithms in enhancing the efficiency and accuracy of melanoma and nevi detection, with the developed model exhibiting robust performance metrics. Nonetheless, limitations exist due to the potential lack of comprehensive representation of melanoma and nevi cases in the dataset, and variations in image quality and acquisition methods, which may influence the model's performance in real-world clinical settings. Therefore, further research, validation studies, and integration into clinical practice are necessary to ensure the reliability and generalizability of these models. This study underscores the promise of artificial intelligence in advancing dermatologic diagnostics, aiming to improve patient outcomes by supporting early detection and treatment initiation for melanoma.
Collapse
Affiliation(s)
| | - Pasha Mazboudi
- Medicine, California University of Science and Medicine, Colton, USA
| | - Akshay J Reddy
- Medicine, California University of Science and Medicine, Colton, USA
| | | | - Monica E Guirgus
- Medicine, California University of Science and Medicine, Colton, USA
| | - Nathaniel Tak
- Medicine, Midwestern University Arizona College of Osteopathic Medicine, Glendale, USA
| | - Mildred Min
- Dermatology, California Northstate University College of Medicine, Elk Grove, USA
| | - Gordon H Arakji
- Health Sciences, California Northstate University, Rancho Cordova, USA
| | - Rakesh Patel
- Internal Medicine, East Tennessee State University Quillen College of Medicine, Johnson City, USA
| |
Collapse
|
7
|
Dandu R, Vinayaka Murthy M, Ravi Kumar Y. Transfer learning for segmentation with hybrid classification to Detect Melanoma Skin Cancer. Heliyon 2023; 9:e15416. [PMID: 37151638 PMCID: PMC10161578 DOI: 10.1016/j.heliyon.2023.e15416] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2022] [Revised: 04/06/2023] [Accepted: 04/06/2023] [Indexed: 05/09/2023] Open
Abstract
Melanoma is an abnormal proliferation of skin cells that arises and develops in most of the cases on surface of skin that is exposed to copious amounts of sunlight. This common type of cancer may develop in areas of the skin that are not exposed to a much abundant sunlight. The research addresses the problem of Segmentation and Classification of Melanoma Skin Cancer. Melanoma is the fifth most common skin cancer lesion. Bio-medical Imaging and Analysis has become more promising, interesting, and beneficial in recent years to address the eventual problems of Melanoma Skin Cancerous Tissues that may develop on Skin Surfaces. The evolved research finds that Attributes Selected for Classification with Color Layout Filter model. The research has produced an optimal result in terms of certain performance metrics accuracy, precision, recall, PRC (what is PRC? Expansion is needed in Abstract), The proposed method has yielded 90.96% of accuracy and 91% percent of precise and 0.91 of recall out of 1.0, 0.95 of ROC AUC, 0.87 of Kappa Statistic, 0.91 of F-Measure. It has been noticed a lowest error with reference to proposed method on certain dataset. Finally, this research recommends that the Attribute Selected Classifier by implementing one of the image enhancement techniques like Color Layout Filter is showing an efficient outcome.
Collapse
|
8
|
Sun J, Yao K, Huang G, Zhang C, Leach M, Huang K, Yang X. Machine Learning Methods in Skin Disease Recognition: A Systematic Review. Processes (Basel) 2023. [DOI: 10.3390/pr11041003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/29/2023] Open
Abstract
Skin lesions affect millions of people worldwide. They can be easily recognized based on their typically abnormal texture and color but are difficult to diagnose due to similar symptoms among certain types of lesions. The motivation for this study is to collate and analyze machine learning (ML) applications in skin lesion research, with the goal of encouraging the development of automated systems for skin disease diagnosis. To assist dermatologists in their clinical diagnosis, several skin image datasets have been developed and published online. Such efforts have motivated researchers and medical staff to develop automatic skin diagnosis systems using image segmentation and classification processes. This paper summarizes the fundamental steps in skin lesion diagnosis based on papers mainly published since 2013. The applications of ML methods (including traditional ML and deep learning (DL)) in skin disease recognition are reviewed based on their contributions, methods, and achieved results. Such technical analysis is beneficial to the continuing development of reliable and effective computer-aided skin disease diagnosis systems. We believe that more research efforts will lead to the current automatic skin diagnosis studies being used in real clinical settings in the near future.
Collapse
|
9
|
Skin Diseases Classification Using Hybrid AI Based Localization Approach. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:6138490. [PMID: 36072725 PMCID: PMC9444379 DOI: 10.1155/2022/6138490] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/12/2022] [Revised: 07/30/2022] [Accepted: 08/05/2022] [Indexed: 11/24/2022]
Abstract
One of the most prevalent diseases that can be initially identified by visual inspection and further identified with the use of dermoscopic examination and other testing is skin cancer. Since eye observation provides the earliest opportunity for artificial intelligence to intercept various skin images, some skin lesion classification algorithms based on deep learning and annotated skin photos display improved outcomes. The researcher used a variety of strategies and methods to identify and stop diseases earlier. All of them yield positive results for identifying and categorizing diseases, but proper disease categorization is still lacking. Computer-aided diagnosis is one of the most crucial methods for more accurate disease detection, although it is rarely used in dermatology. For Feature Extraction, we introduced Spectral Centroid Magnitude (SCM). The given dataset is classified using an enhanced convolutional neural network; the first stage of preprocessing uses a median filter, and the final stage compares the accuracy results to the current method.
Collapse
|
10
|
A Decision Support System for Melanoma Diagnosis from Dermoscopic Images. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12147007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Innovative technologies in dermatology allow for the early screening of skin cancer, which results in a reduction in the mortality rate and surgical treatments. The diagnosis of melanoma is complex not only because of the number of different lesions but because of the high similarity amongst skin lesions of different nature; hence, human vision and physician experience still play a major role. The adoption of automatic systems would aid clinical assessment and make the diagnosis reproducible by eliminating inter- and intra-observer variabilities. In our paper, we describe a computer-aided system for the early diagnosis of melanoma in dermoscopic images. A soft pre-processing phase is performed so as to avoid the loss of details both in texture, colors, and contours, and color-based image segmentation is later carried out using k-means. Features linked to both geometric properties and color characteristics are used to analyze skin lesions through a support vector machine classifier. The PH2 public database is used for the assessment of the procedure’s sensitivity, specificity, and accuracy. A statistical approach is carried out to establish the impact of image quality on performance. The obtained results show remarkable achievements, so our computer-aided approach should be suitable as a Decision Support System for melanoma detection.
Collapse
|
11
|
Diagnosing gastrointestinal diseases from endoscopy images through a multi-fused CNN with auxiliary layers, alpha dropouts, and a fusion residual block. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103683] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
12
|
Mohammed AAH, Chen J. Cleanup Sketched Drawings: Deep Learning-Based Model. Appl Bionics Biomech 2022; 2022:2238077. [PMID: 35578715 PMCID: PMC9107365 DOI: 10.1155/2022/2238077] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2022] [Revised: 03/07/2022] [Accepted: 03/30/2022] [Indexed: 11/22/2022] Open
Abstract
Rough drawings provide artists with a simple and efficient way to express shapes and ideas. Artists frequently use sketches to highlight their envisioned curves, using several groups' raw strokes. These rough sketches need enhancement to remove some subtle impurities and completely simplify curves over the sketched images. This research paper proposes using a fully convolutional network (FCNN) model to simplify rough raster drawings using deep learning. As input, the FCNN takes a sketch image of any size and automatically generates a high-quality simplified sketch image as output. Our model intuitively addresses the shortcomings in the rough sketch image, such as noises and unwanted background, as well as the low resolution of the rough sketch image. The FCNN model is trained by three raster image datasets, which are publicly available online. This paper demonstrates the efficiency and effectiveness of using deep learning in cleaning and improving the roughly drawn image in an automatic way. For evaluating the results, the mean squared error (MSE) metric was used. From experimental results, it was observed that an enhanced FCNN model reported better accuracy, reducing the prediction error by 0.08 percent for simplifying the rough sketch compared to the existing methods.
Collapse
Affiliation(s)
| | - Jiazhou Chen
- College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou, China
| |
Collapse
|
13
|
Ahmed ZAT, Aldhyani THH, Jadhav ME, Alzahrani MY, Alzahrani ME, Althobaiti MM, Alassery F, Alshaflut A, Alzahrani NM, Al-madani AM. Facial Features Detection System To Identify Children With Autism Spectrum Disorder: Deep Learning Models. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2022; 2022:3941049. [PMID: 35419082 PMCID: PMC9001065 DOI: 10.1155/2022/3941049] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/30/2021] [Revised: 12/27/2021] [Accepted: 12/29/2021] [Indexed: 12/04/2022]
Abstract
Autism spectrum disorder (ASD) is a neurodevelopmental disorder associated with brain development that subsequently affects the physical appearance of the face. Autistic children have different patterns of facial features, which set them distinctively apart from typically developed (TD) children. This study is aimed at helping families and psychiatrists diagnose autism using an easy technique, viz., a deep learning-based web application for detecting autism based on experimentally tested facial features using a convolutional neural network with transfer learning and a flask framework. MobileNet, Xception, and InceptionV3 were the pretrained models used for classification. The facial images were taken from a publicly available dataset on Kaggle, which consists of 3,014 facial images of a heterogeneous group of children, i.e., 1,507 autistic children and 1,507 nonautistic children. Given the accuracy of the classification results for the validation data, MobileNet reached 95% accuracy, Xception achieved 94%, and InceptionV3 attained 0.89%.
Collapse
Affiliation(s)
- Zeyad A. T. Ahmed
- Department of Computer Science, Dr. Babasaheb Ambedkar Marathwada University, India
| | - Theyazn H. H. Aldhyani
- Applied College in Abqaiq, King Faisal University, P.O. Box 400, Al-Ahsa 31982, Saudi Arabia
| | - Mukti E. Jadhav
- Shri Shivaji Science & Arts College, Chikhli Dist. Buldana, India
| | - Mohammed Y. Alzahrani
- Department of Computer Sciences and Information Technology, Albaha University, Albaha, P.O. Box 1988, Saudi Arabia
| | - Mohammad Eid Alzahrani
- Department of Engineering and Computer Science, Al Baha University, Albaha, P.O. Box 1988, Saudi Arabia
| | - Maha M. Althobaiti
- Department of Computer Science, College of Computing and Information technology, Taif University, P.O.Box 11099, Taif 21944, Saudi Arabia
| | - Fawaz Alassery
- Department of Computer Engineering, College of Computers and Information Technology, Taif University, P.O. Box 11099, Taif 21944, Saudi Arabia
| | - Ahmed Alshaflut
- College of Computer Science and Information Technology, Albaha University, Albaha, P.O. Box 1988, Saudi Arabia
| | - Nouf Matar Alzahrani
- College of Computer Science and Information Technology, Albaha University, Albaha, P.O. Box 1988, Saudi Arabia
| | | |
Collapse
|
14
|
Deep Learning and Machine Learning Techniques of Diagnosis Dermoscopy Images for Early Detection of Skin Diseases. ELECTRONICS 2021. [DOI: 10.3390/electronics10243158] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
With the increasing incidence of severe skin diseases, such as skin cancer, endoscopic medical imaging has become urgent for revealing the internal and hidden tissues under the skin. Diagnostic information to help doctors make an accurate diagnosis is provided by endoscopy devices. Nonetheless, most skin diseases have similar features, which make it challenging for dermatologists to diagnose patients accurately. Therefore, machine and deep learning techniques can have a critical role in diagnosing dermatoscopy images and in the accurate early detection of skin diseases. In this study, systems for the early detection of skin lesions were developed. The performance of the machine learning and deep learning was evaluated on two datasets (e.g., the International Skin Imaging Collaboration (ISIC 2018) and Pedro Hispano (PH2)). First, the proposed system was based on hybrid features that were extracted by three algorithms: local binary pattern (LBP), gray level co-occurrence matrix (GLCM), and wavelet transform (DWT). Such features were then integrated into a feature vector and classified using artificial neural network (ANN) and feedforward neural network (FFNN) classifiers. The FFNN and ANN classifiers achieved superior results compared to the other methods. Accuracy rates of 95.24% for diagnosing the ISIC 2018 dataset and 97.91% for diagnosing the PH2 dataset were achieved using the FFNN algorithm. Second, convolutional neural networks (CNNs) (e.g., ResNet-50 and AlexNet models) were applied to diagnose skin diseases using the transfer learning method. It was found that the ResNet-50 model fared better than AlexNet. Accuracy rates of 90% for diagnosing the ISIC 2018 dataset and 95.8% for the PH2 dataset were reached using the ResNet-50 model.
Collapse
|
15
|
Tang X, Yang Y, Huang L, Qiu L. The Application of Texture Feature Analysis of Rectus Femoris Based on Local Binary Pattern (LBP) Combined With Gray-Level Co-Occurrence Matrix (GLCM) in Sarcopenia. JOURNAL OF ULTRASOUND IN MEDICINE 2021; 41:2169-2179. [PMID: 34825723 DOI: 10.1002/jum.15896] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/28/2021] [Revised: 11/01/2021] [Accepted: 11/11/2021] [Indexed: 02/05/2023]
Abstract
OBJECTIVES In order to detect the changes in muscle texture of sarcopenia and to explore a new method of ultrasound assessment of muscle changes in sarcopenia. METHODS we used the local binary pattern (LBP) combined with gray-level co-occurrence matrix (GLCM) method to extract and quantitatively analyze the texture information of the rectus femoris of different people, and initially verified the robustness of this method to image gain changes. We recruited young volunteers, elderly volunteers without sarcopenia, and elderly volunteers with sarcopenia in this cross-sectional study. We scanned the rectus femoris and extracted their muscle texture features. RESULTS We found that when ultrasonographic gain varied from 40% to 70%, the intraclass correlation coefficient (ICC) of contrast, entropy, and homogeneity were 0.989, 0.973, and 0.989, respectively. Body mass index was significantly related to contrast (r = 0.285, P < .05), and age had a significant correlation with contrast and homogeneity (r = -0.259 and r = 0.269, P < .05). The elderly volunteers with sarcopenia had the highest entropy (0.363 [0.342-0.403]) and homogeneity (2.203 [2.162-2.277]) in the texture of the rectus femoris among the three groups, and at the same time had the lowest contrast (44.583 [43.492-47.399]), and all P < .05. CONCLUSION LBP combined with GLCM can be a stable method for extracting muscle texture features. At the same time, the contrast, entropy, and homogeneity of the rectus femoris of the elderly with sarcopenia were significantly different from those of the young volunteers and the elderly without sarcopenia, suggesting the texture features of rectus femoris are potential parameters for evaluating muscle function and pathological changes.
Collapse
Affiliation(s)
- Xinyi Tang
- Department of Medical Ultrasound, West China Hospital of Sichuan University, Chengdu, China
| | - Yujia Yang
- Department of Medical Ultrasound, West China Hospital of Sichuan University, Chengdu, China
| | - Li Huang
- National Clinical Research Center for Geriatrics, West China Hospital, Sichuan University, Chengdu, China
| | - Li Qiu
- Department of Medical Ultrasound, West China Hospital of Sichuan University, Chengdu, China
| |
Collapse
|
16
|
Role of Artificial Intelligence in the Early Diagnosis of Oral Cancer. A Scoping Review. Cancers (Basel) 2021; 13:cancers13184600. [PMID: 34572831 PMCID: PMC8467703 DOI: 10.3390/cancers13184600] [Citation(s) in RCA: 32] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2021] [Revised: 08/29/2021] [Accepted: 09/09/2021] [Indexed: 01/06/2023] Open
Abstract
The early diagnosis of cancer can facilitate subsequent clinical patient management. Artificial intelligence (AI) has been found to be promising for improving the diagnostic process. The aim of the present study is to increase the evidence on the application of AI to the early diagnosis of oral cancer through a scoping review. A search was performed in the PubMed, Web of Science, Embase and Google Scholar databases during the period from January 2000 to December 2020, referring to the early non-invasive diagnosis of oral cancer based on AI applied to screening. Only accessible full-text articles were considered. Thirty-six studies were included on the early detection of oral cancer based on images (photographs (optical imaging and enhancement technology) and cytology) with the application of AI models. These studies were characterized by their heterogeneous nature. Each publication involved a different algorithm with potential training data bias and few comparative data for AI interpretation. Artificial intelligence may play an important role in precisely predicting the development of oral cancer, though several methodological issues need to be addressed in parallel to the advances in AI techniques, in order to allow large-scale transfer of the latter to population-based detection protocols.
Collapse
|