Varicose ulcer(C6) wound image tissue classification using multidimensional convolutional neural networks

Mobile Apps for Wound Assessment and Monitoring: Limitations, Advancements and Opportunities

With the proliferation of wound assessment apps across various app stores and the increasing integration of artificial intelligence (AI) in healthcare apps, there is a growing need for a comprehensive evaluation system. Current apps lack sufficient evidence-based reliability, prompting the necessity for a systematic assessment. The objectives of this study are to evaluate the wound assessment and monitoring apps, identify limitations, and outline opportunities for future app development. An electronic search across two major app stores (Google Play store, and Apple App Store) was conducted and the selected apps were rated by three independent raters. A total of 170 apps were discovered, and 10 were selected for review based on a set of inclusion and exclusion criteria. By modifying existing scales, an app rating scale for wound assessment apps is created and used to evaluate the selected ten apps. Our rating scale evaluates apps' functionality and software quality characteristics. Most apps in the app stores, according to our evaluation, do not meet the overall requirements for wound monitoring and assessment. All the apps that we reviewed are focused on practitioners and doctors. According to our evaluation, the app ImitoWound got the highest mean score of 4.24. But this app has 7 criteria among our 11 functionalities criteria. Finally, we have recommended future opportunities to leverage advanced techniques, particularly those involving artificial intelligence, to enhance the functionality and efficacy of wound assessment apps. This research serves as a valuable resource for future developers and researchers seeking to enhance the design of wound assessment-based applications, encompassing improvements in both software quality and functionality.

Region-Based Semi-Two-Stream Convolutional Neural Networks for Pressure Ulcer Recognition

Pressure ulcers are a common, painful, costly, and often preventable complication associated with prolonged immobility in bedridden patients. It is a significant health problem worldwide because it is frequently seen in inpatients and has high treatment costs. For the treatment to be effective and to ensure an international standardization for all patients, it is essential that the diagnosis of pressure ulcers is made in the early stages and correctly. Since invasive methods of obtaining information can be painful for patients, different methods are used to make a correct diagnosis. Image-based diagnosis method is one of them. By using images obtained from patients, it will be possible to obtain successful results by keeping patients away from such painful situations. At this stage, disposable wound rulers are used in clinical practice to measure the length, width, and depth of patients' wounds. The information obtained is then entered into tools such as the Braden Scale, the Norton Scale, and the Waterlow Scale to provide a formal assessment of risk for pressure ulcers. This paper presents a novel benchmark dataset containing pressure ulcer images and a semi-two-stream approach that uses the original images and the cropped wound areas together for diagnosing the stage of pressure ulcers. Various state-of-the-art convolutional neural network (CNN) architectures are evaluated on this dataset. Our experimental results (test accuracy of 93%, the precision of 93%, the recall of 92%, and the F1-score of 93%) show that the proposed semi-two-stream method improves recognition results compared to the base CNN architectures.

Integrated image and location analysis for wound classification: a deep learning approach

The global burden of acute and chronic wounds presents a compelling case for enhancing wound classification methods, a vital step in diagnosing and determining optimal treatments. Recognizing this need, we introduce an innovative multi-modal network based on a deep convolutional neural network for categorizing wounds into four categories: diabetic, pressure, surgical, and venous ulcers. Our multi-modal network uses wound images and their corresponding body locations for more precise classification. A unique aspect of our methodology is incorporating a body map system that facilitates accurate wound location tagging, improving upon traditional wound image classification techniques. A distinctive feature of our approach is the integration of models such as VGG16, ResNet152, and EfficientNet within a novel architecture. This architecture includes elements like spatial and channel-wise Squeeze-and-Excitation modules, Axial Attention, and an Adaptive Gated Multi-Layer Perceptron, providing a robust foundation for classification. Our multi-modal network was trained and evaluated on two distinct datasets comprising relevant images and corresponding location information. Notably, our proposed network outperformed traditional methods, reaching an accuracy range of 74.79-100% for Region of Interest (ROI) without location classifications, 73.98-100% for ROI with location classifications, and 78.10-100% for whole image classifications. This marks a significant enhancement over previously reported performance metrics in the literature. Our results indicate the potential of our multi-modal network as an effective decision-support tool for wound image classification, paving the way for its application in various clinical contexts.

Computer Science meets Vascular Surgery: Keeping a pulse on artificial intelligence

Artificial intelligence (AI)-based technologies have garnered interest across a range of disciplines in the past several years, with an even more recent interest in various health care fields, including Vascular Surgery. AI offers a unique ability to analyze health data more quickly and efficiently than could be done by humans alone and can be used for clinical applications such as diagnosis, risk stratification, and follow-up, as well as patient-used applications to improve both patient and provider experiences, mitigate health care disparities, and individualize treatment. As with all novel technologies, AI is not without its risks and carries with it unique ethical considerations that will need to be addressed before its broad integration into health care systems. AI has the potential to revolutionize the way care is provided to patients, including those requiring vascular care.

Application of multiple deep learning models for automatic burn wound assessment

PURPOSE

Accurate assessment of the percentage of total body surface area (%TBSA) burned is crucial in managing burn injuries. It is difficult to estimate the size of an irregular shape by inspection. Many articles reported the discrepancy of estimating %TBSA burned by different doctors. We set up a system with multiple deep learning (DL) models for %TBSA estimation, as well as the segmentation of possibly poor-perfused deep burn regions from the entire wound.

METHODS

We proposed boundary-based labeling for datasets of total burn wound and palm, whereas region-based labeling for the dataset of deep burn wound. Several powerful DL models (U-Net, PSPNet, DeeplabV3+, Mask R-CNN) with encoders ResNet101 had been trained and tested from the above datasets. With the subject distances, the %TBSA burned could be calculated by the segmentation of total burn wound area with respect to the palm size. The percentage of deep burn area could be obtained from the segmentation of deep burn area from the entire wound.

RESULTS

A total of 4991 images of early burn wounds and 1050 images of palms were boundary-based labeled. 1565 out of 4994 images with deep burn were preprocessed with superpixel segmentation into small regions before labeling. DeeplabV3+ had slightly better performance in three tasks with precision: 0.90767, recall: 0.90065 for total burn wound segmentation; precision: 0.98987, recall: 0.99036 for palm segmentation; and precision: 0.90152, recall: 0.90219 for deep burn segmentation.

CONCLUSION

Combining the segmentation results and clinical data, %TBSA burned, the volume of fluid for resuscitation, and the percentage of deep burn area can be automatically diagnosed by DL models with a pixel-to-pixel method. Artificial intelligence provides consistent, accurate and rapid assessments of burn wounds.

Towards Home-Based Diabetic Foot Ulcer Monitoring: A Systematic Review

It is considered that 1 in 10 adults worldwide have diabetes. Diabetic foot ulcers are some of the most common complications of diabetes, and they are associated with a high risk of lower-limb amputation and, as a result, reduced life expectancy. Timely detection and periodic ulcer monitoring can considerably decrease amputation rates. Recent research has demonstrated that computer vision can be used to identify foot ulcers and perform non-contact telemetry by using ulcer and tissue area segmentation. However, the applications are limited to controlled lighting conditions, and expert knowledge is required for dataset annotation. This paper reviews the latest publications on the use of artificial intelligence for ulcer area detection and segmentation. The PRISMA methodology was used to search for and select articles, and the selected articles were reviewed to collect quantitative and qualitative data. Qualitative data were used to describe the methodologies used in individual studies, while quantitative data were used for generalization in terms of dataset preparation and feature extraction. Publicly available datasets were accounted for, and methods for preprocessing, augmentation, and feature extraction were evaluated. It was concluded that public datasets can be used to form a bigger, more diverse datasets, and the prospects of wider image preprocessing and the adoption of augmentation require further research.

Chronic Wound Image Augmentation and Assessment Using Semi-Supervised Progressive Multi-Granularity EfficientNet

Goal: Augment a small, imbalanced, wound dataset by using semi-supervised learning with a secondary dataset. Then utilize the augmented wound dataset for deep learning-based wound assessment. Methods: The clinically-validated Photographic Wound Assessment Tool (PWAT) scores eight wound attributes: Size, Depth, Necrotic Tissue Type, Necrotic Tissue Amount, Granulation Tissue type, Granulation Tissue Amount, Edges, Periulcer Skin Viability to comprehensively assess chronic wound images. A small corpus of 1639 wound images labeled with ground truth PWAT scores was used as reference. A Semi-Supervised learning and Progressive Multi-Granularity training mechanism were used to leverage a secondary corpus of 9870 unlabeled wound images. Wound scoring utilized the EfficientNet Convolutional Neural Network on the augmented wound corpus. Results: Our proposed Semi-Supervised PMG EfficientNet (SS-PMG-EfficientNet) approach estimated all 8 PWAT sub-scores with classification accuracies and F1 scores of about 90% on average, and outperformed a comprehensive list of baseline models and had a 7% improvement over the prior state-of-the-art (without data augmentation). We also demonstrate that synthetic wound image generation using Generative Adversarial Networks (GANs) did not improve wound assessment. Conclusions: Semi-supervised learning on unlabeled wound images in a secondary dataset achieved impressive performance for deep learning-based wound grading.

Image-Based Artificial Intelligence in Wound Assessment: A Systematic Review

Significance: Accurately predicting wound healing trajectories is difficult for wound care clinicians due to the complex and dynamic processes involved in wound healing. Wound care teams capture images of wounds during clinical visits generating big datasets over time. Developing novel artificial intelligence (AI) systems can help clinicians diagnose, assess the effectiveness of therapy, and predict healing outcomes. Recent Advances: Rapid developments in computer processing have enabled the development of AI-based systems that can improve the diagnosis and effectiveness of therapy in various clinical specializations. In the past decade, we have witnessed AI revolutionizing all types of medical imaging like X-ray, ultrasound, computed tomography, magnetic resonance imaging, etc., but AI-based systems remain to be developed clinically and computationally for high-quality wound care that can result in better patient outcomes. Critical Issues: In the current standard of care, collecting wound images on every clinical visit, interpreting and archiving the data are cumbersome and time consuming. Commercial platforms are developed to capture images, perform wound measurements, and provide clinicians with a workflow for diagnosis, but AI-based systems are still in their infancy. This systematic review summarizes the breadth and depth of the most recent and relevant work in intelligent image-based data analysis and system developments for wound assessment. Future Directions: With increasing availabilities of massive data (wound images, wound-specific electronic health records, etc.) as well as powerful computing resources, AI-based digital platforms will play a significant role in delivering data-driven care to people suffering from debilitating chronic wounds.

Deep learning approach based on superpixel segmentation assisted labeling for automatic pressure ulcer diagnosis

A pressure ulcer is an injury of the skin and underlying tissues adjacent to a bony eminence. Patients who suffer from this disease may have difficulty accessing medical care. Recently, the COVID-19 pandemic has exacerbated this situation. Automatic diagnosis based on machine learning (ML) brings promising solutions. Traditional ML requires complicated preprocessing steps for feature extraction. Its clinical applications are thus limited to particular datasets. Deep learning (DL), which extracts features from convolution layers, can embrace larger datasets that might be deliberately excluded in traditional algorithms. However, DL requires large sets of domain specific labeled data for training. Labeling various tissues of pressure ulcers is a challenge even for experienced plastic surgeons. We propose a superpixel-assisted, region-based method of labeling images for tissue classification. The boundary-based method is applied to create a dataset for wound and re-epithelialization (re-ep) segmentation. Five popular DL models (U-Net, DeeplabV3, PsPNet, FPN, and Mask R-CNN) with encoder (ResNet-101) were trained on the two datasets. A total of 2836 images of pressure ulcers were labeled for tissue classification, while 2893 images were labeled for wound and re-ep segmentation. All five models had satisfactory results. DeeplabV3 had the best performance on both tasks with a precision of 0.9915, recall of 0.9915 and accuracy of 0.9957 on the tissue classification; and a precision of 0.9888, recall of 0.9887 and accuracy of 0.9925 on the wound and re-ep segmentation task. Combining segmentation results with clinical data, our algorithm can detect the signs of wound healing, monitor the progress of healing, estimate the wound size, and suggest the need for surgical debridement.

Artificial Intelligence Evidence-Based Current Status and Potential for Lower Limb Vascular Management

Consultation prioritization is fundamental in optimal healthcare management and its performance can be helped by artificial intelligence (AI)-dedicated software and by digital medicine in general. The need for remote consultation has been demonstrated not only in the pandemic-induced lock-down but also in rurality conditions for which access to health centers is constantly limited. The term “AI” indicates the use of a computer to simulate human intellectual behavior with minimal human intervention. AI is based on a “machine learning” process or on an artificial neural network. AI provides accurate diagnostic algorithms and personalized treatments in many fields, including oncology, ophthalmology, traumatology, and dermatology. AI can help vascular specialists in diagnostics of peripheral artery disease, cerebrovascular disease, and deep vein thrombosis by analyzing contrast-enhanced magnetic resonance imaging or ultrasound data and in diagnostics of pulmonary embolism on multi-slice computed angiograms. Automatic methods based on AI may be applied to detect the presence and determine the clinical class of chronic venous disease. Nevertheless, data on using AI in this field are still scarce. In this narrative review, the authors discuss available data on AI implementation in arterial and venous disease diagnostics and care.

Comprehensive Assessment of Fine-Grained Wound Images Using a Patch-Based CNN With Context-Preserving Attention

Goal: Chronic wounds affect 6.5 million Americans. Wound assessment via algorithmic analysis of smartphone images has emerged as a viable option for remote assessment. Methods: We comprehensively score wounds based on the clinically-validated Photographic Wound Assessment Tool (PWAT), which comprehensively assesses clinically important ranges of eight wound attributes: Size, Depth, Necrotic Tissue Type, Necrotic Tissue Amount, Granulation Tissue type, Granulation Tissue Amount, Edges, Periulcer Skin Viability. We proposed a DenseNet Convolutional Neural Network (CNN) framework with patch-based context-preserving attention to assess the 8 PWAT attributes of four wound types: diabetic ulcers, pressure ulcers, vascular ulcers and surgical wounds. Results: In an evaluation on our dataset of 1639 wound images, our model estimated all 8 PWAT sub-scores with classification accuracies and F1 scores of over 80%. Conclusions: Our work is the first intelligent system that autonomously grades wounds comprehensively based on criteria in the PWAT rubric, alleviating the significant burden that manual wound grading imposes on wound care nurses.

Multiclass wound image classification using an ensemble deep CNN-based classifier

Acute and chronic wounds are a challenge to healthcare systems around the world and affect many people's lives annually. Wound classification is a key step in wound diagnosis that would help clinicians to identify an optimal treatment procedure. Hence, having a high-performance classifier assists wound specialists to classify wound types with less financial and time costs. Different wound classification methods based on machine learning and deep learning have been proposed in the literature. In this study, we have developed an ensemble Deep Convolutional Neural Network-based classifier to categorize wound images into multiple classes including surgical, diabetic, and venous ulcers. The output classification scores of two classifiers (namely, patch-wise and image-wise) are fed into a Multilayer Perceptron to provide a superior classification performance. A 5-fold cross-validation approach is used to evaluate the proposed method. We obtained maximum and average classification accuracy values of 96.4% and 94.28% for binary and 91.9% and 87.7% for 3-class classification problems. The proposed classifier was compared with some common deep classifiers and showed significantly higher accuracy metrics. We also tested the proposed method on the Medetec wound image dataset, and the accuracy values of 91.2% and 82.9% were obtained for binary and 3-class classifications. The results show that our proposed method can be used effectively as a decision support system in classification of wound images or other related clinical applications.

A Systematic Overview of Recent Methods for Non-Contact Chronic Wound Analysis

Chronic wounds or wounds that are not healing properly are a worldwide health problem that affect the global economy and population. Alongside with aging of the population, increasing obesity and diabetes patients, we can assume that costs of chronic wound healing will be even higher. Wound assessment should be fast and accurate in order to reduce the possible complications, and therefore shorten the wound healing process. Contact methods often used by medical experts have drawbacks that are easily overcome by non-contact methods like image analysis, where wound analysis is fully or partially automated. Two major tasks in wound analysis on images are segmentation of the wound from the healthy skin and background, and classification of the most important wound tissues like granulation, fibrin, and necrosis. These tasks are necessary for further assessment like wound measurement or healing evaluation based on tissue representation. Researchers use various methods and algorithms for image wound analysis with the aim to outperform accuracy rates and show the robustness of the proposed methods. Recently, neural networks and deep learning algorithms have driven considerable performance improvement across various fields, which has a led to a significant rise of research papers in the field of wound analysis as well. The aim of this paper is to provide an overview of recent methods for non-contact wound analysis which could be used for developing an end-to-end solution for a fully automated wound analysis system which would incorporate all stages from data acquisition, to segmentation and classification, ending with measurement and healing evaluation.