Automated segmentation of epidermis in high-frequency ultrasound of pathological skin using a cascade of DeepLab v3+ networks and fuzzy connectedness

Adaptive loss-guided multi-stage residual ASPP for lesion segmentation and disease detection in cucumber under complex backgrounds

BACKGROUND

In complex agricultural environments, the presence of shadows, leaf debris, and uneven illumination can hinder the performance of leaf segmentation models for cucumber disease detection. This is further exacerbated by the imbalance in pixel ratios between background and lesion areas, which affects the accuracy of lesion extraction.

RESULTS

An original image segmentation framework, the LS-ASPP model, which utilizes a two-stage Atrous Spatial Pyramid Pooling (ASPP) approach combined with adaptive loss to address these challenges has been proposed. The Leaf-ASPP stage employs attention modules and residual structures to capture multi-scale semantic information and enhance edge perception, allowing for precise extraction of leaf contours from complex backgrounds. In the Spot-ASPP stage, we adjust the dilation rate of ASPP and introduce a Convolutional Attention Block Module (CABM) to accurately segment lesion areas.

CONCLUSIONS

The LS-ASPP model demonstrates improved performance in semantic segmentation accuracy under complex conditions, providing a robust solution for precise cucumber lesion segmentation. By focusing on challenging pixels and adapting to the specific requirements of agricultural image analysis, our framework has the potential to enhance disease detection accuracy and facilitate timely and effective crop management decisions.

A review of psoriasis image analysis based on machine learning

Machine Learning (ML), an Artificial Intelligence (AI) technique that includes both Traditional Machine Learning (TML) and Deep Learning (DL), aims to teach machines to automatically learn tasks by inferring patterns from data. It holds significant promise in aiding medical care and has become increasingly important in improving professional processes, particularly in the diagnosis of psoriasis. This paper presents the findings of a systematic literature review focusing on the research and application of ML in psoriasis analysis over the past decade. We summarized 53 publications by searching the Web of Science, PubMed and IEEE Xplore databases and classified them into three categories: (i) lesion localization and segmentation; (ii) lesion recognition; (iii) lesion severity and area scoring. We have presented the most common models and datasets for psoriasis analysis, discussed the key challenges, and explored future trends in ML within this field. Our aim is to suggest directions for subsequent research.

Computer-Aided Diagnosis of Duchenne Muscular Dystrophy Based on Texture Pattern Recognition on Ultrasound Images Using Unsupervised Clustering Algorithms and Deep Learning

OBJECTIVE

The feasibility of using deep learning in ultrasound imaging to predict the ambulatory status of patients with Duchenne muscular dystrophy (DMD) was previously explored for the first time. The present study further used clustering algorithms for the texture reconstruction of ultrasound images of DMD data sets and analyzed the difference in echo intensity between disease stages.

METHODS

k-means (Kms) and fuzzy c-means (FCM) clustering algorithms were used to reconstruct the DMD data-set textures. Each image was reconstructed using seven texture-feature categories, six of which were used as the primary analysis items. The task of automatically identifying the ambulatory function and DMD severity was performed by establishing a machine-learning model.

RESULTS

The experimental results indicated that the Gaussian Naïve Bayes and k-nearest neighbors classification models achieved an accuracy of 86.78% in ambulatory function classification. The decision-tree model achieved an identification accuracy of 83.80% in severity classification. A deep convolutional neural network model was established as the main structure of the deep-learning model while automatic auxiliary interpretation tasks of ambulatory function and severity were performed, and data augmentation was used to improve the recognition performance of the trained model. Both the visual geometry group (VGG)-16 and VGG-19 models achieved 98.53% accuracy in ambulatory-function classification. The VGG-19 model achieved 92.64% accuracy in severity classification.

CONCLUSION

Regarding the overall results, the Kms and FCM clustering algorithms were used in this study to reconstruct the characteristic texture of the gastrocnemius muscle group in DMD, which was indeed helpful in quantitatively analyzing the deterioration of the gastrocnemius muscle group in patients with DMD at different stages. Subsequent combination of machine-learning and deep-learning technologies can automatically and accurately assist in identifying DMD symptoms and tracking DMD deterioration for long-term observation.

Multiple organ segmentation framework for brain metastasis radiotherapy

Radiotherapy is a preferred treatment for brain metastases, which kills cancer cells via high doses of radiation meanwhile hardly avoiding damage to surrounding healthy cells. Therefore, the delineation of organs-at-risk (OARs) is vital in treatment planning to minimize radiation-induced toxicity. However, the following aspects make OAR delineation a challenging task: extremely imbalanced organ sizes, ambiguous boundaries, and complex anatomical structures. To alleviate these challenges, we imitate how specialized clinicians delineate OARs and present a novel cascaded multi-OAR segmentation framework, called OAR-SegNet. OAR-SegNet comprises two distinct levels of segmentation networks: an Anatomical-Prior-Guided network (APG-Net) and a Point-Cloud-Guided network (PCG-Net). Specifically, APG-Net handles segmentation for all organs, where multi-view segmentation modules and a deep prior loss are designed under the guidance of prior knowledge. After APG-Net, PCG-Net refines small organs through the mini-segmentation and the point-cloud alignment heads. The mini-segmentation head is further equipped with the deep prior feature. Extensive experiments were conducted to demonstrate the superior performance of the proposed method compared to other state-of-the-art medical segmentation methods.

Artificial Intelligence: A Snapshot of Its Application in Chronic Inflammatory and Autoimmune Skin Diseases

Immuno-correlated dermatological pathologies refer to skin disorders that are closely associated with immune system dysfunction or abnormal immune responses. Advancements in the field of artificial intelligence (AI) have shown promise in enhancing the diagnosis, management, and assessment of immuno-correlated dermatological pathologies. This intersection of dermatology and immunology plays a pivotal role in comprehending and addressing complex skin disorders with immune system involvement. The paper explores the knowledge known so far and the evolution and achievements of AI in diagnosis; discusses segmentation and the classification of medical images; and reviews existing challenges, in immunological-related skin diseases. From our review, the role of AI has emerged, especially in the analysis of images for both diagnostic and severity assessment purposes. Furthermore, the possibility of predicting patients' response to therapies is emerging, in order to create tailored therapies.

Correspondence-based Generative Bayesian Deep Learning for semi-supervised volumetric medical image segmentation

Automated medical image segmentation plays a crucial role in diverse clinical applications. The high annotation costs of fully-supervised medical segmentation methods have spurred a growing interest in semi-supervised methods. Existing semi-supervised medical segmentation methods train the teacher segmentation network using labeled data to establish pseudo labels for unlabeled data. The quality of these pseudo labels is constrained as these methods fail to effectively address the significant bias in the data distribution learned from the limited labeled data. To address these challenges, this paper introduces an innovative Correspondence-based Generative Bayesian Deep Learning (C-GBDL) model. Built upon the teacher-student architecture, we design a multi-scale semantic correspondence method to aid the teacher model in generating high-quality pseudo labels. Specifically, our teacher model, embedded with the multi-scale semantic correspondence, learns a better-generalized data distribution from input volumes by feature matching with the reference volumes. Additionally, a double uncertainty estimation schema is proposed to further rectify the noisy pseudo labels. The double uncertainty estimation takes the predictive entropy as the first uncertainty estimation and takes the structural similarity between the input volume and its corresponding reference volumes as the second uncertainty estimation. Four groups of comparative experiments conducted on two public medical datasets demonstrate the effectiveness and the superior performance of our proposed model. Our code is available on https://github.com/yumjoo/C-GBDL.

High-frequency ultrasound in anti-aging skin therapy monitoring

Over the last few decades, high-frequency ultrasound has found multiple applications in various diagnostic fields. The fast development of this imaging technique opens up new diagnostic paths in dermatology, allergology, cosmetology, and aesthetic medicine. In this paper, being the first in this area, we discuss the usability of HFUS in anti-aging skin therapy assessment. The fully automated algorithm combining high-quality image selection and entry echo layer segmentation steps followed by the dermal parameters estimation enables qualitative and quantitative evaluation of the effectiveness of anti-aging products. Considering the parameters of subcutaneous layers, the proposed framework provides a reliable tool for TCA-peel therapy assessment; however, it can be successfully applied to other skin-condition-related problems. In this randomized controlled clinical trial, forty-six postmenopausal women were randomly assigned to the experimental and control groups. Women were treated four times at one-week intervals and applied skin cream daily between visits. The three month follow-up study enables measurement of the long-term effect of the therapy. According to the results, the TCA-based therapy increased epidermal (entry echo layer) thickness, indicating that the thinning process has slowed down and the skin's condition has improved. An interesting outcome is the obtained growth in the intensity of the upper dermis in the experimental group, which might suggest a reduced photo-aging effect of TCA-peel and increased water content. The same conclusions connected with the anti-aging effect of TCA-peel can be drawn by observing the parameters describing the contribution of low and medium-intensity pixels in the upper dermis. The decreased share of low-intensity pixels and increased share of medium-intensity pixels in the upper dermis suggest a significant increase in local protein synthesis.

Invasion depth estimation of carcinoma cells using adaptive stain normalization to improve epidermis segmentation accuracy

Submucosal invasion depth is a significant prognostic factor when assessing lymph node metastasis and cancer itself to plan proper treatment for the patient. Conventionally, oncologists measure the invasion depth by hand which is a laborious, subjective, and time-consuming process. The manual pathological examination by measuring accurate carcinoma cell invasion with considerable inter-observer and intra-observer variations is still challenging. The increasing use of medical imaging and artificial intelligence reveals a significant role in clinical medicine and pathology. In this paper, we propose an approach to study invasive behavior and measure the invasion depth of carcinoma from stained histopathology images. Specifically, our model includes adaptive stain normalization, color decomposition, and morphological reconstruction with adaptive thresholding to separate the epithelium with blue ratio image. Our method splits the image into multiple non-overlapping meaningful segments and successfully finds the homogeneous segments to measure accurate invasion depth. The invasion depths are measured from the inner epithelium edge to outermost pixels of the deepest part of particles in image. We conduct our experiments on skin melanoma tissue samples as well as on organotypic invasion model utilizing myoma tissue and oral squamous cell carcinoma. The performance is experimentally compared to three closely related reference methods and our method provides a superior result in measuring invasion depth. This computational technique will be beneficial for the segmentation of epithelium and other particles for the development of novel computer-aided diagnostic tools in biobank applications.

Learning how to detect: A deep reinforcement learning method for whole-slide melanoma histopathology images

Cutaneous melanoma represents one of the most life-threatening malignancies. Histopathological image analysis serves as a vital tool for early melanoma detection. Deep neural network (DNN) models are frequently employed to aid pathologists in enhancing the efficiency and accuracy of diagnoses. However, due to the paucity of well-annotated, high-resolution, whole-slide histopathology image (WSI) datasets, WSIs are typically fragmented into numerous patches during the model training and testing stages. This process disregards the inherent interconnectedness among patches, potentially impeding the models' performance. Additionally, the presence of excess, non-contributing patches extends processing times and introduces substantial computational burdens. To mitigate these issues, we draw inspiration from the clinical decision-making processes of dermatopathologists to propose an innovative, weakly supervised deep reinforcement learning framework, titled Fast medical decision-making in melanoma histopathology images (FastMDP-RL). This framework expedites model inference by reducing the number of irrelevant patches identified within WSIs. FastMDP-RL integrates two DNN-based agents: the search agent (SeAgent) and the decision agent (DeAgent). The SeAgent initiates actions, steered by the image features observed in the current viewing field at various magnifications. Simultaneously, the DeAgent provides labeling probabilities for each patch. We utilize multi-instance learning (MIL) to construct a teacher-guided model (MILTG), serving a dual purpose: rewarding the SeAgent and guiding the DeAgent. Our evaluations were conducted using two melanoma datasets: the publicly accessible TCIA-CM dataset and the proprietary MELSC dataset. Our experimental findings affirm FastMDP-RL's ability to expedite inference and accurately predict WSIs, even in the absence of pixel-level annotations. Moreover, our research investigates the WSI-based interactive environment, encompassing the design of agents, state and reward functions, and feature extractors suitable for melanoma tissue images. This investigation offers valuable insights and references for researchers engaged in related studies. The code is available at: https://github.com/titizheng/FastMDP-RL.

Effective encoder-decoder neural network for segmentation of orbital tissue in computed tomography images of Graves' orbitopathy patients

PURPOSE

To propose a neural network (NN) that can effectively segment orbital tissue in computed tomography (CT) images of Graves' orbitopathy (GO) patients.

METHODS

We analyzed orbital CT scans from 701 GO patients diagnosed between 2010 and 2019 and devised an effective NN specializing in semantic orbital tissue segmentation in GO patients' CT images. After four conventional (Attention U-Net, DeepLab V3+, SegNet, and HarDNet-MSEG) and the proposed NN train the various manual orbital tissue segmentations, we calculated the Dice coefficient and Intersection over Union for comparison.

RESULTS

CT images of the eyeball, four rectus muscles, the optic nerve, and the lacrimal gland tissues from all 701 patients were analyzed in this study. In the axial image with the largest eyeball area, the proposed NN achieved the best performance, with Dice coefficients of 98.2% for the eyeball, 94.1% for the optic nerve, 93.0% for the medial rectus muscle, and 91.1% for the lateral rectus muscle. The proposed NN also gave the best performance for the coronal image. Our qualitative analysis demonstrated that the proposed NN outputs provided more sophisticated orbital tissue segmentations for GO patients than the conventional NNs.

CONCLUSION

We concluded that our proposed NN exhibited an improved CT image segmentation for GO patients over conventional NNs designed for semantic segmentation tasks.

Computer-Aided Diagnosis Methods for High-Frequency Ultrasound Data Analysis: A Review

Over the last few decades, computer-aided diagnosis systems have become a part of clinical practice. They have the potential to assist clinicians in daily diagnostic tasks. The image processing techniques are fast, repeatable, and robust, which helps physicians to detect, classify, segment, and measure various structures. The recent rapid development of computer methods for high-frequency ultrasound image analysis opens up new diagnostic paths in dermatology, allergology, cosmetology, and aesthetic medicine. This paper, being the first in this area, presents a research overview of high-frequency ultrasound image processing techniques, which have the potential to be a part of computer-aided diagnosis systems. The reviewed methods are categorized concerning the application, utilized ultrasound device, and image data-processing type. We present the bridge between diagnostic needs and already developed solutions and discuss their limitations and future directions in high-frequency ultrasound image analysis. A search was conducted of the technical literature from 2005 to September 2022, and in total, 31 studies describing image processing methods were reviewed. The quantitative and qualitative analysis included 39 algorithms, which were selected as the most effective in this field. They were completed by 20 medical papers and define the needs and opportunities for high-frequency ultrasound application and CAD development.

MVI-Mind: A Novel Deep-Learning Strategy Using Computed Tomography (CT)-Based Radiomics for End-to-End High Efficiency Prediction of Microvascular Invasion in Hepatocellular Carcinoma

Simple Summary

Microvascular invasion is an important indicator for reflecting the prognosis of hepatocellular carcinoma, but the traditional diagnosis requires a postoperative pathological examination. This study is the first to propose an end-to-end deep learning architecture for predicting microvascular invasion in hepatocellular carcinoma by collecting retrospective data. This method can achieve noninvasive, accurate and efficient preoperative prediction only through the patient’s radiomic data, which is very beneficial to doctors for clinical decision making in HCC patients.

Abstract

Microvascular invasion (MVI) in hepatocellular carcinoma (HCC) directly affects a patient’s prognosis. The development of preoperative noninvasive diagnostic methods is significant for guiding optimal treatment plans. In this study, we investigated 138 patients with HCC and presented a novel end-to-end deep learning strategy based on computed tomography (CT) radiomics (MVI-Mind), which integrates data preprocessing, automatic segmentation of lesions and other regions, automatic feature extraction, and MVI prediction. A lightweight transformer and a convolutional neural network (CNN) were proposed for the segmentation and prediction modules, respectively. To demonstrate the superiority of MVI-Mind, we compared the framework’s performance with that of current, mainstream segmentation, and classification models. The test results showed that MVI-Mind returned the best performance in both segmentation and prediction. The mean intersection over union (mIoU) of the segmentation module was 0.9006, and the area under the receiver operating characteristic curve (AUC) of the prediction module reached 0.9223. Additionally, it only took approximately 1 min to output a prediction for each patient, end-to-end using our computing device, which indicated that MVI-Mind could noninvasively, efficiently, and accurately predict the presence of MVI in HCC patients before surgery. This result will be helpful for doctors to make rational clinical decisions.

A Study on the Dynamic Effects and Ecological Stress of Eco-Environment in the Headwaters of the Yangtze River Based on Improved DeepLab V3+ Network

The headwaters of the Yangtze River are a complicated system composed of different eco-environment elements. The abnormal moisture and energy exchanges between the atmosphere and earth systems caused by global climate change are predicted to produce drastic changes in these eco-environment elements. In order to study the dynamic effect and ecological stress in the eco-environment, we adapted the Double Attention Mechanism (DAM) to improve the performance of the DeepLab V3+ network in large-scale semantic segmentation. We proposed Elements Fragmentation (EF) and Elements Information Content (EIC) to quantitatively analyze the spatial distribution characteristics and spatial relationships of eco-environment elements. In this paper, the following conclusions were drawn: (1) we established sample sets based on “Sentinel-2” remote sensing images using the interpretation signs of eco-environment elements; (2) the mAP, mIoU, and Kappa of the improved DeepLab V3+ method were 0.639, 0.778, and 0.825, respectively, which demonstrates a good ability to distinguish the eco-environment elements; (3) between 2015 and 2021, EF gradually increased from 0.2234 to 0.2394, and EIC increased from 23.80 to 25.32, which shows that the eco-environment is oriented to complex, heterogeneous, and discontinuous processes; (4) the headwaters of the Yangtze River are a community of life, and thus we should build a multifunctional ecological management system with which to implement well-organized and efficient scientific ecological rehabilitation projects.

High-Frequency Ultrasound Dataset for Deep Learning-Based Image Quality Assessment

This study aims at high-frequency ultrasound image quality assessment for computer-aided diagnosis of skin. In recent decades, high-frequency ultrasound imaging opened up new opportunities in dermatology, utilizing the most recent deep learning-based algorithms for automated image analysis. An individual dermatological examination contains either a single image, a couple of pictures, or an image series acquired during the probe movement. The estimated skin parameters might depend on the probe position, orientation, or acquisition setup. Consequently, the more images analyzed, the more precise the obtained measurements. Therefore, for the automated measurements, the best choice is to acquire the image series and then analyze its parameters statistically. However, besides the correctly received images, the resulting series contains plenty of non-informative data: Images with different artifacts, noise, or the images acquired for the time stamp when the ultrasound probe has no contact with the patient skin. All of them influence further analysis, leading to misclassification or incorrect image segmentation. Therefore, an automated image selection step is crucial. To meet this need, we collected and shared 17,425 high-frequency images of the facial skin from 516 measurements of 44 patients. Two experts annotated each image as correct or not. The proposed framework utilizes a deep convolutional neural network followed by a fuzzy reasoning system to assess the acquired data’s quality automatically. Different approaches to binary and multi-class image analysis, based on the VGG-16 model, were developed and compared. The best classification results reach 91.7% accuracy for the first, and 82.3% for the second analysis, respectively.