CARes-UNet: Content-aware residual UNet for lesion segmentation of COVID-19 from chest CT images

Lesion segmentation using 3D scan and deep learning for the evaluation of facial portwine stain birthmarks

BACKGROUND

Portwine stain (PWS) birthmarks are congenital vascular malformations. The quantification of PWS area is an important step in lesion classification and treatment evaluation.

AIMS

The aim of this study was to evaluate the combination of 3D scan with deep learning for automated PWS area quantization.

MATERIALS AND METHODS

PWS color was measured using a portable spectrophotometer. PWS patches (29.26-45.82 cm2) of different color and shape were generated for 2D and 3D PWS model. 3D images were acquired by a handheld 3D scanner to create texture maps. For semantic segmentation, an improved DeepLabV3+ network was developed for PWS lesion extraction from texture mapping of 3D images. In order to achieve accurate extraction of lesion regions, the convolutional block attention module (CBAM) and DENSE were introduced and the network was trained under Ranger optimizer. The performance of different backbone networks for PWS lesion extraction were also compared.

RESULTS

IDeepLabV3+ (Xception) showed the best results in PWS lesion extraction and area quantification. Its mean Intersection over Union (MIou) was 0.9797, Mean Pixel Accuracy (MPA) 0.9908, Accuracy 0.9989, Recall 0.9886 and F1-score 0.9897, respectively. In PWS area quantization, the mean value of the area error rate of this scheme was 2.61 ± 2.33.

CONCLUSIONS

The new 3D method developed in this study was able to achieve accurate quantification of PWS lesion area and has potentials for clinical applications.

Enhancing COVID-19 CT Image Segmentation: A Comparative Study of Attention and Recurrence in UNet Models

Imaging plays a key role in the clinical management of Coronavirus disease 2019 (COVID-19) as the imaging findings reflect the pathological process in the lungs. The visual analysis of High-Resolution Computed Tomography of the chest allows for the differentiation of parenchymal abnormalities of COVID-19, which are crucial to be detected and quantified in order to obtain an accurate disease stratification and prognosis. However, visual assessment and quantification represent a time-consuming task for radiologists. In this regard, tools for semi-automatic segmentation, such as those based on Convolutional Neural Networks, can facilitate the detection of pathological lesions by delineating their contour. In this work, we compared four state-of-the-art Convolutional Neural Networks based on the encoder-decoder paradigm for the binary segmentation of COVID-19 infections after training and testing them on 90 HRCT volumetric scans of patients diagnosed with COVID-19 collected from the database of the Pisa University Hospital. More precisely, we started from a basic model, the well-known UNet, then we added an attention mechanism to obtain an Attention-UNet, and finally we employed a recurrence paradigm to create a Recurrent-Residual UNet (R2-UNet). In the latter case, we also added attention gates to the decoding path of an R2-UNet, thus designing an R2-Attention UNet so as to make the feature representation and accumulation more effective. We compared them to gain understanding of both the cognitive mechanism that can lead a neural model to the best performance for this task and the good compromise between the amount of data, time, and computational resources required. We set up a five-fold cross-validation and assessed the strengths and limitations of these models by evaluating the performances in terms of Dice score, Precision, and Recall defined both on 2D images and on the entire 3D volume. From the results of the analysis, it can be concluded that Attention-UNet outperforms the other models by achieving the best performance of 81.93%, in terms of 2D Dice score, on the test set. Additionally, we conducted statistical analysis to assess the performance differences among the models. Our findings suggest that integrating the recurrence mechanism within the UNet architecture leads to a decline in the model's effectiveness for our particular application.

Depth estimation from a single-shot fringe pattern based on DD-Inceptionv2-UNet

The quick and accurate retrieval of an object's depth from a single-shot fringe pattern in fringe projection profilometry has been a topic of ongoing research. In recent years, with the development of deep learning, a deep learning technique to FPP for single-shot 3D measurement is being used. To improve the accuracy of depth estimation from a single-shot fringe pattern, we propose the depthwise separable Dilation Inceptionv2-UNet (DD-Inceptionv2-UNet) by adjusting the depth and width of the network model simultaneously. And we evaluate the model on both simulated and experimental datasets. The experimental results show that the error between the depth map predicted by the proposed method and the label is smaller, and the depth curve map is closer to the ground truth. And on the simulated dataset, the MAE of the proposed method decreased by 35.22%, compared to UNet. On the experimental dataset, the MAE of the proposed method decreased by 34.62%, compared to UNet. The proposed method is relatively outstanding in both quantitative and qualitative evaluations, effectively improving the accuracy of 3D measurement results from a single-shot fringe pattern.

A Systematic Review on Deep Structured Learning for COVID-19 Screening Using Chest CT from 2020 to 2022

The emergence of the COVID-19 pandemic in Wuhan in 2019 led to the discovery of a novel coronavirus. The World Health Organization (WHO) designated it as a global pandemic on 11 March 2020 due to its rapid and widespread transmission. Its impact has had profound implications, particularly in the realm of public health. Extensive scientific endeavors have been directed towards devising effective treatment strategies and vaccines. Within the healthcare and medical imaging domain, the application of artificial intelligence (AI) has brought significant advantages. This study delves into peer-reviewed research articles spanning the years 2020 to 2022, focusing on AI-driven methodologies for the analysis and screening of COVID-19 through chest CT scan data. We assess the efficacy of deep learning algorithms in facilitating decision making processes. Our exploration encompasses various facets, including data collection, systematic contributions, emerging techniques, and encountered challenges. However, the comparison of outcomes between 2020 and 2022 proves intricate due to shifts in dataset magnitudes over time. The initiatives aimed at developing AI-powered tools for the detection, localization, and segmentation of COVID-19 cases are primarily centered on educational and training contexts. We deliberate on their merits and constraints, particularly in the context of necessitating cross-population train/test models. Our analysis encompassed a review of 231 research publications, bolstered by a meta-analysis employing search keywords (COVID-19 OR Coronavirus) AND chest CT AND (deep learning OR artificial intelligence OR medical imaging) on both the PubMed Central Repository and Web of Science platforms.

COVID-19 lung infection segmentation from chest CT images based on CAPA-ResUNet

Coronavirus disease 2019 (COVID-19) epidemic has devastating effects on personal health around the world. It is significant to achieve accurate segmentation of pulmonary infection regions, which is an early indicator of disease. To solve this problem, a deep learning model, namely, the content-aware pre-activated residual UNet (CAPA-ResUNet), was proposed for segmenting COVID-19 lesions from CT slices. In this network, the pre-activated residual block was used for down-sampling to solve the problems of complex foreground and large fluctuations of distribution in datasets during training and to avoid gradient disappearance. The area loss function based on the false segmentation regions was proposed to solve the problem of fuzzy boundary of the lesion area. This model was evaluated by the public dataset (COVID-19 Lung CT Lesion Segmentation Challenge-2020) and compared its performance with those of classical models. Our method gains an advantage over other models in multiple metrics. Such as the Dice coefficient, specificity (Spe), and intersection over union (IoU), our CAPA-ResUNet obtained 0.775 points, 0.972 points, and 0.646 points, respectively. The Dice coefficient of our model was 2.51% higher than Content-aware residual UNet (CARes-UNet). The code is available at https://github.com/malu108/LungInfectionSeg.

Interactive framework for Covid-19 detection and segmentation with feedback facility for dynamically improved accuracy and trust

Due to the severity and speed of spread of the ongoing Covid-19 pandemic, fast but accurate diagnosis of Covid-19 patients has become a crucial task. Achievements in this respect might enlighten future efforts for the containment of other possible pandemics. Researchers from various fields have been trying to provide novel ideas for models or systems to identify Covid-19 patients from different medical and non-medical data. AI-based researchers have also been trying to contribute to this area by mostly providing novel approaches of automated systems using convolutional neural network (CNN) and deep neural network (DNN) for Covid-19 detection and diagnosis. Due to the efficiency of deep learning (DL) and transfer learning (TL) models in classification and segmentation tasks, most of the recent AI-based researches proposed various DL and TL models for Covid-19 detection and infected region segmentation from chest medical images like X-rays or CT images. This paper describes a web-based application framework for Covid-19 lung infection detection and segmentation. The proposed framework is characterized by a feedback mechanism for self learning and tuning. It uses variations of three popular DL models, namely Mask R-CNN, U-Net, and U-Net++. The models were trained, evaluated and tested using CT images of Covid patients which were collected from two different sources. The web application provide a simple user friendly interface to process the CT images from various resources using the chosen models, thresholds and other parameters to generate the decisions on detection and segmentation. The models achieve high performance scores for Dice similarity, Jaccard similarity, accuracy, loss, and precision values. The U-Net model outperformed the other models with more than 98% accuracy.