Ultrasound spine image segmentation using multi-scale feature fusion skip-inception U-Net (SIU-Net)

Automatic segmentation of spine x-ray images based on multiscale feature enhancement network

BACKGROUND

Automatic segmentation of vertebrae in spinal x-ray images is crucial for clinical diagnosis, case analysis, and surgical planning of spinal lesions.

PURPOSE

However, due to the inherent characteristics of x-ray images, including low contrast, high noise, and uneven grey scale, it remains a critical and challenging problem in computer-aided spine image analysis and disease diagnosis applications.

METHODS

In this paper, a Multiscale Feature Enhancement Network (MFENet), is proposed for segmenting whole spinal x-ray images, to aid doctors in diagnosing spinal-related diseases. To enhance feature extraction, the network incorporates a Dual-branch Feature Extraction Module (DFEM) and a Semantic Aggregation Module (SAM). The DFEM has a parallel dual-branch structure. The upper branch utilizes multiscale convolutional kernels to extract features from images. Employing convolutional kernels of different sizes helps capture details and structural information at different scales. The lower branch incorporates attention mechanisms to further optimize feature representation. By modeling the feature maps spatially and across channels, the network becomes more focused on key feature regions and suppresses task-irrelevant information. The SAM leverages contextual semantic information to compensate for details lost during pooling and convolution operations. It integrates high-level feature information from different scales to reduce segmentation result discontinuity. In addition, a hybrid loss function is employed to enhance the network's feature extraction capability.

RESULTS

In this study, we conducted a multitude of experiments utilizing dataset provided by the Spine Surgery Department of Henan Provincial People's Hospital. The experimental results indicate that our proposed MFENet demonstrates superior segmentation performance in spinal segmentation on x-ray images compared to other advanced methods, achieving 92.61 ± 0.431 for MIoU, 92.42 ± 0.329 for DSC, and 99.51 ± 0.037 for Global_accuracy.

CONCLUSIONS

Our model is able to more effectively learn and extract global contextual semantic information, significantly improving spinal segmentation performance, further aiding doctors in analyzing patient conditions.

Automatic Assessment of Ultrasound Curvature Angle for Scoliosis Detection Using 3-D Ultrasound Volume Projection Imaging

OBJECTIVE

Scoliosis is a spinal deformation in which the spine takes a lateral curvature, generating an angle in the coronal plane. The conventional method for detecting scoliosis is measurement of the Cobb angle in spine images obtained by anterior X-ray scanning. Ultrasound imaging of the spine is found to be less ionising than traditional radiographic modalities. For posterior ultrasound scanning, alternate indices of the spinous process angle (SPA) and ultrasound curve angle (UCA) were developed and have proven comparable to those of the traditional Cobb angle. In SPA, the measurements are made using the spinous processes as an anatomical reference, leading to an underestimation of the traditionally used Cobb angles. Alternatively, in UCA, more lateral features of the spine are employed for measurement of the main thoracic and thoracolumbar angles; however, clear identification of bony features is required. The current practice of UCA angle measurement is manual. This research attempts to automate the process so that the errors related to human intervention can be avoided and the scalability of ultrasound scoliosis diagnosis can be improved. The key objective is to develop an automatic scoliosis diagnosis system using 3-D ultrasound imaging.

METHODS

The novel diagnosis system is a three-step process: (i) finding the ultrasound spine image with the most visible lateral features using the convolutional RankNet algorithm; (ii) segmenting the bony features from the noisy ultrasound images using joint spine segmentation and noise removal; and (iii) calculating the UCA automatically using a newly developed centroid pairing and inscribed rectangle slope method.

RESULTS

The proposed method was evaluated on 109 patients with scoliosis of different severity. The results obtained had a good correlation with manually measured UCAs (R2=0.9784 for the main thoracic angle andR2=0.9671 for the thoracolumbar angle) and a clinically acceptable mean absolute difference of the main thoracic angle (2.82 ± 2.67°) and thoracolumbar angle (3.34 ± 2.83°).

CONCLUSION

The proposed method establishes a very promising approach for enabling the applications of economic 3-D ultrasound volume projection imaging for mass screening of scoliosis.

HIMS-Net: Horizontal-vertical interaction and multiple side-outputs network for cyst segmentation in jaw images

Jaw cysts are mainly caused by abnormal tooth development, chronic oral inflammation, or jaw damage, which may lead to facial swelling, deformity, tooth loss, and other symptoms. Due to the diversity and complexity of cyst images, deep-learning algorithms still face many difficulties and challenges. In response to these problems, we present a horizontal-vertical interaction and multiple side-outputs network for cyst segmentation in jaw images. First, the horizontal-vertical interaction mechanism facilitates complex communication paths in the vertical and horizontal dimensions, and it has the ability to capture a wide range of context dependencies. Second, the feature-fused unit is introduced to adjust the network's receptive field, which enhances the ability of acquiring multi-scale context information. Third, the multiple side-outputs strategy intelligently combines feature maps to generate more accurate and detailed change maps. Finally, experiments were carried out on the self-established jaw cyst dataset and compared with different specialist physicians to evaluate its clinical usability. The research results indicate that the Matthews correlation coefficient (Mcc), Dice, and Jaccard of HIMS-Net were 93.61, 93.66 and 88.10% respectively, which may contribute to rapid and accurate diagnosis in clinical practice.

PDRF-Net: a progressive dense residual fusion network for COVID-19 lung CT image segmentation

The lungs of patients with COVID-19 exhibit distinctive lesion features in chest CT images. Fast and accurate segmentation of lesion sites from CT images of patients' lungs is significant for the diagnosis and monitoring of COVID-19 patients. To this end, we propose a progressive dense residual fusion network named PDRF-Net for COVID-19 lung CT segmentation. Dense skip connections are introduced to capture multi-level contextual information and compensate for the feature loss problem in network delivery. The efficient aggregated residual module is designed for the encoding-decoding structure, which combines a visual transformer and the residual block to enable the network to extract richer and minute-detail features from CT images. Furthermore, we introduce a bilateral channel pixel weighted module to progressively fuse the feature maps obtained from multiple branches. The proposed PDRF-Net obtains good segmentation results on two COVID-19 datasets. Its segmentation performance is superior to baseline by 11.6% and 11.1%, and outperforming other comparative mainstream methods. Thus, PDRF-Net serves as an easy-to-train, high-performance deep learning model that can realize effective segmentation of the COVID-19 lung CT images.

Clinical Application of Shock Wave in the Treatment of Avascular Necrosis of the Femoral Head in the Early and Middle Stages

In order to observe the clinical efficacy of shock waves in the treatment of avascular necrosis of the femoral head in the early and middle stages, a clinical application method of a shock wave in the treatment of avascular necrosis of the femoral head in the early and middle stages was proposed. The method combines the CT image segmentation technology to further segment the hip joint image, thereby speeding up the treatment speed and achieving a better treatment effect. Experimental results show that CT image segmentation takes 10.9 hours with an average time of 8 seconds, which is faster than other methods. The shock wave is an effective treatment method for early avascular necrosis of the femoral head, and this method will become one of the main methods for the clinical treatment of this kind of disease.

MSAC-Net: 3D Multi-Scale Attention Convolutional Network for Multi-Spectral Imagery Pansharpening

Pansharpening fuses spectral information from the multi-spectral image and spatial information from the panchromatic image, generating super-resolution multi-spectral images with high spatial resolution. In this paper, we proposed a novel 3D multi-scale attention convolutional network (MSAC-Net) based on the typical U-Net framework for multi-spectral imagery pansharpening. MSAC-Net is designed via 3D convolution, and the attention mechanism replaces the skip connection between the contraction and expansion pathways. Multiple pansharpening layers at the expansion pathway are designed to calculate the reconstruction results for preserving multi-scale spatial information. The MSAC-Net performance is verified on the IKONOS and QuickBird satellites’ datasets, proving that MSAC-Net achieves comparable or superior performance to the state-of-the-art methods. Additionally, 2D and 3D convolution are compared, and the influences of the number of convolutions in the convolution block, the weight of multi-scale information, and the network’s depth on the network performance are analyzed.