Improvement of 3-D Ultrasound Spine Imaging Technique Using Fast Reconstruction Algorithm

Anatomical Prior and Inter-Slice Consistency for Semi-Supervised Vertebral Structure Detection in 3D Ultrasound Volume

Three-dimensional (3D) ultrasound imaging technique has been applied for scoliosis assessment, but the current assessment method only uses coronal projection images and cannot illustrate the 3D deformity and vertebra rotation. The vertebra detection is essential to reveal 3D spine information, but the detection task is challenging due to complex data and limited annotations. We propose VertMatch to detect vertebral structures in 3D ultrasound volume containing a detector and classifier. The detector network finds the potential positions of structures on transverse slice globally, and then the local patches are cropped based on detected positions. The classifier is used to distinguish whether the patches contain real vertebral structures and screen the predicted positions from the detector. VertMatch utilizes unlabeled data in a semi-supervised manner, and we develop two novel techniques for semi-supervised learning: 1) anatomical prior is used to acquire high-quality pseudo labels; 2) inter-slice consistency is used to utilize more unlabeled data by inputting multiple adjacent slices. Experimental results demonstrate that VertMatch can detect vertebra accurately in ultrasound volume and outperforms state-of-the-art methods. Moreover, VertMatch is also validated in automatic spinous process angle measurement on forty subjects with scoliosis, and the results illustrate that it can be a promising approach for the 3D assessment of scoliosis.

Review of Three-Dimensional Handheld Photoacoustic and Ultrasound Imaging Systems and Their Applications

Photoacoustic (PA) imaging is a non-invasive biomedical imaging technique that combines the benefits of optics and acoustics to provide high-resolution structural and functional information. This review highlights the emergence of three-dimensional handheld PA imaging systems as a promising approach for various biomedical applications. These systems are classified into four techniques: direct imaging with 2D ultrasound (US) arrays, mechanical-scanning-based imaging with 1D US arrays, mirror-scanning-based imaging, and freehand-scanning-based imaging. A comprehensive overview of recent research in each imaging technique is provided, and potential solutions for system limitations are discussed. This review will serve as a valuable resource for researchers and practitioners interested in advancements and opportunities in three-dimensional handheld PA imaging technology.

Robot-assisted ultrasound reconstruction for spine surgery: from bench-top to pre-clinical study

PURPOSE

Robot-assisted ultrasound (rUS) systems have already been used to provide non-radiative three-dimensional (3D) reconstructions that form the basis for guiding spine surgical procedures. Despite promising studies on this technology, there are few studies that offer insight into the robustness and generality of the approach by verifying performance in various testing scenarios. Therefore, this study aims at providing an assessment of a rUS system, with technical details from experiments starting at the bench-top to the pre-clinical study.

METHODS

A semi-automatic control strategy was proposed to ensure continuous and smooth robotic scanning. Next, a U-Net-based segmentation approach was developed to automatically process the anatomic features and derive a high-quality 3D US reconstruction. Experiments were conducted on synthetic phantoms and human cadavers to validate the proposed approach.

RESULTS

Average deviations of scanning force were found to be 2.84±0.45 N on synthetic phantoms and to be 5.64±1.10 N on human cadavers. The anatomic features could be reliably reconstructed at mean accuracy of 1.28±0.87 mm for the synthetic phantoms and of 1.74±0.89 mm for the human cadavers.

CONCLUSION

The results and experiments demonstrate the feasibility of the proposed system in a pre-clinical setting. This work is complementary to previous work, encouraging further exploration of the potential of this technology in in vivo studies.

Assessment of thoracic spinal curvatures in static postures using spatially tracked 3D ultrasound volumes: a proof-of-concept study

The assessment of spinal posture is a difficult endeavour given the lack of identifiable bony landmarks for placement of skin markers. Moreover, potentially significant soft tissue artefacts along the spine further affect the accuracy of marker-based approaches. The objective of this proof-of-concept study was to develop an experimental framework to assess spinal postures by using three-dimensional (3D) ultrasound (US) imaging. A phantom spine model immersed in water was scanned using 3D US in a neutral and two curved postures mimicking a forward flexion in the sagittal plane while the US probe was localised by three electromagnetic tracking sensors attached to the probe head. The obtained anatomical 'coarse' registrations were further refined using an automatic registration algorithm and validated by an experienced sonographer. Spinal landmarks were selected in the US images and validated against magnetic resonance imaging data of the same phantom through image registration. Their position was then related to the location of the tracking sensors identified in the acquired US volumes, enabling the localisation of landmarks in the global coordinate system of the tracking device. Results of this study show that localised 3D US enables US-based anatomical reconstructions comparable to clinical standards and the identification of spinal landmarks in different postures of the spine. The accuracy in sensor identification was 0.49 mm on average while the intra- and inter-observer reliability in sensor identification was strongly correlated with a maximum deviation of 0.8 mm. Mapping of landmarks had a small relative distance error of 0.21 mm (SD = ± 0.16) on average. This study implies that localised 3D US holds the potential for the assessment of full spinal posture by accurately and non-invasively localising vertebrae in space.

Adaptive tetrahedral interpolation for reconstruction of uneven freehand 3D ultrasound

Objective.Freehand 3D ultrasound volume reconstruction has received considerable attention in medical research because it can freely perform spatial imaging at a low cost. However, the uneven distribution of the original ultrasound images in space reduces the reconstruction effect of the traditional method.Approach.An adaptive tetrahedral interpolation algorithm is proposed to reconstruct 3D ultrasound volume data. The algorithm adaptively divides the unevenly distributed images into numerous tetrahedrons and interpolates the voxel value in each tetrahedron to reconstruct 3D ultrasound volume data.Main results.Extensive experiments on simulated and clinical data confirm that the proposed method can achieve more accurate reconstruction than six benchmark methods. Specifically, the averaged interpolation error at the gray level can be reduced by 0.22-0.82, and the peak signal-to-noise ratio and the mean structure similarity can be improved by 0.32-1.83 dB and 0.01-0.05, respectively.Significance.With the parallel implementation of the algorithm, one 3D ultrasound volume data with size 279 × 279 × 276 can be reconstructed from 100 slices 2D ultrasound images with size 200 × 200 at 1.04 s. Such a quick and accurate approach has practical value in medical research.

A Review of the Methods on Cobb Angle Measurements for Spinal Curvature

Scoliosis is a common disease of the spine and requires regular monitoring due to its progressive properties. A preferred indicator to assess scoliosis is by the Cobb angle, which is currently measured either manually by the relevant medical staff or semi-automatically, aided by a computer. These methods are not only labor-intensive but also vary in precision by the inter-observer and intra-observer. Therefore, a reliable and convenient method is urgently needed. With the development of computer vision and deep learning, it is possible to automatically calculate the Cobb angles by processing X-ray or CT/MR/US images. In this paper, the research progress of Cobb angle measurement in recent years is reviewed from the perspectives of computer vision and deep learning. By comparing the measurement effects of typical methods, their advantages and disadvantages are analyzed. Finally, the key issues and their development trends are also discussed.