Versatile Low-Cost Volumetric 3D Ultrasound Imaging Using Gimbal-Assisted Distance Sensors and an Inertial Measurement Unit

IMU-Assisted Manual 3D-Ultrasound Imaging Using Motion-Constrained Swept-Fan Scans

Three-dimensional (3D) ultrasonic imaging can enable post-facto plane of interest selection. It can be performed with devices such as wobbler probes, matrix probes, and sensor-based probes. Ultrasound systems that support 3D-imaging are expensive with added hardware complexity compared to 2D-imaging systems. An inertial measurement unit (IMU) can potentially be used for 3D-imaging by using it to track the motion of a one-dimensional array probe and constraining its motion in one degree of freedom (1-DoF) rotation (swept-fan). This work demonstrates the feasibility of an affordable IMU-assisted manual 3D-ultrasound scanner (IAM3US). A consumer-grade IMU-assisted 3D scanner prototype is designed with two support structures for swept-fan. After proper IMU calibration, an appropriate KF-based algorithm estimates the probe orientation during the swept-fan. An improved scanline-based reconstruction method is used for volume reconstruction. The evaluation of the IAM3US system is done by imaging a tennis ball filled with water and the head region of a fetal phantom. From fetal phantom reconstructed volumes, suitable 2D planes are extracted for biparietal diameter (BPD) manual measurements. Later, in-vivo data is collected. The novel contributions of this paper are (1) the application of a recently proposed algorithm for orientation estimation of swept-fan for 3D imaging, chosen based on the noise characteristics of selected consumer grade IMU (2) assessment of the quality of the 1-DoF swept-fan scan with a deflection detector along with monitoring of maximum angular rate during the scan and (3) two probe holder designs to aid the operator in performing the 1-DoF rotational motion and (4) end-to-end 3D-imaging system-integration. Phantom studies and preliminary in-vivo obstetric scans performed on two patients illustrate the usability of the system for diagnosis purposes.

Volumetric B-mode ultrasound and Doppler Imaging: Automatic Tracking With One Single Camera

Vascular diseases may occur in the upper extremities, and the lesions can span the entire length of the blood vessel. One of the most popular methods to identify vascular disorders is ultrasound Doppler imaging. However, traditional two-dimensional (2D) ultrasound Doppler imaging cannot capture the entire length of a long vessel in one image. Medical professionals often have to painstakingly reconstruct three-dimensional (3D) data using 2D ultrasound images to locate the lesions, especially for large blood vessels. 3D ultrasound Doppler imaging can display the morphological structure of blood vessels and the distribution of lesions more directly, providing a more comprehensive view compared to 2D imaging. In this work, we propose a wide-range 3D volumetric ultrasound Doppler imaging system with dual modality, in which a high-definition camera is adopted to automatically track the movement of the ultrasound transducer, simultaneously capturing a corresponding sequence of 2D ultrasound Doppler images. We conducted experiments on human arms using our proposed system and separately with X-ray computerized tomography (X-CT). The comparison results prove the potential value of our proposed system in the diagnosis of arm vascular diseases.

Ultrasound Probe Movement Analysis Using Depth Camera with Compact Handle Design for Probe Contact Force Measurement

The real-time information of the ultrasound probe movement and contact force during scanning is helpful for improving skill of medical professionals. This paper presents an affordable technique using an RGB-depth camera with the MediaPipe Hands framework for capturing the hand gesture to estimate the position and orientation of the ultrasound probe. The method does not require any additional marker which can interfere the motion and the feeling of handheld operation. The tracking accuracies of position and orientation were evaluated experimentally at different camera angles. The 3D printed handle was inserted into the grids of the XYZ plate and the tilt plate. Although the camera angle and the spatial position affect the accuracies, the maximum errors are always less than 7.5 mm and 10 degrees. The custom designed handle consisting of the inner and outer shells allows installation of the small three-axis force sensor for probe contact force measurement while scanning. The design is easy to assemble with an ultrasound probe without requiring any modification. The results of this work can be applied as a guideline for monitoring ultrasound training.

Recent Advances in Tracking Devices for Biomedical Ultrasound Imaging Applications

With the rapid advancement of tracking technologies, the applications of tracking systems in ultrasound imaging have expanded across a wide range of fields. In this review article, we discuss the basic tracking principles, system components, performance analyses, as well as the main sources of error for popular tracking technologies that are utilized in ultrasound imaging. In light of the growing demand for object tracking, this article explores both the potential and challenges associated with different tracking technologies applied to various ultrasound imaging applications, including freehand 3D ultrasound imaging, ultrasound image fusion, ultrasound-guided intervention and treatment. Recent development in tracking technology has led to increased accuracy and intuitiveness of ultrasound imaging and navigation with less reliance on operator skills, thereby benefiting the medical diagnosis and treatment. Although commercially available tracking systems are capable of achieving sub-millimeter resolution for positional tracking and sub-degree resolution for orientational tracking, such systems are subject to a number of disadvantages, including high costs and time-consuming calibration procedures. While some emerging tracking technologies are still in the research stage, their potentials have been demonstrated in terms of the compactness, light weight, and easy integration with existing standard or portable ultrasound machines.

Bioinspired soft electroreceptors for artificial precontact somatosensation

Artificial haptic sensors form the basis of touch-based human-interfaced applications. However, they are unable to respond to remote events before physical contact. Some elasmobranch fishes, such as seawater sharks, use electroreception somatosensory system for remote environmental perception. Inspired by this ability, we design a soft artificial electroreceptor for sensing approaching targets. The electroreceptor, enabled by an elastomeric electret, is capable of encoding environmental precontact information into a series of voltage pulses functioning as unique precontact human interfaces. Electroceptor applications are demonstrated in a prewarning system, robotic control, game operation, and three-dimensional object recognition. These capabilities in perceiving proximal precontact events can lenrich the functionalities and applications of human-interfaced electronics.

Accuracy Report on a Handheld 3D Ultrasound Scanner Prototype Based on a Standard Ultrasound Machine and a Spatial Pose Reading Sensor

The aim of this study was to develop and evaluate a 3D ultrasound scanning method. The main requirements were the freehand architecture of the scanner and high accuracy of the reconstructions. A quantitative evaluation of a freehand 3D ultrasound scanner prototype was performed, comparing the ultrasonographic reconstructions with the CAD (computer-aided design) model of the scanned object, to determine the accuracy of the result. For six consecutive scans, the 3D ultrasonographic reconstructions were scaled and aligned with the model. The mean distance between the 3D objects ranged between 0.019 and 0.05 mm and the standard deviation between 0.287 mm and 0.565 mm. Despite some inherent limitations of our study, the quantitative evaluation of the 3D ultrasonographic reconstructions showed comparable results to other studies performed on smaller areas of the scanned objects, demonstrating the future potential of the developed prototype.

A CNN-based method to reconstruct 3-D spine surfaces from US images in vivo

Three-dimensional (3-D) reconstruction of the spine surface is of strong clinical relevance for the diagnosis and prognosis of spine disorders and intra-operative image guidance. In this paper, we report a new technique to reconstruct lumbar spine surfaces in 3-D from non-invasive ultrasound (US) images acquired in free-hand mode. US images randomly sampled from in vivo scans of 9 rabbits were used to train a U-net convolutional neural network (CNN). More specifically, a late fusion (LF)-based U-net trained jointly on B-mode and shadow-enhanced B-mode images was generated by fusing two individual U-nets and expanding the set of trainable parameters to around twice the capacity of a basic U-net. This U-net was then applied to predict spine surface labels in in vivo images obtained from another rabbit, which were then used for 3-D spine surface reconstruction. The underlying pose of the transducer during the scan was estimated by registering stacks of US images to a geometrical model derived from corresponding CT data and used to align detected surface points. Final performance of the reconstruction method was assessed by computing the mean absolute error (MAE) between pairs of spine surface points detected from US and CT and by counting the total number of surface points detected from US. Comparison was made between the LF-based U-net and a previously developed phase symmetry (PS)-based method. Using the LF-based U-net, the averaged number of US surface points across the lumbar region increased by 21.61% and MAE reduced by 26.28% relative to the PS-based method. The overall MAE (in mm) was 0.24±0.29. Based on these results, we conclude that: 1) the proposed U-net can detect the spine posterior arch with low MAE and large number of US surface points and 2) the newly proposed reconstruction framework may complement and, under certain circumstances, be used without the aid of an external tracking system in intra-operative spine applications.

Three-Dimensional Morphology and Size Measurement of High-Temperature Metal Components Based on Machine Vision Technology: A Review

The three-dimensional (3D) size and morphology of high-temperature metal components need to be measured in real time during manufacturing processes, such as forging and rolling. Since the surface temperature of a metal component is very high during the forming and manufacturing process, manually measuring the size of a metal component at a close distance is difficult; hence, a non-contact measurement technology is required to complete the measurement. Recently, machine vision technology has been developed, which is a non-contact measurement technology that only needs to capture multiple images of a measured object to obtain the 3D size and morphology information, and this technology can be used in some extreme conditions. Machine vision technology has been widely used in industrial, agricultural, military and other fields, especially fields involving various high-temperature metal components. This paper provides a comprehensive review of the application of machine vision technology in measuring the 3D size and morphology of high-temperature metal components. Furthermore, according to the principle and method of measuring equipment structures, this review highlights two aspects in detail: laser scanning measurement and multi-view stereo vision technology. Special attention is paid to each method through comparisons and analyses to provide essential technical references for subsequent researchers.