Computational observers and visualization methods for stereoscopic medical imaging

3D medical images security via light-field imaging

This Letter proposes a selective encryption scheme for three-dimensional (3D) medical images using light-field imaging and two-dimensional (2D) Moore cellular automata (MCA). We first utilize convolutional neural networks (CNNs) to obtain the saliency of each elemental image (EI) originating from a 3D medical image with different viewpoints, and successfully extract the region of interest (ROI) in each EI. In addition, we use 2D MCA with balanced rule to encrypt the ROI of each EI. Finally, the decrypted elemental image array (EIA) can be reconstructed into a full-color and full-parallax 3D image using the display device, which can be visually displayed to doctors so that they can observe from different angles to design accurate treatment plans and improve the level of medical treatment. Our work also requires no preprocessing of 3D images, which is more efficient than the method of using slices for encryption.

Virtual assessment of stereoscopic viewing of digital breast tomosynthesis projection images

Digital breast tomosynthesis (DBT) acquires a series of projection images from different angles as an x-ray source rotates around the breast. Such imaging geometry lends DBT naturally to stereoscopic viewing as two projection images with a reasonable separation angle can easily form a stereo pair. This simulation study assessed the efficacy of stereo viewing of DBT projection images. Three-dimensional computational breast phantoms with realistically shaped synthetic lesions were scanned by three simulated DBT systems. The projection images were combined into a sequence of stereo pairs and presented to a stereomatching-based model observer for deciding lesion presence. Signal-to-noise ratio was estimated, and the detection performance with stack viewing of reconstructed slices was the benchmark. We have shown that: (1) stereo viewing of projection images may underperform stack viewing of reconstructed slices for current DBT geometries; (2) DBT geometries may impact the efficacy of the two viewing modes differently: narrow-arc and wide-arc geometries may be better for stereo viewing and stack viewing, respectively; (3) the efficacy of stereo viewing may be more robust than stack viewing to reductions in dose. While in principle stereo viewing is potentially effective for visualizing DBT data, effective stereo viewing may require specifically optimized DBT image acquisition.

Illumination in Spinal Surgery Depending on Different Approaches and Light Sources

BACKGROUND

Sufficient visualization of the operating field is crucial for success in surgery and is important especially concerning minimally invasive and deep approaches in spine surgery.

METHODS

The spinal microsurgical approach was imitated using an isolated box that was accessed with different devices. Different light sources and auxiliary devices were analyzed and compared. Light sources used were a microscope, a standard operating room lamp, and a headlamp. The auxiliary devices included different tubes with and without optical light fibers, different retractors, and an endoscope.

RESULTS

We demonstrated that different combinations of light sources and auxiliary devices provide significantly different illumination in the artificial operating field. A tube with optical fibers seems to be superior for nonmicroscopic approaches. The smaller these tubes are in diameter, the higher the illuminance on the surgical focus.

CONCLUSIONS

The combination of tube and microscope seems to be the best choice for deep approaches in microsurgical spinal surgery. An endoscope supplies illuminance comparable to a surgical microscope.

Characterization of crosstalk in stereoscopic display devices

Many different types of stereoscopic display devices are used for commercial and research applications. Stereoscopic displays offer the potential to improve performance in detection tasks for medical imaging diagnostic systems. Due to the variety of stereoscopic display technologies, it remains unclear how these compare with each other for detection and estimation tasks. Different stereo devices have different performance trade-offs due to their display characteristics. Among them, crosstalk is known to affect observer perception of 3D content and might affect detection performance. We measured and report the detailed luminance output and crosstalk characteristics for three different types of stereoscopic display devices. We recorded the effect of other issues on recorded luminance profiles such as viewing angle, use of different eye wear, and screen location. Our results show that the crosstalk signature for viewing 3D content can vary considerably when using different types of 3D glasses for active stereo displays. We also show that significant differences are present in crosstalk signatures when varying the viewing angle from 0 degrees to 20 degrees for a stereo mirror 3D display device. Our detailed characterization can help emulate the effect of crosstalk in conducting computational observer image quality assessment evaluations that minimize costly and time-consuming human reader studies.