Color Rendering in Medical Extended-Reality Applications

Calibration of head mounted displays for vision research with virtual reality

Immersion in virtual environments is an important analog for scientists. Situations that cannot be safely organized in the real world are being simulated virtually to observe, evaluate, and train aspects of human behavior for psychology, therapy, and assessment. However, creating an immersive environment using traditional graphics practices may create conflict with a researcher's goal of evaluating user response to well-defined visual stimuli. Standard computer monitors may display color-accurate stimuli, but it is generally viewed from a seating position, where the participant can see real-world visual context. In this article, we propose a novel means to allow vision scientists to exert finer control over the participants visual stimuli and context. We propose and verify a device-agnostic approach to color calibration by analyzing display properties such as luminance, spectral distribution, and chromaticity. We evaluated five different head-mounted displays from different manufacturers and showed how our approach produces conforming visual outputs.

The interior environment design for entrepreneurship education under the virtual reality and artificial intelligence-based learning environment

Nowadays, with the rapid growth of artificial intelligence (AI), entrepreneurship education has attracted more and more attention from society. To this end, it is necessary to gradually transform the traditional teaching mode into a new type of teaching that is more innovative, practical, and inclusive and in line with entrepreneurship education. The focus of the teaching mode change is on the optimization of the teaching environment. For this purpose, a method derived from distributed virtual reality (DVR) technology is specially designed. It refers to the fact that multiple users can join together through a computer network and participate in a virtual space at the same time to experience the virtual experience together. Based on this, the distributed 3D interior design is innovatively proposed. The innovation is mainly reflected in the application of VR technology, which is different from traditional software design. According to the functions and needs of the entrepreneurship teaching environment, first, the distributed feature information is collected, and second, the corresponding color image model is constructed by the fusion method, and edge contour detection and corresponding feature data extraction are carried out for the distributed image. Using a Red, Green, and Blue (RGB) color decomposition method, the pixel feature decomposition of spatially distributed image color is performed. And the feature reorganization of the 3D point cloud is combined to optimize the color space and color features of the combined design. On this basis, the distributed 3D interior design system is designed with VR and visual simulation technology. Finally, the Three-Dimensional Studio Max (3ds MAX) is used to establish 3D modeling, and the modeling software Multigen Creator is adopted to carry out the hierarchical structural design. The test results manifest that the Normalized Root Mean Square Error (RMSE) and information saturation of the distributed 3D interior design are reduced by 0.2 compared with the traditional design, the time overhead is shortened to one-sixth of the original, and the effect is more in line with the design requirements. It is hoped that this design method can provide new ideas and new perspectives for the optimization of the entrepreneurship teaching environment.

Color Variability Constrains Detection of Geometrically Perfect Mirror Symmetry

Symmetry in nature is a result of biological self-organization, driven by evolutionary processes. Detected by the visual systems of various species, from invertebrates to primates, symmetry determines survival relevant choice behaviors and supports adaptive function by reducing stimulus uncertainty. Symmetry also provides a major structural key to bio-inspired artificial vision and shape or movement simulations. In this psychophysical study, local variations in color covering the whole spectrum of visible wavelengths are compared to local variations in luminance contrast across an axis of geometrically perfect vertical mirror symmetry. The chromatic variations are found to delay response time to shape symmetry to a significantly larger extent than achromatic variations. This effect depends on the degree of variability, i.e., stimulus complexity. In both cases, we observe linear increase in response time as a function of local color variations across the vertical axis of symmetry. These results are directly explained by the difference in computational complexity between the two major (magnocellular vs. parvocellular) visual pathways involved in filtering the contrast (luminance vs. luminance and color) of the shapes. It is concluded that color variability across an axis of symmetry proves detrimental to the rapid detection of symmetry, and, presumably, other structural shape regularities. The results have implications for vision-inspired artificial intelligence and robotics exploiting functional principles of human vision for gesture and movement detection, or geometric shape simulation for recognition systems, where symmetry is often a critical property.

Technology Behavior Model—Impact of Extended Reality on Patient Surgery

Smart surgery is a new way to utilize smart devices to change existing surgeries. Smart glasses can enhance the surgical procedure so that the patient can understand the procedure more intuitively. Surgery is for patients, and patient acceptance of extended reality surgery is the purpose of this study. This study uses the technology behavior model, which is more in line with the user’s assessment of the acceptance behavior of the new technology. A triangulated research approach was used, which applies to this study for a specific patient population. Primary data were collected from hospitals through questionnaires and were statistically analyzed by CB&PLS-SEM multimodel using SmartPLS software. It was concluded that patients were influenced by operational emotional factors in undergoing extended reality surgery. The study provides a basis for future research related to the practical application of smart surgery from the patient’s perspective in viewing and accepting surgery.

Evaluation Challenges for the Application of Extended Reality Devices in Medicine

Augmented and virtual reality devices are being actively investigated and implemented for a wide range of medical uses. However, significant gaps in the evaluation of these medical devices and applications hinder their regulatory evaluation. Addressing these gaps is critical to demonstrating the devices' safety and effectiveness. We outline the key technical and clinical evaluation challenges discussed during the US Food and Drug Administration's public workshop, "Medical Extended Reality: Toward Best Evaluation Practices for Virtual and Augmented Reality in Medicine" and future directions for evaluation method development. Evaluation challenges were categorized into several key technical and clinical areas. Finally, we highlight current efforts in the standards communities and illustrate connections between the evaluation challenges and the intended uses of the medical extended reality (MXR) devices. Participants concluded that additional research is needed to assess the safety and effectiveness of MXR devices across the use cases.

Measurement Challenges for Medical Image Display Devices

Visual information is a critical component in the evaluation and communication of patient medical information. As display technologies have evolved, the medical community has sought to take advantage of advances in wider color gamuts, greater display portability, and more immersive imagery. These image quality enhancements have shown improvements in the quality of healthcare through greater efficiency, higher diagnostic accuracy, added functionality, enhanced training, and better health records. However, the display technology advances typically introduce greater complexity in the image workflow and display evaluation. This paper highlights some of the optical measurement challenges created by these new display technologies and offers possible pathways to address them.