Three-dimensional virtual reality simulation of periarticular tumors using Dextroscope reconstruction and simulated surgery: A preliminary 10-case study

Insights and trends review: Use of extended reality (xR) in hand surgery

Digital transformation through extended reality (xR)-comprising virtual, augmented, mixed, and substitutional reality-has become an integral part of the future of clinical and surgical practice. xR technologies facilitate advanced surgical planning, training, therapies and education, reshaping both personal and institutional healthcare. This paper examines the potential changes that xR has introduced into the field of hand surgery, exploring how xR enhances patient-centric care, increases medical service efficiency and revolutionizes surgical training, planning and therapeutic interventions. Key areas such as surgical assistance, telemedicine, therapies and rehabilitation, medical training and education, and improving patient understanding are highlighted. By synthesizing the current literature, this narrative review articulates the theoretical and practical implications of xR, offering insights into its transformative potential and supporting continuous educational advancement in medical practice.

Comparing virtual reality, desktop-based 3D, and 2D versions of a category learning experiment

Virtual reality (VR) has seen increasing application in cognitive psychology in recent years. There is some debate about the impact of VR on both learning outcomes and on patterns of information access behaviors. In this study we compare performance on a category learning task between three groups: one presented with three-dimensional (3D) stimuli while immersed in the HTC Vive VR system (n = 26), another presented with the same 3D stimuli while using a flat-screen desktop computer (n = 26), and a third presented with a two-dimensional projection of the stimuli on a desktop computer while their eye movements were tracked (n = 8). In the VR and 3D conditions, features of the object to be categorized had to be revealed by rotating the object. In the eye tracking control condition (2D), all object features were visible, and participants' gaze was tracked as they examined each feature. Over 240 trials we measured accuracy, reaction times, attentional optimization, time spent on feedback, fixation durations, and fixation counts for each participant as they learned to correctly categorize the stimuli. In the VR condition, participants had increased fixation counts compared to the 3D and 2D conditions. Reaction times for the 2D condition were significantly faster and fixation durations were lower compared to the VR and 3D conditions. We found no significant differences in learning accuracy between the VR, 3D, and 2D conditions. We discuss implications for both researchers interested in using VR to study cognition, and VR developers hoping to use non-VR research to guide their designs and applications.

[Application of diffusion tensor imaging combined with virtual reality three-dimensional reconstruction in the operation of gliomas involved eloquent regions]

OBJECTIVE

To investigate the values of diffusion tensor imaging (DTI) and virtual reality (VR) techniques in design surgery program of gliomas near eloquent regions.

METHODS

In this study, 35 cases were retrospectively analyzed with gliomas involved language areas or rolandic regions operated in Department of Neurosurgery, Peking University Third Hospital from January 2015 to January 2019. Surgery programs were performed by Dextroscope virtual reality system. The pre-operative data, such as the magnetic resonance imaging (MRI), magnetic resonance arteriography (MRA) and DTI was transferred into the VR computer for restitution,Tumors, neural fiber tracts and blood vessels were reconstructed to simulate operation and design individual surgical plan. Neurological function was evaluated 1 week, 1 month and 3 months after operation.

RESULTS

Virtual reality three-dimensional images of the 35 cases were successfully achieved, including neural fiber tracts,blood vessels and the lesions. The displacement and destruction of fiber tracts, the anatomic relationship between tumor and important fiber bundle, artery and vein could be shown clearly. Surgical simulation and surgery program of VR of the 35 patients were successfully performed. The 3D images obtained from virtual reality near to the real surgery. Ten of the 35 cases were defined as rolandic regions tumors, 14 of the 35 cases were defined as language areas tumors and 11 of the 35 cases involved both language areas and rolandic regions. Complete resection of enhancing tumor (CRET) was achieved in 30 cases (85.7%), subtotal resection in 5 cases (14.3%), neurological function improved in 34 cases (97.1%) after operation,and 1 case had no improvement compared with that before(2.9%). Thirteen cases without neurological deficit pre-operation, showed transient neurological deficit ,which were recovered about 10 days post-operation, 12 of 22 cases with pre-operative neurologic deficit, improved one week postoperation, 9 of 22 cases with pre-operative neurologic deficit improved one month after operation, the rest 1 case was recurrent with glioblastoma with aggravated hemiplegia symptom after operation, who died of cerebral hernia 2 months later.

CONCLUSION

Dextroscope virtual reality system can clearly expose and quantify the 3D anatomic relationship of tumors, neural fiber tracts and blood vessels surrounding gliomas near eloquent regions, which is helpful to design the best individualized surgery program, to improve surgical effect.

BioVR: a platform for virtual reality assisted biological data integration and visualization

Background

Functional characterization of single nucleotide variants (SNVs) involves two steps, the first step is to convert DNA to protein and the second step is to visualize protein sequences with their structures. As massively parallel sequencing has emerged as a leading technology in genomics, resulting in a significant increase in data volume, direct visualization of SNVs together with associated protein sequences/structures in a new user interface (UI) would be a more effective way to assess their potential effects on protein function.

Results

We have developed BioVR, an easy-to-use interactive, virtual reality (VR)-assisted platform for integrated visual analysis of DNA/RNA/protein sequences and protein structures using Unity3D and the C# programming language. It utilizes the cutting-edge Oculus Rift, and Leap Motion hand detection, resulting in intuitive navigation and exploration of various types of biological data. Using Gria2 and its associated gene product as an example, we present this proof-of-concept software to integrate protein and nucleic acid data. For any amino acid or nucleotide of interest in the Gria2 sequence, it can be quickly linked to its corresponding location on Gria2 protein structure and visualized within VR.

Conclusions

Using innovative 3D techniques, we provide a VR-based platform for visualization of DNA/RNA sequences and protein structures in aggregate, which can be extended to view omics data.

Electronic supplementary material

The online version of this article (10.1186/s12859-019-2666-z) contains supplementary material, which is available to authorized users.

A review of translational medicine. The future paradigm: how can we connect the orthopedic dots better?

INTRODUCTION

Patients with complex medical and surgical problems often travel great distances to prestigious university medical centers in search of solutions and in some cases for nothing more than a diagnosis of their condition. Translational medicine (TM) is an emerging method and process of facilitating medical advances efficiently from the scientist to the clinician. Most established clinicians and those in training know very little about this new discipline. The purpose of this article is to illustrate TM in varied scientific, medical and surgical fields.

MATERIALS AND METHODS

Anecdotal events in medicine and orthopaedics based upon a practicing orthopaedic surgeon's training and clinical experience are presented.

RESULTS

TM is rapidly assuming a greater presence in the medical community. The National Institute of Health (NIH) recognizes this discipline and has funded TM projects. Numerous institutions in Europe and the USA offer advanced degrees in TM. Finally there is a European Society for Translational Medicine (EUTMS), an International Society for Translational Medicine, and an Academy of Translational Medical Professionals (ATMP).

DISCUSSION

The examples of TM presented in this article support the argument for the formation of more TM networks on the local and regional levels. The need for increased participation of researchers and clinicians requires further study to identify the economic and social impact of TM.

CONCLUSIONS

The examples of TM presented in this article support the argument for the formation of more TM networks on the local and regional levels. Financial constraints for TM can be overcome by pooling government, academic, private, and industry resources in an organized fashion with oversight by a lead TM researcher.

Correlation Factors Analysis of Breast Cancer Tumor Volume Doubling Time Measured by 3D-Ultrasound

BACKGROUND Tumor volume doubling time (TVDT) is relatively important for breast cancer diagnosis and prognosis evaluation. This study aimed to analyze the related factors that may affect the TVDT of breast cancer by three-dimensional ultrasound (3D-US). MATERIAL AND METHODS A total of 69 breast cancer patients were selected. 3D-US was applied to measure the volume of breast lumps diagnosed as BI-RADS-US 4A by conventional ultrasound. TVDT was calculated according to the formula TVDT=DT×log2/log(V2/V1). Multiple linear regression analysis was performed to analyze the factors influencing breast cancer TVDT. RESULTS The mean and median TVDT were 185±126 (range 66-521) and 164 days, respectively. TVDT showed no statistical significance according to regular shape, coarse margin, spicule sign, peripheral hyperechoic halo, microcalcification, and different posterior echo characteristics (P>0.05). Patients grouped by age, axillary lymphatic metastasis, histological differentiation, and Nottingham prognostic index (NPI) score exhibited significantly different TVDT (P<0.05). On the contrary, patients with different menstrual conditions, breast cancer family history, or pathological types presented similar TVDT (P>0.05). TVDT was obviously different in breast cancer with different ER, PR, Ki-67, and molecular subtyping but not HER2 expression. Multivariate analysis revealed that NPI score, axillary lymphatic metastasis, Ki-67, and molecular subtyping were risk factors of TVDT in breast cancer (P<0.05). CONCLUSIONS Breast cancer TVDT was significantly correlated with NPI score, axillary lymphatic metastasis, Ki-67, and molecular subtyping. Triple-negative breast cancer exhibited the most rapid growth.

Orthopaedic tumors: What problems are we solving, and are universities and major medical centers doing enough?

Little has been published about the complexity of orthopaedic tumors compared to others tumors. The current study in the literature treated this problem in terms of classification, surgical intervention and impact on the patient. In this article, factors risks of tumors will be we identified. A strategy based on three dimensional simulations will be explained in order to improve the clinical trials.

Magnetic Resonance Imaging (MRI) Evaluation for Anterior Disc Displacement of the Temporomandibular Joint

Background

Magnetic resonance imaging (MRI) is the criterion standard imaging technique for visualization of the temporomandibular joint (TMJ) region, and is currently considered the optimum modality for comprehensive evaluation in patients with temporomandibular joint disorder (TMD). This study was aimed at finding the value of MRI in pre-clinical diagnosis of TMJ disc displacement.

Material/Methods

Patients primarily diagnosed as having anterior disc displacement by clinical symptoms and X-ray were selected in the present study. MRI was used to evaluate surrounding anatomical structures and position, as well as morphological and signal intensity change between patients and normal controls.

Results

Posterior band position was significantly different between the patient group and control group. At the maximum opened-mouth position, the location of disc intermediate zone returned to normal. At closed-mouth position, the thickness of anterior and middle, but not posterior, band increased. The motion range of the condyle in the anterior disc displacement without reduction (ADDWR) patient group was significantly less than the value in the anterior disc displacement with reduction (ADDR) patient group and the control group. Whether at closed-mouth position or maximum opened-mouth position, the exudate volume in the patient group was greater than in the normal group.

Conclusions

MRI can be successfully used to evaluate multiple morphological changes at different mouth positions of normal volunteers and patients. The disc-condyle relationship can serve as an important indicator in assessing anterior disc displacement, and can be used to distinguish disc displacement with or without reduction.