Facial model collection for medical augmented reality in oncologic cranio-maxillofacial surgery

Type B Aortic Dissection CTA Collection with True and False Lumen Expert Annotations for the Development of AI-based Algorithms

Aortic dissections (ADs) are serious conditions of the main artery of the human body, where a tear in the inner layer of the aortic wall leads to the formation of a new blood flow channel, named false lumen. ADs affecting the aorta distally to the left subclavian artery are classified as a Stanford type B aortic dissection (type B AD). This is linked to substantial morbidity and mortality, however, the course of the disease for the individual case is often unpredictable. Computed tomography angiography (CTA) is the gold standard for the diagnosis of type B AD. To advance the tools available for the analysis of CTA scans, we provide a CTA collection of 40 type B AD cases from clinical routine with corresponding expert segmentations of the true and false lumina. Segmented CTA scans might aid clinicians in decision making, especially if it is possible to fully automate the process. Therefore, the data collection is meant to be used to develop, train and test algorithms.

Head model dataset for mixed reality navigation in neurosurgical interventions for intracranial lesions

Mixed reality navigation (MRN) technology is emerging as an increasingly significant and interesting topic in neurosurgery. MRN enables neurosurgeons to "see through" the head with an interactive, hybrid visualization environment that merges virtual- and physical-world elements. Offering immersive, intuitive, and reliable guidance for preoperative and intraoperative intervention of intracranial lesions, MRN showcases its potential as an economically efficient and user-friendly alternative to standard neuronavigation systems. However, the clinical research and development of MRN systems present challenges: recruiting a sufficient number of patients within a limited timeframe is difficult, and acquiring low-cost, commercially available, medically significant head phantoms is equally challenging. To accelerate the development of novel MRN systems and surmount these obstacles, the study presents a dataset designed for MRN system development and testing in neurosurgery. It includes CT and MRI data from 19 patients with intracranial lesions and derived 3D models of anatomical structures and validation references. The models are available in Wavefront object (OBJ) and Stereolithography (STL) formats, supporting the creation and assessment of neurosurgical MRN applications.

Treatment Planning Strategies for Interstitial Ultrasound Ablation of Prostate Cancer

PURPOSE

To develop patient-specific 3D models using Finite-Difference Time-Domain (FDTD) simulations and pre-treatment planning tools for the selective thermal ablation of prostate cancer with interstitial ultrasound. This involves the integration with a FDA 510(k) cleared catheter-based ultrasound interstitial applicators and delivery system.

METHODS

A 3D generalized "prostate" model was developed to generate temperature and thermal dose profiles for different applicator operating parameters and anticipated perfusion ranges. A priori planning, based upon these pre-calculated lethal thermal dose and iso-temperature clouds, was devised for iterative device selection and positioning. Full 3D patient-specific anatomic modeling of actual placement of single or multiple applicators to conformally ablate target regions can be applied, with optional integrated pilot-point temperature-based feedback control and urethral/rectum cooling. These numerical models were verified against previously reported ex-vivo experimental results obtained in soft tissues.

RESULTS

For generic prostate tissue, 360 treatment schemes were simulated based on the number of transducers (1-4), applied power (8-20 W/cm2), heating time (5, 7.5, 10 min), and blood perfusion (0, 2.5, 5 kg/m3/s) using forward treatment modelling. Selectable ablation zones ranged from 0.8-3.0 cm and 0.8-5.3 cm in radial and axial directions, respectively. 3D patient-specific thermal treatment modeling for 12 Cases of T2/T3 prostate disease demonstrate applicability of workflow and technique for focal, quadrant and hemi-gland ablation. A temperature threshold (e.g., Tthres = 52 °C) at the treatment margin, emulating placement of invasive temperature sensing, can be applied for pilot-point feedback control to improve conformality of thermal ablation. Also, binary power control (e.g., Treg = 45 °C) can be applied which will regulate the applied power level to maintain the surrounding temperature to a safe limit or maximum threshold until the set heating time.

CONCLUSIONS

Prostate-specific simulations of interstitial ultrasound applicators were used to generate a library of thermal-dose distributions to visually optimize and set applicator positioning and directivity during a priori treatment planning pre-procedure. Anatomic 3D forward treatment planning in patient-specific models, along with optional temperature-based feedback control, demonstrated single and multi-applicator implant strategies to effectively ablate focal disease while affording protection of normal tissues.

GAN-based generation of realistic 3D volumetric data: A systematic review and taxonomy

With the massive proliferation of data-driven algorithms, such as deep learning-based approaches, the availability of high-quality data is of great interest. Volumetric data is very important in medicine, as it ranges from disease diagnoses to therapy monitoring. When the dataset is sufficient, models can be trained to help doctors with these tasks. Unfortunately, there are scenarios where large amounts of data is unavailable. For example, rare diseases and privacy issues can lead to restricted data availability. In non-medical fields, the high cost of obtaining enough high-quality data can also be a concern. A solution to these problems can be the generation of realistic synthetic data using Generative Adversarial Networks (GANs). The existence of these mechanisms is a good asset, especially in healthcare, as the data must be of good quality, realistic, and without privacy issues. Therefore, most of the publications on volumetric GANs are within the medical domain. In this review, we provide a summary of works that generate realistic volumetric synthetic data using GANs. We therefore outline GAN-based methods in these areas with common architectures, loss functions and evaluation metrics, including their advantages and disadvantages. We present a novel taxonomy, evaluations, challenges, and research opportunities to provide a holistic overview of the current state of volumetric GANs.

Smartphone Photogrammetric Assessment for Head Measurements

The assessment of cranial deformation is relevant in the field of medicine dealing with infants, especially in paediatric neurosurgery and paediatrics. To address this demand, the smartphone-based solution PhotoMeDAS has been developed, harnessing mobile devices to create three-dimensional (3D) models of infants' heads and, from them, automatic cranial deformation reports. Therefore, it is crucial to examine the accuracy achievable with different mobile devices under similar conditions so prospective users can consider this aspect when using the smartphone-based solution. This study compares the linear accuracy obtained from three smartphone models (Samsung Galaxy S22 Ultra, S22, and S22+). Twelve measurements are taken with each mobile device using a coded cap on a head mannequin. For processing, three different bundle adjustment implementations are tested with and without self-calibration. After photogrammetric processing, the 3D coordinates are obtained. A comparison is made among spatially distributed distances across the head with PhotoMeDAS vs. ground truth established with a Creaform ACADEMIA 50 while-light 3D scanner. With a homogeneous scale factor for all the smartphones, the results showed that the average accuracy for the S22 smartphone is -1.15 ± 0.53 mm, for the S22+, 0.95 ± 0.40 mm, and for the S22 Ultra, -1.8 ± 0.45 mm. Worth noticing is that a substantial improvement is achieved regardless of whether the scale factor is introduced per device.

Medical deep learning-A systematic meta-review

Deep learning has remarkably impacted several different scientific disciplines over the last few years. For example, in image processing and analysis, deep learning algorithms were able to outperform other cutting-edge methods. Additionally, deep learning has delivered state-of-the-art results in tasks like autonomous driving, outclassing previous attempts. There are even instances where deep learning outperformed humans, for example with object recognition and gaming. Deep learning is also showing vast potential in the medical domain. With the collection of large quantities of patient records and data, and a trend towards personalized treatments, there is a great need for automated and reliable processing and analysis of health information. Patient data is not only collected in clinical centers, like hospitals and private practices, but also by mobile healthcare apps or online websites. The abundance of collected patient data and the recent growth in the deep learning field has resulted in a large increase in research efforts. In Q2/2020, the search engine PubMed returned already over 11,000 results for the search term 'deep learning', and around 90% of these publications are from the last three years. However, even though PubMed represents the largest search engine in the medical field, it does not cover all medical-related publications. Hence, a complete overview of the field of 'medical deep learning' is almost impossible to obtain and acquiring a full overview of medical sub-fields is becoming increasingly more difficult. Nevertheless, several review and survey articles about medical deep learning have been published within the last few years. They focus, in general, on specific medical scenarios, like the analysis of medical images containing specific pathologies. With these surveys as a foundation, the aim of this article is to provide the first high-level, systematic meta-review of medical deep learning surveys.

Coatings Functionalization via Laser versus Other Deposition Techniques for Medical Applications: A Comparative Review

The development of new biological devices in response to market demands requires continuous efforts for the improvement of products’ functionalization based upon expansion of the materials used and their fabrication techniques. One viable solution consists of a functionalization substrate covered by layers via an appropriate deposition technique. Laser techniques ensure an enhanced coating’s adherence to the substrate and improved biological characteristics, not compromising the mechanical properties of the functionalized medical device. This is a review of the main laser techniques involved. We mainly refer to pulse laser deposition, matrix-assisted, and laser simple and double writing versus some other well-known deposition methods as magnetron sputtering, 3D bioprinting, inkjet printing, extrusion, solenoid, fuse-deposition modeling, plasma spray (PS), and dip coating. All these techniques can be extended to functionalize surface fabrication to change local morphology, chemistry, and crystal structure, which affect the biomaterial behavior following the chosen application. Surface functionalization laser techniques are strictly controlled within a confined area to deliver a large amount of energy concisely. The laser deposit performances are presented compared to reported data obtained by other techniques.

Validation and accuracy evaluation of automatic segmentation for knee joint pre-planning

BACKGROUND

Proper use of three-dimensional (3D) models generated from medical imaging data in clinical preoperative planning, training and consultation is based on the preliminary proved accuracy of the replication of the patient anatomy. Therefore, this study investigated the dimensional accuracy of 3D reconstructions of the knee joint generated from computed tomography scans via automatic segmentation by comparing them with 3D models generated through manual segmentation.

METHODS

Three unpaired, fresh-frozen right legs were investigated. Three-dimensional models of the femur and the tibia of each leg were manually segmented using a commercial software and compared in terms of geometrical accuracy with the 3D models automatically segmented using proprietary software. Bony landmarks were identified and used to calculate clinically relevant distances: femoral epicondylar distance; posterior femoral epicondylar distance; femoral trochlear groove length; tibial knee center tubercle distance (TKCTD). Pearson's correlation coefficient and Bland and Altman plots were used to evaluate the level of agreement between measured distances.

RESULTS

Differences between parameters measured on 3D models manually and automatically segmented were below 1 mm (range: -0.06 to 0.72 mm), except for TKCTD (between 1.00 and 1.40 mm in two specimens). In addition, there was a significant strong correlation between measurements.

CONCLUSIONS

The results obtained are comparable to those reported in previous studies where accuracy of bone 3D reconstruction was investigated. Automatic segmentation techniques can be used to quickly reconstruct reliable 3D models of bone anatomy and these results may contribute to enhance the spread of this technology in preoperative and operative settings, where it has shown considerable potential.

Augmented Reality for Head and Neck Carcinoma Imaging: Description and Feasibility of an Instant Calibration, Markerless Approach

BACKGROUND AND OBJECTIVE

Augmented reality (AR) can help to overcome current limitations in computer assisted head and neck surgery by granting "X-ray vision" to physicians. Still, the acceptance of AR in clinical applications is limited by technical and clinical challenges. We aim to demonstrate the benefit of a marker-free, instant calibration AR system for head and neck cancer imaging, which we hypothesize to be acceptable and practical for clinical use.

METHODS

We implemented a novel AR system for visualization of medical image data registered with the head or face of the patient prior to intervention. Our system allows the localization of head and neck carcinoma in relation to the outer anatomy. Our system does not require markers or stationary infrastructure, provides instant calibration and allows 2D and 3D multi-modal visualization for head and neck surgery planning via an AR head-mounted display. We evaluated our system in a pre-clinical user study with eleven medical experts.

RESULTS

Medical experts rated our application with a system usability scale score of 74.8 ± 15.9, which signifies above average, good usability and clinical acceptance. An average of 12.7 ± 6.6 minutes of training time was needed by physicians, before they were able to navigate the application without assistance.

CONCLUSIONS

Our AR system is characterized by a slim and easy setup, short training time and high usability and acceptance. Therefore, it presents a promising, novel tool for visualizing head and neck cancer imaging and pre-surgical localization of target structures.

A review on the applications of virtual reality, augmented reality and mixed reality in surgical simulation: an extension to different kinds of surgery

Background: Research proves that the apprenticeship model, which is the gold standard for training surgical residents, is obsolete. For that reason, there is a continuing effort toward the development of high-fidelity surgical simulators to replace the apprenticeship model. Applying Virtual Reality Augmented Reality (AR) and Mixed Reality (MR) in surgical simulators increases the fidelity, level of immersion and overall experience of these simulators.Areas covered: The objective of this review is to provide a comprehensive overview of the application of VR, AR and MR for distinct surgical disciplines, including maxillofacial surgery and neurosurgery. The current developments in these areas, as well as potential future directions, are discussed.Expert opinion: The key components for incorporating VR into surgical simulators are visual and haptic rendering. These components ensure that the user is completely immersed in the virtual environment and can interact in the same way as in the physical world. The key components for the application of AR and MR into surgical simulators include the tracking system as well as the visual rendering. The advantages of these surgical simulators are the ability to perform user evaluations and increase the training frequency of surgical residents.