Fusion of Intraoperative 3D B-mode and Contrast-Enhanced Ultrasound Data for Automatic Identification of Residual Brain Tumors

Ultrasonic Aspirator for Tissue Contact Detection: An Online Classification on Time-Series

The goal of neurosurgical tumor surgery is to remove the tumor completely without damaging healthy brain structures and thereby impairing the patient's neurological functions. This requires careful planning and execution of the operation by experienced neurosurgeons using the latest intraoperative technologies to achieve safe and rapid tumor reduction without harming the patient. To achieve this goal, a standard ultrasonic aspirator designed for tissue removal is equipped with additional intraoperative tissue detection using machine learning methods.Since decision-making in a clinical context must be fast, online contact detection is critical. Data are generated on three types of artificial tissue models in a CNC machine-controlled environment with four different ultrasonic aspirator settings. Contact classification on artificial tissue models is evaluated on four classification algorithms: change point detection (CPD), random forest (RF), recurrent neural network (RNN) and temporal convolutional network (TCN). Data preprocessing steps are applied, and their impacts are investigated. All methods are evaluated on five-fold cross-validation and provide generally good results with a performance of up to 0.977±0.007 in mean F1-score. Preprocessing the data has a positive effect on the classification processes for all methods and consistently improves the metrics. Thus, this work indicates in a first step that contact classification is feasible in an online context for an ultrasonic aspirator. Further research is necessary on different tissue types, as well as hand-held use to more closely resemble the intraoperative clinical conditions.

Toward intraoperative tissue classification: exploiting signal feedback from an ultrasonic aspirator for brain tissue differentiation

PURPOSE

During brain tumor surgery, care must be taken to accurately differentiate between tumorous and healthy tissue, as inadvertent resection of functional brain areas can cause severe consequences. Since visual assessment can be difficult during tissue resection, neurosurgeons have to rely on the mechanical perception of tissue, which in itself is inherently challenging. A commonly used instrument for tumor resection is the ultrasonic aspirator, whose system behavior is already dependent on tissue properties. Using data recorded during tissue fragmentation, machine learning-based tissue differentiation is investigated for the first time utilizing ultrasonic aspirators.

METHODS

Artificial tissue model with two different mechanical properties is synthesized to represent healthy and tumorous tissue. 40,000 temporal measurement points of electrical data are recorded in a laboratory environment using a CNC machine. Three different machine learning approaches are applied: a random forest (RF), a fully connected neural network (NN) and a 1D convolutional neural network (CNN). Additionally, different preprocessing steps are investigated.

RESULTS

Fivefold cross-validation is conducted over the data and evaluated with the metrics F1, accuracy, positive predictive value, true positive rate and area under the receiver operating characteristic. Results show a generally good performance with a mean F1 of up to 0.900 ± 0.096 using a NN approach. Temporal information indicates low impact on classification performance, while a low-pass filter preprocessing step leads to superior results.

CONCLUSION

This work demonstrates the first steps to successfully differentiate healthy brain and tumor tissue using an ultrasonic aspirator during tissue fragmentation. Evaluation shows that both neural network-based classifiers outperform the RF. In addition, the effects of temporal dependencies are found to be reduced when adequate data preprocessing is performed. To ensure subsequent implementation in the clinic, handheld ultrasonic aspirator use needs to be investigated in the future as well as the addition of data to reflect tissue diversity during neurosurgical operations.

Segmentation of brain tumour in 3D Intraoperative Ultrasound imaging

BACKGROUND

Intraoperative ultrasound (iUS), using a navigation system and preoperative magnetic resonance imaging (pMRI), supports the surgeon intraoperatively in identifying tumour margins. Therefore, visual tumour enhancement can be supported by efficient segmentation methods.

METHODS

A semi-automatic and two registration-based segmentation methods are evaluated to extract brain tumours from 3D-iUS data. The registration-based methods estimated the brain deformation after craniotomy based on pMRI and 3D-iUS data. Both approaches use the normalised gradient field and linear correlation of linear combinations metrics. Proposed methods were evaluated on 66 B-mode and contrast-mode 3D-iUS data with metastasis and glioblastoma.

RESULTS

The semi-automatic segmentation achieved superior results with dice similarity index (DSI) values between [85.34, 86.79]% and contour mean distance values between [1.05, 1.11] mm for both modalities and tumour classes.

CONCLUSIONS

Better segmentation results were obtained for metastasis detection than glioblastoma, preferring 3D-intraoperative B-mode over 3D-intraoperative contrast-mode.

Current applications of artificial intelligence for intraoperative decision support in surgery

Research into medical artificial intelligence (AI) has made significant advances in recent years, including surgical applications. This scoping review investigated AI-based decision support systems targeted at the intraoperative phase of surgery and found a wide range of technological approaches applied across several surgical specialties. Within the twenty-one (n = 21) included papers, three main categories of motivations were identified for developing such technologies: (1) augmenting the information available to surgeons, (2) accelerating intraoperative pathology, and (3) recommending surgical steps. While many of the proposals hold promise for improving patient outcomes, important methodological shortcomings were observed in most of the reviewed papers that made it difficult to assess the clinical significance of the reported performance statistics. Despite limitations, the current state of this field suggests that a number of opportunities exist for future researchers and clinicians to work on AI for surgical decision support with exciting implications for improving surgical care.