Optimal Spectral Combination of a Hyperspectral Camera for Intraoperative Hemodynamic and Metabolic Brain Mapping

A priori free spectral unmixing with periodic absorbance changes: application for auto-calibrated intraoperative functional brain mapping

Spectral unmixing designates techniques that allow to decompose measured spectra into linear or non-linear combination of spectra of all targets (endmembers). This technique was initially developed for satellite applications, but it is now also widely used in biomedical applications. However, several drawbacks limit the use of these techniques with standard optical devices like RGB cameras. The devices need to be calibrated and a a priori on the observed scene is often necessary. We propose a new method for estimating endmembers and their proportion automatically and without calibration of the acquisition device based on near separable non-negative matrix factorization. This method estimates the endmembers on spectra of absorbance changes presenting periodic events. This is very common in in vivo biomedical and medical optical imaging where hemodynamics dominate the absorbance fluctuations. We applied the method for identifying functional brain areas during neurosurgery using four different RGB cameras (an industrial camera, a smartphone and two surgical microscopes). Results obtained with the auto-calibration method were consistent with the intraoperative gold standards. Endmembers estimated with the auto-calibration method were similar to the calibrated endmembers used in the modified Beer-Lambert law. The similarity was particularly strong when both cardiac and respiratory periodic events were considered. This work can allow a widespread use of spectral imaging in the industrial or medical field.

Intraoperative identification of functional brain areas with RGB imaging using statistical parametric mapping: Simulation and clinical studies

Complementary technique to preoperative fMRI and electrical brain stimulation (EBS) for glioma resection could improve dramatically the surgical procedure and patient care. Intraoperative RGB optical imaging is a technique for localizing functional areas of the human cerebral cortex that can be used during neurosurgical procedures. However, it still lacks robustness to be used with neurosurgical microscopes as a clinical standard. In particular, a robust quantification of biomarkers of brain functionality is needed to assist neurosurgeons. We propose a methodology to evaluate and optimize intraoperative identification of brain functional areas by RGB imaging. This consist in a numerical 3D brain model based on Monte Carlo simulations to evaluate intraoperative optical setups for identifying functional brain areas. We also adapted fMRI Statistical Parametric Mapping technique to identify functional brain areas in RGB videos acquired for 12 patients. Simulation and experimental results were consistent and showed that the intraoperative identification of functional brain areas is possible with RGB imaging using deoxygenated hemoglobin contrast. Optical functional identifications were consistent with those provided by EBS and preoperative fMRI. We also demonstrated that a halogen lighting may be particularity adapted for functional optical imaging. We showed that an RGB camera combined with a quantitative modeling of brain hemodynamics biomarkers can evaluate in a robust way the functional areas during neurosurgery and serve as a tool of choice to complement EBS and fMRI.

Hyperspectral Imaging in Brain Tumor Surgery-Evidence of Machine Learning-Based Performance

BACKGROUND

Hyperspectral imaging (HSI) has the potential to enhance surgical tissue detection and diagnostics. Definite utilization of intraoperative HSI guidance demands validated machine learning and public datasets that currently do not exist. Moreover, current imaging conventions are dispersed, and evidence-based paradigms for neurosurgical HSI have not been declared.

METHODS

We presented the rationale and a detailed clinical paradigm for establishing microneurosurgical HSI guidance. In addition, a systematic literature review was conducted to summarize the current indications and performance of neurosurgical HSI systems, with an emphasis on machine learning-based methods.

RESULTS

The published data comprised a few case series or case reports aiming to classify tissues during glioma operations. For a multitissue classification problem, the highest overall accuracy of 80% was obtained using deep learning. Our HSI system was capable of intraoperative data acquisition and visualization with minimal disturbance to glioma surgery.

CONCLUSIONS

In a limited number of publications, neurosurgical HSI has demonstrated unique capabilities in contrast to the established imaging techniques. Multidisciplinary work is required to establish communicable HSI standards and clinical impact. Our HSI paradigm endorses systematic intraoperative HSI data collection, which aims to facilitate the related standards, medical device regulations, and value-based medical imaging systems.

Multispectral intraoperative imaging for the detection of the hemodynamic response to interictal epileptiform discharges

Interictal epileptiform discharges (IEDs) are brief neuronal discharges occurring between seizures in patients with epilepsy. The characterization of the hemodynamic response function (HRF) specific to IEDs could increase the accuracy of other functional imaging techniques to localize epileptiform activity, including functional near-infrared spectroscopy and functional magnetic resonance imaging. This study evaluated the possibility of using an intraoperative multispectral imaging system combined with electrocorticography (ECoG) to measure the average HRF associated with IEDs in eight patients. Inter-patient variability of the HRF is illustrated in terms of oxygenated hemoglobin peak latency, oxygenated hemoglobin increase/decrease following IEDs, and signal-to-noise ratio. A sub-region was identified using an unsupervised clustering algorithm in three patients that corresponded to the most active area identified by ECoG.

Review on the Application of Hyperspectral Imaging Technology of the Exposed Cortex in Cerebral Surgery

The study of brain science is vital to human health. The application of hyperspectral imaging in biomedical fields has grown dramatically in recent years due to their unique optical imaging method and multidimensional information acquisition. Hyperspectral imaging technology can acquire two-dimensional spatial information and one-dimensional spectral information of biological samples simultaneously, covering the ultraviolet, visible and infrared spectral ranges with high spectral resolution, which can provide diagnostic information about the physiological, morphological and biochemical components of tissues and organs. This technology also presents finer spectral features for brain imaging studies, and further provides more auxiliary information for cerebral disease research. This paper reviews the recent advance of hyperspectral imaging in cerebral diagnosis. Firstly, the experimental setup, image acquisition and pre-processing, and analysis methods of hyperspectral technology were introduced. Secondly, the latest research progress and applications of hyperspectral imaging in brain tissue metabolism, hemodynamics, and brain cancer diagnosis in recent years were summarized briefly. Finally, the limitations of the application of hyperspectral imaging in cerebral disease diagnosis field were analyzed, and the future development direction was proposed.

Advances in Hyperspectral and Multispectral Optical Spectroscopy and Imaging of Tissue

Optical imaging and characterization of tissue has become a huge applied field due to the advantages of the optical analysis methods, which include non-invasiveness, portability, high sensitivity, and high spectral specificity [...]

Intraoperative Resting-State Functional Connectivity Based on RGB Imaging

RGB optical imaging is a marker-free, contactless, and non-invasive technique that is able to monitor hemodynamic brain response following neuronal activation using task-based and resting-state procedures. Magnetic resonance imaging (fMRI) and functional near infra-red spectroscopy (fNIRS) resting-state procedures cannot be used intraoperatively but RGB imaging provides an ideal solution to identify resting-state networks during a neurosurgical operation. We applied resting-state methodologies to intraoperative RGB imaging and evaluated their ability to identify resting-state networks. We adapted two resting-state methodologies from fMRI for the identification of resting-state networks using intraoperative RGB imaging. Measurements were performed in 3 patients who underwent resection of lesions adjacent to motor sites. The resting-state networks were compared to the identifications provided by RGB task-based imaging and electrical brain stimulation. Intraoperative RGB resting-state networks corresponded to RGB task-based imaging (DICE:0.55±0.29). Resting state procedures showed a strong correspondence between them (DICE:0.66±0.11) and with electrical brain stimulation. RGB imaging is a relevant technique for intraoperative resting-state networks identification. Intraoperative resting-state imaging has several advantages compared to functional task-based analyses: data acquisition is shorter, less complex, and less demanding for the patients, especially for those unable to perform the tasks.

Multimodal imaging of laser speckle contrast imaging combined with mosaic filter-based hyperspectral imaging for precise surgical guidance

OBJECTIVE

To enable a real-time surgical guidance system that simultaneously monitors blood vessel perfusion, oxygen saturation, thrombosis, and tissue recovery by combining multiple optical imaging techniques into a single system: visible imaging, mosaic filter-based snapshot hyperspectral imaging (HSI), and laser speckle contrast imaging (LSCI).

METHODS

The multimodal optical imaging system was demonstrated by clamping blood vessels in the small intestines of rats to create areas of restricted blood flow. Subsequent tissue damage and regeneration were monitored during procedures. Using LSCI, vessel perfusion was measured, revealing the biological activity and survival of organ tissues. Blood oxygen saturation was monitored using HSI in the near-infrared region. Principal component analysis was used over the spectral dimension to identify an HSI wavelength combination optimized for hemodynamic biomarker visualization. HSI and LSCI were complimentary, identifying thrombus generation and tissue recovery, which was not possible in either modality alone.

RESULTS AND CONCLUSION

By analyzing multimodal tissue information from visible imaging, LSCI perfusion imaging, and HSI, a recovery prognosis could be determined based on the blood supply to the organ. The unique combination of the complementary imaging techniques into a single surgical microscope holds promise for improving the real-time determination of blood supply and tissue prognosis during surgery.

SIGNIFICANCE

Precise real-time monitoring for vascular anomalies promises to reduce the risk of organ damage in precise surgical operations such as tissue resection and transplantation. In addition, the convergence of label-free imaging technologies removes delays associated with the injection and diffusion of vascular monitoring dyes.