Hyperspectral imaging and quantitative analysis for prostate cancer detection

Using hyperspectral imaging to predict the occurrence of delayed graft function

Delayed Graft Function (DGF) is a prevalent complication in kidney transplantation (KT) that significantly affects allograft function and patient prognosis. Early and precise identification of DGF is crucial for improving post-transplant outcomes. In this study, we present KGnet, a predictive model leveraging hyperspectral imaging (HSI) to assess delayed graft function status. We analyzed 72 zero-hour biopsy samples from transplanted kidneys with confirmed pathological diagnoses, capturing spectral data across a wavelength range of 400 to 1000 nm. By examining spectral signatures related to tissue oxygenation, perfusion, and metabolic states, our approach enabled the detection of subtle biochemical changes indicative of DGF risk. The preprocessed spectral data were input into KGnet, achieving a prediction accuracy of 94 % for DGF occurrence, significantly outperforming existing predictive models. This study identifies key spectral signatures associated with DGF, allowing for precise risk prediction even before clinical symptoms emerge. Leveraging HSI for early detection introduces a novel pathway for individualized post-transplant management, offering substantial potential to enhance kidney transplantation outcomes and patient quality of life. These findings highlight significant clinical and research implications for the broader application of HSI in transplant medicine.

Advancing hyperspectral imaging and machine learning tools toward clinical adoption in tissue diagnostics: A comprehensive review

Hyperspectral imaging (HSI) has become an evident transformative apparatus in medical diagnostics. The review aims to appraise the present advancement and challenges in HSI for medical applications. It features a variety of medical applications namely diagnosing diabetic retinopathy, neurodegenerative diseases like Parkinson's and Alzheimer's, which illustrates its effectiveness in early diagnosis, early caries detection in periodontal disease, and dermatology by detecting skin cancer. Regardless of these advances, the challenges exist within every aspect that limits its broader clinical adoption. It has various constraints including difficulties with technology related to the complexity of the HSI system and needing specialist training, which may act as a drawback to its clinical settings. This article pertains to potential challenges expressed in medical applications and probable solutions to overcome these constraints. Successful companies that perform advanced solutions with HSI in terms of medical applications are being emphasized in this study to signal the high level of interest in medical diagnosis for systems to incorporate machine learning ML and artificial intelligence AI to foster precision diagnosis and standardized clinical workflow. This advancement signifies progressive possibilities of HSI in real-time clinical assessments. In conclusion despite HSI has been presented as a significant advanced medical imaging tool, addressing its limitations and probable solutions is for broader clinical adoption.

Advancements in Hyperspectral Imaging and Computer-Aided Diagnostic Methods for the Enhanced Detection and Diagnosis of Head and Neck Cancer

Background/Objectives: Head and neck cancer (HNC), predominantly squamous cell carcinoma (SCC), presents a significant global health burden. Conventional diagnostic approaches often face challenges in terms of achieving early detection and accurate diagnosis. This review examines recent advancements in hyperspectral imaging (HSI), integrated with computer-aided diagnostic (CAD) techniques, to enhance HNC detection and diagnosis. Methods: A systematic review of seven rigorously selected studies was performed. We focused on CAD algorithms, such as convolutional neural networks (CNNs), support vector machines (SVMs), and linear discriminant analysis (LDA). These are applicable to the hyperspectral imaging of HNC tissues. Results: The meta-analysis findings indicate that LDA surpasses other algorithms, achieving an accuracy of 92%, sensitivity of 91%, and specificity of 93%. CNNs exhibit moderate performance, with an accuracy of 82%, sensitivity of 77%, and specificity of 86%. SVMs demonstrate the lowest performance, with an accuracy of 76% and sensitivity of 48%, but maintain a high specificity level at 89%. Additionally, in vivo studies demonstrate superior performance when compared to ex vivo studies, reporting higher accuracy (81%), sensitivity (83%), and specificity (79%). Conclusion: Despite these promising findings, challenges persist, such as HSI's sensitivity to external conditions, the need for high-resolution and high-speed imaging, and the lack of comprehensive spectral databases. Future research should emphasize dimensionality reduction techniques, the integration of multiple machine learning models, and the development of extensive spectral libraries to enhance HSI's clinical utility in HNC diagnostics. This review underscores the transformative potential of HSI and CAD techniques in revolutionizing HNC diagnostics, facilitating more accurate and earlier detection, and improving patient outcomes.

Technological Frontiers in Brain Cancer: A Systematic Review and Meta-Analysis of Hyperspectral Imaging in Computer-Aided Diagnosis Systems

Brain cancer is a substantial factor in the mortality associated with cancer, presenting difficulties in the timely identification of the disease. The precision of diagnoses is significantly dependent on the proficiency of radiologists and neurologists. Although there is potential for early detection with computer-aided diagnosis (CAD) algorithms, the majority of current research is hindered by its modest sample sizes. This meta-analysis aims to comprehensively assess the diagnostic test accuracy (DTA) of computer-aided design (CAD) models specifically designed for the detection of brain cancer utilizing hyperspectral (HSI) technology. We employ Quadas-2 criteria to choose seven papers and classify the proposed methodologies according to the artificial intelligence method, cancer type, and publication year. In order to evaluate heterogeneity and diagnostic performance, we utilize Deeks' funnel plot, the forest plot, and accuracy charts. The results of our research suggest that there is no notable variation among the investigations. The CAD techniques that have been examined exhibit a notable level of precision in the automated detection of brain cancer. However, the absence of external validation hinders their potential implementation in real-time clinical settings. This highlights the necessity for additional studies in order to authenticate the CAD models for wider clinical applicability.

Surgical optomics: hyperspectral imaging and deep learning towards precision intraoperative automatic tissue recognition-results from the EX-MACHYNA trial

BACKGROUND

Hyperspectral imaging (HSI), combined with machine learning, can help to identify characteristic tissue signatures enabling automatic tissue recognition during surgery. This study aims to develop the first HSI-based automatic abdominal tissue recognition with human data in a prospective bi-center setting.

METHODS

Data were collected from patients undergoing elective open abdominal surgery at two international tertiary referral hospitals from September 2020 to June 2021. HS images were captured at various time points throughout the surgical procedure. Resulting RGB images were annotated with 13 distinct organ labels. Convolutional Neural Networks (CNNs) were employed for the analysis, with both external and internal validation settings utilized.

RESULTS

A total of 169 patients were included, 73 (43.2%) from Strasbourg and 96 (56.8%) from Verona. The internal validation within centers combined patients from both centers into a single cohort, randomly allocated to the training (127 patients, 75.1%, 585 images) and test sets (42 patients, 24.9%, 181 images). This validation setting showed the best performance. The highest true positive rate was achieved for the skin (100%) and the liver (97%). Misclassifications included tissues with a similar embryological origin (omentum and mesentery: 32%) or with overlaying boundaries (liver and hepatic ligament: 22%). The median DICE score for ten tissue classes exceeded 80%.

CONCLUSION

To improve automatic surgical scene segmentation and to drive clinical translation, multicenter accurate HSI datasets are essential, but further work is needed to quantify the clinical value of HSI. HSI might be included in a new omics science, namely surgical optomics, which uses light to extract quantifiable tissue features during surgery.

Study on an Automatic Classification Method for Determining the Malignancy Grade of Glioma Pathological Sections Based on Hyperspectral Multi-Scale Spatial-Spectral Fusion Features

This study describes a novel method for grading pathological sections of gliomas. Our own integrated hyperspectral imaging system was employed to characterize 270 bands of cancerous tissue samples from microarray slides of gliomas. These samples were then classified according to the guidelines developed by the World Health Organization, which define the subtypes and grades of diffuse gliomas. We explored a hyperspectral feature extraction model called SMLMER-ResNet using microscopic hyperspectral images of brain gliomas of different malignancy grades. The model combines the channel attention mechanism and multi-scale image features to automatically learn the pathological organization of gliomas and obtain hierarchical feature representations, effectively removing the interference of redundant information. It also completes multi-modal, multi-scale spatial-spectral feature extraction to improve the automatic classification of glioma subtypes. The proposed classification method demonstrated high average classification accuracy (>97.3%) and a Kappa coefficient (0.954), indicating its effectiveness in improving the automatic classification of hyperspectral gliomas. The method is readily applicable in a wide range of clinical settings, offering valuable assistance in alleviating the workload of clinical pathologists. Furthermore, the study contributes to the development of more personalized and refined treatment plans, as well as subsequent follow-up and treatment adjustment, by providing physicians with insights into the underlying pathological organization of gliomas.

Artificial Intelligence and Pathomics: Prostate Cancer

Artificial intelligence (AI) has the potential to transform pathologic diagnosis and cancer patient management as a predictive and prognostic biomarker. AI-based systems can be used to examine digitally scanned histopathology slides and differentiate benign from malignant cells and low from high grade. Deep learning models can analyze patient data from individual or multimodal combinations and identify patterns to be used to predict the response to different therapeutic options, the risk of recurrence or progression, and the prognosis of the newly diagnosed patient. AI-based models will improve treatment planning for patients with prostate cancer and improve the efficiency and cost-effectiveness of the pathology laboratory.

Pediatric Brain Tissue Segmentation Using a Snapshot Hyperspectral Imaging (sHSI) Camera and Machine Learning Classifier

Pediatric brain tumors are the second most common type of cancer, accounting for one in four childhood cancer types. Brain tumor resection surgery remains the most common treatment option for brain cancer. While assessing tumor margins intraoperatively, surgeons must send tissue samples for biopsy, which can be time-consuming and not always accurate or helpful. Snapshot hyperspectral imaging (sHSI) cameras can capture scenes beyond the human visual spectrum and provide real-time guidance where we aim to segment healthy brain tissues from lesions on pediatric patients undergoing brain tumor resection. With the institutional research board approval, Pro00011028, 139 red-green-blue (RGB), 279 visible, and 85 infrared sHSI data were collected from four subjects with the system integrated into an operating microscope. A random forest classifier was used for data analysis. The RGB, infrared sHSI, and visible sHSI models achieved average intersection of unions (IoUs) of 0.76, 0.59, and 0.57, respectively, while the tumor segmentation achieved a specificity of 0.996, followed by the infrared HSI and visible HSI models at 0.93 and 0.91, respectively. Despite the small dataset considering pediatric cases, our research leveraged sHSI technology and successfully segmented healthy brain tissues from lesions with a high specificity during pediatric brain tumor resection procedures.

Systematic meta-analysis of computer-aided detection to detect early esophageal cancer using hyperspectral imaging

One of the leading causes of cancer deaths is esophageal cancer (EC) because identifying it in early stage is challenging. Computer-aided diagnosis (CAD) could detect the early stages of EC have been developed in recent years. Therefore, in this study, complete meta-analysis of selected studies that only uses hyperspectral imaging to detect EC is evaluated in terms of their diagnostic test accuracy (DTA). Eight studies are chosen based on the Quadas-2 tool results for systematic DTA analysis, and each of the methods developed in these studies is classified based on the nationality of the data, artificial intelligence, the type of image, the type of cancer detected, and the year of publishing. Deeks' funnel plot, forest plot, and accuracy charts were made. The methods studied in these articles show the automatic diagnosis of EC has a high accuracy, but external validation, which is a prerequisite for real-time clinical applications, is lacking.

HeiPorSPECTRAL - the Heidelberg Porcine HyperSPECTRAL Imaging Dataset of 20 Physiological Organs

Hyperspectral Imaging (HSI) is a relatively new medical imaging modality that exploits an area of diagnostic potential formerly untouched. Although exploratory translational and clinical studies exist, no surgical HSI datasets are openly accessible to the general scientific community. To address this bottleneck, this publication releases HeiPorSPECTRAL ( https://www.heiporspectral.org ; https://doi.org/10.5281/zenodo.7737674 ), the first annotated high-quality standardized surgical HSI dataset. It comprises 5,758 spectral images acquired with the TIVITA® Tissue and annotated with 20 physiological porcine organs from 8 pigs per organ distributed over a total number of 11 pigs. Each HSI image features a resolution of 480 × 640 pixels acquired over the 500-1000 nm wavelength range. The acquisition protocol has been designed such that the variability of organ spectra as a function of several parameters including the camera angle and the individual can be assessed. A comprehensive technical validation confirmed both the quality of the raw data and the annotations. We envision potential reuse within this dataset, but also its reuse as baseline data for future research questions outside this dataset. Measurement(s) Spectral Reflectance Technology Type(s) Hyperspectral Imaging Sample Characteristic - Organism Sus scrofa.

Emerging Technology for Intraoperative Margin and Assisting in Post-Surgery tissue diagnostic for Future Breast-Conserving

INTRODUCTION

Tissue-preserving surgery is utilized progressively in cancer therapy, where a clear surgical margin is critical to avoid cancer recurrence, specifically in breast cancer (BC) surgery. The Intraoperative pathologic approaches that rely on tissue segmenting and staining have been recognized as the ground truth for BC diagnosis. Nevertheless, these methods are constrained by its complication and timewasting for tissue preparation.

OBJECTIVE

We present a non-invasive optical imaging system incorporating a hyperspectral (HS) camera to discriminate between cancerous and non-cancerous tissues in ex-vivo breast specimens, which could be an intraoperative diagnostic technique to aid surgeons during surgery and later a valuable tool to assist pathologists.

METHODS

We have established a hyperspectral Imaging (HSI) system comprising a push-broom HS camera at wavelength 380∼1050 nm with source light 390∼980 nm. We have measured the investigated samples' diffuse reflectance (R_d), fixed on slides from 30 distinct patients incorporating mutually normal and ductal carcinoma tissue. The samples were divided into two groups, stained tissues during the surgery (control group) and unstained samples (test group), both captured with the HSI system in the visible and near-infrared (VIS-NIR) range. Then, to address the problem of the spectral nonuniformity of the illumination device and the influence of the dark current, the radiance data were normalized to yield the radiance of the specimen and neutralize the intensity effect to focus on the spectral reflectance shift for each tissue. The selection of the threshold window from the measured R_d is carried out by exploiting the statistical analysis by calculating each region's mean and standard deviation. Afterward, we selected the optimum spectral images from the HS data cube to apply a custom K-means algorithm and contour delineation to identify the regular districts from the BC regions.

RESULTS

We noticed that the measured spectral R_d for the malignant tissues of the investigated case studies versus the reference source light varies regarding the cancer stage, as sometimes the R_d is higher for the tumor or vice versa for the normal tissue. Later, from the analysis of the whole samples, we found that the most appropriate wavelength for the BC tissues was 447 nm, which was highly reflected versus the normal tissue. However, the most convenient one for the normal tissue was at 545 nm with high reflection versus the BC tissue. Finally, we implement a moving average filter for noise reduction and a custom K-means clustering algorithm on the selected two spectral images (447, 551 nm) to identify the various regions and effectively-identified spectral tissue variations with a sensitivity of 98.95%, and specificity of 98.44%. A pathologist later confirmed these outcomes as the ground truth for the tissue sample investigations.

CONCLUSIONS

The proposed system could help the surgeon and the pathologist identify the cancerous tissue margins from the non-cancerous tissue with a non-invasive, rapid, and minimum time method achieving high sensitivity up to 98.95%.

Estimating quantitative physiological and morphological tissue parameters of murine tumor models using hyperspectral imaging and optical profilometry

Understanding tumors and their microenvironment are essential for successful and accurate disease diagnosis. Tissue physiology and morphology are altered in tumors compared to healthy tissues, and there is a need to monitor tumors and their surrounding tissues, including blood vessels, non-invasively. This preliminary study utilizes a multimodal optical imaging system combining hyperspectral imaging (HSI) and three-dimensional (3D) optical profilometry (OP) to capture hyperspectral images and surface shapes of subcutaneously grown murine tumor models. Hyperspectral images are corrected with 3D OP data and analyzed using the inverse-adding doubling (IAD) method to extract tissue properties such as melanin volume fraction and oxygenation. Blood vessels are segmented using the B-COSFIRE algorithm from oxygenation maps. From 3D OP data, tumor volumes are calculated and compared to manual measurements using a vernier caliper. Results show that tumors can be distinguished from healthy tissue based on most extracted tissue parameters ( p < 0.05 ). Furthermore, blood oxygenation is 50% higher within the blood vessels than in the surrounding tissue, and tumor volumes calculated using 3D OP agree within 26% with manual measurements using a vernier caliper. Results suggest that combining HSI and OP could provide relevant quantitative information about tumors and improve the disease diagnosis.

Signal to noise ratio quantifies the contribution of spectral channels to classification of human head and neck tissues ex vivo using deep learning and multispectral imaging

SIGNIFICANCE

Accurate identification of tissues is critical for performing safe surgery. Combining multispectral imaging (MSI) with deep learning is a promising approach to increasing tissue discrimination and classification. Evaluating the contributions of spectral channels to tissue discrimination is important for improving MSI systems.

AIM

Develop a metric to quantify the contributions of individual spectral channels to tissue classification in MSI.

APPROACH

MSI was integrated into a digital operating microscope with three sensors and seven illuminants. Two convolutional neural network (CNN) models were trained to classify 11 head and neck tissue types using white light (RGB) or MSI images. The signal to noise ratio (SNR) of spectral channels was compared with the impact of channels on tissue classification performance as determined using CNN visualization methods.

RESULTS

Overall tissue classification accuracy was higher with use of MSI images compared with RGB images, both for classification of all 11 tissue types and binary classification of nerve and parotid ( p < 0.001 ). Removing spectral channels with SNR > 20 reduced tissue classification accuracy.

CONCLUSIONS

The spectral channel SNR is a useful metric for both understanding CNN tissue classification and quantifying the contributions of different spectral channels in an MSI system.

Visible near-infrared hyperspectral imaging and supervised classification for the detection of small intestinal necrosis tissue in vivo

Complete recognition of necrotic areas during small bowel tissue resection remains challenging due to the lack of optimal intraoperative aid identification techniques. This research utilizes hyperspectral imaging techniques to automatically distinguish normal and necrotic areas of small intestinal tissue. Sample data were obtained from the animal model of small intestinal tissue of eight Japanese large-eared white rabbits developed by experienced physicians. A spectral library of normal and necrotic regions of small intestinal tissue was created and processed using six different supervised classification algorithms. The results show that hyperspectral imaging combined with supervised classification algorithms can be a suitable technique to automatically distinguish between normal and necrotic areas of small intestinal tissue. This new technique could aid physicians in objectively identify normal and necrotic areas of small intestinal tissue.

Automatic optical biopsy for colorectal cancer using hyperspectral imaging and artificial neural networks

BACKGROUND

Intraoperative identification of cancerous tissue is fundamental during oncological surgical or endoscopic procedures. This relies on visual assessment supported by histopathological evaluation, implying a longer operative time. Hyperspectral imaging (HSI), a contrast-free and contactless imaging technology, provides spatially resolved spectroscopic analysis, with the potential to differentiate tissue at a cellular level. However, HSI produces "big data", which is impossible to directly interpret by clinicians. We hypothesize that advanced machine learning algorithms (convolutional neural networks-CNNs) can accurately detect colorectal cancer in HSI data.

METHODS

In 34 patients undergoing colorectal resections for cancer, immediately after extraction, the specimen was opened, the tumor-bearing section was exposed and imaged using HSI. Cancer and normal mucosa were categorized from histopathology. A state-of-the-art CNN was developed to automatically detect regions of colorectal cancer in a hyperspectral image. Accuracy was validated with three levels of cross-validation (twofold, fivefold, and 15-fold).

RESULTS

32 patients had colorectal adenocarcinomas confirmed by histopathology (9 left, 11 right, 4 transverse colon, and 9 rectum). 6 patients had a local initial stage (T1-2) and 26 had a local advanced stage (T3-4). The cancer detection performance of the CNN using 15-fold cross-validation showed high sensitivity and specificity (87% and 90%, respectively) and a ROC-AUC score of 0.95 (considered outstanding). In the T1-2 group, the sensitivity and specificity were 89% and 90%, respectively, and in the T3-4 group, the sensitivity and specificity were 81% and 93%, respectively.

CONCLUSIONS

Automatic colorectal cancer detection on fresh specimens using HSI, using a properly trained CNN is feasible and accurate, even with small datasets, regardless of the local tumor extension. In the near future, this approach may become a useful intraoperative tool during oncological endoscopic and surgical procedures, and may result in precise and non-destructive optical biopsies to support objective and consistent tumor-free resection margins.

Recent Advances in Counterfeit Art, Document, Photo, Hologram, and Currency Detection Using Hyperspectral Imaging

Forgery and tampering continue to provide unnecessary economic burdens. Although new anti-forgery and counterfeiting technologies arise, they inadvertently lead to the sophistication of forgery techniques over time, to a point where detection is no longer viable without technological aid. Among the various optical techniques, one of the recently used techniques to detect counterfeit products is HSI, which captures a range of electromagnetic data. To aid in the further exploration and eventual application of the technique, this study categorizes and summarizes existing related studies on hyperspectral imaging and creates a mini meta-analysis of this stream of literature. The literature review has been classified based on the product HSI has used in counterfeit documents, photos, holograms, artwork, and currency detection.

Label-free hyperspectral imaging and deep-learning prediction of retinal amyloid β-protein and phosphorylated tau

Alzheimer's disease (AD) is a major risk for the aging population. The pathological hallmarks of AD-an abnormal deposition of amyloid β-protein (Aβ) and phosphorylated tau (pTau)-have been demonstrated in the retinas of AD patients, including in prodromal patients with mild cognitive impairment (MCI). Aβ pathology, especially the accumulation of the amyloidogenic 42-residue long alloform (Aβ42), is considered an early and specific sign of AD, and together with tauopathy, confirms AD diagnosis. To visualize retinal Aβ and pTau, state-of-the-art methods use fluorescence. However, administering contrast agents complicates the imaging procedure. To address this problem from fundamentals, ex-vivo studies were performed to develop a label-free hyperspectral imaging method to detect the spectral signatures of Aβ42 and pS396-Tau, and predicted their abundance in retinal cross-sections. For the first time, we reported the spectral signature of pTau and demonstrated an accurate prediction of Aβ and pTau distribution powered by deep learning. We expect our finding will lay the groundwork for label-free detection of AD.

Spectral organ fingerprints for machine learning-based intraoperative tissue classification with hyperspectral imaging in a porcine model

Visual discrimination of tissue during surgery can be challenging since different tissues appear similar to the human eye. Hyperspectral imaging (HSI) removes this limitation by associating each pixel with high-dimensional spectral information. While previous work has shown its general potential to discriminate tissue, clinical translation has been limited due to the method's current lack of robustness and generalizability. Specifically, the scientific community is lacking a comprehensive spectral tissue atlas, and it is unknown whether variability in spectral reflectance is primarily explained by tissue type rather than the recorded individual or specific acquisition conditions. The contribution of this work is threefold: (1) Based on an annotated medical HSI data set (9059 images from 46 pigs), we present a tissue atlas featuring spectral fingerprints of 20 different porcine organs and tissue types. (2) Using the principle of mixed model analysis, we show that the greatest source of variability related to HSI images is the organ under observation. (3) We show that HSI-based fully-automatic tissue differentiation of 20 organ classes with deep neural networks is possible with high accuracy (> 95%). We conclude from our study that automatic tissue discrimination based on HSI data is feasible and could thus aid in intraoperative decisionmaking and pave the way for context-aware computer-assisted surgery systems and autonomous robotics.

Hyperspectral evaluation of vasculature in induced peritonitis mouse models

Imaging of blood vessel structure in combination with functional information about blood oxygenation can be important in characterizing many different health conditions in which the growth of new vessels contributes to the overall condition. In this paper, we present a method for extracting comprehensive maps of the vasculature from hyperspectral images that include tissue and vascular oxygenation. We also show results from a preclinical study of peritonitis in mice. First, we analyze hyperspectral images using Beer-Lambert exponential attenuation law to obtain maps of hemoglobin species throughout the sample. We then use an automatic segmentation algorithm to extract blood vessels from the hemoglobin map and combine them into a vascular structure-oxygenation map. We apply this methodology to a series of hyperspectral images of the abdominal wall of mice with and without induced peritonitis. Peritonitis is an inflammation of peritoneum that leads, if untreated, to complications such as peritoneal sclerosis and even death. Characteristic inflammatory response can also be accompanied by changes in vasculature, such as neoangiogenesis. We demonstrate a potential application of the proposed segmentation and processing method by introducing an abnormal tissue fraction metric that quantifies the amount of tissue that deviates from the average values of healthy controls. It is shown that the proposed metric successfully discriminates between healthy control subjects and model subjects with induced peritonitis and has a high statistical significance.

Raman hyperspectral imaging coupled to three-dimensional discriminant analysis: Classification of meningiomas brain tumour grades

Meningiomas remains a clinical dilemma. They are the commonest "benign" types of brain tumours and, although being typically benign, they are divided into three WHO grades categories (I, II and III) which are associated with the tumour growth rate and likelihood of recurrence. Recurrence depends on extend of surgery as well as histopathological diagnosis. There is a marked variation amongst surgeons in the follow-up arrangements for their patients even within the same unit which has a significant clinical, and financial implication. Knowing the tumour grade rapidly is an important factor to predict surgical outcomes and adequate patient treatment. Clinical follow up sometimes is haphazard and not based on clear evidence. Spectrochemical techniques are a powerful tool for cancer diagnostics. Raman hyperspectral imaging is able to generate spatially-distributed spectrochemical signatures with great sensitivity. Using this technique, 95 brain tissue samples (66 meningiomas WHO grade I, 24 meningiomas WHO grade II and 5 meningiomas that reoccurred) were analysed in order to discriminate grade I and grade II samples. Newly-developed three-dimensional discriminant analysis algorithms were used to process the hyperspectral imaging data in a 3D fashion. Three-dimensional principal component analysis quadratic discriminant analysis (3D-PCA-QDA) was able to distinguish grade I and grade II meningioma samples with 96% test accuracy (100% sensitivity and 95% specificity). This technique is here shown to be a high-throughput, reagent-free, non-destructive, and can give accurate predictive information regarding the meningioma tumour grade, hence, having enormous clinical potential with regards to being developed for intra-operative real-time assessment of disease.

Multi-Task Interaction Learning for Spatiospectral Image Super-Resolution

High spatial resolution and high spectral resolution images (HR-HSIs) are widely applied in geosciences, medical diagnosis, and beyond. However, how to get images with both high spatial resolution and high spectral resolution is still a problem to be solved. In this paper, we present a deep spatial-spectral feature interaction network (SSFIN) for reconstructing an HR-HSI from a low-resolution multispectral image (LR-MSI), e.g., RGB image. In particular, we introduce two auxiliary tasks, i.e., spatial super-resolution (SR) and spectral SR to help the network recover the HR-HSI better. Since higher spatial resolution can provide more detailed information about image texture and structure, and richer spectrum can provide more attribute information, we propose a spatial-spectral feature interaction block (SSFIB) to make the spatial SR task and the spectral SR task benefit each other. Therefore, we can make full use of the rich spatial and spectral information extracted from the spatial SR task and spectral SR task, respectively. Moreover, we use a weight decay strategy (for the spatial and spectral SR tasks) to train the SSFIN, so that the model can gradually shift attention from the auxiliary tasks to the primary task. Both quantitative and visual results on three widely used HSI datasets demonstrate that the proposed method achieves a considerable gain compared to other state-of-the-art methods. Source code is available at https://github.com/junjun-jiang/SSFIN.

Identification of DAPI-stained normal, inflammatory, and carcinoma hepatic cells based on hyperspectral microscopy

Gross chromatin imbalance and high DNA content are distinct features of various types of cancer cells. However, severe inflammation can also produce similar symptoms in cells. In this study, normal, inflammatory, and carcinoma hepatic cells were stained with 4',6-diamidino-2-phenylindole (DAPI) and investigated by hyperspectral microscopy. DAPI is a DNA-sensitive fluorochrome. Therefore, the differences in the cellular DNA of the samples can be revealed by the corresponding fluorescence. Our experimental results demonstrate that although chromosomal disorder and high DNA content both occur in severely inflammatory and carcinoma hepatic cells, there is still a slight difference in their DNA, making their fluorescent intensity and even their spectral shapes distinguishable. Based on these spectral features, we developed a method for the precise identification of normal, inflammatory, and carcinoma hepatic cells in the field of view. The identification accuracy for these three types of cells was 99.8%. We believe that examination that combines DAPI staining with hyperspectral microscopy is a potential method for the identification and investigation of various types of cancer tissues.

Tumor cell identification and classification in esophageal adenocarcinoma specimens by hyperspectral imaging

Esophageal cancer is the sixth leading cause of cancer-related death worldwide. Histopathological confirmation is a key step in tumor diagnosis. Therefore, simplification in decision-making by discrimination between malignant and non-malignant cells of histological specimens can be provided by combination of new imaging technology and artificial intelligence (AI). In this work, hyperspectral imaging (HSI) data from 95 patients were used to classify three different histopathological features (squamous epithelium cells, esophageal adenocarcinoma (EAC) cells, and tumor stroma cells), based on a multi-layer perceptron with two hidden layers. We achieved an accuracy of 78% for EAC and stroma cells, and 80% for squamous epithelium. HSI combined with machine learning algorithms is a promising and innovative technique, which allows image acquisition beyond Red–Green–Blue (RGB) images. Further method validation and standardization will be necessary, before automated tumor cell identification algorithms can be used in daily clinical practice.

LED-based Hyperspectral Endoscopic Imaging

Hyperspectral endoscopy can offer multiple advantages as compared to conventional endoscopy. Our goal is to design and develop a real-time hyperspectral endoscopic imaging system for the diagnosis of gastrointestinal (GI) tract cancers using a micro-LED array as an in-situ illumination source. The wavelengths of the system range from ultraviolet to visible and near infrared. To evaluate the use of the LED array for hyperspectral imaging, we designed a prototype system and conducted ex vivo experiments using normal and cancerous tissues of mice, chicken, and sheep. We compared the results of our LED-based approach with our reference hyperspectral camera system. The results confirm the similarity between the LED-based hyperspectral imaging system and the reference HSI camera. Our LED-based hyperspectral imaging system can be used not only as an endoscope but also as a laparoscopic or handheld devices for cancer detection and surgery.

Automatic detection of basal cell carcinoma by hyperspectral imaging

The purpose of this study was to test the ability of hyperspectral imaging (HSI) combined with unsupervised anomaly detectors to automatically differentiate basal cell carcinoma (BCC) from normal skin. Hyperspectral images of the face of a female patient with a BCC of the lower lip were acquired using a visible/near-infrared HSI system and two anomaly detection algorithms (Reed-Xiaoli and Reed-Xiaoli/Uniform Target hybrid anomaly detectors) were used to detect pathological tissue from normal skin. The results revealed that the receiver operating characteristic curve of the Reed-Xiaoli/Uniform Target hybrid detector was higher than that of the Reed-Xiaoli detector in the range of false positive rates between 0 and 0.8. The area under curve values were good (0.7074 and 0.8607, respectively) with Reed-Xiaoli/Uniform Target hybrid detector performing better. In conclusion, HSI combined with either of two anomaly detectors can play a promising role in the automated screening of BCC.

Artificial Intelligence in Brain Tumour Surgery-An Emerging Paradigm

Artificial intelligence (AI) platforms have the potential to cause a paradigm shift in brain tumour surgery. Brain tumour surgery augmented with AI can result in safer and more effective treatment. In this review article, we explore the current and future role of AI in patients undergoing brain tumour surgery, including aiding diagnosis, optimising the surgical plan, providing support during the operation, and better predicting the prognosis. Finally, we discuss barriers to the successful clinical implementation, the ethical concerns, and we provide our perspective on how the field could be advanced.

Deep Learning Analysis of In Vivo Hyperspectral Images for Automated Intraoperative Nerve Detection

Nerves are critical structures that may be difficult to recognize during surgery. Inadvertent nerve injuries can have catastrophic consequences for the patient and lead to life-long pain and a reduced quality of life. Hyperspectral imaging (HSI) is a non-invasive technique combining photography with spectroscopy, allowing non-invasive intraoperative biological tissue property quantification. We show, for the first time, that HSI combined with deep learning allows nerves and other tissue types to be automatically recognized in in vivo hyperspectral images. An animal model was used, and eight anesthetized pigs underwent neck midline incisions, exposing several structures (nerve, artery, vein, muscle, fat, skin). State-of-the-art machine learning models were trained to recognize these tissue types in HSI data. The best model was a convolutional neural network (CNN), achieving an overall average sensitivity of 0.91 and a specificity of 1.0, validated with leave-one-patient-out cross-validation. For the nerve, the CNN achieved an average sensitivity of 0.76 and a specificity of 0.99. In conclusion, HSI combined with a CNN model is suitable for in vivo nerve recognition.

Optical coherence hyperspectral microscopy with a single supercontinuum light source

In the paper, we have developed an optical coherence hyperspectral microscopy with a single supercontinuum light source. The microscopy consists of optical coherence tomography (OCT) and hyperspectral imaging (HSI), which can visualize the structural and functional characteristics of biological tissues. The 500 to 700 nm band is selected for HSI and OCT imaging, where HSI enables imaging of oxygen saturation and hemoglobin (Hb) content, while OCT acquires structural characteristics to assess the morphology of biological tissues. The system performance of the optical coherence hyperspectral microscopy is verified by normal mice ears, and the practical applications of the microscopy is further performed in 4T1 and inflammation Balb/c mice ears in vivo. The experimental results demonstrate that the microscopy has potential to provide complementary information for clinical applications.

Protocol for Creating Antibodies with Complex Fluorescence Spectra

Fluorescent antibodies are a workhorse of biomedical science, but fluorescence multiplexing has been notoriously difficult due to spectral overlap between fluorophores. We recently established proof-of-principal for fluorescence Multiplexing using Spectral Imaging and Combinatorics (MuSIC), which uses combinations of existing fluorophores to create unique spectral signatures for increased multiplexing. However, a method for labeling antibodies with MuSIC probes has not yet been developed. Here, we present a method for labeling antibodies with MuSIC probes. We conjugate a DBCO-Peg5-NHS ester linker to antibodies and a single-stranded DNA "docking strand" to the linker and, finally, hybridize two MuSIC-compatible, fluorescently labeled oligos to the docking strand. We validate the labeling protocol with spin-column purification and absorbance measurements. We demonstrate the approach using (i) Cy3, (ii) Tex615, and (iii) a Cy3-Tex615 combination as three different MuSIC probes attached to three separate batches of antibodies. We created single-, double-, and triple-positive beads that are analogous to single cells by incubating MuSIC probe-labeled antibodies with protein A beads. Spectral flow cytometry experiments demonstrate that each MuSIC probe can be uniquely distinguished, and the fraction of beads in a mixture with different staining patterns are accurately inferred. The approach is general and might be more broadly applied to cell-type profiling or tissue heterogeneity studies in clinical, biomedical, and drug discovery research.

Diagnosis of cholangiocarcinoma from microscopic hyperspectral pathological dataset by deep convolution neural networks

This paper focuses on automatic Cholangiocarcinoma (CC) diagnosis from microscopic hyperspectral (HSI) pathological dataset with deep learning method. The first benchmark based on the microscopic hyperspectral pathological images is set up. Particularly, 880 scenes of multidimensional hyperspectral Cholangiocarcinoma images are collected and manually labeled each pixel as either tumor or non-tumor for supervised learning. Moreover, each scene from the slide is given a binary label indicating whether it is from a patient or a normal person. Different from traditional RGB images, the HSI acquires pixels in multiple spectral intervals, which is added as an extension on the channel dimension of 3-channel RGB image. This work aims at fully exploiting the spatial-spectral HSI data through a deep Convolution Neural Network (CNN). The whole scene is first divided into several patches. Then they are fed into CNN for the tumor/non-tumor binary prediction and the tumor area regression. The further diagnosis on the scene is made by random forest based on the features from patch prediction. Experiments show that HSI provides a more accurate result than RGB image. Moreover, a spectral interval convolution and normalization scheme are proposed for further mining the spectral information in HSI, which demonstrates the effectiveness of the spatial-spectral data for CC diagnosis.

Hyperspectral image-based analysis of thermal damage for ex-vivo bovine liver utilizing radiofrequency ablation

BACKGROUND & OBJECTIVE

Thermal ablation is the predominant methodology to treat liver tumors for segregating patients who are not permitted to have surgical intervention. However, noticing or predicting the size of the thermal strategies is a challenging endeavor. We aim to analyze the effects of ablation district volume following radiofrequency ablation (RFA) of ex-vivo liver exploiting a custom Hyperspectral Imaging (HSI) system.

MATERIALS AND METHODS

RFA was conducted on the ex-vivo bovine liver at focal and peripheral blood vessel sites and observed by Custom HSI system, which has been designed to assess the exactness and proficiency using visible and near-infrared wavelengths region for tissue thermal effect. The experiment comprised up to ten trials with RFA. The experiment was carried out in two stages to assess the percentage of the thermal effect on the investigated sample superficially and for the side penetration effect. Measuring the diffuse reflectance (Ŗ_d) of the sample to identify the spectral reflectance shift which could differentiate between normal and ablated tissue exploiting the designed cross-correlation algorithm for monitoring of thermal ablation.

RESULTS

Determination of the diffuse reflection (Ŗ_d) spectral signature responses from normal, thermal effected, and thermal ablation regions of the investigated liver sample. Where the ideal wavelength range at (600-640 nm) could discriminate between these different regions. Then, exploited the converted RGB image of the HS liver tissue after RFA for more validations which shows that the optimum wavelength for differentiation at (530-560 nm and 600-640 nm). Finally, applying statistical analysis to validate our results presenting that wavelength 600 nm had the highest standard deviation (δ) to differentiate between various thermally affected regions regarding the normal tissue and wavelength 640 nm shows the highest (δ) to differentiate between the ablated and normal regions.

CONCLUSION

The designed and implemented medical imaging system incorporated the hyperspectral camera capabilities with the associate cross-correlation algorithm that could successfully distinguish between the ablated and thermally affected regions to assist the surgery during the tumor therapy.

Tongue Tumor Detection in Hyperspectral Images Using Deep Learning Semantic Segmentation

OBJECTIVE

The utilization of hyperspectral imaging (HSI) in real-time tumor segmentation during a surgery have recently received much attention, but it remains a very challenging task.

METHODS

In this work, we propose semantic segmentation methods, and compare them with other relevant deep learning algorithms for tongue tumor segmentation. To the best of our knowledge, this is the first work using deep learning semantic segmentation for tumor detection in HSI data using channel selection, and accounting for more spatial tissue context, and global comparison between the prediction map, and the annotation per sample. Results, and Conclusion: On a clinical data set with tongue squamous cell carcinoma, our best method obtains very strong results of average dice coefficient, and area under the ROC-curve of [Formula: see text], and [Formula: see text], respectively on the original spatial image size. The results show that a very good performance can be achieved even with a limited amount of data. We demonstrate that important information regarding tumor decision is encoded in various channels, but some channel selection, and filtering is beneficial over the full spectra. Moreover, we use both visual (VIS), and near-infrared (NIR) spectrum, rather than commonly used only VIS spectrum; although VIS spectrum is generally of higher significance, we demonstrate NIR spectrum is crucial for tumor capturing in some cases.

SIGNIFICANCE

The HSI technology augmented with accurate deep learning algorithms has a huge potential to be a promising alternative to digital pathology or a doctors' supportive tool in real-time surgeries.

Integration of transcriptomes analysis with spectral signature of total RNA for generation of affordable remote sensing of Hepatocellular carcinoma in serum clinical specimens

Hepatocellular carcinoma (HCC) is a major global health problem with about 841,000 new cases and 782,000 deaths annually, due to lacking early biomarker/s, and centralized diagnosis. Transcriptomes research despite its infancy has proved excellence in its implementation in identifying a coherent specific cancer RNAs differential expression. However, results are sometimes overlapped by other cancer types which negatively affecting specificity, plus the high cost of the equipment used. Hyperspectral imaging (HSI) is an advanced tool with unique, spectroscopic features, is an emerging tool that has widely been used in cancer detection. Herein, a pilot study has been performed for HCC diagnosis, by exploiting HIS properties and the analysis of the transcriptome for the development of non-invasive remote HCC sensing. HSI data cube images of the sera extracted total RNA have been analyzed in HCC, normal subject, liver benign tumor, and chronic HCV with cirrhotic/non-cirrhotic liver groups. Data analyses have revealed a specific spectral signature for all groups and can be easily discriminated; at the computed optimum wavelength. Moreover, we have developed a simple setup based on a commercial laser pointer for sample illumination and a Smartphone CCD camera, with HSI consistent data output. We hypothesized that RNA differential expression and its spatial organization/folding are the key players in the obtained spectral signatures. To the best of our knowledge, we are the first to use HSI for sensing cancer based on total RNA in serum, using a Smartphone CCD camera/laser pointer. The proposed biosensor is simple, rapid (2 min), and affordable with specificity and sensitivity of more than 98% and high accuracy.

Visualization of quantitative lipid distribution in mouse liver through near-infrared hyperspectral imaging

Lipid distribution in the liver provides crucial information for diagnosing the severity of fatty liver and fatty liver-associated liver cancer. Therefore, a noninvasive, label-free, and quantitative modality is eagerly anticipated. We report near-infrared hyperspectral imaging for the quantitative visualization of lipid content in mouse liver based on partial least square regression (PLSR) and support vector regression (SVR). Analysis results indicate that SVR with standard normal variate pretreatment outperforms PLSR by achieving better root mean square error (15.3 mg/g) and higher determination coefficient (0.97). The quantitative mapping of lipid content in the mouse liver is realized using SVR.

Novel endoscopic optical diagnostic technologies in medical trial research: recent advancements and future prospects

Novel endoscopic biophotonic diagnostic technologies have the potential to non-invasively detect the interior of a hollow organ or cavity of the human body with subcellular resolution or to obtain biochemical information about tissue in real time. With the capability to visualize or analyze the diagnostic target in vivo, these techniques gradually developed as potential candidates to challenge histopathology which remains the gold standard for diagnosis. Consequently, many innovative endoscopic diagnostic techniques have succeeded in detection, characterization, and confirmation: the three critical steps for routine endoscopic diagnosis. In this review, we mainly summarize researches on emerging endoscopic optical diagnostic techniques, with emphasis on recent advances. We also introduce the fundamental principles and the development of those techniques and compare their characteristics. Especially, we shed light on the merit of novel endoscopic imaging technologies in medical research. For example, hyperspectral imaging and Raman spectroscopy provide direct molecular information, while optical coherence tomography and multi-photo endomicroscopy offer a more extensive detection range and excellent spatial-temporal resolution. Furthermore, we summarize the unexplored application fields of these endoscopic optical techniques in major hospital departments for biomedical researchers. Finally, we provide a brief overview of the future perspectives, as well as bottlenecks of those endoscopic optical diagnostic technologies. We believe all these efforts will enrich the diagnostic toolbox for endoscopists, enhance diagnostic efficiency, and reduce the rate of missed diagnosis and misdiagnosis.

A review of the medical hyperspectral imaging systems and unmixing algorithms' in biological tissues

Hyperspectral fluorescence imaging (HFI) is a well-known technique in the medical research field and is considered a non-invasive tool for tissue diagnosis. This review article gives a brief introduction to acquisition methods, including the image preprocessing methods, feature selection and extraction methods, data classification techniques and medical image analysis along with recent relevant references. The process of fusion of unsupervised unmixing techniques with other classification methods, like the combination of support vector machine with an artificial neural network, the latest snapshot Hyperspectral imaging (HSI) and vortex analysis techniques are also outlined. Finally, the recent applications of hyperspectral images in cellular differentiation of various types of cancer are discussed.

Hyperspectral Imaging for Glioblastoma Surgery: Improving Tumor Identification Using a Deep Spectral-Spatial Approach

The primary treatment for malignant brain tumors is surgical resection. While gross total resection improves the prognosis, a supratotal resection may result in neurological deficits. On the other hand, accurate intraoperative identification of the tumor boundaries may be very difficult, resulting in subtotal resections. Histological examination of biopsies can be used repeatedly to help achieve gross total resection but this is not practically feasible due to the turn-around time of the tissue analysis. Therefore, intraoperative techniques to recognize tissue types are investigated to expedite the clinical workflow for tumor resection and improve outcome by aiding in the identification and removal of the malignant lesion. Hyperspectral imaging (HSI) is an optical imaging technique with the power of extracting additional information from the imaged tissue. Because HSI images cannot be visually assessed by human observers, we instead exploit artificial intelligence techniques and leverage a Convolutional Neural Network (CNN) to investigate the potential of HSI in twelve in vivo specimens. The proposed framework consists of a 3D-2D hybrid CNN-based approach to create a joint extraction of spectral and spatial information from hyperspectral images. A comparison study was conducted exploiting a 2D CNN, a 1D DNN and two conventional classification methods (SVM, and the SVM classifier combined with the 3D-2D hybrid CNN) to validate the proposed network. An overall accuracy of 80% was found when tumor, healthy tissue and blood vessels were classified, clearly outperforming the state-of-the-art approaches. These results can serve as a basis for brain tumor classification using HSI, and may open future avenues for image-guided neurosurgical applications.

Custom optical imaging system for ex-vivo breast cancer detection based on spectral signature

BACKGROUND AND PURPOSE

Breast cancer is a popular well-known tumor in women globally and the subsequent driving reason for malignancy death. The purpose of the present study is to develop Low cost, commercial, and affordable system that discriminates malignant from normal breast tissues by exploiting the unique properties of Hyperspectral (HS) Imaging.

MATERIALS AND METHODS

The difference in the optical properties of the investigated breast tissues gives various reactions to light transmission, absorption, and especially the reflection over the spectral range. A custom optical imaging system (COIS) was designed to assess variable responses to monochromatic LEDs (415, 565, 660 nm) to highlight the differences in the reflectance properties of malignant/normal tissue. Statistical analysis was computed for determining the ideal wavelength to differentiate between normal and malignant regions. The experiment was repeated using the same LEDs, and low-cost CCD camera to examine the capability of such a system to discriminate between normal and malignant tissue.

RESULTS

Spectral images obtained by Hyperspectral camera, have been analyzed to reveal the difference of reflectance malignant and normal breast tissue. Superficial spectral reflection image with blue LED (415 nm) showed high variance (10.11). However, a more-depth reflection image with red LED (660 nm) showed low variance (4.44). So the optimum contrast image was produced by combining the three spectral information images from blue, green, and red LED. The COIS using a commercial CCD camera was in agreement with the HS camera.

CONCLUSIONS

The novel COIS of the commercial Low-cost CCD Camera is reliable and can be used with endoscopy technique as an assistant tool for surgical doctor to make decision and assess the resection edges in real time during surgery.

Parallel Classification Pipelines for Skin Cancer Detection Exploiting Hyperspectral Imaging on Hybrid Systems

The early detection of skin cancer is of crucial importance to plan an effective therapy to treat the lesion. In routine medical practice, the diagnosis is based on the visual inspection of the lesion and it relies on the dermatologists’ expertise. After a first examination, the dermatologist may require a biopsy to confirm if the lesion is malignant or not. This methodology suffers from false positives and negatives issues, leading to unnecessary surgical procedures. Hyperspectral imaging is gaining relevance in this medical field since it is a non-invasive and non-ionizing technique, capable of providing higher accuracy than traditional imaging methods. Therefore, the development of an automatic classification system based on hyperspectral images could improve the medical practice to distinguish pigmented skin lesions from malignant, benign, and atypical lesions. Additionally, the system can assist general practitioners in first aid care to prevent noncritical lesions from reaching dermatologists, thereby alleviating the workload of medical specialists. In this paper is presented a parallel pipeline for skin cancer detection that exploits hyperspectral imaging. The computational times of the serial processing have been reduced by adopting multicore and many-core technologies, such as OpenMP and CUDA paradigms. Different parallel approaches have been combined, leading to the development of fifteen classification pipeline versions. Experimental results using in-vivo hyperspectral images show that a hybrid parallel approach is capable of classifying an image of 50 × 50 pixels with 125 bands in less than 1 s.

Exploiting scale-invariance: a top layer targeted inverse model for hyperspectral images of wounds

Detection of re-epithelialization in wound healing is important, but challenging. Hyperspectral imaging can be used for non-destructive characterization, but efficient techniques are needed to extract and interpret the information. An inverse photon transport model suitable for characterization of re-epithelialization is validated and explored in this study. It exploits scale-invariance to enable fitting of the epidermal skin layer only. Monte Carlo simulations indicate that the fitted layer transmittance and reflectance spectra are unique, and that there exists an infinite number of coupled parameter solutions. The method is used to explain the optical behavior of and detect re-epithelialization in an in vitro wound model.

Dark-field hyperspectral imaging for label free detection of nano-bio-materials

Nanomaterials are playing an increasingly important role in cancer diagnosis and treatment. Nanoparticle (NP)-based technologies have been utilized for targeted drug delivery during chemotherapies, photodynamic therapy, and immunotherapy. Another active area of research is the toxicity studies of these nanomaterials to understand the cellular uptake and transport of these materials in cells, tissues, and environment. Traditional techniques such as transmission electron microscopy, and mass spectrometry to analyze NP-based cellular transport or toxicity effect are expensive, require extensive sample preparation, and are low-throughput. Dark-field hyperspectral imaging (DF-HSI), an integration of spectroscopy and microscopy/imaging, provides the ability to investigate cellular transport of these NPs and to quantify the distribution of them within bio-materials. DF-HSI also offers versatility in non-invasively monitoring microorganisms, single cell, and proteins. DF-HSI is a low-cost, label-free technique that is minimally invasive and is a viable choice for obtaining high-throughput quantitative molecular analyses. Multimodal imaging modalities such as Fourier transform infrared and Raman spectroscopy are also being integrated with HSI systems to enable chemical imaging of the samples. HSI technology is being applied in surgeries to obtain molecular information about the tissues in real-time. This article provides brief overview of fundamental principles of DF-HSI and its application for nanomaterials, protein-detection, single-cell analysis, microbiology, surgical procedures along with technical challenges and future integrative approach with other imaging and measurement modalities. This article is categorized under: Diagnostic Tools > in vitro Nanoparticle-Based Sensing Diagnostic Tools > in vivo Nanodiagnostics and Imaging Implantable Materials and Surgical Technologies > Nanoscale Tools and Techniques in Surgery.

Hyperspectral imaging for diagnosis and detection of ex-vivo breast cancer

BACKGROUND AND PURPOSE

Breast cancer is one of the most widely recognized tumors. .Diagnosis made in the early stage of disease may imporve outcomes. The discovery of malignant growth utilizing noninvasive light intrusive methods in lieu of conventional excisional biopsy may assist in achieving this goal.

MATERIALS AND METHODS

The change of the optical properties of ex-vivo breast tissues provides different responses to light transmission, absorption, and particularly the reflection over the spectrum range. We offer the use of Hyperspectral imaging (HSI) with advanced image processing and pattern recognition in order to analyze HSI data for breast cancer detection. The spectral signatures were mined and evaluated in both malignant and normal tissue. K-mean clustering was designed for classifying hyperspectral data in order to evaluate and detection of cancer tissue. This method was used to detect ex-vivo breast cancer. Spatial spectral images were created to high spot the differences in the reflectance properties of malignant versus normal tissue.

RESULTS

Trials showed that the superficial spectral reflection images within 500 nm wavelength showed high variance (214.65) between cancerous and normal breast tissues. On the other hand, image within 620 nm wavelength showed low variance (0.0020).However, the superimposed of spectral region 420-620 nm was proposed as the optimum bandwidth. Finally, the proposed HS imaging system was capable to discriminate the tumor region from normal tissue of the ex-vivo breast sample with sensitivity and a specificity of 95 % and 96 %.

CONCLUSIONS

High sensitivity and specificity were achieved, which proposes potential for HSI as an edge evaluation method to enhance the surgical outcome compared to the presently available techniques in the clinics.

Hyperspectral Superpixel-Wise Glioblastoma Tumor Detection in Histological Samples

The combination of hyperspectral imaging (HSI) and digital pathology may yield more accurate diagnosis. In this work, we propose the use of superpixels in HS images for combining regions of pixels that can be classified according to their spectral information to classify glioblastoma (GB) brain tumors in histologic slides. The superpixels are generated by a modified simple linear iterative clustering (SLIC) method to accommodate HS images. This work employs a dataset of H&E (Hematoxylin and Eosin) stained histology slides from 13 patients with GB and over 426,000 superpixels. A linear support vector machine (SVM) classifier was performed on independent training, validation, and testing datasets. The results of this investigation show that the proposed method can detect GB brain tumors from non-tumor samples with average sensitivity and specificity of 87% and 81%, respectively. The overall accuracy of this method is 83%. The study demonstrates that hyperspectral digital pathology can be useful for detecting GB brain tumors by exploiting spectral information alone on a superpixel level.

Hyperspectral and multispectral imaging in digital and computational pathology: a systematic review [Invited]

Hyperspectral imaging (HSI) and multispectral imaging (MSI) technologies have the potential to transform the fields of digital and computational pathology. Traditional digitized histopathological slides are imaged with RGB imaging. Utilizing HSI/MSI, spectral information across wavelengths within and beyond the visual range can complement spatial information for the creation of computer-aided diagnostic tools for both stained and unstained histological specimens. In this systematic review, we summarize the methods and uses of HSI/MSI for staining and color correction, immunohistochemistry, autofluorescence, and histopathological diagnostic research. Studies include hematology, breast cancer, head and neck cancer, skin cancer, and diseases of central nervous, gastrointestinal, and genitourinary systems. The use of HSI/MSI suggest an improvement in the detection of diseases and clinical practice compared with traditional RGB analysis, and brings new opportunities in histological analysis of samples, such as digital staining or alleviating the inter-laboratory variability of digitized samples. Nevertheless, the number of studies in this field is currently limited, and more research is needed to confirm the advantages of this technology compared to conventional imagery.

Gastric cancer diagnosis using hyperspectral imaging with principal component analysis and spectral angle mapper

SIGNIFICANCE

Hyperspectral imaging (HSI) is an emerging optical technique that has a double function of spectroscopy and imaging.

AIM

Near-infrared hyperspectral imaging (NIR-HSI) (900 to 1700 nm) with the help of chemometrics was investigated for gastric cancer diagnosis.

APPROACH

Mean spectra and standard deviation of normal and cancerous pixels were extracted. Principal component analysis (PCA) was used to compress the dimension of hypercube data and select the optimal wavelengths. Moreover, spectral angle mapper (SAM) was utilized as chemometrics to discriminate gastric cancer from normal.

RESULTS

Major spectral difference of cancerous and normal gastric tissue was observed around 975, 1215, and 1450 nm by comparison. A total of six wavelengths (i.e., 975, 1075, 1215, 1275, 1390, and 1450 nm) were then selected as optimal wavelengths by PCA. The accuracy using SAM is up to 90% according to hematoxylin-eosin results.

CONCLUSIONS

These results suggest that NIR-HSI has the potential as a cutting-edge optical diagnostic technique for gastric cancer diagnosis with suitable chemometrics.

Classification of hyperspectral endocrine tissue images using support vector machines

BACKGROUND

Thyroidectomy is one of the most commonly performed surgical procedures. The region of the neck has a very complex structural organization. It would be beneficial to introduce a tool that can assist the surgeon in tissue discrimination during the procedure. One such solution is the noninvasive and contactless technique, called hyperspectral imaging (HSI).

METHODS

To interpret the HSI data, we implemented a supervised classification method to automatically discriminate the parathyroid, the thyroid, and the recurrent laryngeal nerve from surrounding tissue(muscle, skin) and materials (instruments, gauze). A leave-one-patient-out cross-validation was performed.

RESULTS

The best performance was obtained using support vector machine (SVM) with a classification and visualization in less than 1.4 seconds. A mean patient accuracy of 68% ± 23% was obtained for all tissues and material types.

CONCLUSIONS

The proposed method showed promising results and have to be confirmed on a larger cohort of patient data.

A background correction method to compensate illumination variation in hyperspectral imaging

Hyperspectral imaging (HSI) can measure both spatial (morphological) and spectral (biochemical) information from biological tissues. While HSI appears promising for biomedical applications, interpretation of hyperspectral images can be challenging when data is acquired in complex biological environments. Variations in surface topology or optical power distribution at the sample, encountered for example during endoscopy, can lead to errors in post-processing of the HSI data, compromising disease diagnostic capabilities. Here, we propose a background correction method to compensate for such variations, which estimates the optical properties of illumination at the target based on the normalised spectral profile of the light source and the measured HSI intensity values at a fixed wavelength where the absorption characteristics of the sample are relatively low (in this case, 800 nm). We demonstrate the feasibility of the proposed method by imaging blood samples, tissue-mimicking phantoms, and ex vivo chicken tissue. Moreover, using synthetic HSI data composed from experimentally measured spectra, we show the proposed method would improve statistical analysis of HSI data. The proposed method could help the implementation of HSI techniques in practical clinical applications, where controlling the illumination pattern and power is difficult.

Detection of Tumoral Epithelial Lesions Using Hyperspectral Imaging and Deep Learning

We propose a new method for the analysis and classification of HSI images. The method uses deep learning to interpret the molecular vibrational behaviour of healthy and tumoral human epithelial tissue, based on data gathered via SWIR (short-wave infrared) spectroscopy. We analyzed samples of Melanoma, Dysplastic Nevus and healthy skin. Preliminary results show that human epithelial tissue is sensitive to SWIR to the point of making possible the differentiation between healthy and tumor tissues. We conclude that HSI-SWIR can be used to build new methods for tumor classification.