Hyperspectral imaging for diagnosis and detection of ex-vivo breast cancer

Precision Imaging for Early Detection of Esophageal Cancer

Early detection of early-stage esophageal cancer (ECA) is crucial for timely intervention and improved treatment outcomes. Hyperspectral imaging (HSI) and artificial intelligence (AI) technologies offer promising avenues for enhancing diagnostic accuracy in this context. This study utilized a dataset comprising 3984 white light images (WLIs) and 3666 narrow-band images (NBIs). We employed the Yolov5 model, a state-of-the-art object detection algorithm, to predict early ECA based on the provided images. The dataset was divided into two subsets: RGB-WLIs and NBIs, and four distinct models were trained using these datasets. The experimental results revealed that the prediction performance of the training model was notably enhanced when using HSI compared to general NBI training. The HSI training model demonstrated an 8% improvement in accuracy, along with a 5-8% enhancement in precision and recall measures. Notably, the model trained with WLIs exhibited the most significant improvement. Integration of HSI with AI technologies improves the prediction performance for early ECA detection. This study underscores the potential of deep learning identification models to aid in medical detection research. Integrating these models with endoscopic diagnostic systems in healthcare settings could offer faster and more accurate results, thereby improving overall detection performance.

Visible-short wavelength near infrared hyperspectral imaging coupled with multivariate curve resolution-alternating least squares for diagnosis of breast cancer

This study investigates the application of visible-short wavelength near-infrared hyperspectral imaging (Vis-SWNIR HSI) in the wavelength range of 400-950 nm and advanced chemometric techniques for diagnosing breast cancer (BC). The research involved 56 ex-vivo samples encompassing both cancerous and non-cancerous breast tissue from females. First, HSI images were analyzed using multivariate curve resolution-alternating least squares (MCR-ALS) to exploit pure spatial and spectral profiles of active components. Then, the MCR-ALS resolved spatial profiles were arranged in a new data matrix for exploration and discrimination between benign and cancerous tissue samples using principal component analysis (PCA) and partial least squares-discriminant analysis (PLS-DA). The PLS-DA classification accuracy of 82.1 % showed the potential of HSI and chemometrics for non-invasive detection of BC. Additionally, the resolved spectral profiles by MCR-ALS can be used to track the changes in the breast tissue during cancer and treatment. It is concluded that the proposed strategy in this work can effectively differentiate between cancerous and non-cancerous breast tissue and pave the way for further studies and potential clinical implementation of this innovative approach, offering a promising avenue for improving early detection and treatment outcomes in BC patients.

Systematic Meta-Analysis of Computer-Aided Detection of Breast Cancer Using Hyperspectral Imaging

The most commonly occurring cancer in the world is breast cancer with more than 500,000 cases across the world. The detection mechanism for breast cancer is endoscopist-dependent and necessitates a skilled pathologist. However, in recent years many computer-aided diagnoses (CADs) have been used to diagnose and classify breast cancer using traditional RGB images that analyze the images only in three-color channels. Nevertheless, hyperspectral imaging (HSI) is a pioneering non-destructive testing (NDT) image-processing technique that can overcome the disadvantages of traditional image processing which analyzes the images in a wide-spectrum band. Eight studies were selected for systematic diagnostic test accuracy (DTA) analysis based on the results of the Quadas-2 tool. Each of these studies' techniques is categorized according to the ethnicity of the data, the methodology employed, the wavelength that was used, the type of cancer diagnosed, and the year of publication. A Deeks' funnel chart, forest charts, and accuracy plots were created. The results were statistically insignificant, and there was no heterogeneity among these studies. The methods and wavelength bands that were used with HSI technology to detect breast cancer provided high sensitivity, specificity, and accuracy. The meta-analysis of eight studies on breast cancer diagnosis using HSI methods reported average sensitivity, specificity, and accuracy of 78%, 89%, and 87%, respectively. The highest sensitivity and accuracy were achieved with SVM (95%), while CNN methods were the most commonly used but had lower sensitivity (65.43%). Statistical analyses, including meta-regression and Deeks' funnel plots, showed no heterogeneity among the studies and highlighted the evolving performance of HSI techniques, especially after 2019.

Crystalloid volume versus catecholamines for management of hemorrhagic shock during esophagectomy: assessment of microcirculatory tissue oxygenation of the gastric conduit in a porcine model using hyperspectral imaging - an experimental study

INTRODUCTION

Oncologic esophagectomy is a two-cavity procedure with considerable morbidity and mortality. Complex anatomy and the proximity to major vessels constitute a risk for massive intraoperative hemorrhage. Currently, there is no conclusive consensus on the ideal anesthesiologic countermeasure in case of such immense blood loss. The objective of this work was to identify the most promising anesthesiologic management in case of intraoperative hemorrhage with regards to tissue perfusion of the gastric conduit during esophagectomy using hyperspectral imaging.

MATERIAL AND METHODS

An established live porcine model ( n =32) for esophagectomy was used with gastric conduit formation and simulation of a linear stapled side-to-side esophagogastrostomy. After a standardized procedure of controlled blood loss of about 1 l per pig, the four experimental groups ( n =8 each) differed in anesthesiologic intervention, that is, (I) permissive hypotension, (II) catecholamine therapy using noradrenaline, (III) crystalloid volume supplementation, and (IV) combined crystalloid volume supplementation with noradrenaline therapy. Hyperspectral imaging tissue oxygenation (StO 2 ) of the gastric conduit was evaluated and correlated with systemic perfusion parameters. Measurements were conducted before (T0) and after (T1) laparotomy, after hemorrhage (T2), and 60 min (T3) and 120 min (T4) after anesthesiologic intervention.

RESULTS

StO 2 values of the gastric conduit showed significantly different results between the four experimental groups, with 63.3% (±7.6%) after permissive hypotension (I), 45.9% (±6.4%) after catecholamine therapy (II), 70.5% (±6.1%) after crystalloid volume supplementation (III), and 69.0% (±3.7%) after combined therapy (IV). StO 2 values correlated strongly with systemic lactate values (r=-0.67; CI -0.77 to -0.54), which is an established prognostic factor.

CONCLUSION

Crystalloid volume supplementation (III) yields the highest StO 2 values and lowest systemic lactate values and therefore appears to be the superior primary treatment strategy after hemorrhage during esophagectomy with regards to microcirculatory tissue oxygenation of the gastric conduit.

Hyperspectral dark-field microscopy of human breast lumpectomy samples for tumor margin detection in breast-conserving surgery

Significance

Hyperspectral dark-field microscopy (HSDFM) and data cube analysis algorithms demonstrate successful detection and classification of various tissue types, including carcinoma regions in human post-lumpectomy breast tissues excised during breast-conserving surgeries.

Aim

We expand the application of HSDFM to the classification of tissue types and tumor subtypes in pre-histopathology human breast lumpectomy samples.

Approach

Breast tissues excised during breast-conserving surgeries were imaged by the HSDFM and analyzed. The performance of the HSDFM is evaluated by comparing the backscattering intensity spectra of polystyrene microbead solutions with the Monte Carlo simulation of the experimental data. For classification algorithms, two analysis approaches, a supervised technique based on the spectral angle mapper (SAM) algorithm and an unsupervised technique based on the K -means algorithm are applied to classify various tissue types including carcinoma subtypes. In the supervised technique, the SAM algorithm with manually extracted endmembers guided by H&E annotations is used as reference spectra, allowing for segmentation maps with classified tissue types including carcinoma subtypes.

Results

The manually extracted endmembers of known tissue types and their corresponding threshold spectral correlation angles for classification make a good reference library that validates endmembers computed by the unsupervised K -means algorithm. The unsupervised K -means algorithm, with no a priori information, produces abundance maps with dominant endmembers of various tissue types, including carcinoma subtypes of invasive ductal carcinoma and invasive mucinous carcinoma. The two carcinomas' unique endmembers produced by the two methods agree with each other within < 2 % residual error margin.

Conclusions

Our report demonstrates a robust procedure for the validation of an unsupervised algorithm with the essential set of parameters based on the ground truth, histopathological information. We have demonstrated that a trained library of the histopathology-guided endmembers and associated threshold spectral correlation angles computed against well-defined reference data cubes serve such parameters. Two classification algorithms, supervised and unsupervised algorithms, are employed to identify regions with carcinoma subtypes of invasive ductal carcinoma and invasive mucinous carcinoma present in the tissues. The two carcinomas' unique endmembers used by the two methods agree to < 2 % residual error margin. This library of high quality and collected under an environment with no ambient background may be instrumental to develop or validate more advanced unsupervised data cube analysis algorithms, such as effective neural networks for efficient subtype classification.

Technological Frontiers in Brain Cancer: A Systematic Review and Meta-Analysis of Hyperspectral Imaging in Computer-Aided Diagnosis Systems

Brain cancer is a substantial factor in the mortality associated with cancer, presenting difficulties in the timely identification of the disease. The precision of diagnoses is significantly dependent on the proficiency of radiologists and neurologists. Although there is potential for early detection with computer-aided diagnosis (CAD) algorithms, the majority of current research is hindered by its modest sample sizes. This meta-analysis aims to comprehensively assess the diagnostic test accuracy (DTA) of computer-aided design (CAD) models specifically designed for the detection of brain cancer utilizing hyperspectral (HSI) technology. We employ Quadas-2 criteria to choose seven papers and classify the proposed methodologies according to the artificial intelligence method, cancer type, and publication year. In order to evaluate heterogeneity and diagnostic performance, we utilize Deeks' funnel plot, the forest plot, and accuracy charts. The results of our research suggest that there is no notable variation among the investigations. The CAD techniques that have been examined exhibit a notable level of precision in the automated detection of brain cancer. However, the absence of external validation hinders their potential implementation in real-time clinical settings. This highlights the necessity for additional studies in order to authenticate the CAD models for wider clinical applicability.

Surgical optomics: hyperspectral imaging and deep learning towards precision intraoperative automatic tissue recognition-results from the EX-MACHYNA trial

BACKGROUND

Hyperspectral imaging (HSI), combined with machine learning, can help to identify characteristic tissue signatures enabling automatic tissue recognition during surgery. This study aims to develop the first HSI-based automatic abdominal tissue recognition with human data in a prospective bi-center setting.

METHODS

Data were collected from patients undergoing elective open abdominal surgery at two international tertiary referral hospitals from September 2020 to June 2021. HS images were captured at various time points throughout the surgical procedure. Resulting RGB images were annotated with 13 distinct organ labels. Convolutional Neural Networks (CNNs) were employed for the analysis, with both external and internal validation settings utilized.

RESULTS

A total of 169 patients were included, 73 (43.2%) from Strasbourg and 96 (56.8%) from Verona. The internal validation within centers combined patients from both centers into a single cohort, randomly allocated to the training (127 patients, 75.1%, 585 images) and test sets (42 patients, 24.9%, 181 images). This validation setting showed the best performance. The highest true positive rate was achieved for the skin (100%) and the liver (97%). Misclassifications included tissues with a similar embryological origin (omentum and mesentery: 32%) or with overlaying boundaries (liver and hepatic ligament: 22%). The median DICE score for ten tissue classes exceeded 80%.

CONCLUSION

To improve automatic surgical scene segmentation and to drive clinical translation, multicenter accurate HSI datasets are essential, but further work is needed to quantify the clinical value of HSI. HSI might be included in a new omics science, namely surgical optomics, which uses light to extract quantifiable tissue features during surgery.

Intelligent tumor tissue classification for Hybrid Health Care Units

Introduction

In the evolving healthcare landscape, we aim to integrate hyperspectral imaging into Hybrid Health Care Units to advance the diagnosis of medical diseases through the effective fusion of cutting-edge technology. The scarcity of medical hyperspectral data limits the use of hyperspectral imaging in disease classification.

Methods

Our study innovatively integrates hyperspectral imaging to characterize tumor tissues across diverse body locations, employing the Sharpened Cosine Similarity framework for tumor classification and subsequent healthcare recommendation. The efficiency of the proposed model is evaluated using Cohen's kappa, overall accuracy, and f1-score metrics.

Results

The proposed model demonstrates remarkable efficiency, with kappa of 91.76%, an overall accuracy of 95.60%, and an f1-score of 96%. These metrics indicate superior performance of our proposed model over existing state-of-the-art methods, even in limited training data.

Conclusion

This study marks a milestone in hybrid healthcare informatics, improving personalized care and advancing disease classification and recommendations.

Test-time augmentation with synthetic data addresses distribution shifts in spectral imaging

PURPOSE

Surgical scene segmentation is crucial for providing context-aware surgical assistance. Recent studies highlight the significant advantages of hyperspectral imaging (HSI) over traditional RGB data in enhancing segmentation performance. Nevertheless, the current hyperspectral imaging (HSI) datasets remain limited and do not capture the full range of tissue variations encountered clinically.

METHODS

Based on a total of 615 hyperspectral images from a total of 16 pigs, featuring porcine organs in different perfusion states, we carry out an exploration of distribution shifts in spectral imaging caused by perfusion alterations. We further introduce a novel strategy to mitigate such distribution shifts, utilizing synthetic data for test-time augmentation.

RESULTS

The effect of perfusion changes on state-of-the-art (SOA) segmentation networks depended on the organ and the specific perfusion alteration induced. In the case of the kidney, we observed a performance decline of up to 93% when applying a state-of-the-art (SOA) network under ischemic conditions. Our method improved on the state-of-the-art (SOA) by up to 4.6 times.

CONCLUSION

Given its potential wide-ranging relevance to diverse pathologies, our approach may serve as a pivotal tool to enhance neural network generalization within the realm of spectral imaging.

Advancements in non-invasive hyperspectral imaging: Mapping blood oxygen levels and vascular health for clinical and research applications

Oxygen content is crucial for the functioning of human body organs, as it plays a vital role in cellular respiration, which generates energy necessary for life-sustaining functions. The absence of adequate oxygen leads to cellular dysfunction and eventual organismal death due to energy deprivation. In this study, we designed a rapid, non-invasive, and non-contact custom hyperspectral imaging system to assess blood perfusion in arteries, capillaries, and veins across various human organs, including the arm, eye, and leg. The system recorded cube images consisting of multispectral image ranges, capturing spectral information in both the visible and infrared spectra. Segmentation of the visible spectrum (400 to 700 nm) and the infrared spectrum (700 to 1000 nm) facilitated the mapping of blood oxygen levels in the investigated samples. The estimated oxygen levels were calculated using the custom hyperspectral imaging system and associated algorithm, with validation and calibration performed against the gold standard pulse oximeter. Our results demonstrate that the custom hyperspectral imaging system accurately mapped blood perfusion and oxygen levels in organs, showing strong agreement with pulse oximeter measurements. This study underscores the utility of custom hyperspectral imaging in non-invasively assessing blood oxygenation and perfusion in human organs, offering a promising avenue for clinical diagnostics and monitoring of vascular health.

A novel visible and near-infrared hyperspectral imaging platform for automated breast-cancer detection

BACKGROUND

Breast cancer is a leading cause of cancer-related deaths among women worldwide. Early and accurate detection is crucial for improving patient outcomes. Our study utilizes Visible and Near-Infrared Hyperspectral Imaging (VIS-NIR HSI), a promising non-invasive technique, to detect cancerous regions in ex-vivo breast specimens based on their hyperspectral response.

METHODS

In this paper, we present a novel HSI platform integrated with fuzzy c-means clustering for automated breast cancer detection. We acquire hyperspectral data from breast tissue samples, and preprocess it to reduce noise and enhance hyperspectral features. Fuzzy c-means clustering is then applied to segment cancerous regions based on their spectral characteristics.

RESULTS

Our approach demonstrates promising results. We evaluated the quality of the clustering using metrics like Silhouette Index (SI), Davies-Bouldin Index (DBI), and Calinski-Harabasz Index (CHI). The clustering metrics results revealed an optimal number of 6 clusters for breast tissue classification, and the SI values ranged from 0.68 to 0.72, indicating well-separated clusters. Moreover, the CHI values showed that the clusters were well-defined, and the DBI values demonstrated low cluster dispersion. Additionally, the sensitivity, specificity, and accuracy of our system were evaluated on a dataset of breast tissue samples. We achieved an average sensitivity of 96.83%, specificity of 93.39%, and accuracy of 95.12%. These results indicate the effectiveness of our HSI-based approach in distinguishing cancerous and non-cancerous regions.

CONCLUSIONS

The paper introduces a robust hyperspectral imaging platform coupled with fuzzy c-means clustering for automated breast cancer detection. The clustering metrics results support the reliability of our approach in effectively segmenting breast tissue samples. In addition, the system shows high sensitivity and specificity, making it a valuable tool for early-stage breast cancer diagnosis. This innovative approach holds great potential for improving breast cancer screening and, thereby, enhancing our understanding of the disease and its detection patterns.

Automated hyperspectral imaging for non-invasive characterization of human eye vasculature: A potential tool for ocular vascular evaluation

The vascular supply to the human eye plays a vital role in maintaining ocular health, making its non-invasive evaluation essential for diagnosing and managing various ocular disorders. This paper presents a novel approach utilizing hyperspectral imaging (HSI) to non-invasively characterize human eye vasculature. The proposed system aims to specifically identify the blood atrium and veins of the human eye at 470 nm and 750 nm, respectively, using quantitative phase analysis and k-means clustering. The study involved capturing diffused reflection spectra and hyperspectral images of the human eye at different wavelengths to reveal distinctive vascular features. The results of ten volunteers demonstrate promising capabilities in automated differentiation of atrium and veins, as well as the potential for mapping varicose veins in the lower limb. This non-invasive and non-contact imaging technique shows great promise in facilitating accurate and detailed evaluation of ocular blood flow, providing valuable information for clinical diagnosis and treatment in ophthalmology and vascular medicine fields.

Targeted multispectral filter array design for the optimization of endoscopic cancer detection in the gastrointestinal tract

Significance

Color differences between healthy and diseased tissue in the gastrointestinal (GI) tract are detected visually by clinicians during white light endoscopy; however, the earliest signs of cancer are often just a slightly different shade of pink compared to healthy tissue making it hard to detect. Improving contrast in endoscopy is important for early detection of disease in the GI tract during routine screening and surveillance.

Aim

We aim to target alternative colors for imaging to improve contrast using custom multispectral filter arrays (MSFAs) that could be deployed in an endoscopic "chip-on-tip" configuration.

Approach

Using an open-source toolbox, Opti-MSFA, we examined the optimal design of MSFAs for early cancer detection in the GI tract. The toolbox was first extended to use additional classification models (k -nearest neighbor, support vector machine, and spectral angle mapper). Using input spectral data from published clinical trials examining the esophagus and colon, we optimized the design of MSFAs with three to nine different bands.

Results

We examined the variation of the spectral and spatial classification accuracies as a function of the number of bands. The MSFA configurations tested showed good classification accuracies when compared to the full hyperspectral data available from the clinical spectra used in these studies.

Conclusion

The ability to retain good classification accuracies with a reduced number of spectral bands could enable the future deployment of multispectral imaging in an endoscopic chip-on-tip configuration using simplified MSFA hardware. Further studies using an expanded clinical dataset are needed to confirm these findings.

Custom Hyperspectral Imaging System Reveals Unique Spectral Signatures of Heart, Kidney, and Liver Tissues

The rapid advancement of diagnostic and therapeutic optical techniques for oncology demands a good understanding of the optical properties of biological tissues. This study explores the capabilities of hyperspectral (HS) cameras as a non-invasive and non-contact optical imaging system to distinguish and highlight spectral differences inbiological soft tissuesof three structures (kidney, heart, and liver) for use inendoscopic interventionoropen surgery. The study presents an optical system consisting of two individual setups, the transmission setup, and the reflection setup, both incorporating anHS camerawith apolychromatic light sourcewithin the range of 380 to 1050 nm to measure tissue's light transmission (Tr) and diffuse light reflectance (Rd), respectively. The optical system was calibrated with a customizedliquid optical phantom, then 30 samples from various organs were investigated fortissue characterizationby measuring both Tr and Rd at the visible and near infrared (VIS-NIR) band. We exploited the ANOVA test, subsequently by a Tukey's test on the created three independent clusters (kidney vs. heart: group I / kidney vs. liver: group II / heart vs. liver: group III) to identify the optimum wavelength for each tissue regarding their spectroscopic optical properties in the VIS-NIR spectrum. The optimum spectral span for the determined light Tr of the three groups was 640 ∼ 680 nm, and the ideal range was 720 ∼ 760 nm for the measured light Rd for mutual group I and group II. However, the group III range was different at a range of 520 ∼ 560 nm. Therefore, the investigation provides vital information concerning theoptimum spectral scalefor the computed light Tr and Rd of the investigatedbiological tissues(kidney, liver, and heart) to be employed in diagnostic andtherapeutic medical applications.

Hyperspectral imaging to predict the effect of cyclophosphamide in primary membranous nephropathy

BACKGROUND

Presently, there is a lack of accurate predictors of the efficacy of primary membranous nephropathy. The aim of this study is to explore the application value of hyperspectral imaging in predicting the efficacy of cyclophosphamide treatment in primary membranous nephropathy.

METHOD

A total of 30 patients with primary membranous nephropathy who were treated with glucocorticoid combined with cyclophosphamide were collected. Hematoxylin-eosin stained renal pathological images were acquired by hyperspectral imaging system at the spectral range of 400-1000 nm. The remission group data set contained 23 samples, while the non-remission group data set contained 28 samples. A one-dimensional convolutional neural network model was established to train and test the hyperspectral data, and the performance of the model was evaluated.

RESULT

From the spectral curve, the spectral difference between the remission group and the non-remission group was obvious between 525 and 700 nm. The spectral data in this band were analyzed by one-dimensional convolutional neural network, and the confusion matrix showed that the remission group and the non-remission group were successfully classified. The precision and recall were 0.89 and 0.81 for the non-response group and 0.83 and 0.90 for the response group, respectively, with an F1 score of 0.85 in both groups. The area under the AUC curve of the classification model reached 0.857.

CONCLUSION

In this study, a one-dimensional convolutional neural network model was used to analyze the hyperspectral images of renal pathology of PMN patients, and the patients in remission group and non-remission group were successfully classified after glucocorticoid combined with cyclophosphamide treatment.

Development of a custom optical imaging system for non-invasive monitoring and delineation of lower limb varicose veins using hyperspectral imaging and quantitative phase analysis

BACKGROUND

Varicose veins (VV) are a prevalent chronic venous disorder, particularly affecting women of childbearing age. This condition is associated with significant complications, including pain, discomfort, leg cramps, ulceration, reduced quality of life, absenteeism, and even mortality. This study aims to develop a custom non-invasive, non-contact optical imaging system combined with magnitude and phase image calculation to monitor and visualize varicose veins and their tributaries using hyperspectral imaging and quantitative phase analysis with a k-means clustering algorithm.

RESULTS

Ten volunteers participated in the optical imaging system study. They were exposed to a polychromatic light source spanning the wavelength range of 400 nm-950 nm. The diffuse reflection spectra for varicose veins exhibited a peak at 530 nm, while leg veins showed a peak at 780 nm. Hyperspectral images obtained at these specific wavelengths were normalized in order to homogenize the spectral signatures of each pixel (converting the hyperspectral image to 8 bit RGB image) and filtered using a moving average filter. Subsequently, the varicose veins and leg veins were delineated and detected using quantitative phase analysis and a k-means clustering algorithm.

CONCLUSION

In conclusion, the custom optical imaging system, utilizing hyperspectral imaging and the associated clustering algorithm, provides detailed information regarding the spatial distribution of varicose veins. This information can assist vascular physicians in facilitating easier diagnosis and treatment planning.

A Review of Recent Advances in Computer-Aided Detection Methods Using Hyperspectral Imaging Engineering to Detect Skin Cancer

Skin cancer, a malignant neoplasm originating from skin cell types including keratinocytes, melanocytes, and sweat glands, comprises three primary forms: basal cell carcinoma (BCC), squamous cell carcinoma (SCC), and malignant melanoma (MM). BCC and SCC, while constituting the most prevalent categories of skin cancer, are generally considered less aggressive compared to MM. Notably, MM possesses a greater capacity for invasiveness, enabling infiltration into adjacent tissues and dissemination via both the circulatory and lymphatic systems. Risk factors associated with skin cancer encompass ultraviolet (UV) radiation exposure, fair skin complexion, a history of sunburn incidents, genetic predisposition, immunosuppressive conditions, and exposure to environmental carcinogens. Early detection of skin cancer is of paramount importance to optimize treatment outcomes and preclude the progression of disease, either locally or to distant sites. In pursuit of this objective, numerous computer-aided diagnosis (CAD) systems have been developed. Hyperspectral imaging (HSI), distinguished by its capacity to capture information spanning the electromagnetic spectrum, surpasses conventional RGB imaging, which relies solely on three color channels. Consequently, this study offers a comprehensive exploration of recent CAD investigations pertaining to skin cancer detection and diagnosis utilizing HSI, emphasizing diagnostic performance parameters such as sensitivity and specificity.

Research for accurate auxiliary diagnosis of lung cancer based on intracellular fluorescent fingerprint information

The distinctions in pathological types and genetic subtypes of lung cancer have a direct impact on the choice of treatment choices and clinical prognosis in clinical practice. This study used pathological histological sections of surgically removed or biopsied tumor tissue from 36 patients. Based on a small sample size, millions of spectral data points were extracted to investigate the feasibility of employing intracellular fluorescent fingerprint information to diagnose the pathological types and mutational status of lung cancer. The intracellular fluorescent fingerprint information revealed the EGFR gene mutation characteristics in lung cancer, and the area under the curve (AUC) value for the optimal model was 0.98. For the classification of lung cancer pathological types, the macro average AUC value for the ensemble-learning model was 0.97. Our research contributes new idea for pathological diagnosis of lung cancer and offers a quick, easy, and accurate auxiliary diagnostic approach.

Multispectral Imaging Method for Rapid Identification and Analysis of Paraffin-Embedded Pathological Tissues

The study of the interaction between light and biological tissue is of great help in the identification of diseases as well as structural alterations in tissues. In the present study, we have developed a tissue diagnostic technique by using multispectral imaging in the visible spectrum combined with principal component analysis (PCA). We used information from the propagation of light through paraffin-embedded tissues to assess differences in the eye tissues of control mouse embryos compared to mouse embryos whose mothers were deprived of folic acid (FA), a crucial vitamin necessary for the growth and development of the fetus. After acquiring the endmembers from the multispectral images, spectral unmixing was used to identify the abundances of those endmembers in each pixel. For each acquired image, the final analysis was performed by performing a pixel-by-pixel and wavelength-by-wavelength absorbance calculation. Non-negative least squares (NNLS) were used in this research. The abundance maps obtained for the first endmember revealed vascular alterations (vitreous and choroid) in the embryos with maternal FA deficiency. However, the abundance maps obtained for the third endmember showed alterations in the texture of some tissues such as the lens and retina. Results indicated that multispectral imaging applied to paraffin-embedded tissues enhanced tissue visualization. Using this method, first, it can be seen tissue damage location and then decide what kind of biological techniques to apply.

Systematic meta-analysis of computer-aided detection to detect early esophageal cancer using hyperspectral imaging

One of the leading causes of cancer deaths is esophageal cancer (EC) because identifying it in early stage is challenging. Computer-aided diagnosis (CAD) could detect the early stages of EC have been developed in recent years. Therefore, in this study, complete meta-analysis of selected studies that only uses hyperspectral imaging to detect EC is evaluated in terms of their diagnostic test accuracy (DTA). Eight studies are chosen based on the Quadas-2 tool results for systematic DTA analysis, and each of the methods developed in these studies is classified based on the nationality of the data, artificial intelligence, the type of image, the type of cancer detected, and the year of publishing. Deeks' funnel plot, forest plot, and accuracy charts were made. The methods studied in these articles show the automatic diagnosis of EC has a high accuracy, but external validation, which is a prerequisite for real-time clinical applications, is lacking.

A Comparison of Spectroscopy and Imaging Techniques Utilizing Spectrally Resolved Diffusely Reflected Light for Intraoperative Margin Assessment in Breast-Conserving Surgery: A Systematic Review and Meta-Analysis

Up to 19% of patients require re-excision surgery due to positive margins in breast-conserving surgery (BCS). Intraoperative margin assessment tools (IMAs) that incorporate tissue optical measurements could help reduce re-excision rates. This review focuses on methods that use and assess spectrally resolved diffusely reflected light for breast cancer detection in the intraoperative setting. Following PROSPERO registration (CRD42022356216), an electronic search was performed. The modalities searched for were diffuse reflectance spectroscopy (DRS), multispectral imaging (MSI), hyperspectral imaging (HSI), and spatial frequency domain imaging (SFDI). The inclusion criteria encompassed studies of human in vivo or ex vivo breast tissues, which presented data on accuracy. The exclusion criteria were contrast use, frozen samples, and other imaging adjuncts. 19 studies were selected following PRISMA guidelines. Studies were divided into point-based (spectroscopy) or whole field-of-view (imaging) techniques. A fixed-or random-effects model analysis generated pooled sensitivity/specificity for the different modalities, following heterogeneity calculations using the Q statistic. Overall, imaging-based techniques had better pooled sensitivity/specificity (0.90 (CI 0.76-1.03)/0.92 (CI 0.78-1.06)) compared with probe-based techniques (0.84 (CI 0.78-0.89)/0.85 (CI 0.79-0.91)). The use of spectrally resolved diffusely reflected light is a rapid, non-contact technique that confers accuracy in discriminating between normal and malignant breast tissue, and it constitutes a potential IMA tool.

Tissue Classification of Breast Cancer by Hyperspectral Unmixing

(1) Background: Assessing the resection margins during breast-conserving surgery is an important clinical need to minimize the risk of recurrent breast cancer. However, currently there is no technique that can provide real-time feedback to aid surgeons in the margin assessment. Hyperspectral imaging has the potential to overcome this problem. To classify resection margins with this technique, a tissue discrimination model should be developed, which requires a dataset with accurate ground-truth labels. However, establishing such a dataset for resection specimens is difficult. (2) Methods: In this study, we therefore propose a novel approach based on hyperspectral unmixing to determine which pixels within hyperspectral images should be assigned to the ground-truth labels from histopathology. Subsequently, we use this hyperspectral-unmixing-based approach to develop a tissue discrimination model on the presence of tumor tissue within the resection margins of ex vivo breast lumpectomy specimens. (3) Results: In total, 372 measured locations were included on the lumpectomy resection surface of 189 patients. We achieved a sensitivity of 0.94, specificity of 0.85, accuracy of 0.87, Matthew's correlation coefficient of 0.71, and area under the curve of 0.92. (4) Conclusion: Using this hyperspectral-unmixing-based approach, we demonstrated that the measured locations with hyperspectral imaging on the resection surface of lumpectomy specimens could be classified with excellent performance.

Discrimination between normal and necrotic small intestinal tissue using hyperspectral imaging and unsupervised classification

Objective and automatic clinical discrimination of normal and necrotic sites of small intestinal tissue remains challenging. In this study, hyperspectral imaging (HSI) and unsupervised classification techniques were used to distinguish normal and necrotic sites of small intestinal tissues. Small intestinal tissue hyperspectral images of eight Japanese large-eared white rabbits were acquired using a visible near-infrared hyperspectral camera, and K-means and density peaks (DP) clustering algorithms were used to differentiate between normal and necrotic tissue. The three cases in this study showed that the average clustering purity of the DP clustering algorithm reached 92.07% when the two band combinations of 500-622 and 700-858 nm were selected. The results of this study suggest that HSI and DP clustering can assist physicians in distinguishing between normal and necrotic sites in the small intestine in vivo.

Emerging Technology for Intraoperative Margin and Assisting in Post-Surgery tissue diagnostic for Future Breast-Conserving

INTRODUCTION

Tissue-preserving surgery is utilized progressively in cancer therapy, where a clear surgical margin is critical to avoid cancer recurrence, specifically in breast cancer (BC) surgery. The Intraoperative pathologic approaches that rely on tissue segmenting and staining have been recognized as the ground truth for BC diagnosis. Nevertheless, these methods are constrained by its complication and timewasting for tissue preparation.

OBJECTIVE

We present a non-invasive optical imaging system incorporating a hyperspectral (HS) camera to discriminate between cancerous and non-cancerous tissues in ex-vivo breast specimens, which could be an intraoperative diagnostic technique to aid surgeons during surgery and later a valuable tool to assist pathologists.

METHODS

We have established a hyperspectral Imaging (HSI) system comprising a push-broom HS camera at wavelength 380∼1050 nm with source light 390∼980 nm. We have measured the investigated samples' diffuse reflectance (R_d), fixed on slides from 30 distinct patients incorporating mutually normal and ductal carcinoma tissue. The samples were divided into two groups, stained tissues during the surgery (control group) and unstained samples (test group), both captured with the HSI system in the visible and near-infrared (VIS-NIR) range. Then, to address the problem of the spectral nonuniformity of the illumination device and the influence of the dark current, the radiance data were normalized to yield the radiance of the specimen and neutralize the intensity effect to focus on the spectral reflectance shift for each tissue. The selection of the threshold window from the measured R_d is carried out by exploiting the statistical analysis by calculating each region's mean and standard deviation. Afterward, we selected the optimum spectral images from the HS data cube to apply a custom K-means algorithm and contour delineation to identify the regular districts from the BC regions.

RESULTS

We noticed that the measured spectral R_d for the malignant tissues of the investigated case studies versus the reference source light varies regarding the cancer stage, as sometimes the R_d is higher for the tumor or vice versa for the normal tissue. Later, from the analysis of the whole samples, we found that the most appropriate wavelength for the BC tissues was 447 nm, which was highly reflected versus the normal tissue. However, the most convenient one for the normal tissue was at 545 nm with high reflection versus the BC tissue. Finally, we implement a moving average filter for noise reduction and a custom K-means clustering algorithm on the selected two spectral images (447, 551 nm) to identify the various regions and effectively-identified spectral tissue variations with a sensitivity of 98.95%, and specificity of 98.44%. A pathologist later confirmed these outcomes as the ground truth for the tissue sample investigations.

CONCLUSIONS

The proposed system could help the surgeon and the pathologist identify the cancerous tissue margins from the non-cancerous tissue with a non-invasive, rapid, and minimum time method achieving high sensitivity up to 98.95%.

High Dynamic Range Dual-Modal White Light Imaging Improves the Accuracy of Tumor Bed Sampling After Neoadjuvant Therapy for Breast Cancer

OBJECTIVES

Accurate evaluation of residual cancer burden remains challenging because of the lack of appropriate techniques for tumor bed sampling. This study evaluated the application of a white light imaging system to help pathologists differentiate the components and location of tumor bed in specimens.

METHODS

The high dynamic range dual-mode white light imaging (HDR-DWI) system was developed to capture antiglare reflection and multiexposure HDR transmission images. It was tested in 60 specimens of modified radical mastectomy after neoadjuvant therapy. We observed the differential transmittance among tumor tissue, fibrosis tissue, and adipose tissue.

RESULTS

The sensitivity and specificity of HDR-DWI were compared with x-ray or visual examination to determine whether HDR-DWI was superior in identifying tumor beds. We found that tumor tissue had lower transmittance (0.12 ± 0.03) than fibers (0.15 ± 0.04) and fats (0.27 ± 0.07) (P < .01).

CONCLUSIONS

HDR-DWI was more sensitive in identifying fiber and tumor tissues than cabinet x-ray and visual observation (P < .01). In addition, HDR-DWI could identify more fibrosis areas than the currently used whole slide imaging did in 12 samples (12/60). We have determined that HDR-DWI can provide more in-depth tumor bed information than x-ray and visual examination do, which will help prevent diagnostic errors in tumor bed sampling.

Estimating quantitative physiological and morphological tissue parameters of murine tumor models using hyperspectral imaging and optical profilometry

Understanding tumors and their microenvironment are essential for successful and accurate disease diagnosis. Tissue physiology and morphology are altered in tumors compared to healthy tissues, and there is a need to monitor tumors and their surrounding tissues, including blood vessels, non-invasively. This preliminary study utilizes a multimodal optical imaging system combining hyperspectral imaging (HSI) and three-dimensional (3D) optical profilometry (OP) to capture hyperspectral images and surface shapes of subcutaneously grown murine tumor models. Hyperspectral images are corrected with 3D OP data and analyzed using the inverse-adding doubling (IAD) method to extract tissue properties such as melanin volume fraction and oxygenation. Blood vessels are segmented using the B-COSFIRE algorithm from oxygenation maps. From 3D OP data, tumor volumes are calculated and compared to manual measurements using a vernier caliper. Results show that tumors can be distinguished from healthy tissue based on most extracted tissue parameters ( p < 0.05 ). Furthermore, blood oxygenation is 50% higher within the blood vessels than in the surrounding tissue, and tumor volumes calculated using 3D OP agree within 26% with manual measurements using a vernier caliper. Results suggest that combining HSI and OP could provide relevant quantitative information about tumors and improve the disease diagnosis.

Visible near-infrared hyperspectral imaging and supervised classification for the detection of small intestinal necrosis tissue in vivo

Complete recognition of necrotic areas during small bowel tissue resection remains challenging due to the lack of optimal intraoperative aid identification techniques. This research utilizes hyperspectral imaging techniques to automatically distinguish normal and necrotic areas of small intestinal tissue. Sample data were obtained from the animal model of small intestinal tissue of eight Japanese large-eared white rabbits developed by experienced physicians. A spectral library of normal and necrotic regions of small intestinal tissue was created and processed using six different supervised classification algorithms. The results show that hyperspectral imaging combined with supervised classification algorithms can be a suitable technique to automatically distinguish between normal and necrotic areas of small intestinal tissue. This new technique could aid physicians in objectively identify normal and necrotic areas of small intestinal tissue.

Automatic optical biopsy for colorectal cancer using hyperspectral imaging and artificial neural networks

BACKGROUND

Intraoperative identification of cancerous tissue is fundamental during oncological surgical or endoscopic procedures. This relies on visual assessment supported by histopathological evaluation, implying a longer operative time. Hyperspectral imaging (HSI), a contrast-free and contactless imaging technology, provides spatially resolved spectroscopic analysis, with the potential to differentiate tissue at a cellular level. However, HSI produces "big data", which is impossible to directly interpret by clinicians. We hypothesize that advanced machine learning algorithms (convolutional neural networks-CNNs) can accurately detect colorectal cancer in HSI data.

METHODS

In 34 patients undergoing colorectal resections for cancer, immediately after extraction, the specimen was opened, the tumor-bearing section was exposed and imaged using HSI. Cancer and normal mucosa were categorized from histopathology. A state-of-the-art CNN was developed to automatically detect regions of colorectal cancer in a hyperspectral image. Accuracy was validated with three levels of cross-validation (twofold, fivefold, and 15-fold).

RESULTS

32 patients had colorectal adenocarcinomas confirmed by histopathology (9 left, 11 right, 4 transverse colon, and 9 rectum). 6 patients had a local initial stage (T1-2) and 26 had a local advanced stage (T3-4). The cancer detection performance of the CNN using 15-fold cross-validation showed high sensitivity and specificity (87% and 90%, respectively) and a ROC-AUC score of 0.95 (considered outstanding). In the T1-2 group, the sensitivity and specificity were 89% and 90%, respectively, and in the T3-4 group, the sensitivity and specificity were 81% and 93%, respectively.

CONCLUSIONS

Automatic colorectal cancer detection on fresh specimens using HSI, using a properly trained CNN is feasible and accurate, even with small datasets, regardless of the local tumor extension. In the near future, this approach may become a useful intraoperative tool during oncological endoscopic and surgical procedures, and may result in precise and non-destructive optical biopsies to support objective and consistent tumor-free resection margins.

Comparison of preprocessing techniques to reduce nontissue-related variations in hyperspectral reflectance imaging

SIGNIFICANCE

Hyperspectral reflectance imaging can be used in medicine to identify tissue types, such as tumor tissue. Tissue classification algorithms are developed based on, e.g., machine learning or principle component analysis. For the development of these algorithms, data are generally preprocessed to remove variability in data not related to the tissue itself since this will improve the performance of the classification algorithm. In hyperspectral imaging, the measured spectra are also influenced by reflections from the surface (glare) and height variations within and between tissue samples.

AIM

To compare the ability of different preprocessing algorithms to decrease variations in spectra induced by glare and height differences while maintaining contrast based on differences in optical properties between tissue types.

APPROACH

We compare eight preprocessing algorithms commonly used in medical hyperspectral imaging: standard normal variate, multiplicative scatter correction, min-max normalization, mean centering, area under the curve normalization, single wavelength normalization, first derivative, and second derivative. We investigate conservation of contrast stemming from differences in: blood volume fraction, presence of different absorbers, scatter amplitude, and scatter slope-while correcting for glare and height variations. We use a similarity metric, the overlap coefficient, to quantify contrast between spectra. We also investigate the algorithms for clinical datasets from the colon and breast.

CONCLUSIONS

Preprocessing reduces the overlap due to glare and distance variations. In general, the algorithms standard normal variate, min-max, area under the curve, and single wavelength normalization are the most suitable to preprocess data used to develop a classification algorithm for tissue classification. The type of contrast between tissue types determines which of these four algorithms is most suitable.

Recent Advances in Counterfeit Art, Document, Photo, Hologram, and Currency Detection Using Hyperspectral Imaging

Forgery and tampering continue to provide unnecessary economic burdens. Although new anti-forgery and counterfeiting technologies arise, they inadvertently lead to the sophistication of forgery techniques over time, to a point where detection is no longer viable without technological aid. Among the various optical techniques, one of the recently used techniques to detect counterfeit products is HSI, which captures a range of electromagnetic data. To aid in the further exploration and eventual application of the technique, this study categorizes and summarizes existing related studies on hyperspectral imaging and creates a mini meta-analysis of this stream of literature. The literature review has been classified based on the product HSI has used in counterfeit documents, photos, holograms, artwork, and currency detection.

Diagnostic Approaches For COVID-19: Lessons Learned and the Path Forward

Coronavirus disease 2019 (COVID-19) is a transmitted respiratory disease caused by the infection of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Although humankind has experienced several outbreaks of infectious diseases, the COVID-19 pandemic has the highest rate of infection and has had high levels of social and economic repercussions. The current COVID-19 pandemic has highlighted the limitations of existing virological tests, which have failed to be adopted at a rate to properly slow the rapid spread of SARS-CoV-2. Pandemic preparedness has developed as a focus of many governments around the world in the event of a future outbreak. Despite the largely widespread availability of vaccines, the importance of testing has not diminished to monitor the evolution of the virus and the resulting stages of the pandemic. Therefore, developing diagnostic technology that serves as a line of defense has become imperative. In particular, that test should satisfy three criteria to be widely adopted: simplicity, economic feasibility, and accessibility. At the heart of it all, it must enable early diagnosis in the course of infection to reduce spread. However, diagnostic manufacturers need guidance on the optimal characteristics of a virological test to ensure pandemic preparedness and to aid in the effective treatment of viral infections. Nanomaterials are a decisive element in developing COVID-19 diagnostic kits as well as a key contributor to enhance the performance of existing tests. Our objective is to develop a profile of the criteria that should be available in a platform as the target product. In this work, virus detection tests were evaluated from the perspective of the COVID-19 pandemic, and then we generalized the requirements to develop a target product profile for a platform for virus detection.

Review on the Application of Hyperspectral Imaging Technology of the Exposed Cortex in Cerebral Surgery

The study of brain science is vital to human health. The application of hyperspectral imaging in biomedical fields has grown dramatically in recent years due to their unique optical imaging method and multidimensional information acquisition. Hyperspectral imaging technology can acquire two-dimensional spatial information and one-dimensional spectral information of biological samples simultaneously, covering the ultraviolet, visible and infrared spectral ranges with high spectral resolution, which can provide diagnostic information about the physiological, morphological and biochemical components of tissues and organs. This technology also presents finer spectral features for brain imaging studies, and further provides more auxiliary information for cerebral disease research. This paper reviews the recent advance of hyperspectral imaging in cerebral diagnosis. Firstly, the experimental setup, image acquisition and pre-processing, and analysis methods of hyperspectral technology were introduced. Secondly, the latest research progress and applications of hyperspectral imaging in brain tissue metabolism, hemodynamics, and brain cancer diagnosis in recent years were summarized briefly. Finally, the limitations of the application of hyperspectral imaging in cerebral disease diagnosis field were analyzed, and the future development direction was proposed.

Discriminating healthy from tumor tissue in breast lumpectomy specimens using deep learning-based hyperspectral imaging

Achieving an adequate resection margin during breast-conserving surgery remains challenging due to the lack of intraoperative feedback. Here, we evaluated the use of hyperspectral imaging to discriminate healthy tissue from tumor tissue in lumpectomy specimens. We first used a dataset obtained on tissue slices to develop and evaluate three convolutional neural networks. Second, we fine-tuned the networks with lumpectomy data to predict the tissue percentages of the lumpectomy resection surface. A MCC of 0.92 was achieved on the tissue slices and an RMSE of 9% on the lumpectomy resection surface. This shows the potential of hyperspectral imaging to classify the resection margins of lumpectomy specimens.

FPI Based Hyperspectral Imager for the Complex Surfaces—Calibration, Illumination and Applications

Hyperspectral imaging (HSI) applications for biomedical imaging and dermatological applications have been recently under research interest. Medical HSI applications are non-invasive methods with high spatial and spectral resolution. HS imaging can be used to delineate malignant tumours, detect invasions, and classify lesion types. Typical challenges of these applications relate to complex skin surfaces, leaving some skin areas unreachable. In this study, we introduce a novel spectral imaging concept and conduct a clinical pre-test, the findings of which can be used to develop the concept towards a clinical application. The SICSURFIS spectral imager concept combines a piezo-actuated Fabry–Pérot interferometer (FPI) based hyperspectral imager, a specially designed LED module and several sizes of stray light protection cones for reaching and adapting to the complex skin surfaces. The imager is designed for the needs of photometric stereo imaging for providing the skin surface models (3D) for each captured wavelength. The captured HS images contained 33 selected wavelengths (ranging from 477 nm to 891 nm), which were captured simultaneously with accordingly selected LEDs and three specific angles of light. The pre-test results show that the data collected with the new SICSURFIS imager enable the use of the spectral and spatial domains with surface model information. The imager can reach complex skin surfaces. Healthy skin, basal cell carcinomas and intradermal nevi lesions were classified and delineated pixel-wise with promising results, but further studies are needed. The results were obtained with a convolutional neural network.

Hyperspectral Imaging for Clinical Applications

Measuring morphological and biochemical features of tissue is crucial for disease diagnosis and surgical guidance, providing clinically significant information related to pathophysiology. Hyperspectral imaging (HSI) techniques obtain both spatial and spectral features of tissue without labeling molecules such as fluorescent dyes, which provides rich information for improved disease diagnosis and treatment. Recent advances in HSI systems have demonstrated its potential for clinical applications, especially in disease diagnosis and image-guided surgery. This review summarizes the basic principle of HSI and optical systems, deep-learning-based image analysis, and clinical applications of HSI to provide insight into this rapidly growing field of research. In addition, the challenges facing the clinical implementation of HSI techniques are discussed.

Oxygen saturation measurements using novel diffused reflectance with hyperspectral imaging: Towards facile COVID-19 diagnosis

Oxygen saturation level plays a vital role in screening, diagnosis, and therapeutic assessment of disease's assortment. There is an urgent need to design and implement early detection devices and applications for the COVID-19 pandemic; this study reports on the development of customized, highly sensitive, non-invasive, non-contact diffused reflectance system coupled with hyperspectral imaging for mapping subcutaneous blood circulation depending on its oxygen saturation level. The forearm of 15 healthy adult male volunteers with age range of (20-38 years) were illuminated via a polychromatic light source of a spectrum range 400-980 nm. Each patient had been scanned five times to calculate the mean spectroscopic reflectance images using hyperspectral camera. The customized signal processing algorithm includes normalization and moving average filter for noise removal. Afterward, employing K-means clustering for image segmentation to assess the accuracy of blood oxygen saturation (SpO₂) levels. The reliability of the developed diffused reflectance system was verified with the ground truth technique, a standard pulse oximeter. Non-invasive, non-contact diffused reflectance spectrum demonstrated maximum signal variation at 610 nm according to SpO₂ level. Statistical analysis (mean, standard deviation) of diffused reflectance hyperspectral images at 610 nm offered precise calibrated measurements to the standard pulse oximeter. Diffused reflectance associated with hyperspectral imaging is a prospective technique to assist with phlebotomy and vascular approach. Additionally, it could permit future surgical or pharmacological intercessions that titrate or limit ischemic injury continuously. Furthermore, this technique could offer a fast reliable indication of SpO₂ levels for COVID-19 diagnosis.

Multi-Aspect Optoacoustic Imaging of Breast Tumors under Chemotherapy with Exogenous and Endogenous Contrasts: Focus on Apoptosis and Hypoxia

Breast cancer is a complex tumor type involving many biological processes. Most chemotherapeutic agents exert their antitumoral effects by rapid induction of apoptosis. Another main feature of breast cancer is hypoxia, which may drive malignant progression and confer resistance to various forms of therapy. Thus, multi-aspect imaging of both tumor apoptosis and oxygenation in vivo would be of enormous value for the effective evaluation of therapy response. Herein, we demonstrate the capability of a hybrid imaging modality known as multispectral optoacoustic tomography (MSOT) to provide high-resolution, simultaneous imaging of tumor apoptosis and oxygenation, based on both the exogenous contrast of an apoptosis-targeting dye and the endogenous contrast of hemoglobin. MSOT imaging was applied on mice bearing orthotopic 4T1 breast tumors before and following treatment with doxorubicin. Apoptosis was monitored over time by imaging the distribution of xPLORE-APOFL750©, a highly sensitive poly-caspase binding apoptotic probe, within the tumors. Oxygenation was monitored by tracking the distribution of oxy- and deoxygenated hemoglobin within the same tumor areas. Doxorubicin treatment induced an increase in apoptosis-depending optoacoustic signal of xPLORE-APOFL750© at 24 h after treatment. Furthermore, our results showed spatial correspondence between xPLORE-APO750© and deoxygenated hemoglobin. In vivo apoptotic status of the tumor tissue was independently verified by ex vivo fluorescence analysis. Overall, our results provide a rationale for the use of MSOT as an effective tool for simultaneously investigating various aspects of tumor pathophysiology and potential effects of therapeutic regimes based on both endogenous and exogenous molecular contrasts.

Hyperspectral image-based analysis of thermal damage for ex-vivo bovine liver utilizing radiofrequency ablation

BACKGROUND & OBJECTIVE

Thermal ablation is the predominant methodology to treat liver tumors for segregating patients who are not permitted to have surgical intervention. However, noticing or predicting the size of the thermal strategies is a challenging endeavor. We aim to analyze the effects of ablation district volume following radiofrequency ablation (RFA) of ex-vivo liver exploiting a custom Hyperspectral Imaging (HSI) system.

MATERIALS AND METHODS

RFA was conducted on the ex-vivo bovine liver at focal and peripheral blood vessel sites and observed by Custom HSI system, which has been designed to assess the exactness and proficiency using visible and near-infrared wavelengths region for tissue thermal effect. The experiment comprised up to ten trials with RFA. The experiment was carried out in two stages to assess the percentage of the thermal effect on the investigated sample superficially and for the side penetration effect. Measuring the diffuse reflectance (Ŗ_d) of the sample to identify the spectral reflectance shift which could differentiate between normal and ablated tissue exploiting the designed cross-correlation algorithm for monitoring of thermal ablation.

RESULTS

Determination of the diffuse reflection (Ŗ_d) spectral signature responses from normal, thermal effected, and thermal ablation regions of the investigated liver sample. Where the ideal wavelength range at (600-640 nm) could discriminate between these different regions. Then, exploited the converted RGB image of the HS liver tissue after RFA for more validations which shows that the optimum wavelength for differentiation at (530-560 nm and 600-640 nm). Finally, applying statistical analysis to validate our results presenting that wavelength 600 nm had the highest standard deviation (δ) to differentiate between various thermally affected regions regarding the normal tissue and wavelength 640 nm shows the highest (δ) to differentiate between the ablated and normal regions.

CONCLUSION

The designed and implemented medical imaging system incorporated the hyperspectral camera capabilities with the associate cross-correlation algorithm that could successfully distinguish between the ablated and thermally affected regions to assist the surgery during the tumor therapy.

Integration of transcriptomes analysis with spectral signature of total RNA for generation of affordable remote sensing of Hepatocellular carcinoma in serum clinical specimens

Hepatocellular carcinoma (HCC) is a major global health problem with about 841,000 new cases and 782,000 deaths annually, due to lacking early biomarker/s, and centralized diagnosis. Transcriptomes research despite its infancy has proved excellence in its implementation in identifying a coherent specific cancer RNAs differential expression. However, results are sometimes overlapped by other cancer types which negatively affecting specificity, plus the high cost of the equipment used. Hyperspectral imaging (HSI) is an advanced tool with unique, spectroscopic features, is an emerging tool that has widely been used in cancer detection. Herein, a pilot study has been performed for HCC diagnosis, by exploiting HIS properties and the analysis of the transcriptome for the development of non-invasive remote HCC sensing. HSI data cube images of the sera extracted total RNA have been analyzed in HCC, normal subject, liver benign tumor, and chronic HCV with cirrhotic/non-cirrhotic liver groups. Data analyses have revealed a specific spectral signature for all groups and can be easily discriminated; at the computed optimum wavelength. Moreover, we have developed a simple setup based on a commercial laser pointer for sample illumination and a Smartphone CCD camera, with HSI consistent data output. We hypothesized that RNA differential expression and its spatial organization/folding are the key players in the obtained spectral signatures. To the best of our knowledge, we are the first to use HSI for sensing cancer based on total RNA in serum, using a Smartphone CCD camera/laser pointer. The proposed biosensor is simple, rapid (2 min), and affordable with specificity and sensitivity of more than 98% and high accuracy.

Delineation of the Arm Blood Vessels Utilizing Hyperspectral Imaging to Assist with Phlebotomy for Exploiting the Cutaneous Tissue Oxygen Concentration

SIGNIFICANCE

The estimation of tissue oxygenation is vital in the diagnosis and therapeutic evaluation of a huge assortment of diseases. The hyperspectral (HS) imaging system is a rising innovation that can be utilized to build a highly sensitive, non-invasive, and tissue hemoglobin immersion map.

OBJECTIVE

As a result of the urgent need to design and implement early detection devices and applications for the COVID-19 pandemic, we propose building a non-invasive custom optical imaging system to assist with phlebotomy and vascular approach to survey the reliability of blood oxygen saturation (SpO2) levels recovered from spectral images.

MATERIALS AND METHODS

HS images were gathered from 15 healthy subjects without previous medical history complications and with an average age range of 20 to 38 years, who were undergoing phlebotomy. The forearm was vigorously illuminated utilizing an HS camera with polychromatic source light of spectrum range (400∼980 nm). Spectroscopic reflectance images were caught by a focal plane exhibit for the region of interest (ROI). Then the custom algorithm comprising normalization and moving average filtering for noise removal was applied, followed by K-mean clustering for image segmentation to visualize and highlight the arteries and the veins in the investigated forearm.

RESULTS

The investigations show that after normalization of the recorded signal from the HS camera of the participating subjects it was noticed that at wavelength of 460 nm the oxygenated arteries had a stronger signal than the de-oxygenated veins, and at a wavelength of 750 nm the de-oxygenated veins had a stronger signal than the oxygenated arteries. Thus, the ideal wavelength to reveal the oxygenated arteries was 460 nm, and the ideal wavelength to reveal the de-oxygenated veins was 750 nm.

CONCLUSIONS

HSI is a prospective technique to assist with phlebotomy and non-contact oxygen saturation approach. Additionally, it may permit future surgical or pharmacological intercessions that titrate or limit ischemic injury continuously.

A review of the medical hyperspectral imaging systems and unmixing algorithms' in biological tissues

Hyperspectral fluorescence imaging (HFI) is a well-known technique in the medical research field and is considered a non-invasive tool for tissue diagnosis. This review article gives a brief introduction to acquisition methods, including the image preprocessing methods, feature selection and extraction methods, data classification techniques and medical image analysis along with recent relevant references. The process of fusion of unsupervised unmixing techniques with other classification methods, like the combination of support vector machine with an artificial neural network, the latest snapshot Hyperspectral imaging (HSI) and vortex analysis techniques are also outlined. Finally, the recent applications of hyperspectral images in cellular differentiation of various types of cancer are discussed.

Hyperspectral Imaging for Glioblastoma Surgery: Improving Tumor Identification Using a Deep Spectral-Spatial Approach

The primary treatment for malignant brain tumors is surgical resection. While gross total resection improves the prognosis, a supratotal resection may result in neurological deficits. On the other hand, accurate intraoperative identification of the tumor boundaries may be very difficult, resulting in subtotal resections. Histological examination of biopsies can be used repeatedly to help achieve gross total resection but this is not practically feasible due to the turn-around time of the tissue analysis. Therefore, intraoperative techniques to recognize tissue types are investigated to expedite the clinical workflow for tumor resection and improve outcome by aiding in the identification and removal of the malignant lesion. Hyperspectral imaging (HSI) is an optical imaging technique with the power of extracting additional information from the imaged tissue. Because HSI images cannot be visually assessed by human observers, we instead exploit artificial intelligence techniques and leverage a Convolutional Neural Network (CNN) to investigate the potential of HSI in twelve in vivo specimens. The proposed framework consists of a 3D-2D hybrid CNN-based approach to create a joint extraction of spectral and spatial information from hyperspectral images. A comparison study was conducted exploiting a 2D CNN, a 1D DNN and two conventional classification methods (SVM, and the SVM classifier combined with the 3D-2D hybrid CNN) to validate the proposed network. An overall accuracy of 80% was found when tumor, healthy tissue and blood vessels were classified, clearly outperforming the state-of-the-art approaches. These results can serve as a basis for brain tumor classification using HSI, and may open future avenues for image-guided neurosurgical applications.

Custom optical imaging system for ex-vivo breast cancer detection based on spectral signature

BACKGROUND AND PURPOSE

Breast cancer is a popular well-known tumor in women globally and the subsequent driving reason for malignancy death. The purpose of the present study is to develop Low cost, commercial, and affordable system that discriminates malignant from normal breast tissues by exploiting the unique properties of Hyperspectral (HS) Imaging.

MATERIALS AND METHODS

The difference in the optical properties of the investigated breast tissues gives various reactions to light transmission, absorption, and especially the reflection over the spectral range. A custom optical imaging system (COIS) was designed to assess variable responses to monochromatic LEDs (415, 565, 660 nm) to highlight the differences in the reflectance properties of malignant/normal tissue. Statistical analysis was computed for determining the ideal wavelength to differentiate between normal and malignant regions. The experiment was repeated using the same LEDs, and low-cost CCD camera to examine the capability of such a system to discriminate between normal and malignant tissue.

RESULTS

Spectral images obtained by Hyperspectral camera, have been analyzed to reveal the difference of reflectance malignant and normal breast tissue. Superficial spectral reflection image with blue LED (415 nm) showed high variance (10.11). However, a more-depth reflection image with red LED (660 nm) showed low variance (4.44). So the optimum contrast image was produced by combining the three spectral information images from blue, green, and red LED. The COIS using a commercial CCD camera was in agreement with the HS camera.

CONCLUSIONS

The novel COIS of the commercial Low-cost CCD Camera is reliable and can be used with endoscopy technique as an assistant tool for surgical doctor to make decision and assess the resection edges in real time during surgery.