A method for real-time classification of insect vectors of mosaic and brown streak disease in cassava plants for future implementation within a low-cost, handheld, in-field multispectral imaging sensor

BACKGROUND

The paper introduces a multispectral imaging system and data-processing approach for the identification and discrimination of morphologically indistinguishable cryptic species of the destructive crop pest, the whitefly Bemisia tabaci. This investigation and the corresponding system design, was undertaken in two phases under controlled laboratory conditions. The first exploited a prototype benchtop variant of the proposed sensor system to analyse four cryptic species of whitefly reared under similar conditions. The second phase, of the methodology development, employed a commercial high-precision laboratory hyperspectral imager to recover reference data from five cryptic species of whitefly, immobilized through flash freezing, and taken from across four feeding environments.

RESULTS

The initial results, for the single feeding environment, showed that a correct species classification could be achieved in 85-95% of cases, utilising linear Partial Least Squares approaches. The robustness of the classification approach was then extended both in terms of the automated spatial extraction of the most pertinent insect body parts, to assist with the spectral classification model, as well as the incorporation of a non-linear Support Vector Classifier to maintain the overall classification accuracy at 88-98%, irrespective of the feeding and crop environment.

CONCLUSION

This study demonstrates that through an integration of both the spatial data, associated with the multispectral images being used to separate different regions of the insect, and subsequent spectral analysis of those sub-regions, that B. tabaci viral vectors can be differentiated from other cryptic species, that appear morphologically indistinguishable to a human observer, with an accuracy of up to 98%. The implications for the engineering design for an in-field, handheld, sensor system is discussed with respect to the learning gained from this initial stage of the methodology development.

Investigation of pausing fermentation of salamis with multispectral imaging for optimal sensory evaluations

The fermentation process of salamis involves several parameters influencing taste, texture, and color of the salami. One significant parameter is the fermentation time. It is difficult to conduct sensory evaluations to assess the effect of time without introducing variation between observation days. It may be possible to overcome this by stalling or pausing the fermentation by deep-chilling the salamis. This study investigates the difference of non- and deep-chilled salamis with the use of a multispectral imaging system. The statistical investigation, based on image features relating to size, visual texture, and color of the sausages over time, showed that it may be possible to stall the fermentation process. It was shown that a statistical difference in the two kinds of samples is present. For the size feature the difference could be quantified into a number of days. However, for the important color feature only a statistical difference was observed, whereas the visual difference expressed in terms of ΔE_ab^⁎ was barely present.

Novel non-destructive quality assessment techniques of onion bulbs: a comparative study

This study was designed to compare the performances of four different non-destructive methods of assessing onion quality, one of which was based on near-infrared spectroscopy, and three of which were based on spectral imaging. These methods involve a combination of wavelengths from visible to near-infrared with different acquisition systems that were applied to discriminate between pre-sorted onions by in situ measurements of the onion surface. Compared with the partial least squares discriminant analysis classification models associated with different methods, hyperspectral imaging (HSI) with both static horizontal and rotating orientation obtained a higher level of sensitivity and specificity with a lower classification error than did other methods. Moreover, models built with the reduced variables did not lower the model performances. Overall, these results demonstrate that HSI with selected wavelengths would be useful for further developing an improved real-time system for sorting onion bulbs.

Study of the adhesion of explosive residues to the finger and transfer to clothing and luggage

It is important to understand the extent of transfer of explosive particles to different surfaces in order to better evaluate potential cross-contamination by explosives in crowded security controls such as those at airports. This work investigated the transfer of nine explosive residues (ANFO, dynamite, black powder, TNT, HMTD, PETN, NH₄NO₃, KNO₃, NaClO₃) through fingerprints from one surface to another. First, the extent of adhesion of explosive residues from different surfaces to the bare finger, nitrile and latex gloves was studied. Then, the transfer of explosive residues from one surface to another through fingerprints was investigated. Cotton fabric (hereinafter referred to as cotton) as clothing material and polycarbonate plastic (hereinafter referred to as polycarbonate) as luggage material were chosen for the experiments. These surfaces containing explosive particles were imaged using a reflex camera before and after the particles were transferred. Afterwards the images were processed in MATLAB where pixels corresponding to explosive residues were quantified. Results demonstrated that transfer of explosive residues frequently occurred with certain differences among materials. Generally, the amount of explosive particles adhered to the finger decreased in the following order: skin>latex>nitrile, while the transfer of particles from the finger to another surface was the opposite. The adhesion of explosive residues from polycarbonate to the finger was found to be better compared to cotton, while the amount of particles transferred to cotton was higher.

Multispectral photoacoustic microscopy and optical coherence tomography using a single supercontinuum source

We report on the use of a single supercontinuum (SC) source for multimodal imaging. The 2-octave bandwidth (475-2300 nm) makes the SC source suitable for optical coherence tomography (OCT) as well as for multispectral photoacoustic microscopy (MPAM). The IR band centered at 1310 nm is chosen for OCT to penetrate deeper into tissue with 8 mW average power on the sample. The 500-840 nm band is used for MPAM. The source has the ability to select the central wavelength as well as the spectral bandwidth. An energy of more than 35 nJ within a less than 50 nm bandwidth is achieved on the sample for wavelengths longer than 500 nm. In the present paper, we demonstrate the capabilities of such a multimodality imaging instrument based on a single optical source. In vitro mouse ear B-scan images are presented.

Superpixel segmentation and pigment identification of colored relics based on visible spectral image

To enrich the contents of digital archive and to guide the copy and restoration of colored relics, non-invasive methods for extraction of painting boundary and identification of pigment composition are proposed in this study based on the visible spectral images of colored relics. Superpixel concept is applied for the first time to the field of oversegmentation of visible spectral images and implemented on the visible spectral images of colored relics to extract their painting boundary. Since different pigments are characterized by their own spectrum and the same kind of pigment has the similar geometric profile in spectrum, an automatic identification method is established by comparing the proximity between the geometric profiles of the unknown spectrum from each superpixel and the pre-known spectrum from a deliberately prepared database. The methods are validated using the visible spectral images of the ancient wall paintings in Mogao Grottoes. By the way, the visible spectral images are captured by a multispectral imaging system consisting of two broadband filters and a RGB camera with high spatial resolution.

Comparing the effectiveness of hyperspectral imaging and Raman spectroscopy: a case study on Armenian manuscripts

There is great practical and scholarly interest in the identification of pigments in works of art. This paper compares the effectiveness of the widely used Raman Spectroscopy (RS), with hyperspectral imaging (HSI), a reflectance imaging technique, to evaluate the reliability of HSI for the identification of pigments in historic works of art and to ascertain if there are any benefits from using HSI or a combination of both. We undertook a case study based on six Armenian illuminated manuscripts (eleventh-eighteenth centuries CE) in the Bodleian Library, University of Oxford. RS, and HSI (380-1000 nm) were both used to analyse the same 10 folios, with the data then used to test the accuracy and efficiency of HSI against the known results from RS using reflectance spectra reference databases compiled by us for the project. HSI over the wavelength range 380-1000 nm agreed with RS at best 93% of the time, and performance was enhanced using the SFF algorithm and by using a database with many similarities to the articles under analysis. HSI is significantly quicker at scanning large areas, and can be used alongside RS to identify and map large areas of pigment more efficiently than RS alone. HSI therefore has potential for improving the speed of pigment identification across manuscript folios and artwork but must be used in conjunction with a technique such as RS.

A Quantitative Pathology Approach to Analyze the Development of Human Cancer-Associated Tertiary Lymphoid Structures

Tertiary lymphoid structures (TLS) develop in the human tumor microenvironment and correlate with prolonged survival in most cancer types. We recently demonstrated that TLS development follows sequential maturation stages and culminates in the generation of a germinal center (GC) reaction. This maturation process is crucial for the prognostic relevance of TLS in lung and colorectal cancer patients.The mechanisms underlying TLS development in various inflammatory conditions or their functional relevance in tumor immunity are not fully understood. Investigating which cell types and soluble mediators orchestrate lymphoid neogenesis in human tissues requires a method that allows simultaneous detection of multiple markers.Here, we describe a quantitative pathology approach to identify and quantify different TLS maturation stages in combination with other parameters. This approach consists of seven-color immunofluorescence protocol using tyramide signal amplification combined with multispectral microscopy and quantitative data acquisition from histological images.

Spectral Behavior of White Pigment Mixtures Using Reflectance, Ultraviolet-Fluorescence Spectroscopy, and Multispectral Imaging

Reflectance spectroscopy, ultraviolet (UV)-fluorescence spectroscopy, and multispectral imaging have been widely employed for pigment identification on paintings. From ancient times to the present, lead white, zinc white, and titanium white have been the most important white pigments used for paintings and they are used as pigment markers for dating a work of art. The spectral behavior of these pigments is reported in several scientific papers and websites, but those of their mixtures are quite unknown. We present a combined nondestructive approach for identifying mixtures of lead white, zinc white, and titanium white as powder and dispersed in two different binder media (egg yolk and linseed oil) by using reflectance spectroscopy, spectrofluorimetry, multispectral reflectance and UV-fluorescence imaging. We propose a novel approach for mapping the presence of white pigments in paintings by false color images obtained from multispectral reflectance and UV-fluorescence images. We found that the presence of lead white mixed with either zinc white or titanium white is highly detectable. Zinc white mixed with lead white or titanium white can be identified due to its UV-fluorescence emission, whereas titanium white in association with lead white or zinc white is distinguishable by its reflectance spectral features. In most cases, the UV-fluorescence analyses also permit the recognition of the binder media in which the pigments are dispersed.

Rapid detection of frozen-then-thawed minced beef using multispectral imaging and Fourier transform infrared spectroscopy

In recent years, fraud detection has become a major priority for food authorities, as fraudulent practices can have various economic and safety consequences. This work explores ways of identifying frozen-then-thawed minced beef labeled as fresh in a rapid, large-scale and cost-effective way. For this reason, freshly-ground beef was purchased from seven separate shops at different times, divided in fifteen portions and placed in Petri dishes. Multi-spectral images and FTIR spectra of the first five were immediately acquired while the remaining were frozen (-20°C) and stored for 7 and 32days (5 samples for each time interval). Samples were thawed and subsequently subjected to similar data acquisition. In total, 105 multispectral images and FTIR spectra were collected which were further analyzed using partial least-squares discriminant analysis and support vector machines. Two meat batches (30 samples) were reserved for independent validation and the remaining five batches were divided in training and test set (75 samples). Results showed 100% overall correct classification for test and external validation MSI data, while FTIR data yielded 93.3 and 96.7% overall correct classification for FTIR test set and external validation set respectively.

Characteristics of Xanthosoma sagittifolium roots during cooking, using physicochemical analysis, uniaxial compression, multispectral imaging and low field NMR spectroscopy

To effectively promote the industrial utilization of cocoyam (Xanthosoma sagittifolium) roots for enhanced food sustainability and security, there is a need to study their molecular, mechanical and physicochemical properties in detail. The physicochemical and textural characteristics of the red and white varieties of cocoyam roots were thus analysed by low field nuclear magnetic resonance relaxometry, multispectral imaging, uniaxial compression testing, and relevant physicochemical analysis in the current study. Both varieties had similar dry matter content, as well as physical and mechanical properties. However, up to four fast-interacting water populations were observed in the roots, dependent on the root variety and their degree of gelatinization during cooking. Changes in the relaxation parameters indicated weak gelatinization of starch at approximately 80 °C in both varieties. However, shorter relaxation times and a higher proportion of restricted water in the white variety indicated that this variety was slightly more sensitive towards gelatinization. A strong negative correlation existed between dry matter and all multispectral wavelengths >800 nm, suggesting the potential use of that spectral region for rapid analysis of dry matter and water content of the roots. The small, but significant differences in the structural and gelatinization characteristics of the two varieties indicated that they may not be equally suited for further processing, e.g. to flours or starches. Processors thus need to choose their raw materials wisely dependent on the aimed product characteristics. However, the spectroscopic methods applied in the study were shown to be effective in assessing important quality attributes during cooking of the roots.

Evaluation of Cerebral Hemodynamics and Tissue Morphology of In Vivo Rat Brain Using Spectral Diffuse Reflectance Imaging

We investigated a quantitative imaging of reduced scattering coefficients μ_s'( λ) and the absorption coefficients μ_a( λ) of in vivo cortical tissues in the range from visible to near-infrared (NIR) wavelengths based on diffuse reflectance spectral imaging technique. In this method, diffuse reflectance images of in vivo cortical tissue are acquired at nine wavelengths (500, 520, 540, 560, 570, 580, 600, 730, and 760 nm). A multiple regression analysis aided by the Monte Carlo simulation for the absorbance spectra is then utilized to estimate the optical coefficients of cortical tissue. This analysis calculates the concentration of oxygenated hemoglobin and that of deoxygenated hemoglobin, the scattering amplitude a and the scattering power b. The spectrum of absorption coefficient is deduced from the estimated concentrations of oxygenated hemoglobin and deoxygenated hemoglobin. The spectrum of reduced scattering coefficient is determined by the estimated scattering amplitude and scattering power. The particle size distribution of microstructure is calculated from the estimated scattering power b for evaluating the morphological change in brain tissue quantitatively. Animal experiments with in vivo exposed brain of rats demonstrated that the responses of the absorption properties to hyperoxic and anoxic conditions are in agreement with the expected well-known cortical hemodynamics. The average particle size was significantly reduced immediately after the onset of anoxia and then it was changed into an increase, which implied the swelling and shrinkage of the cellular and subcellular structures induced by loss of tissue viability in brain tissue.

Phenotyping Multiple Subsets of Immune Cells In Situ in Formalin-Fixed, Paraffin-Embedded Tissue Sections

Some somatic illnesses such as peripheral tumours can present with psychiatric symptoms. Many of these are characterized by changes in biomarkers related to the inflammation or immune response. Here, we describe a multispectral imaging protocol that can be used to phenotype immune and other cell types through simultaneous imaging of multiple proteins in sections of peripheral solid tumours and other tissues. This approach can also be used to assess the spatial organization of these cells within the tissue.

Transferring results from NIR-hyperspectral to NIR-multispectral imaging systems: A filter-based simulation applied to the classification of Arabica and Robusta green coffee

Due to the differences in terms of both price and quality, the availability of effective instrumentation to discriminate between Arabica and Robusta coffee is extremely important. To this aim, the use of multispectral imaging systems could provide reliable and accurate real-time monitoring at relatively low costs. However, in practice the implementation of multispectral imaging systems is not straightforward: the present work investigates this issue, starting from the outcome of variable selection performed using a hyperspectral system. Multispectral data were simulated considering four commercially available filters matching the selected spectral regions, and used to calculate multivariate classification models with Partial Least Squares-Discriminant Analysis (PLS-DA) and sparse PLS-DA. Proper strategies for the definition of the training set and the selection of the most effective combinations of spectral channels led to satisfactory classification performances (100% classification efficiency in prediction of the test set).

Multispectral Imaging Analysis of Circulating Tumor Cells in Negatively Enriched Peripheral Blood Samples

A variety of biomarkers are present on cells in peripheral blood of patients with a variety of disorders, including solid tumor malignancies. While rare, characterization of these cells for specific protein levels with the advanced technology proposed, will lead to future validation studies of blood samples as "liquid biopsies" for the evaluation of disease status and therapeutic response. While circulating tumor cells (CTCs) have been isolated in the blood samples of patients with solid tumors, the exact role of CTCs as clinically useful predictive markers is still debated. Current commercial technology has significant bias in that a positive selection technology is used that preassumes specific cell surface markers (such as EpCAM) are present on CTCs. However, CTCs with low EpCAM expression have been experimentally demonstrated to be more likely to be missed by this method. In contrast, this application uses a previously developed, technology that performs a purely negative enrichment methodology on peripheral blood, yielding highly enriched blood samples that contain CTCs as well as other, undefined cell types. The focus of this contribution is the use of multispectral imaging of epifluorescent, microscopic images of these enriched cells in order to help develop clinically relevant liquid biopsies from peripheral blood samples.

Imaging Neural Architecture in Brainbow Samples

The fluorescent protein revolution has made the light microscope the most widely used tool for studying biological structure from the single-molecule to whole organism scales. However, traditional approaches are limited in their ability to resolve components in highly complex structures, such as the brain. In recent years, this limitation has been circumvented by the development of multicolor labeling methods, termed Brainbow. Brainbow tools rely on site-specific recombinases to make stochastic "choices" between different combinations of fluorescent proteins so that structures in close proximity to one another can be resolved based on their color profile. These new approaches, however, call for more refined methods of sample preparation and imaging optimized for multispectral imaging, which are presented here. The most robust approach for generating useful Brainbow data combines immunohistology with multispectral laser scanning confocal microscopy. This chapter, therefore, focuses on this particular technique, though the imaging principle discussed here is applicable to other Brainbow approaches as well.

Spectral Unmixing Methods and Tools for the Detection and Quantitation of Collagen and Other Macromolecules in Tissue Specimens

Collagen and other components in the extracellular matrix are proving of increasing importance for the understanding of complex cell and tissue interactions in a variety of settings. Detection and quantitation of these components can still prove challenging, and a number of techniques have been developed. We focus here on methods in fluorescence-based assessments, including multiplexed immunodetection and the use of simpler histochemical stains, both complemented by linear unmixing techniques. Typically, differentiating these components requires the use of a set of optical filters to isolate each fluorescent compound from each other and from often bright background autofluorescence signals. However, standard fluorescent microscopes are usually only able to separate a limited number of components. If the emission spectra of the fluorophores are spectrally distinct, but overlapping, sophisticated spectral imaging or computational methods can be used to optimize separation and quantitation. This chapter describes spectral unmixing methodology and associated open-source software tools available to analyze multispectral as well as simple color (RGB) images.

In vivo oximetry of human bulbar conjunctival and episcleral microvasculature using snapshot multispectral imaging

Multispectral imaging (MSI) is a well-established technique for non-invasive oximetry of retinal blood vessels, which has contributed to the understanding of a variety of retinal conditions, including glaucoma, diabetes, vessel occlusion, and retinal auto-regulation. We report the first study to use snapshot multi-spectral imaging (SMSI) for oximetry of the bulbar conjunctival and episcleral microvasculature in the anterior segment of the eye. We report the oxygen dynamics of the bulbar conjunctival and episcleral microvasculature at normoxia and at acute mild hypoxia conditions. A retinal-fundus camera fitted with a custom Image-Replicating Imaging Spectrometer was used to image the bulbar conjunctival and episcleral microvasculature in ten healthy human subjects at normoxia (21% Fraction of Inspired Oxygen [FiO2]) and acute mild hypoxia (15% FiO2) conditions. Eyelid closure was used to control oxygen diffusion between ambient air and the sclera surface. Four subjects were imaged for 30 seconds immediately following eyelid opening. Vessel diameter and Optical Density Ratio (ODR: a direct proxy for oxygen saturation) of vessels was computed automatically. Oximetry capability was validated using a simple phantom that mimicked the scleral vasculature. Acute mild hypoxia resulted in a decrease in blood oxygen saturation (SO2) (i.e. an increase in ODR) when compared with normoxia in both bulbar conjunctival (p < 0.001) and episcleral vessels (p = 0.03). Average episcleral diameter increased from 78.9 ± 8.7 μm (mean ± standard deviation) at normoxia to 97.6 ± 14.3 μm at hypoxia (p = 0.02). Diameters of bulbar conjunctival vessels showed no significant change from 80.1 ± 7.6 μm at normoxia to 80.6 ± 7.0 μm at hypoxia (p = 0.89). When exposed to ambient air, hypoxic bulbar conjunctival vessels rapidly reoxygenated due to oxygen diffusion from ambient air. Reoxygenation occured in an exponential manner, and SO2 reached normoxia baseline levels. The average ½ time to full reoxygenation was 3.4 ± 1.4 s. As a consequence of oxygen diffusion, bulbar conjunctival vessels will be highly oxygenated (i.e. close to 100% SO2) when exposed to ambient air. Episcleral vessels were not observed to undergo any significant oxygen diffusion, instead behaving similarly to pulse oximetry measurements. This is the first study to the image oxygen dynamics of bulbar conjunctival and episcleral microvasculature, and consequently, the first study to directly observe the rapid reoxygenation of hypoxic bulbar conjunctival vessels when exposed to ambient air. Oximetry of bulbar conjunctival vessels could potentially provide insight into conditions where oxygen dynamics of the microvasculature are not fully understood, such as diabetes, sickle-cell diseases, and dry-eye syndrome. Oximetry in the bulbar conjunctival and episcleral microvasculature could be complimentary or alternative to retinal oximetry.

Robust near real-time estimation of physiological parameters from megapixel multispectral images with inverse Monte Carlo and random forest regression

PURPOSE

Multispectral imaging can provide reflectance measurements at multiple spectral bands for each image pixel. These measurements can be used for estimation of important physiological parameters, such as oxygenation, which can provide indicators for the success of surgical treatment or the presence of abnormal tissue. The goal of this work was to develop a method to estimate physiological parameters in an accurate and rapid manner suited for modern high-resolution laparoscopic images.

METHODS

While previous methods for oxygenation estimation are based on either simple linear methods or complex model-based approaches exclusively suited for off-line processing, we propose a new approach that combines the high accuracy of model-based approaches with the speed and robustness of modern machine learning methods. Our concept is based on training random forest regressors using reflectance spectra generated with Monte Carlo simulations.

RESULTS

According to extensive in silico and in vivo experiments, the method features higher accuracy and robustness than state-of-the-art online methods and is orders of magnitude faster than other nonlinear regression based methods.

CONCLUSION

Our current implementation allows for near real-time oxygenation estimation from megapixel multispectral images and is thus well suited for online tissue analysis.

Assessment of advanced glycated end product accumulation in skin using auto fluorescence multispectral imaging

Several studies have shown that advanced glycation end products (AGE) play a role in both the microvascular and macrovascular complications of diabetes and are closely linked to inflammation and atherosclerosis. AGEs accumulate in skin and can be detected using their auto fluorescence (AF). A significant correlation exists between AGE AF and the levels of AGEs as obtained from skin biopsies. A commercial device, the AGE Reader, has become available to assess skin AF for clinical purposes but, while displaying promising results, it is limited to single-point measurements performed in contact to skin tissue. Furthermore, in vivo imaging of AGE accumulation is virtually unexplored. We proposed a non-invasive, contact-less novel technique for quantifying fluorescent AGE deposits in skin tissue using a multispectral imaging camera setup (MSI) during ultraviolet (UV) exposure. Imaging involved applying a region-of-interest mask, avoiding specular reflections and a simple calibration. Results of a study conducted on 16 subjects with skin types ranging from fair to deeply pigmented skin, showed that AGE measured with MSI in forearm skin was significantly correlated with the AGE reference method (AGE Reader on forearm skin, R=0.68, p=0.005). AGE measured in facial skin was borderline significantly related to AGE Reader on forearm skin (R=0.47, p=0.078). These results support the use of the technique in devices for non-touch measurement of AGE content in either facial or forearm skin tissue over time.

Lipid volume fraction in atherosclerotic plaque phantoms classified under saline conditions by multispectral angioscopy at near-infrared wavelengths around 1200 nm

To identify high-risk atherosclerotic lesions, we require detailed information on the stability of atherosclerotic plaques. In this study, we quantitatively classified the lipid volume fractions in atherosclerotic plaque phantoms by a novel angioscope combined with near-infrared multispectral imaging. The multispectral angioscope was operated at peak absorption wavelengths of lipid in vulnerable plaques (1150, 1200, and 1300 nm) and at lower absorption wavelengths of water. The potential of the multispectral angioscope was demonstrated in atherosclerotic plaque phantoms containing 10-60 vol.% lipid and immersed in saline solution. The acquired multispectral data were processed by a spectral angle mapper algorithm, which enhanced the simulated plaque areas. Consequently, we classified the lipid volume fractions into five categories (0-5, 5-15, 15-30, 30-50, and 50-60 vol.%). Multispectral angioscopy at wavelengths around 1200 nm is a powerful tool for quantitatively evaluating the stability of atherosclerotic plaques based on the lipid volume fractions.

Expression and colocalization of β-catenin and lymphoid enhancing factor-1 in prostate cancer progression

The purpose of this study was to objectively investigate β-catenin and LEF1 abundance, subcellular localization, and colocalization across benign and staged prostate cancer (PCa) specimens. A tissue microarray containing tumor-adjacent histologically benign prostate tissue (BPT; n = 48 patients), high-grade prostatic intraepithelial neoplasia (HGPIN; n = 25), localized PCa (n = 42), aggressive PCa (n = 31), and metastases (n = 22) was stained using multiplexed immunohistochemistry with antibodies toward E-cadherin, β-catenin, and LEF1. Multispectral imaging was used for quantitation, and protein expression and colocalization was evaluated across PCa progression. Stromal nuclear β-catenin abundance was greater in HGPIN and PCa compared with BPT (P < .05 for both), and epithelial nuclear β-catenin abundance was lower in metastatic PCa than in BPT (P < .05 for both). Epithelial and stromal nuclear LEF1 abundance was greater in HGPIN compared with BPT, whereas epithelial nuclear LEF1 was also greater in metastases. The proportion of epithelial and stromal nuclear double-positive β-catenin(+)/LEF1(+) cells was greater in HGPIN compared with BPT. In addition, the proportion of epithelial β-catenin(+)/LEF1(+) cells was greater in localized PCa and metastases compared with BPT. A significant amount of stromal cells were positive for LEF1 but not β-catenin. β-Catenin and LEF1 abundance were negatively correlated in the epithelium (P < .0001) but not the stroma (P > .05). We conclude that β-catenin and LEF1 colocalization is increased in HGPIN and metastasis relative to BPT, suggesting a role for β-catenin/LEF1-mediated transcription in both malignant transformation and metastasis of PCa. Furthermore, our results suggest that LEF1 abundance alone is not a reliable readout for β-catenin activity in prostate tissues.

Application of multispectral imaging in quantitative immunohistochemistry study of breast cancer: a comparative study

Multispectral imaging (MSI) based on imaging and spectroscopy, as relatively novel to the field of histopathology, has been used in biomedical multidisciplinary researches. We analyzed and compared the utility of multispectral (MS) versus conventional red-green-blue (RGB) images for immunohistochemistry (IHC) staining to explore the advantages of MSI in clinical-pathological diagnosis. The MS images acquired of IHC-stained membranous marker human epidermal growth factor receptor 2 (HER2), cytoplasmic marker cytokeratin5/6 (CK5/6), and nuclear marker estrogen receptor (ER) have higher resolution, stronger contrast, and more accurate segmentation than the RGB images. The total signal optical density (OD) values for each biomarker were higher in MS images than in RGB images (all P < 0.05). Moreover, receiver operator characteristic (ROC) analysis revealed that a greater area under the curve (AUC), higher sensitivity, and specificity in evaluation of HER2 gene were achieved by MS images (AUC = 0.91, 89.1 %, 83.2 %) than RGB images (AUC = 0.87, 84.5, and 81.8 %). There was no significant difference between quantitative results of RGB images and clinico-pathological characteristics (P > 0.05). However, by quantifying MS images, the total signal OD values of HER2 positive expression were correlated with lymph node status and histological grades (P = 0.02 and 0.04). Additionally, the consistency test results indicated the inter-observer agreement was more robust in MS images for HER2 (inter-class correlation coefficient (ICC) = 0.95, r s = 0.94), CK5/6 (ICC = 0.90, r s = 0.88), and ER (ICC = 0.94, r s = 0.94) (all P < 0.001) than that in RGB images for HER2 (ICC = 0.91, r s = 0.89), CK5/6 (ICC = 0.85, r s = 0.84), and ER (ICC = 0.90, r s = 0.89) (all P < 0.001). Our results suggest that the application of MS images in quantitative IHC analysis could obtain higher accuracy, reliability, and more information of protein expression in relation to clinico-pathological characteristics versus conventional RGB images. It may become an optimal IHC digital imaging system used in quantitative pathology.

SIGIRR/TIR8, an important regulator of TLR4 and IL-1R-mediated NF-κB activation, predicts biochemical recurrence after prostatectomy in low-grade prostate carcinomas

Single Ig IL-1-related receptor (SIGIRR) is a negative regulator of toll-like receptor 4 and IL-1-mediated activation of nuclear factor κ-light-chain enhancer of activated B cells. The purpose of this study was to qualitatively and quantitatively determine SIGIRR protein expression in human prostate tissues and associate SIGIRR expression with clinical parameters. SIGIRR expression was quantified in glandular prostate tissue using immunohistochemistry and multispectral imaging, and expression was evaluated in relation to clinicopathological features of benign prostatic hyperplasia and prostate cancer (PCa). Subgroupings of low Gleason score (≤ 6 and 3 + 4) and high Gleason score (4 + 3 and ≥ 8) were used for patient outcomes. SIGIRR was predominantly expressed in the cytoplasm and nucleus of the prostatic epithelium with little expression within the stroma. Compared with normal prostate, cytoplasmic SIGIRR expression was similar in benign prostatic hyperplasia, high-grade prostatic intraepithelial neoplasia, PCa, and metastases. A decrease in nuclear expression was found in metastasis samples (P = .04). Changes in SIGIRR expression were not associated with Gleason score, pathological stage, tumor volume, surgical margin status, or serum prostate-specific antigen (P > .05). Nuclear (P = .96) and cytoplasmic (P = .89) SIGIRR expressions were not related to patient outcomes in univariable analysis, but in the analysis of patients with low Gleason scores, high cytoplasmic SIGIRR expression was associated with biochemical recurrence in both univariable (P = .01) and multivariable (hazard ratio, 2.31 [95% confidence interval 1.05-5.06]; P = .04) analyses. Similarly, in multivariable analysis of only low-stage (pT2) tumors, SIGIRR independently predicted biochemical recurrence (P = .009). We conclude that SIGIRR predicts biochemical recurrence in patients with low Gleason score and low pathological stage PCa.

Rapid and non-destructive identification of water-injected beef samples using multispectral imaging analysis

Water-injected beef has aroused public concern as a major food-safety issue in meat products. In the study, the potential of multispectral imaging analysis in the visible and near-infrared (405-970 nm) regions was evaluated for identifying water-injected beef. A multispectral vision system was used to acquire images of beef injected with up to 21% content of water, and partial least squares regression (PLSR) algorithm was employed to establish prediction model, leading to quantitative estimations of actual water increase with a correlation coefficient (r) of 0.923. Subsequently, an optimized model was achieved by integrating spectral data with feature information extracted from ordinary RGB data, yielding better predictions (r = 0.946). Moreover, the prediction equation was transferred to each pixel within the images for visualizing the distribution of actual water increase. These results demonstrate the capability of multispectral imaging technology as a rapid and non-destructive tool for the identification of water-injected beef.

Multispectral photoacoustic microscopy based on an optical-acoustic objective

We have developed reflection-mode multispectral photoacoustic microscopy (PAM) based on a novel optical-acoustic objective that integrates a customized ultrasonic transducer and a commercial reflective microscope objective into one solid piece. This technical innovation provides zero chromatic aberration and convenient confocal alignment of the optical excitation and acoustic detection. With a wavelength-tunable optical-parametric-oscillator laser, we have demonstrated multispectral PAM over an ultrabroad spectral range of 270-1300 nm. A near-constant lateral resolution of ∼2.8 μm is achieved experimentally. Capitalizing on the consistent performance over the ultraviolet, visible, and near-infrared range, multispectral PAM enables label-free concurrent imaging of cell nucleus (DNA/RNA contrast at 270 nm), blood vessel (hemoglobin contrast at 532 nm), and sebaceous gland (lipid contrast at 1260 nm) at the same spatial scale in a living mouse ear.

Analysis and validation of tissue biomarkers for renal cell carcinoma using automated high-throughput evaluation of protein expression

The objective of this study was to compare the predictive ability of potential tissue biomarkers to known prognostic factors that predict renal cell carcinoma (RCC) recurrence using an automated system of immunohistochemical analysis. After institutional review board approval, a tissue microarray was constructed using tissue from patients who had partial or radical nephrectomy for RCC. Patients with metastatic disease were excluded. Immunohistochemical staining of the tissue microarray for Ki-67, C-reactive protein, carbonic anhydrase 9, and hypoxia-inducible factors 1α and 2α was analyzed using automated image analysis. Univariable and multivariable analyses were performed to evaluate the association of putative biomarkers and known prognostic factors. Of 216 patients who met the entrance criteria, 34 (16%) patients developed metastatic recurrence within a median follow-up interval of 60.9 (interquartile range, 13.9-87.1) months. RCC morphotypes analyzed in this study include clear cell (n = 156), papillary (n = 38), chromophobe (n = 16), and collecting duct/unclassified (n = 6). Univariate analysis identified that only increased Ki-67 was predictive of RCC recurrence among the proteins evaluated, in addition to other known clinicopathological prognostic factors. After multivariate analysis, Ki-67 was identified as an independently predictive risk factor for RCC recurrence (hazard ratio [HR], 3.73 [confidence interval {CI}, 1.60-8.68]). Other independent predictors of RCC recurrence included tumor diameter (HR, 1.20 [CI, 1.02-1.41]) and perinephric fat invasion (HR, 4.49 [CI, 1.11-18.20]). We conclude that Ki-67 positivity is independently predictive of RCC recurrence after surgery in nonmetastatic patients. Automated analysis of tissue protein expression can facilitate a more objective and expedient investigation of tissue biomarkers for RCC.

Biodistribution Study of Nanoparticle Encapsulated Photodynamic Therapy Drugs Using Multispectral Imaging

Photodynamictherapy (PDT) uses a drug called a photosensitizer that is excited by irradiation with a laser light of a particular wavelength, which generates reactive singlet oxygen that damages the tumor cells. The photosensitizer and light are inert; therefore, systemic toxicities are minimized in PDT. The synthesis of novel PDT drugs and the use of nanosized carriers for photosensitizers may improve the efficiency of the therapy and the delivery of the drug. In this study, we formulated two nanoparticles with and without a targeting ligand to encapsulate phthalocyanines 4 (Pc 4) molecule and compared their biodistributions. Metastatic human head and neck cancer cells (M4e) were transplanted into nude mice. After 2-3 weeks, the mice were injected with Pc 4, Pc 4 encapsulated into surface coated iron oxide (IO-Pc 4), and IO-Pc 4 conjugated with a fibronectin-mimetic peptide (FMP-IO-Pc 4) which binds specifically to integrin β1. The mice were imaged using a multispectral camera. Using multispectral images, a library of spectral signatures was created and the signal per pixel of each tumor was calculated, in a grayscale representation of the unmixed signal of each drug. An enhanced biodistribution of nanoparticle encapsulated PDT drugs compared to non-formulated Pc 4 was observed. Furthermore, specific targeted nanoparticles encapsulated Pc 4 has a quicker delivery time and accumulation in tumor tissue than the non-targeted nanoparticles. The nanoparticle-encapsulated PDT drug can have a variety of potential applications in cancer imaging and treatment.

The use of multispectral imaging to distinguish reactive urothelium from neoplastic urothelium

Context:

The interpretation of urothelial atypia in a setting of chronic inflammation and reactive changes can prove difficult with small biopsies. Limited recuts lessen the efficacy of ancillary studies such as CK20, P53 and CD44 in these instances.

Objective:

To evaluate a triple-immunostain with the assistance of multispectral microscopy.

Design:

Fifty-three bladder biopsies with previous diagnosis of benign/reactive, dysplastic, carcinoma in situ or carcinoma were prepared using a tripleimmunostain cocktail consisting of CK20, P53 and CD44. Three control stains were used for the purpose of creating a spectral library for the Nuance CRI Flex microscopy system. All specimens were interpreted by light microscopy, processed with the Nuance 2.71 software, and CK20 and P53 were scored blinded to the case diagnoses. CD44 was not scored as it proved difficult to interpret in many cases.

Results:

The results demonstrated that it was possible to separate CK20, P53 and the counterstain that were co-localized in the biopsies. Separation of the stains demonstrated a correlation of p53 and CK20 dual expression in biopsies diagnosed as carcinoma. Low or undetectable levels of expression were seen in biopsies later diagnosed as reactive or benign.

Conclusion:

The combination of multispectral microscopy and multiple immunostain cocktails form a powerful and useful tool for the interpretation of small biopsies with faint or difficult to interpret staining and for cases with limited material such as small-bladder biopsies.