1
|
Gilet V, Mabilleau G, Loumaigne M, Coic L, Vitale R, Oberlin T, de Morais Goulart JH, Dobigeon N, Ruckebusch C, Rousseau D. Superpixels meet essential spectra for fast Raman hyperspectral microimaging. OPTICS EXPRESS 2024; 32:932-948. [PMID: 38175114 DOI: 10.1364/oe.509736] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/02/2023] [Accepted: 12/02/2023] [Indexed: 01/05/2024]
Abstract
In the context of spectral unmixing, essential information corresponds to the most linearly dissimilar rows and/or columns of a two-way data matrix which are indispensable to reproduce the full data matrix in a convex linear way. Essential information has recently been shown accessible on-the-fly via a decomposition of the measured spectra in the Fourier domain and has opened new perspectives for fast Raman hyperspectral microimaging. In addition, when some spatial prior is available about the sample, such as the existence of homogeneous objects in the image, further acceleration for the data acquisition procedure can be achieved by using superpixels. The expected gain in acquisition time is shown to be around three order of magnitude on simulated and real data with very limited distortions of the estimated spectrum of each object composing the images.
Collapse
|
2
|
Jiang Z, Wang X, Chu K, Smith ZJ. Fast Raman imaging through the combination of context-aware matrix completion and low spectral resolution. Analyst 2023; 148:4710-4720. [PMID: 37622207 DOI: 10.1039/d3an00997a] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/26/2023]
Abstract
Raman hyperspectral imaging is an effective method for label-free imaging with chemical specificity, yet the weak signals and correspondingly long integration times have hindered its wide adoption as a routine analytical method. Recently, low resolution Raman imaging has been proposed to improve the spectral signal-to-noise ratio, which significantly improves the speed of Raman imaging. In this paper, low resolution Raman spectroscopy is combined with "context-aware" matrix completion, where regions of the sample that are not of interest are skipped, and the regions that are measured are under-sampled, then reconstructed with a low-rank constraint. Both simulations and experiment show that low-resolution Raman boosts the speed and image quality of the computationally-reconstructed Raman images, allowing deeper sub-sampling, reduced exposure time, and an overall >10-fold improvement in imaging speed, without sacrificing chemical specificity or spatial image quality. As the method utilizes traditional point-scan imaging, it retains full confocality and is "backwards-compatible" with pre-existing traditional Raman instruments, broadening the potential scope of Raman imaging applications.
Collapse
Affiliation(s)
- Ziling Jiang
- University of Science and Technology of China, Department of Precision Machinery & Precision Instrumentation, Hefei, Anhui, China 230027.
| | - Xianli Wang
- University of Science and Technology of China, Department of Precision Machinery & Precision Instrumentation, Hefei, Anhui, China 230027.
| | - Kaiqin Chu
- University of Science and Technology of China, Suzhou Institute for Advanced Research, Suzhou, Jiangsu, China 215123
| | - Zachary J Smith
- University of Science and Technology of China, Department of Precision Machinery & Precision Instrumentation, Hefei, Anhui, China 230027.
| |
Collapse
|
3
|
Scarbrough D, Cottrell S, Czerski J, Kingsolver I, Field J, Bartels R, Squier J. Design and analysis of polygonal mirror-based scan engines for improved spatial frequency modulation imaging. APPLIED OPTICS 2023; 62:3861-3873. [PMID: 37706695 DOI: 10.1364/ao.487907] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/15/2023] [Accepted: 04/17/2023] [Indexed: 09/15/2023]
Abstract
Spatial frequency modulation imaging (SPIFI) is a structured illumination single pixel imaging technique that is most often achieved via a rotating modulation disk. This implementation produces line images with exposure times on the order of tens of milliseconds. Here, we present a new architecture for SPIFI using a polygonal scan mirror with the following advances: (1) reducing SPIFI line image exposure times by 2 orders of magnitude, (2) facet-to-facet measurement and correction for polygonal scan design, and (3) a new anamorphic magnification scheme that improves resolution for long working distance optics.
Collapse
|
4
|
Justel T, Galland F, Roueff A. Compressed Raman method combining classification and estimation of spectra with optimized binary filters. OPTICS LETTERS 2022; 47:1101-1104. [PMID: 35230301 DOI: 10.1364/ol.447769] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/05/2021] [Accepted: 01/17/2022] [Indexed: 06/14/2023]
Abstract
Compressed Raman methods allow classification between known chemical species with only a few measurements through binary filters. We propose a methodology for binary filter optimization, in which filters are modified at each pixel so that classification can still be achieved pixel by pixel with a few measurements acquired in parallel, while retaining the ability to reconstruct a full spectrum when combining measurements from several pixels. This approach is robust to intensity variations between pixels. It relies on a generalized Bhattacharyya bound and on the Cramér-Rao bound to tailor filters with optimized performance.
Collapse
|
5
|
Kallepalli A, Innes J, Padgett MJ. Compressed sensing in the far-field of the spatial light modulator in high noise conditions. Sci Rep 2021; 11:17460. [PMID: 34465854 PMCID: PMC8408209 DOI: 10.1038/s41598-021-97072-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2021] [Accepted: 08/19/2021] [Indexed: 12/02/2022] Open
Abstract
Single-pixel imaging techniques as an alternative to focal-plane detector arrays are being widely investigated. The interest in these single-pixel techniques is partly their compatibility with compressed sensing but also their applicability to spectral regions where focal planes arrays are simply not obtainable. Here, we show how a phased-array modulator source can be used to create Hadamard intensity patterns in the far-field, thereby enabling single-pixel imaging. Further, we successfully illustrate an implementation of compressed sensing for image reconstruction in conditions of high noise. In combination, this robust technique could be applied to any spectral region where spatial light phase modulators or phased-array sources are available.
Collapse
Affiliation(s)
- Akhil Kallepalli
- School of Physics and Astronomy, University of Glasgow, Glasgow, G12 8QQ, UK.
| | - John Innes
- Innovation and Technology Group, Leonardo MW Ltd., Edinburgh, EH3 9GL, UK
| | - Miles J Padgett
- School of Physics and Astronomy, University of Glasgow, Glasgow, G12 8QQ, UK
| |
Collapse
|
6
|
Scotté C, Sivankutty S, Bartels RA, Rigneault H. Line-scan compressive Raman imaging with spatiospectral encoding. OPTICS LETTERS 2020; 45:5567-5570. [PMID: 33001949 DOI: 10.1364/ol.400151] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/16/2020] [Accepted: 09/01/2020] [Indexed: 06/11/2023]
Abstract
We report a line-scanning imaging modality of compressive Raman technology with a single-pixel detector. The spatial information along the illumination line is encoded onto one axis of a digital micromirror device, while spectral coding masks are applied along the orthogonal direction. We demonstrate imaging and classification of three different chemical species.
Collapse
|
7
|
Heuke S, Sivankutty S, Scotte C, Stockton P, Bartels RA, Sentenac A, Rigneault H. Spatial frequency modulated imaging in coherent anti-Stokes Raman microscopy. OPTICA 2020; 7:417-424. [PMID: 34926725 PMCID: PMC8682967 DOI: 10.1364/optica.386526] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/23/2019] [Accepted: 03/02/2020] [Indexed: 06/14/2023]
Abstract
For sparse samples or in the presence of ambient light, the signal-to-noise ratio (SNR) performance of single-point-scanning coherent anti-Stokes Raman scattering (CARS) images is not optimized. As an improvement, we propose replacing the conventional CARS focus-point illumination with a periodically structured focus line while continuing to collect the transmitted CARS intensity on a single detector. The object information along the illuminated line is obtained by numerically processing the CARS signal recorded for various periods of the structured focus line. We demonstrate experimentally the feasibility of this spatial frequency modulated imaging (SPIFI) in CARS (SPIFI-CARS) and SHG (SPIFI-SHG) and identify situations where its SNR is better than that of the single-point-scanning approach.
Collapse
Affiliation(s)
- Sandro Heuke
- Aix Marseille Univ, CNRS, Centrale Marseille, Institut Fresnel, Marseille, France
| | - Siddharth Sivankutty
- Aix Marseille Univ, CNRS, Centrale Marseille, Institut Fresnel, Marseille, France
| | - Camille Scotte
- Aix Marseille Univ, CNRS, Centrale Marseille, Institut Fresnel, Marseille, France
| | - Patrick Stockton
- School of Biomedical Engineering, Colorado State University, Fort Collins, Colorado 80523, USA
| | - Randy A. Bartels
- School of Biomedical Engineering, Colorado State University, Fort Collins, Colorado 80523, USA
| | - Anne Sentenac
- Aix Marseille Univ, CNRS, Centrale Marseille, Institut Fresnel, Marseille, France
| | - Hervé Rigneault
- Aix Marseille Univ, CNRS, Centrale Marseille, Institut Fresnel, Marseille, France
| |
Collapse
|
8
|
Pena AM, Chen X, Pence IJ, Bornschlögl T, Jeong S, Grégoire S, Luengo GS, Hallegot P, Obeidy P, Feizpour A, Chan KF, Evans CL. Imaging and quantifying drug delivery in skin - Part 2: Fluorescence andvibrational spectroscopic imaging methods. Adv Drug Deliv Rev 2020; 153:147-168. [PMID: 32217069 PMCID: PMC7483684 DOI: 10.1016/j.addr.2020.03.003] [Citation(s) in RCA: 33] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2019] [Revised: 03/10/2020] [Accepted: 03/18/2020] [Indexed: 01/31/2023]
Abstract
Understanding the delivery and diffusion of topically-applied drugs on human skin is of paramount importance in both pharmaceutical and cosmetics research. This information is critical in early stages of drug development and allows the identification of the most promising ingredients delivered at optimal concentrations to their target skin compartments. Different skin imaging methods, invasive and non-invasive, are available to characterize and quantify the spatiotemporal distribution of a drug within ex vivo and in vivo human skin. The first part of this review detailed invasive imaging methods (autoradiography, MALDI and SIMS). This second part reviews non-invasive imaging methods that can be applied in vivo: i) fluorescence (conventional, confocal, and multiphoton) and second harmonic generation microscopies and ii) vibrational spectroscopic imaging methods (infrared, confocal Raman, and coherent Raman scattering microscopies). Finally, a flow chart for the selection of imaging methods is presented to guide human skin ex vivo and in vivo drug delivery studies.
Collapse
Affiliation(s)
- Ana-Maria Pena
- L'Oréal Research and Innovation, 1 avenue Eugène Schueller BP22, 93600 Aulnay-sous-Bois, France
| | - Xueqin Chen
- L'Oréal Research and Innovation, 1 avenue Eugène Schueller BP22, 93600 Aulnay-sous-Bois, France
| | - Isaac J Pence
- Wellman Center for Photomedicine, Massachusetts General Hospital, Harvard Medical School, CNY149-3, 13(th) St, Charlestown, MA 02129, United States of America
| | - Thomas Bornschlögl
- L'Oréal Research and Innovation, 1 avenue Eugène Schueller BP22, 93600 Aulnay-sous-Bois, France
| | - Sinyoung Jeong
- Wellman Center for Photomedicine, Massachusetts General Hospital, Harvard Medical School, CNY149-3, 13(th) St, Charlestown, MA 02129, United States of America
| | - Sébastien Grégoire
- L'Oréal Research and Innovation, 1 avenue Eugène Schueller BP22, 93600 Aulnay-sous-Bois, France.
| | - Gustavo S Luengo
- L'Oréal Research and Innovation, 1 avenue Eugène Schueller BP22, 93600 Aulnay-sous-Bois, France
| | - Philippe Hallegot
- L'Oréal Research and Innovation, 1 avenue Eugène Schueller BP22, 93600 Aulnay-sous-Bois, France
| | - Peyman Obeidy
- Wellman Center for Photomedicine, Massachusetts General Hospital, Harvard Medical School, CNY149-3, 13(th) St, Charlestown, MA 02129, United States of America
| | - Amin Feizpour
- Wellman Center for Photomedicine, Massachusetts General Hospital, Harvard Medical School, CNY149-3, 13(th) St, Charlestown, MA 02129, United States of America
| | - Kin F Chan
- Simpson Interventions, Inc., Woodside, CA 94062, United States of America
| | - Conor L Evans
- Wellman Center for Photomedicine, Massachusetts General Hospital, Harvard Medical School, CNY149-3, 13(th) St, Charlestown, MA 02129, United States of America.
| |
Collapse
|
9
|
Réfrégier P, Chevallier E, Galland F. Compressed Raman classification method with upper-bounded error probability. OPTICS LETTERS 2019; 44:5836-5839. [PMID: 31774792 DOI: 10.1364/ol.44.005836] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/28/2019] [Accepted: 10/29/2019] [Indexed: 06/10/2023]
Abstract
Classification of different species with Raman measurements is analyzed when a total of exactly $ N $N photons are detected with binary filtered Raman spectra instead of fixing the measuring time. The optimal classification method for this problem leads to classification error probabilities upper-bounded by the Bhattacharyya bound and that are invariant to the multiplication of the spectrum intensities by an unknown factor. Furthermore, it is shown that this approach can be implemented with a number of binary filters smaller than the number of species to discriminate.
Collapse
|