1
|
Bhargava R. Digital Histopathology by Infrared Spectroscopic Imaging. ANNUAL REVIEW OF ANALYTICAL CHEMISTRY (PALO ALTO, CALIF.) 2023; 16:205-230. [PMID: 37068745 PMCID: PMC10408309 DOI: 10.1146/annurev-anchem-101422-090956] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Infrared (IR) spectroscopic imaging records spatially resolved molecular vibrational spectra, enabling a comprehensive measurement of the chemical makeup and heterogeneity of biological tissues. Combining this novel contrast mechanism in microscopy with the use of artificial intelligence can transform the practice of histopathology, which currently relies largely on human examination of morphologic patterns within stained tissue. First, this review summarizes IR imaging instrumentation especially suited to histopathology, analyses of its performance, and major trends. Second, an overview of data processing methods and application of machine learning is given, with an emphasis on the emerging use of deep learning. Third, a discussion on workflows in pathology is provided, with four categories proposed based on the complexity of methods and the analytical performance needed. Last, a set of guidelines, termed experimental and analytical specifications for spectroscopic imaging in histopathology, are proposed to help standardize the diversity of approaches in this emerging area.
Collapse
Affiliation(s)
- Rohit Bhargava
- Department of Bioengineering; Department of Electrical and Computer Engineering; Department of Mechanical Science and Engineering; Department of Chemical and Biomolecular Engineering; Department of Chemistry; Cancer Center at Illinois; and Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA;
| |
Collapse
|
2
|
Fang J, Huang K, Wu E, Yan M, Zeng H. Mid-infrared single-photon 3D imaging. LIGHT, SCIENCE & APPLICATIONS 2023; 12:144. [PMID: 37296123 DOI: 10.1038/s41377-023-01179-2] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/30/2022] [Revised: 04/25/2023] [Accepted: 05/08/2023] [Indexed: 06/12/2023]
Abstract
Active mid-infrared (MIR) imagers capable of retrieving three-dimensional (3D) structure and reflectivity information are highly attractive in a wide range of biomedical and industrial applications. However, infrared 3D imaging at low-light levels is still challenging due to the deficiency of sensitive and fast MIR sensors. Here we propose and implement a MIR time-of-flight imaging system that operates at single-photon sensitivity and femtosecond timing resolution. Specifically, back-scattered infrared photons from a scene are optically gated by delay-controlled ultrashort pump pulses through nonlinear frequency upconversion. The upconverted images with time stamps are then recorded by a silicon camera to facilitate the 3D reconstruction with high lateral and depth resolutions. Moreover, an effective numerical denoiser based on spatiotemporal correlation allows us to reveal the object profile and reflectivity under photon-starving conditions with a detected flux below 0.05 photons/pixel/second. The presented MIR 3D imager features high detection sensitivity, precise timing resolution, and wide-field operation, which may open new possibilities in life and material sciences.
Collapse
Affiliation(s)
- Jianan Fang
- State Key Laboratory of Precision Spectroscopy, East China Normal University, Shanghai, China
| | - Kun Huang
- State Key Laboratory of Precision Spectroscopy, East China Normal University, Shanghai, China.
- Chongqing Key Laboratory of Precision Optics, Chongqing Institute of East China Normal University, Chongqing, China.
- Collaborative Innovation Center of Extreme Optics, Shanxi University, Taiyuan, Shanxi, China.
| | - E Wu
- State Key Laboratory of Precision Spectroscopy, East China Normal University, Shanghai, China
- Chongqing Key Laboratory of Precision Optics, Chongqing Institute of East China Normal University, Chongqing, China
| | - Ming Yan
- State Key Laboratory of Precision Spectroscopy, East China Normal University, Shanghai, China
- Chongqing Key Laboratory of Precision Optics, Chongqing Institute of East China Normal University, Chongqing, China
| | - Heping Zeng
- State Key Laboratory of Precision Spectroscopy, East China Normal University, Shanghai, China.
- Chongqing Key Laboratory of Precision Optics, Chongqing Institute of East China Normal University, Chongqing, China.
- Chongqing Institute for Brain and Intelligence, Guangyang Bay Laboratory, Chongqing, China.
- Shanghai Research Center for Quantum Sciences, Shanghai, China.
- Jinan Institute of Quantum Technology, Jinan, Shandong, China.
| |
Collapse
|
3
|
Wang T, Chen Y, Wang B, Wu M. Recent progress of second near-infrared (NIR-II) fluorescence microscopy in bioimaging. Front Physiol 2023; 14:1126805. [PMID: 36895633 PMCID: PMC9990761 DOI: 10.3389/fphys.2023.1126805] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2022] [Accepted: 02/09/2023] [Indexed: 02/25/2023] Open
Abstract
Visualizing biological tissues in vivo at a cellular or subcellular resolution to explore molecular signaling and cell behaviors is a crucial direction for research into biological processes. In vivo imaging can provide quantitative and dynamic visualization/mapping in biology and immunology. New microscopy techniques combined with near-infrared region fluorophores provide additional avenues for further progress in vivo bioimaging. Based on the development of chemical materials and physical optoelectronics, new NIR-II microscopy techniques are emerging, such as confocal and multiphoton microscopy, light-sheet fluorescence microscopy (LSFM), and wide-field microscopy. In this review, we introduce the characteristics of in vivo imaging using NIR-II fluorescence microscopy. We also cover the recent advances in NIR-II fluorescence microscopy techniques in bioimaging and the potential for overcoming current challenges.
Collapse
Affiliation(s)
- Tian Wang
- Department of Obstetrics and Gynecology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Yingying Chen
- Department of Obstetrics and Gynecology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Bo Wang
- Department of Obstetrics and Gynecology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Mingfu Wu
- Department of Obstetrics and Gynecology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| |
Collapse
|
4
|
Knez D, Toulson BW, Chen A, Ettenberg MH, Nguyen H, Potma EO, Fishman DA. Spectral imaging at high definition and high speed in the mid-infrared. SCIENCE ADVANCES 2022; 8:eade4247. [PMID: 36383646 PMCID: PMC9668290 DOI: 10.1126/sciadv.ade4247] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/15/2022] [Accepted: 10/20/2022] [Indexed: 06/16/2023]
Abstract
Spectral imaging in the mid-infrared (MIR) range provides simultaneous morphological and chemical information of a wide variety of samples. However, current MIR technologies struggle to produce high-definition images over a broad spectral range at acquisition rates that are compatible with real-time processes. We present a novel spectral imaging technique based on nondegenerate two-photon absorption of temporally chirped optical MIR pulses. This approach avoids complex image processing or reconstruction and enables high-speed acquisition of spectral data cubes (xyω) at high-pixel density in under a second.
Collapse
Affiliation(s)
- David Knez
- Department of Chemistry, University of California, Irvine, Irvine, CA 92697, USA
| | - Benjamin W. Toulson
- Department of Chemistry, University of California, Irvine, Irvine, CA 92697, USA
| | - Anabel Chen
- Department of Chemistry, University of California, Irvine, Irvine, CA 92697, USA
| | - Martin H. Ettenberg
- Princeton Infrared Technologies Inc., 7 Deerpark Dr. Suite E, Monmouth Junction, NJ 08852, USA
| | - Hai Nguyen
- Princeton Infrared Technologies Inc., 7 Deerpark Dr. Suite E, Monmouth Junction, NJ 08852, USA
| | - Eric O. Potma
- Department of Chemistry, University of California, Irvine, Irvine, CA 92697, USA
| | - Dmitry A. Fishman
- Department of Chemistry, University of California, Irvine, Irvine, CA 92697, USA
| |
Collapse
|