1
|
Saunders N, Monel B, Cayet N, Archetti L, Moreno H, Jeanne A, Marguier A, Buchrieser J, Wai T, Schwartz O, Fréchin M. Dynamic label-free analysis of SARS-CoV-2 infection reveals virus-induced subcellular remodeling. Nat Commun 2024; 15:4996. [PMID: 38862527 PMCID: PMC11166935 DOI: 10.1038/s41467-024-49260-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2023] [Accepted: 05/30/2024] [Indexed: 06/13/2024] Open
Abstract
Assessing the impact of SARS-CoV-2 on organelle dynamics allows a better understanding of the mechanisms of viral replication. We combine label-free holotomographic microscopy with Artificial Intelligence to visualize and quantify the subcellular changes triggered by SARS-CoV-2 infection. We study the dynamics of shape, position and dry mass of nucleoli, nuclei, lipid droplets and mitochondria within hundreds of single cells from early infection to syncytia formation and death. SARS-CoV-2 infection enlarges nucleoli, perturbs lipid droplets, changes mitochondrial shape and dry mass, and separates lipid droplets from mitochondria. We then used Bayesian network modeling on organelle dry mass states to define organelle cross-regulation networks and report modifications of organelle cross-regulation that are triggered by infection and syncytia formation. Our work highlights the subcellular remodeling induced by SARS-CoV-2 infection and provides an Artificial Intelligence-enhanced, label-free methodology to study in real-time the dynamics of cell populations and their content.
Collapse
Affiliation(s)
- Nell Saunders
- Virus & Immunity Unit, Institut Pasteur, Université Paris Cité, CNRS, UMR 3569, Paris, France
| | - Blandine Monel
- Virus & Immunity Unit, Institut Pasteur, Université Paris Cité, CNRS, UMR 3569, Paris, France
| | - Nadège Cayet
- Institut Pasteur, Université Paris Cité, Ultrastructural Bioimaging Unit, 75015, Paris, France
| | - Lorenzo Archetti
- Deep Quantitative Biology Department, Nanolive SA, Tolochenaz, Switzerland
| | - Hugo Moreno
- Deep Quantitative Biology Department, Nanolive SA, Tolochenaz, Switzerland
| | - Alexandre Jeanne
- Deep Quantitative Biology Department, Nanolive SA, Tolochenaz, Switzerland
| | - Agathe Marguier
- Deep Quantitative Biology Department, Nanolive SA, Tolochenaz, Switzerland
| | - Julian Buchrieser
- Virus & Immunity Unit, Institut Pasteur, Université Paris Cité, CNRS, UMR 3569, Paris, France
| | - Timothy Wai
- Mitochondrial Biology Group, Institut Pasteur, Université Paris Cité, CNRS, UMR 3691, Paris, France
| | - Olivier Schwartz
- Virus & Immunity Unit, Institut Pasteur, Université Paris Cité, CNRS, UMR 3569, Paris, France.
- Vaccine Research Institute, Creteil, France.
| | - Mathieu Fréchin
- Deep Quantitative Biology Department, Nanolive SA, Tolochenaz, Switzerland.
| |
Collapse
|
2
|
Goswami N, Anastasio MA, Popescu G. Quantitative phase imaging techniques for measuring scattering properties of cells and tissues: a review-part I. JOURNAL OF BIOMEDICAL OPTICS 2024; 29:S22713. [PMID: 39026612 PMCID: PMC11257415 DOI: 10.1117/1.jbo.29.s2.s22713] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Revised: 04/30/2024] [Accepted: 05/20/2024] [Indexed: 07/20/2024]
Abstract
Significance Quantitative phase imaging (QPI) techniques offer intrinsic information about the sample of interest in a label-free, noninvasive manner and have an enormous potential for wide biomedical applications with negligible perturbations to the natural state of the sample in vitro. Aim We aim to present an in-depth review of the scattering formulation of light-matter interactions as applied to biological samples such as cells and tissues, discuss the relevant quantitative phase measurement techniques, and present a summary of various reported applications. Approach We start with scattering theory and scattering properties of biological samples followed by an exploration of various microscopy configurations for 2D QPI for measurement of structure and dynamics. Results We reviewed 157 publications and presented a range of QPI techniques and discussed suitable applications for each. We also presented the theoretical frameworks for phase reconstruction associated with the discussed techniques and highlighted their domains of validity. Conclusions We provide detailed theoretical as well as system-level information for a wide range of QPI techniques. Our study can serve as a guideline for new researchers looking for an exhaustive literature review of QPI methods and relevant applications.
Collapse
Affiliation(s)
- Neha Goswami
- University of Illinois Urbana-Champaign, Department of Bioengineering, Urbana, Illinois, United States
| | - Mark A. Anastasio
- University of Illinois Urbana-Champaign, Department of Bioengineering, Urbana, Illinois, United States
- University of Illinois Urbana-Champaign, Department of Electrical and Computer Engineering, Urbana, Illinois, United States
| | - Gabriel Popescu
- University of Illinois Urbana-Champaign, Department of Bioengineering, Urbana, Illinois, United States
- University of Illinois Urbana-Champaign, Department of Electrical and Computer Engineering, Urbana, Illinois, United States
| |
Collapse
|
3
|
Raj P, Gupta H, Anantha P, Barman I. Cell-TIMP: Cellular Trajectory Inference based on Morphological Parameter. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.04.18.590109. [PMID: 38712120 PMCID: PMC11071304 DOI: 10.1101/2024.04.18.590109] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/08/2024]
Abstract
Cellular morphology, shaped by various genetic and environmental influences, is pivotal to studying experimental cell biology, necessitating precise measurement and analysis techniques. Traditional approaches, which rely on geometric metrics derived from stained images, encounter obstacles stemming from both the imaging and analytical domains. Staining processes can disrupt the cell's natural state and diminish accuracy due to photobleaching, while conventional analysis techniques, which categorize cells based on shape to discern pathophysiological conditions, often fail to capture the continuous and asynchronous nature of biological processes such as cell differentiation, immune responses, and cancer progression. In this work, we propose the use of quantitative phase imaging for morphological assessment due to its label-free nature. For analysis, we repurposed the genomic analysis toolbox to perform trajectory inference analysis purely based on morphology information. We applied the developed framework to study the progression of leukemia and breast cancer metastasis. Our approach revealed a clear pattern of morphological evolution tied to the diseases' advancement, highlighting the efficacy of our method in identifying functionally significant shape changes where conventional techniques falter. This advancement offers a fresh perspective on analyzing cellular morphology and holds significant potential for the broader research community, enabling a deeper understanding of complex biological dynamics.
Collapse
Affiliation(s)
- Piyush Raj
- Department of Mechanical Engineering, Johns Hopkins University, Baltimore, Maryland, USA
| | - Himanshu Gupta
- Centre for Applied Autonomous Sensor Systems (AASS), Örebro University, Örebro, Sweden
| | - Pooja Anantha
- Department of Mechanical Engineering, Johns Hopkins University, Baltimore, Maryland, USA
| | - Ishan Barman
- Department of Mechanical Engineering, Johns Hopkins University, Baltimore, Maryland, USA
- The Russell H. Morgan Department of Radiology and Radiological Science, The Johns Hopkins University, School of Medicine, Baltimore, Maryland, USA
- Department of Oncology, Johns Hopkins University, Baltimore, Maryland, USA
| |
Collapse
|
4
|
Goswami N, Winston N, Choi W, Lai NZE, Arcanjo RB, Chen X, Sobh N, Nowak RA, Anastasio MA, Popescu G. EVATOM: an optical, label-free, machine learning assisted embryo health assessment tool. Commun Biol 2024; 7:268. [PMID: 38443460 PMCID: PMC10915136 DOI: 10.1038/s42003-024-05960-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Accepted: 02/22/2024] [Indexed: 03/07/2024] Open
Abstract
The combination of a good quality embryo and proper maternal health factors promise higher chances of a successful in vitro fertilization (IVF) procedure leading to clinical pregnancy and live birth. Of these two factors, selection of a good embryo is a controllable aspect. The current gold standard in clinical practice is visual assessment of an embryo based on its morphological appearance by trained embryologists. More recently, machine learning has been incorporated into embryo selection "packages". Here, we report EVATOM: a machine-learning assisted embryo health assessment tool utilizing an optical quantitative phase imaging technique called artificial confocal microscopy (ACM). We present a label-free nucleus detection method with, to the best of our knowledge, novel quantitative embryo health biomarkers. Two viability assessment models are presented for grading embryos into two classes: healthy/intermediate (H/I) or sick (S) class. The models achieve a weighted F1 score of 1.0 and 0.99 respectively on the in-distribution test set of 72 fixed embryos and a weighted F1 score of 0.9 and 0.95 respectively on the out-of-distribution test dataset of 19 time-instances from 8 live embryos.
Collapse
Affiliation(s)
- Neha Goswami
- Department of Bioengineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA.
- Beckman Institute of Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA.
| | - Nicola Winston
- Division of Reproductive Endocrinology and Infertility, Department of Obstetrics and Gynecology, University of Illinois at Chicago College of Medicine, Chicago, IL, 60612, USA
| | - Wonho Choi
- Department of Animal Sciences, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| | - Nastasia Z E Lai
- Department of Animal Sciences, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| | - Rachel B Arcanjo
- Department of Animal Sciences, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
- Department of Animal Science, University of California, Davis, CA, 95616, USA
| | - Xi Chen
- Beckman Institute of Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
- School of Applied and Engineering Physics, Cornell University, Ithaca, NY, 14850, USA
| | - Nahil Sobh
- NCSA Center for Artificial Intelligence Innovation, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| | - Romana A Nowak
- Department of Animal Sciences, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA.
| | - Mark A Anastasio
- Department of Bioengineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA.
- Beckman Institute of Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA.
- Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA.
| | - Gabriel Popescu
- Department of Bioengineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
- Beckman Institute of Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
- Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| |
Collapse
|
5
|
Zamani E, Ksantini N, Sheehy G, Ember KJI, Baloukas B, Zabeida O, Trang T, Mahfoud M, Sapieha JE, Martinu L, Leblond F. Spectral effects and enhancement quantification in healthy human saliva with surface-enhanced Raman spectroscopy using silver nanopillar substrates. Lasers Surg Med 2024; 56:206-217. [PMID: 38073098 DOI: 10.1002/lsm.23746] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2023] [Revised: 11/15/2023] [Accepted: 11/21/2023] [Indexed: 02/21/2024]
Abstract
OBJECTIVES Raman spectroscopy as a diagnostic tool for biofluid applications is limited by low inelastic scattering contributions compared to the fluorescence background from biomolecules. Surface-enhanced Raman spectroscopy (SERS) can increase Raman scattering signals, thereby offering the potential to reduce imaging times. We aimed to evaluate the enhancement related to the plasmonic effect and quantify the improvements in terms of spectral quality associated with SERS measurements in human saliva. METHODS Dried human saliva was characterized using spontaneous Raman spectroscopy and SERS. A fabrication protocol was implemented leading to the production of silver (Ag) nanopillar substrates by glancing angle deposition. Two different imaging systems were used to interrogate saliva from 161 healthy donors: a custom single-point macroscopic system and a Raman micro-spectroscopy instrument. Quantitative metrics were established to compare spontaneous RS and SERS measurements: the Raman spectroscopy quality factor (QF), the photonic count rate (PR), the signal-to-background ratio (SBR). RESULTS SERS measurements acquired with an excitation energy four times smaller than with spontaneous RS resulted in improved QF, PR values an order of magnitude larger and a SBR twice as large. The SERS enhancement reached 100×, depending on which Raman bands were considered. CONCLUSIONS Single-point measurement of dried saliva with silver nanopillars substrates led to reproducible SERS measurements, paving the way to real-time tools of diagnosis in human biofluids.
Collapse
Affiliation(s)
- Esmat Zamani
- Department of Engineering Physics, Polytechnique Montreal, Montréal, Canada
- Centre de Recherche du Centre Hospitalier de l'Université de Montréal, Montreal, Canada
| | - Nassim Ksantini
- Department of Engineering Physics, Polytechnique Montreal, Montréal, Canada
- Centre de Recherche du Centre Hospitalier de l'Université de Montréal, Montreal, Canada
| | - Guillaume Sheehy
- Department of Engineering Physics, Polytechnique Montreal, Montréal, Canada
- Centre de Recherche du Centre Hospitalier de l'Université de Montréal, Montreal, Canada
| | - Katherine J I Ember
- Department of Engineering Physics, Polytechnique Montreal, Montréal, Canada
- Centre de Recherche du Centre Hospitalier de l'Université de Montréal, Montreal, Canada
| | - Bill Baloukas
- Department of Engineering Physics, Polytechnique Montreal, Montréal, Canada
| | - Oleg Zabeida
- Department of Engineering Physics, Polytechnique Montreal, Montréal, Canada
| | - Tran Trang
- Department of Engineering Physics, Polytechnique Montreal, Montréal, Canada
- Centre de Recherche du Centre Hospitalier de l'Université de Montréal, Montreal, Canada
| | - Myriam Mahfoud
- Department of Engineering Physics, Polytechnique Montreal, Montréal, Canada
- Centre de Recherche du Centre Hospitalier de l'Université de Montréal, Montreal, Canada
| | | | - Ludvik Martinu
- Department of Engineering Physics, Polytechnique Montreal, Montréal, Canada
| | - Frédéric Leblond
- Department of Engineering Physics, Polytechnique Montreal, Montréal, Canada
- Centre de Recherche du Centre Hospitalier de l'Université de Montréal, Montreal, Canada
| |
Collapse
|
6
|
Wang K, Song L, Wang C, Ren Z, Zhao G, Dou J, Di J, Barbastathis G, Zhou R, Zhao J, Lam EY. On the use of deep learning for phase recovery. LIGHT, SCIENCE & APPLICATIONS 2024; 13:4. [PMID: 38161203 PMCID: PMC10758000 DOI: 10.1038/s41377-023-01340-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Revised: 11/13/2023] [Accepted: 11/16/2023] [Indexed: 01/03/2024]
Abstract
Phase recovery (PR) refers to calculating the phase of the light field from its intensity measurements. As exemplified from quantitative phase imaging and coherent diffraction imaging to adaptive optics, PR is essential for reconstructing the refractive index distribution or topography of an object and correcting the aberration of an imaging system. In recent years, deep learning (DL), often implemented through deep neural networks, has provided unprecedented support for computational imaging, leading to more efficient solutions for various PR problems. In this review, we first briefly introduce conventional methods for PR. Then, we review how DL provides support for PR from the following three stages, namely, pre-processing, in-processing, and post-processing. We also review how DL is used in phase image processing. Finally, we summarize the work in DL for PR and provide an outlook on how to better use DL to improve the reliability and efficiency of PR. Furthermore, we present a live-updating resource ( https://github.com/kqwang/phase-recovery ) for readers to learn more about PR.
Collapse
Affiliation(s)
- Kaiqiang Wang
- Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong SAR, China.
- School of Physical Science and Technology, Northwestern Polytechnical University, Xi'an, China.
- Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China.
| | - Li Song
- Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong SAR, China
| | - Chutian Wang
- Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong SAR, China
| | - Zhenbo Ren
- School of Physical Science and Technology, Northwestern Polytechnical University, Xi'an, China
| | - Guangyuan Zhao
- Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Jiazhen Dou
- School of Information Engineering, Guangdong University of Technology, Guangzhou, China
| | - Jianglei Di
- School of Information Engineering, Guangdong University of Technology, Guangzhou, China
| | - George Barbastathis
- Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Renjie Zhou
- Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Jianlin Zhao
- School of Physical Science and Technology, Northwestern Polytechnical University, Xi'an, China.
| | - Edmund Y Lam
- Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong SAR, China.
| |
Collapse
|
7
|
Astratov VN, Sahel YB, Eldar YC, Huang L, Ozcan A, Zheludev N, Zhao J, Burns Z, Liu Z, Narimanov E, Goswami N, Popescu G, Pfitzner E, Kukura P, Hsiao YT, Hsieh CL, Abbey B, Diaspro A, LeGratiet A, Bianchini P, Shaked NT, Simon B, Verrier N, Debailleul M, Haeberlé O, Wang S, Liu M, Bai Y, Cheng JX, Kariman BS, Fujita K, Sinvani M, Zalevsky Z, Li X, Huang GJ, Chu SW, Tzang O, Hershkovitz D, Cheshnovsky O, Huttunen MJ, Stanciu SG, Smolyaninova VN, Smolyaninov II, Leonhardt U, Sahebdivan S, Wang Z, Luk’yanchuk B, Wu L, Maslov AV, Jin B, Simovski CR, Perrin S, Montgomery P, Lecler S. Roadmap on Label-Free Super-Resolution Imaging. LASER & PHOTONICS REVIEWS 2023; 17:2200029. [PMID: 38883699 PMCID: PMC11178318 DOI: 10.1002/lpor.202200029] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/17/2022] [Indexed: 06/18/2024]
Abstract
Label-free super-resolution (LFSR) imaging relies on light-scattering processes in nanoscale objects without a need for fluorescent (FL) staining required in super-resolved FL microscopy. The objectives of this Roadmap are to present a comprehensive vision of the developments, the state-of-the-art in this field, and to discuss the resolution boundaries and hurdles which need to be overcome to break the classical diffraction limit of the LFSR imaging. The scope of this Roadmap spans from the advanced interference detection techniques, where the diffraction-limited lateral resolution is combined with unsurpassed axial and temporal resolution, to techniques with true lateral super-resolution capability which are based on understanding resolution as an information science problem, on using novel structured illumination, near-field scanning, and nonlinear optics approaches, and on designing superlenses based on nanoplasmonics, metamaterials, transformation optics, and microsphere-assisted approaches. To this end, this Roadmap brings under the same umbrella researchers from the physics and biomedical optics communities in which such studies have often been developing separately. The ultimate intent of this paper is to create a vision for the current and future developments of LFSR imaging based on its physical mechanisms and to create a great opening for the series of articles in this field.
Collapse
Affiliation(s)
- Vasily N. Astratov
- Department of Physics and Optical Science, University of North Carolina at Charlotte, Charlotte, North Carolina 28223-0001, USA
| | - Yair Ben Sahel
- Department of Computer Science and Applied Mathematics, Weizmann Institute of Science, Rehovot 7610001, Israel
| | - Yonina C. Eldar
- Department of Computer Science and Applied Mathematics, Weizmann Institute of Science, Rehovot 7610001, Israel
| | - Luzhe Huang
- Electrical and Computer Engineering Department, University of California, Los Angeles, California 90095, USA
- Bioengineering Department, University of California, Los Angeles, California 90095, USA
- California Nano Systems Institute (CNSI), University of California, Los Angeles, California 90095, USA
| | - Aydogan Ozcan
- Electrical and Computer Engineering Department, University of California, Los Angeles, California 90095, USA
- Bioengineering Department, University of California, Los Angeles, California 90095, USA
- California Nano Systems Institute (CNSI), University of California, Los Angeles, California 90095, USA
- David Geffen School of Medicine, University of California, Los Angeles, California 90095, USA
| | - Nikolay Zheludev
- Optoelectronics Research Centre, University of Southampton, Southampton, SO17 1BJ, UK
- Centre for Disruptive Photonic Technologies, The Photonics Institute, School of Physical and Mathematical Sciences, Nanyang Technological University, 637371, Singapore
| | - Junxiang Zhao
- Department of Electrical and Computer Engineering, University of California, San Diego, 9500 Gilman Drive, La Jolla, California 92093, USA
| | - Zachary Burns
- Department of Electrical and Computer Engineering, University of California, San Diego, 9500 Gilman Drive, La Jolla, California 92093, USA
| | - Zhaowei Liu
- Department of Electrical and Computer Engineering, University of California, San Diego, 9500 Gilman Drive, La Jolla, California 92093, USA
- Material Science and Engineering, University of California, San Diego, 9500 Gilman Drive, La Jolla, California 92093, USA
| | - Evgenii Narimanov
- School of Electrical Engineering, and Birck Nanotechnology Center, Purdue University, West Lafayette, Indiana 47907, USA
| | - Neha Goswami
- Quantitative Light Imaging Laboratory, Beckman Institute of Advanced Science and Technology, University of Illinois at Urbana-Champaign, Illinois 61801, USA
| | - Gabriel Popescu
- Quantitative Light Imaging Laboratory, Beckman Institute of Advanced Science and Technology, University of Illinois at Urbana-Champaign, Illinois 61801, USA
| | - Emanuel Pfitzner
- Department of Chemistry, University of Oxford, Oxford OX1 3QZ, United Kingdom
| | - Philipp Kukura
- Department of Chemistry, University of Oxford, Oxford OX1 3QZ, United Kingdom
| | - Yi-Teng Hsiao
- Institute of Atomic and Molecular Sciences (IAMS), Academia Sinica 1, Roosevelt Rd. Sec. 4, Taipei 10617 Taiwan
| | - Chia-Lung Hsieh
- Institute of Atomic and Molecular Sciences (IAMS), Academia Sinica 1, Roosevelt Rd. Sec. 4, Taipei 10617 Taiwan
| | - Brian Abbey
- Australian Research Council Centre of Excellence for Advanced Molecular Imaging, La Trobe University, Melbourne, Victoria, Australia
- Department of Chemistry and Physics, La Trobe Institute for Molecular Science (LIMS), La Trobe University, Melbourne, Victoria, Australia
| | - Alberto Diaspro
- Optical Nanoscopy and NIC@IIT, CHT, Istituto Italiano di Tecnologia, Via Enrico Melen 83B, 16152 Genoa, Italy
- DIFILAB, Department of Physics, University of Genoa, Via Dodecaneso 33, 16146 Genoa, Italy
| | - Aymeric LeGratiet
- Optical Nanoscopy and NIC@IIT, CHT, Istituto Italiano di Tecnologia, Via Enrico Melen 83B, 16152 Genoa, Italy
- Université de Rennes, CNRS, Institut FOTON - UMR 6082, F-22305 Lannion, France
| | - Paolo Bianchini
- Optical Nanoscopy and NIC@IIT, CHT, Istituto Italiano di Tecnologia, Via Enrico Melen 83B, 16152 Genoa, Italy
- DIFILAB, Department of Physics, University of Genoa, Via Dodecaneso 33, 16146 Genoa, Italy
| | - Natan T. Shaked
- Tel Aviv University, Faculty of Engineering, Department of Biomedical Engineering, Tel Aviv 6997801, Israel
| | - Bertrand Simon
- LP2N, Institut d’Optique Graduate School, CNRS UMR 5298, Université de Bordeaux, Talence France
| | - Nicolas Verrier
- IRIMAS UR UHA 7499, Université de Haute-Alsace, Mulhouse, France
| | | | - Olivier Haeberlé
- IRIMAS UR UHA 7499, Université de Haute-Alsace, Mulhouse, France
| | - Sheng Wang
- School of Physics and Technology, Wuhan University, China
- Wuhan Institute of Quantum Technology, China
| | - Mengkun Liu
- Department of Physics and Astronomy, Stony Brook University, USA
- National Synchrotron Light Source II, Brookhaven National Laboratory, USA
| | - Yeran Bai
- Boston University Photonics Center, Boston, MA 02215, USA
| | - Ji-Xin Cheng
- Boston University Photonics Center, Boston, MA 02215, USA
| | - Behjat S. Kariman
- Optical Nanoscopy and NIC@IIT, CHT, Istituto Italiano di Tecnologia, Via Enrico Melen 83B, 16152 Genoa, Italy
- DIFILAB, Department of Physics, University of Genoa, Via Dodecaneso 33, 16146 Genoa, Italy
| | - Katsumasa Fujita
- Department of Applied Physics and the Advanced Photonics and Biosensing Open Innovation Laboratory (AIST); and the Transdimensional Life Imaging Division, Institute for Open and Transdisciplinary Research Initiatives, Osaka University, Osaka, Japan
| | - Moshe Sinvani
- Faculty of Engineering and the Nano-Technology Center, Bar-Ilan University, Ramat Gan, 52900 Israel
| | - Zeev Zalevsky
- Faculty of Engineering and the Nano-Technology Center, Bar-Ilan University, Ramat Gan, 52900 Israel
| | - Xiangping Li
- Guangdong Provincial Key Laboratory of Optical Fiber Sensing and Communications, Institute of Photonics Technology, Jinan University, Guangzhou 510632, China
| | - Guan-Jie Huang
- Department of Physics and Molecular Imaging Center, National Taiwan University, Taipei 10617, Taiwan
- Brain Research Center, National Tsing Hua University, Hsinchu 30013, Taiwan
| | - Shi-Wei Chu
- Department of Physics and Molecular Imaging Center, National Taiwan University, Taipei 10617, Taiwan
- Brain Research Center, National Tsing Hua University, Hsinchu 30013, Taiwan
| | - Omer Tzang
- School of Chemistry, The Sackler faculty of Exact Sciences, and the Center for Light matter Interactions, and the Tel Aviv University Center for Nanoscience and Nanotechnology, Tel Aviv 69978, Israel
| | - Dror Hershkovitz
- School of Chemistry, The Sackler faculty of Exact Sciences, and the Center for Light matter Interactions, and the Tel Aviv University Center for Nanoscience and Nanotechnology, Tel Aviv 69978, Israel
| | - Ori Cheshnovsky
- School of Chemistry, The Sackler faculty of Exact Sciences, and the Center for Light matter Interactions, and the Tel Aviv University Center for Nanoscience and Nanotechnology, Tel Aviv 69978, Israel
| | - Mikko J. Huttunen
- Laboratory of Photonics, Physics Unit, Tampere University, FI-33014, Tampere, Finland
| | - Stefan G. Stanciu
- Center for Microscopy – Microanalysis and Information Processing, Politehnica University of Bucharest, 313 Splaiul Independentei, 060042, Bucharest, Romania
| | - Vera N. Smolyaninova
- Department of Physics Astronomy and Geosciences, Towson University, 8000 York Rd., Towson, MD 21252, USA
| | - Igor I. Smolyaninov
- Department of Electrical and Computer Engineering, University of Maryland, College Park, MD 20742, USA
| | - Ulf Leonhardt
- Weizmann Institute of Science, Rehovot 7610001, Israel
| | - Sahar Sahebdivan
- EMTensor GmbH, TechGate, Donau-City-Strasse 1, 1220 Wien, Austria
| | - Zengbo Wang
- School of Computer Science and Electronic Engineering, Bangor University, Bangor, LL57 1UT, United Kingdom
| | - Boris Luk’yanchuk
- Faculty of Physics, Lomonosov Moscow State University, Moscow 119991, Russia
| | - Limin Wu
- Department of Materials Science and State Key Laboratory of Molecular Engineering of Polymers, Fudan University, Shanghai 200433, China
| | - Alexey V. Maslov
- Department of Radiophysics, University of Nizhny Novgorod, Nizhny Novgorod, 603022, Russia
| | - Boya Jin
- Department of Physics and Optical Science, University of North Carolina at Charlotte, Charlotte, North Carolina 28223-0001, USA
| | - Constantin R. Simovski
- Department of Electronics and Nano-Engineering, Aalto University, FI-00076, Espoo, Finland
- Faculty of Physics and Engineering, ITMO University, 199034, St-Petersburg, Russia
| | - Stephane Perrin
- ICube Research Institute, University of Strasbourg - CNRS - INSA de Strasbourg, 300 Bd. Sébastien Brant, 67412 Illkirch, France
| | - Paul Montgomery
- ICube Research Institute, University of Strasbourg - CNRS - INSA de Strasbourg, 300 Bd. Sébastien Brant, 67412 Illkirch, France
| | - Sylvain Lecler
- ICube Research Institute, University of Strasbourg - CNRS - INSA de Strasbourg, 300 Bd. Sébastien Brant, 67412 Illkirch, France
| |
Collapse
|
8
|
Xia Y, Yun H, Liu Y, Luan J, Li M. MGCBFormer: The multiscale grid-prior and class-inter boundary-aware transformer for polyp segmentation. Comput Biol Med 2023; 167:107600. [PMID: 37931522 DOI: 10.1016/j.compbiomed.2023.107600] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2023] [Revised: 09/23/2023] [Accepted: 10/17/2023] [Indexed: 11/08/2023]
Abstract
The polyp segmentation technology based on deep learning could better and faster help doctors diagnose the polyps in the intestinal wall, which are predecessors of colorectal cancer. Mainstream polyp segmentation methods are implemented under full supervision. For these methods, expensive and precious pixel-level labels couldn't be utilized sufficiently, and it's a deviation direction to strengthen the feature expression only using the more powerful backbone network instead of fully mining existing polyp target information. To address the situation, the multiscale grid-prior and class-inter boundary-aware transformer (MGCBFormer) is proposed. MGCBFormer is composed of highly interpretable components: 1) the multiscale grid-prior and nested channel attention block (MGNAB) for seeking the optimal feature expression, 2) the class-inter boundary-aware block (CBB) for focusing on the foreground boundary and fully inhibiting the background boundary by combining the boundary preprocessing strategy, 3) reasonable deep supervision branches and noise filters called the global double-axis association coupler (GDAC). Numerous persuasive experiments are conducted on five public polyp datasets (Kvasir-SEG, CVC-ClinicDB, CVC-ColonDB, CVC-300, and ETIS-LaribPolypDB) comparing with twelve methods of polyp segmentation, and demonstrate the superior predictive performance and generalization ability of MGCBFormer over the state-of-the-art polyp segmentation methods.
Collapse
Affiliation(s)
- Yang Xia
- School of Electronic Information Engineering, Changchun University, Changchun, 130022, China
| | - Haijiao Yun
- School of Electronic Information Engineering, Changchun University, Changchun, 130022, China.
| | - Yanjun Liu
- School of Electronic Information Engineering, Changchun University, Changchun, 130022, China
| | - Jinyang Luan
- School of Electronic Information Engineering, Changchun University, Changchun, 130022, China
| | - Mingjing Li
- School of Electronic Information Engineering, Changchun University, Changchun, 130022, China
| |
Collapse
|
9
|
Klenk C, Erber J, Fresacher D, Röhrl S, Lengl M, Heim D, Irl H, Schlegel M, Haller B, Lahmer T, Diepold K, Rasch S, Hayden O. Platelet aggregates detected using quantitative phase imaging associate with COVID-19 severity. COMMUNICATIONS MEDICINE 2023; 3:161. [PMID: 37935793 PMCID: PMC10630365 DOI: 10.1038/s43856-023-00395-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2023] [Accepted: 10/25/2023] [Indexed: 11/09/2023] Open
Abstract
BACKGROUND The clinical spectrum of acute SARS-CoV-2 infection ranges from an asymptomatic to life-threatening disease. Considering the broad spectrum of severity, reliable biomarkers are required for early risk stratification and prediction of clinical outcomes. Despite numerous efforts, no COVID-19-specific biomarker has been established to guide further diagnostic or even therapeutic approaches, most likely due to insufficient validation, methodical complexity, or economic factors. COVID-19-associated coagulopathy is a hallmark of the disease and is mainly attributed to dysregulated immunothrombosis. This process describes an intricate interplay of platelets, innate immune cells, the coagulation cascade, and the vascular endothelium leading to both micro- and macrothrombotic complications. In this context, increased levels of immunothrombotic components, including platelet and platelet-leukocyte aggregates, have been described and linked to COVID-19 severity. METHODS Here, we describe a label-free quantitative phase imaging approach, allowing the identification of cell-aggregates and their components at single-cell resolution within 30 min, which prospectively qualifies the method as point-of-care (POC) testing. RESULTS We find a significant association between the severity of COVID-19 and the amount of platelet and platelet-leukocyte aggregates. Additionally, we observe a linkage between severity, aggregate composition, and size distribution of platelets in aggregates. CONCLUSIONS This study presents a POC-compatible method for rapid quantitative analysis of blood cell aggregates in patients with COVID-19.
Collapse
Affiliation(s)
- Christian Klenk
- Heinz-Nixdorf-Chair of Biomedical Electronics, School of Computation, Information and Technology, Technical University of Munich, TranslaTUM, 81675, Munich, Germany
| | - Johanna Erber
- TUM School of Medicine and Health, Department of Clinical Medicine - Clinical Department for Internal Medicine II, University Medical Centre, Technical University of Munich, 81675, Munich, Germany
| | - David Fresacher
- Heinz-Nixdorf-Chair of Biomedical Electronics, School of Computation, Information and Technology, Technical University of Munich, TranslaTUM, 81675, Munich, Germany
- Chair for Data Processing, School of Computation, Information and Technology, Technical University of Munich, 80333, Munich, Germany
| | - Stefan Röhrl
- Chair for Data Processing, School of Computation, Information and Technology, Technical University of Munich, 80333, Munich, Germany
| | - Manuel Lengl
- Chair for Data Processing, School of Computation, Information and Technology, Technical University of Munich, 80333, Munich, Germany
| | - Dominik Heim
- Heinz-Nixdorf-Chair of Biomedical Electronics, School of Computation, Information and Technology, Technical University of Munich, TranslaTUM, 81675, Munich, Germany
| | - Hedwig Irl
- TUM School of Medicine and Health, Department of Clinical Medicine - Clinical Department of Anaesthesiology and Intensive Care Medicine, University Medical Centre, Technical University of Munich, 81675, Munich, Germany
| | - Martin Schlegel
- TUM School of Medicine and Health, Department of Clinical Medicine - Clinical Department of Anaesthesiology and Intensive Care Medicine, University Medical Centre, Technical University of Munich, 81675, Munich, Germany
| | - Bernhard Haller
- TUM School of Medicine and Health, Department of Clinical Medicine - Institute of AI and Informatics in Medicine, University Medical Centre, Technical University of Munich, 81675, Munich, Germany
| | - Tobias Lahmer
- TUM School of Medicine and Health, Department of Clinical Medicine - Clinical Department for Internal Medicine II, University Medical Centre, Technical University of Munich, 81675, Munich, Germany
| | - Klaus Diepold
- Chair for Data Processing, School of Computation, Information and Technology, Technical University of Munich, 80333, Munich, Germany
| | - Sebastian Rasch
- TUM School of Medicine and Health, Department of Clinical Medicine - Clinical Department for Internal Medicine II, University Medical Centre, Technical University of Munich, 81675, Munich, Germany
| | - Oliver Hayden
- Heinz-Nixdorf-Chair of Biomedical Electronics, School of Computation, Information and Technology, Technical University of Munich, TranslaTUM, 81675, Munich, Germany.
| |
Collapse
|
10
|
Park J, Bai B, Ryu D, Liu T, Lee C, Luo Y, Lee MJ, Huang L, Shin J, Zhang Y, Ryu D, Li Y, Kim G, Min HS, Ozcan A, Park Y. Artificial intelligence-enabled quantitative phase imaging methods for life sciences. Nat Methods 2023; 20:1645-1660. [PMID: 37872244 DOI: 10.1038/s41592-023-02041-4] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2023] [Accepted: 09/11/2023] [Indexed: 10/25/2023]
Abstract
Quantitative phase imaging, integrated with artificial intelligence, allows for the rapid and label-free investigation of the physiology and pathology of biological systems. This review presents the principles of various two-dimensional and three-dimensional label-free phase imaging techniques that exploit refractive index as an intrinsic optical imaging contrast. In particular, we discuss artificial intelligence-based analysis methodologies for biomedical studies including image enhancement, segmentation of cellular or subcellular structures, classification of types of biological samples and image translation to furnish subcellular and histochemical information from label-free phase images. We also discuss the advantages and challenges of artificial intelligence-enabled quantitative phase imaging analyses, summarize recent notable applications in the life sciences, and cover the potential of this field for basic and industrial research in the life sciences.
Collapse
Affiliation(s)
- Juyeon Park
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea
| | - Bijie Bai
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA
- Bioengineering Department, University of California, Los Angeles, Los Angeles, CA, USA
| | - DongHun Ryu
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea
- Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Tairan Liu
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA
| | - Chungha Lee
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea
| | - Yi Luo
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA
| | - Mahn Jae Lee
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea
- Graduate School of Medical Science and Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
| | - Luzhe Huang
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA
| | - Jeongwon Shin
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea
- Department of Biological Sciences, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
| | - Yijie Zhang
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA
| | | | - Yuzhu Li
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA
| | - Geon Kim
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea
| | | | - Aydogan Ozcan
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA.
- Bioengineering Department, University of California, Los Angeles, Los Angeles, CA, USA.
| | - YongKeun Park
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea.
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea.
- Tomocube, Daejeon, Republic of Korea.
| |
Collapse
|
11
|
Butt SS, Fida I, Fatima M, Khan MS, Mustafa S, Khan MN, Ahmad I. Quantitative phase imaging for characterization of single cell growth dynamics. Lasers Med Sci 2023; 38:241. [PMID: 37851109 DOI: 10.1007/s10103-023-03902-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Accepted: 09/30/2023] [Indexed: 10/19/2023]
Abstract
Quantitative phase imaging (QPI) has emerged as an indispensable tool in the field of biomedicine, offering the ability to obtain quantitative maps of phase changes due to optical path length delays without the need for contrast agents. These maps provide valuable information about cellular morphology and dynamics, unperturbed by the introduction of exogenous substances. In this review, a summary of recent studies that have focused on elucidating the growth dynamics of individual cells using QPI is presented. Specifically, investigations into cellular changes occurring during mitosis, the differentiation of cellular organelles, the assessment of distinct cell death processes (i.e., apoptosis, necrosis, and oncosis) and the precise measurement of live cell temperature are explored. Furthermore, the captivating applications of QPI in theragnostics, where its potential for transformative impact is prominently showcased, are highlighted. Finally, the challenges that need to be overcome for its wider adoption and successful integration into biomedical research are outlined.
Collapse
Affiliation(s)
| | - Irum Fida
- The Women University Multan, Multan, Pakistan
| | | | - Muskan Saif Khan
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Sonia Mustafa
- School of Precision Instrument and Opto-electronics Engineering, Tianjin University, Tianjin, China
| | | | - Iftikhar Ahmad
- Institute of Radiotherapy and Nuclear Medicine (IRNUM), Peshawar, Pakistan.
| |
Collapse
|
12
|
Wu J, Zhang HX, Zhang J. The molecular mechanism of non-covalent inhibitor WU-04 targeting SARS-CoV-2 3CLpro and computational evaluation of its effectiveness against mainstream coronaviruses. Phys Chem Chem Phys 2023; 25:23555-23567. [PMID: 37655706 DOI: 10.1039/d3cp03828a] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/02/2023]
Abstract
There is an urgent need for highly effective therapeutic agents to interrupt the continued spread of SARS-CoV-2. As a pivotal protease in the replication process of coronaviruses, the 3CLpro protein is considered as a potential target of drug development to stop the spread and infection of the virus. In this work, molecular dynamics (MD) simulations were used to elucidate the molecular mechanism of a novel and highly effective non-covalent inhibitor, WU-04, targeting the SARS-CoV-2 3CLpro protein. The difference in dynamic behavior between the apo-3CLpro and the holo-3CLpro systems suggests that the presence of WU-04 inhibits the motion amplitude of the 3CLpro protein relative to the apo-3CLpro system, thus maintaining a stable conformational binding state. The energy calculations and interaction analysis show that the hot-spot residues Q189, M165, M49, E166, and H41 and the warm-spot residues H163 and C145 have a strong binding capacity to WU-04 by forming multiple hydrogen bonds and hydrophobic interactions, which stabilizes the binding of the inhibitor. After that, the resistance of WU-04 to the six SARS-CoV-2 variants (Alpha, Beta, Gamma, Delta, Lambda, and Omicron) and two other mainstream coronavirus (SARS-CoV and MERS-CoV) 3CLpro proteins was further investigated. Excitingly, the slight difference in energy values relative to the SARS-CoV-2 system indicates that WU-04 is still highly effective against the coronaviruses, which becomes crucial evidence that WU-04 is a pan-inhibitor of the 3CLpro protein in various SARS-CoV-2 variants and other mainstream coronaviruses. The study will hopefully provide theoretical insights for the future rational design and improvement of novel non-covalent inhibitors targeting the 3CLpro protein.
Collapse
Affiliation(s)
- Jianhua Wu
- Institute of Theoretical Chemistry, College of Chemistry, Jilin University, Changchun 130023, Jilin, People's Republic of China.
| | - Hong-Xing Zhang
- Institute of Theoretical Chemistry, College of Chemistry, Jilin University, Changchun 130023, Jilin, People's Republic of China.
| | - Jilong Zhang
- Institute of Theoretical Chemistry, College of Chemistry, Jilin University, Changchun 130023, Jilin, People's Republic of China.
| |
Collapse
|
13
|
Pirone D, Montella A, Sirico D, Mugnano M, Del Giudice D, Kurelac I, Tirelli M, Iolascon A, Bianco V, Memmolo P, Capasso M, Miccio L, Ferraro P. Phenotyping neuroblastoma cells through intelligent scrutiny of stain-free biomarkers in holographic flow cytometry. APL Bioeng 2023; 7:036118. [PMID: 37753527 PMCID: PMC10519746 DOI: 10.1063/5.0159399] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Accepted: 08/21/2023] [Indexed: 09/28/2023] Open
Abstract
To efficiently tackle certain tumor types, finding new biomarkers for rapid and complete phenotyping of cancer cells is highly demanded. This is especially the case for the most common pediatric solid tumor of the sympathetic nervous system, namely, neuroblastoma (NB). Liquid biopsy is in principle a very promising tool for this purpose, but usually enrichment and isolation of circulating tumor cells in such patients remain difficult due to the unavailability of universal NB cell-specific surface markers. Here, we show that rapid screening and phenotyping of NB cells through stain-free biomarkers supported by artificial intelligence is a viable route for liquid biopsy. We demonstrate the concept through a flow cytometry based on label-free holographic quantitative phase-contrast microscopy empowered by machine learning. In detail, we exploit a hierarchical decision scheme where at first level NB cells are classified from monocytes with 97.9% accuracy. Then we demonstrate that different phenotypes are discriminated within NB class. Indeed, for each cell classified as NB its belonging to one of four NB sub-populations (i.e., CHP212, SKNBE2, SHSY5Y, and SKNSH) is evaluated thus achieving accuracy in the range 73.6%-89.1%. The achieved results solve the realistic problem related to the identification circulating tumor cell, i.e., the possibility to recognize and detect tumor cells morphologically similar to blood cells, which is the core issue in liquid biopsy based on stain-free microscopy. The presented approach operates at lab-on-chip scale and emulates real-world scenarios, thus representing a future route for liquid biopsy by exploiting intelligent biomedical imaging.
Collapse
Affiliation(s)
| | | | - Daniele Sirico
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems “E. Caianiello,” via Campi Flegrei 34, 80078 Pozzuoli, Napoli, Italy
| | - Martina Mugnano
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems “E. Caianiello,” via Campi Flegrei 34, 80078 Pozzuoli, Napoli, Italy
| | - Danila Del Giudice
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems “E. Caianiello,” via Campi Flegrei 34, 80078 Pozzuoli, Napoli, Italy
| | | | | | | | - Vittorio Bianco
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems “E. Caianiello,” via Campi Flegrei 34, 80078 Pozzuoli, Napoli, Italy
| | - Pasquale Memmolo
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems “E. Caianiello,” via Campi Flegrei 34, 80078 Pozzuoli, Napoli, Italy
| | - Mario Capasso
- Authors to whom correspondence should be addressed: and
| | - Lisa Miccio
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems “E. Caianiello,” via Campi Flegrei 34, 80078 Pozzuoli, Napoli, Italy
| | - Pietro Ferraro
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems “E. Caianiello,” via Campi Flegrei 34, 80078 Pozzuoli, Napoli, Italy
| |
Collapse
|
14
|
Liu T, Li Y, Koydemir HC, Zhang Y, Yang E, Eryilmaz M, Wang H, Li J, Bai B, Ma G, Ozcan A. Rapid and stain-free quantification of viral plaque via lens-free holography and deep learning. Nat Biomed Eng 2023; 7:1040-1052. [PMID: 37349390 PMCID: PMC10427422 DOI: 10.1038/s41551-023-01057-7] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2022] [Accepted: 05/14/2023] [Indexed: 06/24/2023]
Abstract
A plaque assay-the gold-standard method for measuring the concentration of replication-competent lytic virions-requires staining and usually more than 48 h of runtime. Here we show that lens-free holographic imaging and deep learning can be combined to expedite and automate the assay. The compact imaging device captures phase information label-free at a rate of approximately 0.32 gigapixels per hour per well, covers an area of about 30 × 30 mm2 and a 10-fold larger dynamic range of virus concentration than standard assays, and quantifies the infected area and the number of plaque-forming units. For the vesicular stomatitis virus, the automated plaque assay detected the first cell-lysing events caused by viral replication as early as 5 h after incubation, and in less than 20 h it detected plaque-forming units at rates higher than 90% at 100% specificity. Furthermore, it reduced the incubation time of the herpes simplex virus type 1 by about 48 h and that of the encephalomyocarditis virus by about 20 h. The stain-free assay should be amenable for use in virology research, vaccine development and clinical diagnosis.
Collapse
Affiliation(s)
- Tairan Liu
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, USA
- Bioengineering Department, University of California, Los Angeles, USA
- California NanoSystems Institute (CNSI), University of California, Los Angeles, CA, USA
| | - Yuzhu Li
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, USA
- Bioengineering Department, University of California, Los Angeles, USA
- California NanoSystems Institute (CNSI), University of California, Los Angeles, CA, USA
| | - Hatice Ceylan Koydemir
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, USA
- Department of Biomedical Engineering, Texas A&M University, College Station, TX, USA
- Center for Remote Health Technologies and Systems, Texas A&M University, College Station, TX, USA
| | - Yijie Zhang
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, USA
- Bioengineering Department, University of California, Los Angeles, USA
- California NanoSystems Institute (CNSI), University of California, Los Angeles, CA, USA
| | - Ethan Yang
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, USA
- Department of Mathematics, University of California, Los Angeles, CA, USA
| | - Merve Eryilmaz
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, USA
- Bioengineering Department, University of California, Los Angeles, USA
| | - Hongda Wang
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, USA
- Bioengineering Department, University of California, Los Angeles, USA
- California NanoSystems Institute (CNSI), University of California, Los Angeles, CA, USA
| | - Jingxi Li
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, USA
- Bioengineering Department, University of California, Los Angeles, USA
- California NanoSystems Institute (CNSI), University of California, Los Angeles, CA, USA
| | - Bijie Bai
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, USA
- Bioengineering Department, University of California, Los Angeles, USA
- California NanoSystems Institute (CNSI), University of California, Los Angeles, CA, USA
| | - Guangdong Ma
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, USA
- School of Physics, Xi'an Jiaotong University, Xi'an, China
| | - Aydogan Ozcan
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, USA.
- Bioengineering Department, University of California, Los Angeles, USA.
- California NanoSystems Institute (CNSI), University of California, Los Angeles, CA, USA.
- Department of Surgery, University of California, Los Angeles, CA, USA.
| |
Collapse
|
15
|
Fanous MJ, Pillar N, Ozcan A. Digital staining facilitates biomedical microscopy. FRONTIERS IN BIOINFORMATICS 2023; 3:1243663. [PMID: 37564725 PMCID: PMC10411189 DOI: 10.3389/fbinf.2023.1243663] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Accepted: 07/17/2023] [Indexed: 08/12/2023] Open
Abstract
Traditional staining of biological specimens for microscopic imaging entails time-consuming, laborious, and costly procedures, in addition to producing inconsistent labeling and causing irreversible sample damage. In recent years, computational "virtual" staining using deep learning techniques has evolved into a robust and comprehensive application for streamlining the staining process without typical histochemical staining-related drawbacks. Such virtual staining techniques can also be combined with neural networks designed to correct various microscopy aberrations, such as out-of-focus or motion blur artifacts, and improve upon diffracted-limited resolution. Here, we highlight how such methods lead to a host of new opportunities that can significantly improve both sample preparation and imaging in biomedical microscopy.
Collapse
Affiliation(s)
- Michael John Fanous
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, United States
| | - Nir Pillar
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, United States
- Bioengineering Department, University of California, Los Angeles, CA, United States
| | - Aydogan Ozcan
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, United States
- Bioengineering Department, University of California, Los Angeles, CA, United States
- California NanoSystems Institute (CNSI), University of California, Los Angeles, CA, United States
- Department of Surgery, David Geffen School of Medicine, University of California, Los Angeles, CA, United States
| |
Collapse
|
16
|
Tayal S, Tiwari S, Mehta DS. Label-free high-resolution white light quantitative phase nanoscopy system. JOURNAL OF BIOPHOTONICS 2023; 16:e202200298. [PMID: 36602467 DOI: 10.1002/jbio.202200298] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/28/2022] [Revised: 11/17/2022] [Accepted: 01/02/2023] [Indexed: 06/17/2023]
Abstract
We present a high-resolution white light quantitative phase nanoscopy (WLQPN) system that can be utilized to visualize nanoparticles and subcellular features of the biological specimens. The five-phase shifting technique, along with deconvolution, is adopted to obtain super-resolution in phase imaging. The phase shifting technique can provide full detector resolution, making it beneficial as compared to the well-known Fourier analysis method. The Fourier transform method requires minimum angle of sin - 1 3 f x λ , where f x is maximum achievable spatial frequency. It limits the highest achievable resolution to much below the actual diffraction limit of the system. Thus, to obtain a high-resolution phase map of the biological specimen, a two-step process is adopted. First, the phase map is recovered using the five-phase shifting algorithm, with full detector spatial resolution. Second, the complex field is obtained from the recovered phase map and further processed using the Richardson Lucy total variation deconvolution algorithm to obtain super-resolution phase images. The present technique was tested on 1951 USAF resolution chart, 200 nm polystyrene beads and Escherichia coli bacteria using a 50×, 0.55NA objective lens. The 200 nm polystyrene beads are visually resolvable and subcellular features of the E. coli bacteria are also observed, suggesting a significant improvement in the resolution.
Collapse
Affiliation(s)
- Shilpa Tayal
- Bio-photonics and Green Photonics Laboratory, Department of Physics, Indian Institute of Technology Delhi, New Delhi, India
| | - Shubham Tiwari
- Bio-photonics and Green Photonics Laboratory, Department of Physics, Indian Institute of Technology Delhi, New Delhi, India
| | - Dalip Singh Mehta
- Bio-photonics and Green Photonics Laboratory, Department of Physics, Indian Institute of Technology Delhi, New Delhi, India
| |
Collapse
|
17
|
Wu J, Zhang HX, Zhang J. Investigation on the interaction mechanism of different SARS-CoV-2 spike variants with hACE2: insights from molecular dynamics simulations. Phys Chem Chem Phys 2023; 25:2304-2319. [PMID: 36597957 DOI: 10.1039/d2cp04349a] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2023]
Abstract
Since the COVID-19 pandemic caused by Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2), SARS-CoV-2 has evolved by acquiring genomic mutations, resulting in the recent emergence of several SARS-CoV-2 variants with improved transmissibility and infectivity relative to the original strain. An underlying mechanism may be the increased ability of the mutants to bind the receptor proteins and infect the host cell. In this work, we implemented all-atom molecular dynamics (MD) simulations to study the binding and interaction of the receptor binding domain (RBD) of the SARS-CoV-2 spike protein singly (D614G), doubly (D614G + L452R and D614G + N501Y), triply (D614G + N501Y + E484K), and quadruply (D614G + N501Y + E484K + K417T) mutated variants with the human angiotensin-converting enzyme 2 (hACE2) receptor protein in the host cell. A combination of multiple analysis approaches elucidated the effects of mutations and the extent of molecular divergence from multiple perspectives, including the dynamic correlated motions, interaction patterns, dominant motions, free energy landscape, and charge distribution on the electrostatic potential surface between the hACE2 and all RBD variants. Moreover, free energy calculations using the MM/PBSA method evaluated the binding affinity between these RBD variants and hACE2. The results showed that the D614G + N501Y + E484K variant possessed the lowest free energy value (highest affinity) compared to the D614G + N501Y + E484K + K417T, D614G + L452R, D614G + N501Y, and D614G mutants. The residue-based energy decomposition also indicated that the energy contribution of residues at the mutation site to the total binding energy was highly variable. The interaction mechanisms between the different RBD variants and hACE2 elucidated in this study will provide some insights into the development of drugs targeting the new SARS-CoV-2 variants.
Collapse
Affiliation(s)
- Jianhua Wu
- Institute of Theoretical Chemistry, College of Chemistry, Jilin University, Changchun 130023, Jilin, People's Republic of China.
| | - Hong-Xing Zhang
- Institute of Theoretical Chemistry, College of Chemistry, Jilin University, Changchun 130023, Jilin, People's Republic of China.
| | - Jilong Zhang
- Institute of Theoretical Chemistry, College of Chemistry, Jilin University, Changchun 130023, Jilin, People's Republic of China.
| |
Collapse
|
18
|
Shin J, Kim G, Park J, Lee M, Park Y. Long-term label-free assessments of individual bacteria using three-dimensional quantitative phase imaging and hydrogel-based immobilization. Sci Rep 2023; 13:46. [PMID: 36593327 PMCID: PMC9806822 DOI: 10.1038/s41598-022-27158-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2022] [Accepted: 12/27/2022] [Indexed: 01/03/2023] Open
Abstract
Three-dimensional (3D) quantitative phase imaging (QPI) enables long-term label-free tomographic imaging and quantitative analysis of live individual bacteria. However, the Brownian motion or motility of bacteria in a liquid medium produces motion artifacts during 3D measurements and hinders precise cell imaging and analysis. Meanwhile, existing cell immobilization methods produce noisy backgrounds and even alter cellular physiology. Here, we introduce a protocol that utilizes hydrogels for high-quality 3D QPI of live bacteria maintaining bacterial physiology. We demonstrate long-term high-resolution quantitative imaging and analysis of individual bacteria, including measuring the biophysical parameters of bacteria and responses to antibiotic treatments.
Collapse
Affiliation(s)
- Jeongwon Shin
- grid.37172.300000 0001 2292 0500Department of Biological Sciences, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, 34141 South Korea
| | - Geon Kim
- grid.37172.300000 0001 2292 0500Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, 34141 South Korea ,grid.37172.300000 0001 2292 0500KAIST Institute for Health Science and Technology, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, 34141 South Korea
| | - Jinho Park
- grid.37172.300000 0001 2292 0500Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, 34141 South Korea
| | - Moosung Lee
- grid.37172.300000 0001 2292 0500Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, 34141 South Korea ,grid.37172.300000 0001 2292 0500KAIST Institute for Health Science and Technology, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, 34141 South Korea
| | - YongKeun Park
- grid.37172.300000 0001 2292 0500Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, 34141 South Korea ,grid.37172.300000 0001 2292 0500KAIST Institute for Health Science and Technology, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, 34141 South Korea ,Tomocube Inc., Daejeon, 34051 South Korea
| |
Collapse
|
19
|
Zhang Z, Liu D, Huo Y, Ning T. Ultralow-level all-optical self-switching in a nanostructured moiré superlattice. OPTICS LETTERS 2022; 47:5260-5263. [PMID: 36240337 DOI: 10.1364/ol.468191] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/17/2022] [Accepted: 09/20/2022] [Indexed: 06/16/2023]
Abstract
We report an all-optical self-switching performed at an ultralow-level of intensity in a nanostructured moiré superlattice on a silicon platform. The moiré superlattice was formed by twisting two sets of triangular lattices in a silicon membrane in the same layer with a twist angle of 9.43°. The near flatband was formed, and the electric field was well confined in the center of the superlattice, which enabled all-optical switching under an ultralow intensity when the Kerr nonlinearity of silicon was considered. The intensity, which was reduced to 300 W/m2 and even 20 W/m2, can cause the transmittance of the nanostructure to change from 0 to 80% under x- and y-polarized pump light, respectively, and could be further decreased by optimizing the nanostructure or nonlinear materials. The results indicate that moiré superlattices fabricated from nonlinear materials are promising for integrated all-optical devices.
Collapse
|
20
|
Fanous MJ, Popescu G. GANscan: continuous scanning microscopy using deep learning deblurring. LIGHT, SCIENCE & APPLICATIONS 2022; 11:265. [PMID: 36071043 PMCID: PMC9452654 DOI: 10.1038/s41377-022-00952-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/15/2022] [Revised: 07/31/2022] [Accepted: 08/07/2022] [Indexed: 05/05/2023]
Abstract
Most whole slide imaging (WSI) systems today rely on the "stop-and-stare" approach, where, at each field of view, the scanning stage is brought to a complete stop before the camera snaps a picture. This procedure ensures that each image is free of motion blur, which comes at the expense of long acquisition times. In order to speed up the acquisition process, especially for large scanning areas, such as pathology slides, we developed an acquisition method in which the data is acquired continuously while the stage is moving at high speeds. Using generative adversarial networks (GANs), we demonstrate this ultra-fast imaging approach, referred to as GANscan, which restores sharp images from motion blurred videos. GANscan allows us to complete image acquisitions at 30x the throughput of stop-and-stare systems. This method is implemented on a Zeiss Axio Observer Z1 microscope, requires no specialized hardware, and accomplishes successful reconstructions at stage speeds of up to 5000 μm/s. We validate the proposed method by imaging H&E stained tissue sections. Our method not only retrieves crisp images from fast, continuous scans, but also adjusts for defocusing that occurs during scanning within +/- 5 μm. Using a consumer GPU, the inference runs at <20 ms/ image.
Collapse
Affiliation(s)
- Michael John Fanous
- Quantitative Light Imaging Laboratory, Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL, 61801, USA.
- Department of Bioengineering, University of Illinois at Urbana-Champaign, 306 N. Wright Street, Urbana, IL, 61801, USA.
| | - Gabriel Popescu
- Quantitative Light Imaging Laboratory, Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL, 61801, USA.
- Department of Bioengineering, University of Illinois at Urbana-Champaign, 306 N. Wright Street, Urbana, IL, 61801, USA.
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, 306 N. Wright Street, Urbana, IL, 61801, USA.
| |
Collapse
|
21
|
Wu J, Zhang J, Zhang HX. Computational Design of Miniprotein Inhibitors Targeting SARS-CoV-2 Spike Protein. LANGMUIR : THE ACS JOURNAL OF SURFACES AND COLLOIDS 2022; 38:10690-10703. [PMID: 35984970 PMCID: PMC9437664 DOI: 10.1021/acs.langmuir.2c01699] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/28/2022] [Revised: 07/31/2022] [Indexed: 05/16/2023]
Abstract
The ongoing pandemic of COVID-19 caused by SARS-CoV-2 has become a global health problem. There is an urgent need to develop therapeutic drugs, effective therapies, and vaccines to prevent the spread of the virus. The virus first enters the host cell through the interaction between the receptor binding domain (RBD) of spike protein and the peptidase domain (PD) of the angiotensin-converting enzyme 2 (ACE2). Therefore, blocking the binding of RBD and ACE2 is a promising strategy to inhibit the invasion and infection of the virus in the host cell. In the study, we designed several miniprotein inhibitors against SARS-CoV-2 by single/double/triple-point mutant, based on the initial inhibitor LCB3. Molecular dynamics (MD) simulations and trajectory analysis were performed for an in-depth analysis of the structural stability, essential protein motions, and per-residue energy decomposition involved in the interaction of inhibitors with the RBD. The results showed that the inhibitors have adapted the protein RBD in the binding interface, thereby forming stable complexes. These inhibitors display low binding free energy in the MM/PBSA calculations, substantiating their strong interaction with RBD. Moreover, the binding affinity of the best miniprotein inhibitor, H6Y-M7L-L17F mutant, to RBD was ∼45 980 times (ΔG = RT ln Ki) higher than that of the initial inhibitor LCB3. Following H6Y-M7L-L17F mutant, the inhibitors with strong binding activity are successively H6Y-L17F, L17F, H6Y, and F30Y mutants. Our research proves that the miniprotein inhibitors can maintain their secondary structure and have a highly stable blocking (binding) effect on SARS-CoV-2. This study proposes novel miniprotein mutant inhibitors with enhanced binding to spike protein and provides potential guidance for the rational design of new SARS-CoV-2 spike protein inhibitors.
Collapse
Affiliation(s)
- Jianhua Wu
- Institute
of Theoretical Chemistry, College of Chemistry, Jilin University, Changchun 130023, Jilin, People’s Republic of China
| | - Jilong Zhang
- Institute
of Theoretical Chemistry, College of Chemistry, Jilin University, Changchun 130023, Jilin, People’s Republic of China
| | - Hong-Xing Zhang
- Institute
of Theoretical Chemistry, College of Chemistry, Jilin University, Changchun 130023, Jilin, People’s Republic of China
| |
Collapse
|
22
|
Deroubaix A, Kramvis A. Imaging Techniques: Essential Tools for the Study of SARS-CoV-2 Infection. Front Cell Infect Microbiol 2022; 12:794264. [PMID: 35937687 PMCID: PMC9355083 DOI: 10.3389/fcimb.2022.794264] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2021] [Accepted: 06/21/2022] [Indexed: 01/08/2023] Open
Abstract
The world has seen the emergence of a new virus in 2019, SARS-CoV-2, causing the COVID-19 pandemic and millions of deaths worldwide. Microscopy can be much more informative than conventional detection methods such as RT-PCR. This review aims to present the up-to-date microscopy observations in patients, the in vitro studies of the virus and viral proteins and their interaction with their host, discuss the microscopy techniques for detection and study of SARS-CoV-2, and summarize the reagents used for SARS-CoV-2 detection. From basic fluorescence microscopy to high resolution techniques and combined technologies, this article shows the power and the potential of microscopy techniques, especially in the field of virology.
Collapse
Affiliation(s)
- Aurélie Deroubaix
- Hepatitis Virus Diversity Research Unit, Department of Internal Medicine, School of Clinical Medicine, Faculty of Health Sciences, University of the Witwatersrand, Johannesburg, South Africa
- Life Sciences Imaging Facility, University of the Witwatersrand, Johannesburg, South Africa
| | - Anna Kramvis
- Hepatitis Virus Diversity Research Unit, Department of Internal Medicine, School of Clinical Medicine, Faculty of Health Sciences, University of the Witwatersrand, Johannesburg, South Africa
| |
Collapse
|
23
|
Kirubasankar B, Won YS, Adofo LA, Choi SH, Kim SM, Kim KK. Atomic and structural modifications of two-dimensional transition metal dichalcogenides for various advanced applications. Chem Sci 2022; 13:7707-7738. [PMID: 35865881 PMCID: PMC9258346 DOI: 10.1039/d2sc01398c] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2022] [Accepted: 05/18/2022] [Indexed: 12/14/2022] Open
Abstract
Two-dimensional (2D) transition metal dichalcogenides (TMDs) and their heterostructures have attracted significant interest in both academia and industry because of their unusual physical and chemical properties. They offer numerous applications, such as electronic, optoelectronic, and spintronic devices, in addition to energy storage and conversion. Atomic and structural modifications of van der Waals layered materials are required to achieve unique and versatile properties for advanced applications. This review presents a discussion on the atomic-scale and structural modifications of 2D TMDs and their heterostructures via post-treatment. Atomic-scale modifications such as vacancy generation, substitutional doping, functionalization and repair of 2D TMDs and structural modifications including phase transitions and construction of heterostructures are discussed. Such modifications on the physical and chemical properties of 2D TMDs enable the development of various advanced applications including electronic and optoelectronic devices, sensing, catalysis, nanogenerators, and memory and neuromorphic devices. Finally, the challenges and prospects of various post-treatment techniques and related future advanced applications are addressed.
Collapse
Affiliation(s)
- Balakrishnan Kirubasankar
- Department of Energy Science, Sungkyunkwan University Suwon 16419 South Korea .,Department of Chemistry, Sookmyung Women's University Seoul 14072 South Korea
| | - Yo Seob Won
- Department of Energy Science, Sungkyunkwan University Suwon 16419 South Korea .,Center for Integrated Nanostructure Physics (CINAP), Institute for Basic Science (IBS), Sungkyunkwan University Suwon 16419 South Korea
| | - Laud Anim Adofo
- Department of Energy Science, Sungkyunkwan University Suwon 16419 South Korea .,Center for Integrated Nanostructure Physics (CINAP), Institute for Basic Science (IBS), Sungkyunkwan University Suwon 16419 South Korea
| | - Soo Ho Choi
- Center for Integrated Nanostructure Physics (CINAP), Institute for Basic Science (IBS), Sungkyunkwan University Suwon 16419 South Korea
| | - Soo Min Kim
- Department of Chemistry, Sookmyung Women's University Seoul 14072 South Korea
| | - Ki Kang Kim
- Department of Energy Science, Sungkyunkwan University Suwon 16419 South Korea .,Center for Integrated Nanostructure Physics (CINAP), Institute for Basic Science (IBS), Sungkyunkwan University Suwon 16419 South Korea
| |
Collapse
|
24
|
Sun J, Wu J, Wu S, Goswami R, Girardo S, Cao L, Guck J, Koukourakis N, Czarske JW. Quantitative phase imaging through an ultra-thin lensless fiber endoscope. LIGHT, SCIENCE & APPLICATIONS 2022; 11:204. [PMID: 35790748 PMCID: PMC9255502 DOI: 10.1038/s41377-022-00898-2] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/08/2022] [Revised: 06/10/2022] [Accepted: 06/16/2022] [Indexed: 05/29/2023]
Abstract
Quantitative phase imaging (QPI) is a label-free technique providing both morphology and quantitative biophysical information in biomedicine. However, applying such a powerful technique to in vivo pathological diagnosis remains challenging. Multi-core fiber bundles (MCFs) enable ultra-thin probes for in vivo imaging, but current MCF imaging techniques are limited to amplitude imaging modalities. We demonstrate a computational lensless microendoscope that uses an ultra-thin bare MCF to perform quantitative phase imaging with microscale lateral resolution and nanoscale axial sensitivity of the optical path length. The incident complex light field at the measurement side is precisely reconstructed from the far-field speckle pattern at the detection side, enabling digital refocusing in a multi-layer sample without any mechanical movement. The accuracy of the quantitative phase reconstruction is validated by imaging the phase target and hydrogel beads through the MCF. With the proposed imaging modality, three-dimensional imaging of human cancer cells is achieved through the ultra-thin fiber endoscope, promising widespread clinical applications.
Collapse
Affiliation(s)
- Jiawei Sun
- Laboratory of Measurement and Sensor System Technique (MST), TU Dresden, Helmholtzstrasse 18, 01069, Dresden, Germany.
- Competence Center for Biomedical Computational Laser Systems (BIOLAS), TU Dresden, Dresden, Germany.
| | - Jiachen Wu
- Laboratory of Measurement and Sensor System Technique (MST), TU Dresden, Helmholtzstrasse 18, 01069, Dresden, Germany
- State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instruments, Tsinghua University, 100084, Beijing, China
| | - Song Wu
- Institute for Integrative Nanosciences, IFW Dresden, Helmholtzstraße 20, 01069, Dresden, Germany
| | - Ruchi Goswami
- Max Planck Institute for the Science of Light & Max-Planck-Zentrum für Physik und Medizin, 91058, Erlangen, Germany
| | - Salvatore Girardo
- Max Planck Institute for the Science of Light & Max-Planck-Zentrum für Physik und Medizin, 91058, Erlangen, Germany
| | - Liangcai Cao
- State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instruments, Tsinghua University, 100084, Beijing, China
| | - Jochen Guck
- Max Planck Institute for the Science of Light & Max-Planck-Zentrum für Physik und Medizin, 91058, Erlangen, Germany
- Cluster of Excellence Physics of Life, TU Dresden, Dresden, Germany
| | - Nektarios Koukourakis
- Laboratory of Measurement and Sensor System Technique (MST), TU Dresden, Helmholtzstrasse 18, 01069, Dresden, Germany.
- Competence Center for Biomedical Computational Laser Systems (BIOLAS), TU Dresden, Dresden, Germany.
| | - Juergen W Czarske
- Laboratory of Measurement and Sensor System Technique (MST), TU Dresden, Helmholtzstrasse 18, 01069, Dresden, Germany.
- Competence Center for Biomedical Computational Laser Systems (BIOLAS), TU Dresden, Dresden, Germany.
- Cluster of Excellence Physics of Life, TU Dresden, Dresden, Germany.
- Institute of Applied Physics, TU Dresden, Dresden, Germany.
| |
Collapse
|
25
|
Hussain R, Ongaro AE, Rodriguez de la Concepción ML, Wajs E, Riveira-Muñoz E, Ballana E, Blanco J, Toledo R, Chamorro A, Massanella M, Mateu L, Grau E, Clotet B, Carrillo J, Pruneri V. Small form factor flow virometer for SARS-CoV-2. BIOMEDICAL OPTICS EXPRESS 2022; 13:1609-1619. [PMID: 35415002 PMCID: PMC8973178 DOI: 10.1364/boe.450212] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/30/2021] [Revised: 01/19/2022] [Accepted: 01/22/2022] [Indexed: 05/20/2023]
Abstract
Current diagnostics of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection heavily rely on reverse transcription-polymerase chain reaction (RT-PCR) or on rapid antigen detection tests. The former suffers from long time-to-result and high cost while the latter from poor sensitivity. Therefore, it is crucial to develop rapid, sensitive, robust, and inexpensive methods for SARS-CoV-2 testing. Herein, we report a novel optofluidic technology, a flow-virometry reader (FVR), for fast and reliable SARS-CoV-2 detection in saliva samples. A small microfluidic chip together with a laser-pumped optical head detects the presence of viruses tagged with fluorescent antibodies directly from saliva samples. The technology has been validated using clinical samples with high sensitivity (91.2%) and specificity (90%). Thanks also to its short time-to-result (<30 min) and small size (25 × 30 × 13 cm), which can be further reduced in the future, it is a strong alternative to existing tests, especially for point-of-care (POC) and low resource settings.
Collapse
Affiliation(s)
- Rubaiya Hussain
- ICFO-Institut de Ciències Fotòniques, The Barcelona Institute of Science and Technology, 08860, Castelldefels (Barcelona), Spain
- Contributed equally
| | - Alfredo E Ongaro
- ICFO-Institut de Ciències Fotòniques, The Barcelona Institute of Science and Technology, 08860, Castelldefels (Barcelona), Spain
- Contributed equally
| | - Maria L Rodriguez de la Concepción
- IrsiCaixa AIDS Research Institute, Germans Trias i Pujol Research Institute (IGTP), Can Ruti Campus, UAB, 08916, Badalona, Catalonia, Spain
- Contributed equally
| | - Ewelina Wajs
- ICFO-Institut de Ciències Fotòniques, The Barcelona Institute of Science and Technology, 08860, Castelldefels (Barcelona), Spain
| | - Eva Riveira-Muñoz
- IrsiCaixa AIDS Research Institute, Germans Trias i Pujol Research Institute (IGTP), Can Ruti Campus, UAB, 08916, Badalona, Catalonia, Spain
| | - Ester Ballana
- IrsiCaixa AIDS Research Institute, Germans Trias i Pujol Research Institute (IGTP), Can Ruti Campus, UAB, 08916, Badalona, Catalonia, Spain
| | - Julià Blanco
- IrsiCaixa AIDS Research Institute, Germans Trias i Pujol Research Institute (IGTP), Can Ruti Campus, UAB, 08916, Badalona, Catalonia, Spain
| | - Ruth Toledo
- Infectious Diseases Department, Fight against AIDS Foundation (FLS), Germans Trias i Pujol Hospital, 08916, Badalona, Catalonia, Spain
| | - Anna Chamorro
- Infectious Diseases Department, Fight against AIDS Foundation (FLS), Germans Trias i Pujol Hospital, 08916, Badalona, Catalonia, Spain
| | - Marta Massanella
- IrsiCaixa AIDS Research Institute, Germans Trias i Pujol Research Institute (IGTP), Can Ruti Campus, UAB, 08916, Badalona, Catalonia, Spain
| | - Lourdes Mateu
- Infectious Diseases Department, Fight against AIDS Foundation (FLS), Germans Trias i Pujol Hospital, 08916, Badalona, Catalonia, Spain
| | - Eulalia Grau
- IrsiCaixa AIDS Research Institute, Germans Trias i Pujol Research Institute (IGTP), Can Ruti Campus, UAB, 08916, Badalona, Catalonia, Spain
| | - Bonaventura Clotet
- IrsiCaixa AIDS Research Institute, Germans Trias i Pujol Research Institute (IGTP), Can Ruti Campus, UAB, 08916, Badalona, Catalonia, Spain
- Infectious Diseases Department, Fight against AIDS Foundation (FLS), Germans Trias i Pujol Hospital, 08916, Badalona, Catalonia, Spain
- University of Vic-Central University of Catalonia (UVic-UCC), 08500, Vic, Catalonia, Spain
| | - Jorge Carrillo
- IrsiCaixa AIDS Research Institute, Germans Trias i Pujol Research Institute (IGTP), Can Ruti Campus, UAB, 08916, Badalona, Catalonia, Spain
| | - Valerio Pruneri
- ICFO-Institut de Ciències Fotòniques, The Barcelona Institute of Science and Technology, 08860, Castelldefels (Barcelona), Spain
- ICREA- Institució Catalana de Recerca i Estudis Avançats, 08010, Barcelona, Spain
| |
Collapse
|
26
|
Pirone D, Sirico D, Miccio L, Bianco V, Mugnano M, Ferraro P, Memmolo P. Speeding up reconstruction of 3D tomograms in holographic flow cytometry via deep learning. LAB ON A CHIP 2022; 22:793-804. [PMID: 35076055 DOI: 10.1039/d1lc01087e] [Citation(s) in RCA: 21] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
Tomographic flow cytometry by digital holography is an emerging imaging modality capable of collecting multiple views of moving and rotating cells with the aim of recovering their refractive index distribution in 3D. Although this modality allows us to access high-resolution imaging with high-throughput, the huge amount of time-lapse holographic images to be processed (hundreds of digital holograms per cell) constitutes the actual bottleneck. This prevents the system from being suitable for lab-on-a-chip platforms in real-world applications, where fast analysis of measured data is mandatory. Here we demonstrate a significant speeding-up reconstruction of phase-contrast tomograms by introducing in the processing pipeline a multi-scale fully-convolutional context aggregation network. Although it was originally developed in the context of semantic image analysis, we demonstrate for the first time that it can be successfully adapted to a holographic lab-on-chip platform for achieving 3D tomograms through a faster computational process. We trained the network with input-output image pairs to reproduce the end-to-end holographic reconstruction process, i.e. recovering quantitative phase maps (QPMs) of single cells from their digital holograms. Then, the sequence of QPMs of the same rotating cell is used to perform the tomographic reconstruction. The proposed approach significantly reduces the computational time for retrieving tomograms, thus making them available in a few seconds instead of tens of minutes, while essentially preserving the high-content information of tomographic data. Moreover, we have accomplished a compact deep convolutional neural network parameterization that can fit into on-chip SRAM and a small memory footprint, thus demonstrating its possible exploitation to provide onboard computations for lab-on-chip devices with low processing hardware resources.
Collapse
Affiliation(s)
- Daniele Pirone
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems "E. Caianiello", Via Campi Flegrei 34, 80078 Pozzuoli, Napoli, Italy.
- DIETI, Department of Electrical Engineering and Information Technologies, University of Naples "Federico II", via Claudio 21, 80125 Napoli, Italy
| | - Daniele Sirico
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems "E. Caianiello", Via Campi Flegrei 34, 80078 Pozzuoli, Napoli, Italy.
| | - Lisa Miccio
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems "E. Caianiello", Via Campi Flegrei 34, 80078 Pozzuoli, Napoli, Italy.
| | - Vittorio Bianco
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems "E. Caianiello", Via Campi Flegrei 34, 80078 Pozzuoli, Napoli, Italy.
| | - Martina Mugnano
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems "E. Caianiello", Via Campi Flegrei 34, 80078 Pozzuoli, Napoli, Italy.
| | - Pietro Ferraro
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems "E. Caianiello", Via Campi Flegrei 34, 80078 Pozzuoli, Napoli, Italy.
| | - Pasquale Memmolo
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems "E. Caianiello", Via Campi Flegrei 34, 80078 Pozzuoli, Napoli, Italy.
| |
Collapse
|
27
|
Ben Baruch S, Rotman-Nativ N, Baram A, Greenspan H, Shaked NT. Cancer-Cell Deep-Learning Classification by Integrating Quantitative-Phase Spatial and Temporal Fluctuations. Cells 2021; 10:3353. [PMID: 34943859 PMCID: PMC8699730 DOI: 10.3390/cells10123353] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2021] [Revised: 11/23/2021] [Accepted: 11/25/2021] [Indexed: 11/26/2022] Open
Abstract
We present a new classification approach for live cells, integrating together the spatial and temporal fluctuation maps and the quantitative optical thickness map of the cell, as acquired by common-path quantitative-phase dynamic imaging and processed with a deep-learning framework. We demonstrate this approach by classifying between two types of cancer cell lines of different metastatic potential originating from the same patient. It is based on the fact that both the cancer-cell morphology and its mechanical properties, as indicated by the cell temporal and spatial fluctuations, change over the disease progression. We tested different fusion methods for inputting both the morphological optical thickness maps and the coinciding spatio-temporal fluctuation maps of the cells to the classifying network framework. We show that the proposed integrated triple-path deep-learning architecture improves over deep-learning classification that is based only on the cell morphological evaluation via its quantitative optical thickness map, demonstrating the benefit in the acquisition of the cells over time and in extracting their spatio-temporal fluctuation maps, to be used as an input to the classifying deep neural network.
Collapse
Affiliation(s)
| | | | | | | | - Natan T. Shaked
- Department of Biomedical Engineering, Tel Aviv University, Tel Aviv 6997801, Israel; (S.B.B.); (N.R.-N.); (A.B.); (H.G.)
| |
Collapse
|