1
|
Rivenson Y, Liu T, Wei Z, Zhang Y, de Haan K, Ozcan A. PhaseStain: the digital staining of label-free quantitative phase microscopy images using deep learning. LIGHT, SCIENCE & APPLICATIONS 2019; 8:23. [PMID: 30728961 PMCID: PMC6363787 DOI: 10.1038/s41377-019-0129-y] [Citation(s) in RCA: 155] [Impact Index Per Article: 31.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/23/2018] [Revised: 01/05/2019] [Accepted: 01/11/2019] [Indexed: 05/03/2023]
Abstract
Using a deep neural network, we demonstrate a digital staining technique, which we term PhaseStain, to transform the quantitative phase images (QPI) of label-free tissue sections into images that are equivalent to the brightfield microscopy images of the same samples that are histologically stained. Through pairs of image data (QPI and the corresponding brightfield images, acquired after staining), we train a generative adversarial network and demonstrate the effectiveness of this virtual-staining approach using sections of human skin, kidney, and liver tissue, matching the brightfield microscopy images of the same samples stained with Hematoxylin and Eosin, Jones' stain, and Masson's trichrome stain, respectively. This digital-staining framework may further strengthen various uses of label-free QPI techniques in pathology applications and biomedical research in general, by eliminating the need for histological staining, reducing sample preparation related costs and saving time. Our results provide a powerful example of some of the unique opportunities created by data-driven image transformations enabled by deep learning.
Collapse
Affiliation(s)
- Yair Rivenson
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA 90095 USA
- Bioengineering Department, University of California, Los Angeles, CA 90095 USA
- California NanoSystems Institute (CNSI), University of California, Los Angeles, CA 90095 USA
| | - Tairan Liu
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA 90095 USA
- Bioengineering Department, University of California, Los Angeles, CA 90095 USA
- California NanoSystems Institute (CNSI), University of California, Los Angeles, CA 90095 USA
| | - Zhensong Wei
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA 90095 USA
- Bioengineering Department, University of California, Los Angeles, CA 90095 USA
- California NanoSystems Institute (CNSI), University of California, Los Angeles, CA 90095 USA
| | - Yibo Zhang
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA 90095 USA
- Bioengineering Department, University of California, Los Angeles, CA 90095 USA
- California NanoSystems Institute (CNSI), University of California, Los Angeles, CA 90095 USA
| | - Kevin de Haan
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA 90095 USA
- Bioengineering Department, University of California, Los Angeles, CA 90095 USA
- California NanoSystems Institute (CNSI), University of California, Los Angeles, CA 90095 USA
| | - Aydogan Ozcan
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA 90095 USA
- Bioengineering Department, University of California, Los Angeles, CA 90095 USA
- California NanoSystems Institute (CNSI), University of California, Los Angeles, CA 90095 USA
- Department of Surgery, David Geffen School of Medicine, University of California, Los Angeles, CA 90095 USA
| |
Collapse
|