1
|
Siu DMD, Lee KCM, Chung BMF, Wong JSJ, Zheng G, Tsia KK. Optofluidic imaging meets deep learning: from merging to emerging. LAB ON A CHIP 2023; 23:1011-1033. [PMID: 36601812 DOI: 10.1039/d2lc00813k] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
Propelled by the striking advances in optical microscopy and deep learning (DL), the role of imaging in lab-on-a-chip has dramatically been transformed from a silo inspection tool to a quantitative "smart" engine. A suite of advanced optical microscopes now enables imaging over a range of spatial scales (from molecules to organisms) and temporal window (from microseconds to hours). On the other hand, the staggering diversity of DL algorithms has revolutionized image processing and analysis at the scale and complexity that were once inconceivable. Recognizing these exciting but overwhelming developments, we provide a timely review of their latest trends in the context of lab-on-a-chip imaging, or coined optofluidic imaging. More importantly, here we discuss the strengths and caveats of how to adopt, reinvent, and integrate these imaging techniques and DL algorithms in order to tailor different lab-on-a-chip applications. In particular, we highlight three areas where the latest advances in lab-on-a-chip imaging and DL can form unique synergisms: image formation, image analytics and intelligent image-guided autonomous lab-on-a-chip. Despite the on-going challenges, we anticipate that they will represent the next frontiers in lab-on-a-chip imaging that will spearhead new capabilities in advancing analytical chemistry research, accelerating biological discovery, and empowering new intelligent clinical applications.
Collapse
Affiliation(s)
- Dickson M D Siu
- Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong, Hong Kong.
| | - Kelvin C M Lee
- Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong, Hong Kong.
| | - Bob M F Chung
- Advanced Biomedical Instrumentation Centre, Hong Kong Science Park, Shatin, New Territories, Hong Kong
| | - Justin S J Wong
- Conzeb Limited, Hong Kong Science Park, Shatin, New Territories, Hong Kong
| | - Guoan Zheng
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT, USA
| | - Kevin K Tsia
- Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong, Hong Kong.
- Advanced Biomedical Instrumentation Centre, Hong Kong Science Park, Shatin, New Territories, Hong Kong
| |
Collapse
|
2
|
Sun A, Li T, Jin T, Li Y, Li K, Song C, Xi L. Acoustic Standing Wave Aided Multiparametric Photoacoustic Imaging Flow Cytometry. Anal Chem 2021; 93:14820-14827. [PMID: 34714062 DOI: 10.1021/acs.analchem.1c03713] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Abstract
Photoacoustic imaging reveals great potential for the study of individual cells due to the rich imaging contrast for both label-free and labeled cells. However, previously reported photoacoustic imaging flow cytometry configuration suffers from inadequate imaging quality and challenge to distinguish multiple cells. In order to solve such issues, we propose a novel acoustic standing wave aided multiparametric photoacoustic imaging flow cytometry (MPAFC) system. The acoustic standing wave is introduced to improve the imaging quality and speed. Multispectral illumination along with cell geometry, photoacoustic amplitude, and acoustic frequency spectrum enables the proposed system to precisely identify multiple types of cells with one scanning. On the basis of the identification, elimination of melanoma cells, and targeted labeled glioma cells have been performed with an elimination efficiency of >95%. Additionally, the MPAFC system is able to image and capture melanoma cells at a lowest concentration of 100 cells mL-1 in pure blood. Current results suggest that the proposed MPAFC may provide a precise and efficient tool for cell detection, manipulation, and elimination in both fundamental and clinical studies.
Collapse
Affiliation(s)
- Aihui Sun
- Harbin Institute of Technology, Harbin 150001, P. R. China.,Department of Biomedical Engineering, Southern University of Science and Technology, Shenzhen 518055, P. R. China
| | - Tingting Li
- Department of Biomedical Engineering, Southern University of Science and Technology, Shenzhen 518055, P. R. China
| | - Tian Jin
- Department of Biomedical Engineering, Southern University of Science and Technology, Shenzhen 518055, P. R. China
| | - Yaxi Li
- Harbin Institute of Technology, Harbin 150001, P. R. China.,Department of Biomedical Engineering, Southern University of Science and Technology, Shenzhen 518055, P. R. China
| | - Kai Li
- Department of Biomedical Engineering, Southern University of Science and Technology, Shenzhen 518055, P. R. China
| | - Chaolong Song
- School of Mechanical Engineering and Electronic Information, China University of Geosciences, Wuhan, 430074, P. R. China
| | - Lei Xi
- Department of Biomedical Engineering, Southern University of Science and Technology, Shenzhen 518055, P. R. China
| |
Collapse
|
3
|
Kleiber A, Kraus D, Henkel T, Fritzsche W. Review: tomographic imaging flow cytometry. LAB ON A CHIP 2021; 21:3655-3666. [PMID: 34514484 DOI: 10.1039/d1lc00533b] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Within the last decades, conventional flow cytometry (FC) has evolved as a powerful measurement method in clinical diagnostics, biology, life sciences and healthcare. Imaging flow cytometry (IFC) extends the power of traditional FC by adding high resolution optical and spectroscopic information. However, the conventional IFC only provides a 2D projection of a 3D object. To overcome this limitation, tomographic imaging flow cytometry (tIFC) was developed to access 3D information about the target particles. The goal of tIFC is to visualize surfaces and internal structures in a holistic way. This review article gives an overview of the past and current developments in tIFC.
Collapse
Affiliation(s)
- Andreas Kleiber
- Leibniz Institute of Photonic Technology, Albert-Einstein-Straße 9, D-07745 Jena, Germany
| | - Daniel Kraus
- Leibniz Institute of Photonic Technology, Albert-Einstein-Straße 9, D-07745 Jena, Germany
| | - Thomas Henkel
- Leibniz Institute of Photonic Technology, Albert-Einstein-Straße 9, D-07745 Jena, Germany
| | - Wolfgang Fritzsche
- Leibniz Institute of Photonic Technology, Albert-Einstein-Straße 9, D-07745 Jena, Germany
| |
Collapse
|
4
|
Mandracchia B, Son J, Jia S. Super-resolution optofluidic scanning microscopy. LAB ON A CHIP 2021; 21:489-493. [PMID: 33325966 PMCID: PMC8024922 DOI: 10.1039/d0lc00889c] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/19/2023]
Abstract
Optofluidics enables visualizing diverse anatomical and functional traits of single-cell specimens with new degrees of imaging capabilities. However, the current optofluidic microscopy systems suffer from either low resolution to reveal subcellular details or incompatibility with general microfluidic devices or operations. Here, we report optofluidic scanning microscopy (OSM) for super-resolution, live-cell imaging. The system exploits multi-focal excitation using the innate fluidic motion of the specimens, allowing for minimal instrumental complexity and full compatibility with various microfluidic configurations. The results present effective resolution doubling, optical sectioning and contrast enhancement. We anticipate the OSM system to offer a promising super-resolution optofluidic paradigm for miniaturization and different levels of integration at the chip scale.
Collapse
Affiliation(s)
- Biagio Mandracchia
- Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, GA, USA.
| | - Jeonghwan Son
- Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, GA, USA.
| | - Shu Jia
- Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, GA, USA.
| |
Collapse
|
5
|
Mejía Morales J, Hammarström B, Lippi GL, Vassalli M, Glynne-Jones P. Acoustofluidic phase microscopy in a tilted segmentation-free configuration. BIOMICROFLUIDICS 2021; 15:014102. [PMID: 33456640 PMCID: PMC7787693 DOI: 10.1063/5.0036585] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/06/2020] [Accepted: 12/17/2020] [Indexed: 06/12/2023]
Abstract
A low-cost device for registration-free quantitative phase microscopy (QPM) based on the transport of intensity equation of cells in continuous flow is presented. The method uses acoustic focusing to align cells into a single plane where all cells move at a constant speed. The acoustic focusing plane is tilted with respect to the microscope's focal plane in order to obtain cell images at multiple focal positions. As the cells are displaced at constant speed, phase maps can be generated without the need to segment and register individual objects. The proposed inclined geometry allows for the acquisition of a vertical stack without the need for any moving part, and it enables a cost-effective and robust implementation of QPM. The suitability of the solution for biological imaging is tested on blood samples, demonstrating the ability to recover the phase map of single red blood cells flowing through the microchip.
Collapse
Affiliation(s)
| | | | - Gian Luca Lippi
- Institut de Physique de Nice, Université Côte d’Azur, CNRS, 06560 Valbonne, France
| | - Massimo Vassalli
- James Watt School of Engineering, University of Glasgow, G12 8LT Glasgow, United Kingdom
| | - Peter Glynne-Jones
- Engineering Sciences, University of Southampton, SO17 1BJ Southampton, United Kingdom
| |
Collapse
|
6
|
Kleiber A, Ramoji A, Mayer G, Neugebauer U, Popp J, Henkel T. 3-Step flow focusing enables multidirectional imaging of bioparticles for imaging flow cytometry. LAB ON A CHIP 2020; 20:1676-1686. [PMID: 32282005 DOI: 10.1039/d0lc00244e] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Multidirectional imaging flow cytometry (mIFC) extends conventional imaging flow cytometry (IFC) for the image-based measurement of 3D-geometrical features of particles. The innovative core is a flow rotation unit in which a vertical sample lamella is incrementally rotated by 90 degrees into a horizontal lamella. The required multidirectional views are generated by guiding all particles at a controllable shear flow position of the parabolic velocity profile of the capillary slit detection chamber. All particles pass the detection chamber in a two-dimensional sheet under controlled rotation while each particle is imaged multiple times. This generates new options for automated particle analysis. In an experimental application, we used our system for the accurate classification of 15 species of pollen based on 3D-morphological information. We demonstrate how the combination of multi directional imaging with advanced machine learning algorithms can improve the accuracy of automated bio-particle classification. As an additional benefit, we significantly decrease the number of false positives in the classification of foreign particles, i.e. those elements which do not belong to one of the trained classes by the 3D-extension of the classification algorithm.
Collapse
Affiliation(s)
- Andreas Kleiber
- Leibniz Institute of Photonic Technology, Albert-Einstein-Straße 9, D-07745 Jena, Germany.
| | - Anuradha Ramoji
- Leibniz Institute of Photonic Technology, Albert-Einstein-Straße 9, D-07745 Jena, Germany. and Center of Sepsis Control and Care (CSCC), Jena University Hospital, Am Klinikum 1, D-07747 Jena, Germany
| | - Günter Mayer
- Leibniz Institute of Photonic Technology, Albert-Einstein-Straße 9, D-07745 Jena, Germany.
| | - Ute Neugebauer
- Leibniz Institute of Photonic Technology, Albert-Einstein-Straße 9, D-07745 Jena, Germany. and Institute of Physical Chemistry and Abbe Center of Photonics, Helmholtzweg 4, D-07743 Jena, Germany and Center of Sepsis Control and Care (CSCC), Jena University Hospital, Am Klinikum 1, D-07747 Jena, Germany
| | - Jürgen Popp
- Leibniz Institute of Photonic Technology, Albert-Einstein-Straße 9, D-07745 Jena, Germany. and Institute of Physical Chemistry and Abbe Center of Photonics, Helmholtzweg 4, D-07743 Jena, Germany and Center of Sepsis Control and Care (CSCC), Jena University Hospital, Am Klinikum 1, D-07747 Jena, Germany
| | - Thomas Henkel
- Leibniz Institute of Photonic Technology, Albert-Einstein-Straße 9, D-07745 Jena, Germany.
| |
Collapse
|
7
|
Paiè P, Martínez Vázquez R, Osellame R, Bragheri F, Bassi A. Microfluidic Based Optical Microscopes on Chip. Cytometry A 2018; 93:987-996. [PMID: 30211977 PMCID: PMC6220811 DOI: 10.1002/cyto.a.23589] [Citation(s) in RCA: 36] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2018] [Revised: 07/23/2018] [Accepted: 07/25/2018] [Indexed: 12/21/2022]
Abstract
Last decade's advancements in optofluidics allowed obtaining an ever increasing integration of different functionalities in lab on chip devices to culture, analyze, and manipulate single cells and entire biological specimens. Despite the importance of optical imaging for biological sample monitoring in microfluidics, imaging is traditionally achieved by placing microfluidics channels in standard bench-top optical microscopes. Recently, the development of either integrated optical elements or lensless imaging methods allowed optical imaging techniques to be implemented in lab on chip systems, thus increasing their automation, compactness, and portability. In this review, we discuss known solutions to implement microscopes on chip that exploit different optical methods such as bright-field, phase contrast, holographic, and fluorescence microscopy.
Collapse
Affiliation(s)
- Petra Paiè
- Istituto di Fotonica e NanotecnologieConsiglio Nazionale dell RicerchePiazza Leonardo da Vinci 3220133 MilanItaly
| | - Rebeca Martínez Vázquez
- Istituto di Fotonica e NanotecnologieConsiglio Nazionale dell RicerchePiazza Leonardo da Vinci 3220133 MilanItaly
| | - Roberto Osellame
- Istituto di Fotonica e NanotecnologieConsiglio Nazionale dell RicerchePiazza Leonardo da Vinci 3220133 MilanItaly
- Dipartimento di FisicaPolitecnico di MilanoPiazza Leonardo da Vinci 3220133 MilanItaly
| | - Francesca Bragheri
- Istituto di Fotonica e NanotecnologieConsiglio Nazionale dell RicerchePiazza Leonardo da Vinci 3220133 MilanItaly
| | - Andrea Bassi
- Istituto di Fotonica e NanotecnologieConsiglio Nazionale dell RicerchePiazza Leonardo da Vinci 3220133 MilanItaly
- Dipartimento di FisicaPolitecnico di MilanoPiazza Leonardo da Vinci 3220133 MilanItaly
| |
Collapse
|
8
|
Guckenberger A, Kihm A, John T, Wagner C, Gekle S. Numerical-experimental observation of shape bistability of red blood cells flowing in a microchannel. SOFT MATTER 2018; 14:2032-2043. [PMID: 29473072 DOI: 10.1039/c7sm02272g] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/25/2023]
Abstract
Red blood cells flowing through capillaries assume a wide variety of different shapes owing to their high deformability. Predicting the realized shapes is a complex field as they are determined by the intricate interplay between the flow conditions and the membrane mechanics. In this work we construct the shape phase diagram of a single red blood cell with a physiological viscosity ratio flowing in a microchannel. We use both experimental in vitro measurements as well as 3D numerical simulations to complement the respective other one. Numerically, we have easy control over the initial starting configuration and natural access to the full 3D shape. With this information we obtain the phase diagram as a function of initial position, starting shape and cell velocity. Experimentally, we measure the occurrence frequency of the different shapes as a function of the cell velocity to construct the experimental diagram which is in good agreement with the numerical observations. Two different major shapes are found, namely croissants and slippers. Notably, both shapes show coexistence at low (<1 mm s-1) and high velocities (>3 mm s-1) while in-between only croissants are stable. This pronounced bistability indicates that RBC shapes are not only determined by system parameters such as flow velocity or channel size, but also strongly depend on the initial conditions.
Collapse
Affiliation(s)
- Achim Guckenberger
- Biofluid Simulation and Modeling, Theoretische Physik, Universität Bayreuth, Germany.
| | | | | | | | | |
Collapse
|