1
|
Matthews SA, Coelho C, Rodriguez Salas EE, Brock EE, Hodge VJ, Walker JA, Wilson LG. Real-time 3D tracking of swimming microbes using digital holographic microscopy and deep learning. PLoS One 2024; 19:e0301182. [PMID: 38669245 PMCID: PMC11051601 DOI: 10.1371/journal.pone.0301182] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2023] [Accepted: 03/12/2024] [Indexed: 04/28/2024] Open
Abstract
The three-dimensional swimming tracks of motile microorganisms can be used to identify their species, which holds promise for the rapid identification of bacterial pathogens. The tracks also provide detailed information on the cells' responses to external stimuli such as chemical gradients and physical objects. Digital holographic microscopy (DHM) is a well-established, but computationally intensive method for obtaining three-dimensional cell tracks from video microscopy data. We demonstrate that a common neural network (NN) accelerates the analysis of holographic data by an order of magnitude, enabling its use on single-board computers and in real time. We establish a heuristic relationship between the distance of a cell from the focal plane and the size of the bounding box assigned to it by the NN, allowing us to rapidly localise cells in three dimensions as they swim. This technique opens the possibility of providing real-time feedback in experiments, for example by monitoring and adapting the supply of nutrients to a microbial bioreactor in response to changes in the swimming phenotype of microbes, or for rapid identification of bacterial pathogens in drinking water or clinical samples.
Collapse
Affiliation(s)
- Samuel A. Matthews
- School of Physics, Engineering and Technology, University of York, Heslington, York, United Kingdom
| | - Carlos Coelho
- School of Physics, Engineering and Technology, University of York, Heslington, York, United Kingdom
| | - Erick E. Rodriguez Salas
- School of Physics, Engineering and Technology, University of York, Heslington, York, United Kingdom
| | - Emma E. Brock
- School of Physics, Engineering and Technology, University of York, Heslington, York, United Kingdom
| | | | - James A. Walker
- Department of Computer Science, Deramore Lane, York, United Kingdom
| | - Laurence G. Wilson
- School of Physics, Engineering and Technology, University of York, Heslington, York, United Kingdom
| |
Collapse
|
2
|
Kim K, Yang H, Lee J, Lee WG. Metaverse Wearables for Immersive Digital Healthcare: A Review. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2023; 10:e2303234. [PMID: 37740417 PMCID: PMC10625124 DOI: 10.1002/advs.202303234] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Revised: 07/15/2023] [Indexed: 09/24/2023]
Abstract
The recent exponential growth of metaverse technology has been instrumental in reshaping a myriad of sectors, not least digital healthcare. This comprehensive review critically examines the landscape and future applications of metaverse wearables toward immersive digital healthcare. The key technologies and advancements that have spearheaded the metamorphosis of metaverse wearables are categorized, encapsulating all-encompassed extended reality, such as virtual reality, augmented reality, mixed reality, and other haptic feedback systems. Moreover, the fundamentals of their deployment in assistive healthcare (especially for rehabilitation), medical and nursing education, and remote patient management and treatment are investigated. The potential benefits of integrating metaverse wearables into healthcare paradigms are multifold, encompassing improved patient prognosis, enhanced accessibility to high-quality care, and high standards of practitioner instruction. Nevertheless, these technologies are not without their inherent challenges and untapped opportunities, which span privacy protection, data safeguarding, and innovation in artificial intelligence. In summary, future research trajectories and potential advancements to circumvent these hurdles are also discussed, further augmenting the incorporation of metaverse wearables within healthcare infrastructures in the post-pandemic era.
Collapse
Affiliation(s)
- Kisoo Kim
- Intelligent Optical Module Research CenterKorea Photonics Technology Institute (KOPTI)Gwangju61007Republic of Korea
| | - Hyosill Yang
- Department of NursingCollege of Nursing ScienceKyung Hee UniversitySeoul02447Republic of Korea
| | - Jihun Lee
- Department of Mechanical EngineeringCollege of EngineeringKyung Hee UniversityYongin17104Republic of Korea
| | - Won Gu Lee
- Department of Mechanical EngineeringCollege of EngineeringKyung Hee UniversityYongin17104Republic of Korea
| |
Collapse
|
3
|
Bianco V, D'Agostino M, Pirone D, Giugliano G, Mosca N, Di Summa M, Scerra G, Memmolo P, Miccio L, Russo T, Stella E, Ferraro P. Label-Free Intracellular Multi-Specificity in Yeast Cells by Phase-Contrast Tomographic Flow Cytometry. SMALL METHODS 2023; 7:e2300447. [PMID: 37670547 DOI: 10.1002/smtd.202300447] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Revised: 08/14/2023] [Indexed: 09/07/2023]
Abstract
In-flow phase-contrast tomography provides a 3D refractive index of label-free cells in cytometry systems. Its major limitation, as with any quantitative phase imaging approach, is the lack of specificity compared to fluorescence microscopy, thus restraining its huge potentialities in single-cell analysis and diagnostics. Remarkable results in introducing specificity are obtained through artificial intelligence (AI), but only for adherent cells. However, accessing the 3D fluorescence ground truth and obtaining accurate voxel-level co-registration of image pairs for AI training is not viable for high-throughput cytometry. The recent statistical inference approach is a significant step forward for label-free specificity but remains limited to cells' nuclei. Here, a generalized computational strategy based on a self-consistent statistical inference to achieve intracellular multi-specificity is shown. Various subcellular compartments (i.e., nuclei, cytoplasmic vacuoles, the peri-vacuolar membrane area, cytoplasm, vacuole-nucleus contact site) can be identified and characterized quantitatively at different phases of the cells life cycle by using yeast cells as a biological model. Moreover, for the first time, virtual reality is introduced for handling the information content of multi-specificity in single cells. Full fruition is proofed for exploring and interacting with 3D quantitative biophysical parameters of the identified compartments on demand, thus opening the route to a metaverse for 3D microscopy.
Collapse
Affiliation(s)
- Vittorio Bianco
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems "E. Caianiello", Via Campi Flegrei 34, Pozzuoli, Napoli, 80078, Italy
| | - Massimo D'Agostino
- Department of Molecular Medicine and Medical Biotechnology, University of Naples "Federico II", Via S. Pansini 5, Naples, 80131, Italy
| | - Daniele Pirone
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems "E. Caianiello", Via Campi Flegrei 34, Pozzuoli, Napoli, 80078, Italy
| | - Giusy Giugliano
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems "E. Caianiello", Via Campi Flegrei 34, Pozzuoli, Napoli, 80078, Italy
| | - Nicola Mosca
- Institute of Intelligent Industrial Technologies and Systems for Advanced Manufacturing, National Research Council of Italy, Via Amendola 122/D-O, Bari, 70125, Italy
| | - Maria Di Summa
- Institute of Intelligent Industrial Technologies and Systems for Advanced Manufacturing, National Research Council of Italy, Via Amendola 122/D-O, Bari, 70125, Italy
| | - Gianluca Scerra
- Department of Molecular Medicine and Medical Biotechnology, University of Naples "Federico II", Via S. Pansini 5, Naples, 80131, Italy
| | - Pasquale Memmolo
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems "E. Caianiello", Via Campi Flegrei 34, Pozzuoli, Napoli, 80078, Italy
| | - Lisa Miccio
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems "E. Caianiello", Via Campi Flegrei 34, Pozzuoli, Napoli, 80078, Italy
| | - Tommaso Russo
- Department of Molecular Medicine and Medical Biotechnology, University of Naples "Federico II", Via S. Pansini 5, Naples, 80131, Italy
| | - Ettore Stella
- Institute of Intelligent Industrial Technologies and Systems for Advanced Manufacturing, National Research Council of Italy, Via Amendola 122/D-O, Bari, 70125, Italy
| | - Pietro Ferraro
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems "E. Caianiello", Via Campi Flegrei 34, Pozzuoli, Napoli, 80078, Italy
| |
Collapse
|
4
|
Deeks HM, Zinovjev K, Barnoud J, Mulholland AJ, van der Kamp MW, Glowacki DR. Free energy along drug-protein binding pathways interactively sampled in virtual reality. Sci Rep 2023; 13:16665. [PMID: 37794083 PMCID: PMC10551034 DOI: 10.1038/s41598-023-43523-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2023] [Accepted: 09/25/2023] [Indexed: 10/06/2023] Open
Abstract
We describe a two-step approach for combining interactive molecular dynamics in virtual reality (iMD-VR) with free energy (FE) calculation to explore the dynamics of biological processes at the molecular level. We refer to this combined approach as iMD-VR-FE. Stage one involves using a state-of-the-art 'human-in-the-loop' iMD-VR framework to generate a diverse range of protein-ligand unbinding pathways, benefitting from the sophistication of human spatial and chemical intuition. Stage two involves using the iMD-VR-sampled pathways as initial guesses for defining a path-based reaction coordinate from which we can obtain a corresponding free energy profile using FE methods. To investigate the performance of the method, we apply iMD-VR-FE to investigate the unbinding of a benzamidine ligand from a trypsin protein. The binding free energy calculated using iMD-VR-FE is similar for each pathway, indicating internal consistency. Moreover, the resulting free energy profiles can distinguish energetic differences between pathways corresponding to various protein-ligand conformations (e.g., helping to identify pathways that are more favourable) and enable identification of metastable states along the pathways. The two-step iMD-VR-FE approach offers an intuitive way for researchers to test hypotheses for candidate pathways in biomolecular systems, quickly obtaining both qualitative and quantitative insight.
Collapse
Affiliation(s)
- Helen M Deeks
- Center for Computational Chemistry, School of Chemistry, University of Bristol, Bristol, BS8 1TS, UK
| | - Kirill Zinovjev
- Departamento de Química Física, Universidad de Valencia, 46100, Burjassot, Spain
- School of Biochemistry, University of Bristol, Bristol, BS8 1TD, UK
| | - Jonathan Barnoud
- Center for Computational Chemistry, School of Chemistry, University of Bristol, Bristol, BS8 1TS, UK
- CiTIUS | Centro Singular de Investigación en Tecnoloxías Intelixentes da USC, Rúa de Jenaro de la Fuente, s/n, 15705, Santiago de Compostela, A Coruña, Spain
| | - Adrian J Mulholland
- Center for Computational Chemistry, School of Chemistry, University of Bristol, Bristol, BS8 1TS, UK
| | - Marc W van der Kamp
- Center for Computational Chemistry, School of Chemistry, University of Bristol, Bristol, BS8 1TS, UK.
- School of Biochemistry, University of Bristol, Bristol, BS8 1TD, UK.
| | - David R Glowacki
- CiTIUS | Centro Singular de Investigación en Tecnoloxías Intelixentes da USC, Rúa de Jenaro de la Fuente, s/n, 15705, Santiago de Compostela, A Coruña, Spain.
| |
Collapse
|