1
|
Ciga O, Xu T, Martel AL. Self supervised contrastive learning for digital histopathology. MACHINE LEARNING WITH APPLICATIONS 2022. [DOI: 10.1016/j.mlwa.2021.100198] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022] Open
|
2
|
Micro-Net: A unified model for segmentation of various objects in microscopy images. Med Image Anal 2019; 52:160-173. [DOI: 10.1016/j.media.2018.12.003] [Citation(s) in RCA: 89] [Impact Index Per Article: 17.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2018] [Revised: 12/13/2018] [Accepted: 12/14/2018] [Indexed: 11/23/2022]
|
3
|
Sorokin DV, Peterlik I, Tektonidis M, Rohr K, Matula P. Non-Rigid Contour-Based Registration of Cell Nuclei in 2-D Live Cell Microscopy Images Using a Dynamic Elasticity Model. IEEE TRANSACTIONS ON MEDICAL IMAGING 2018; 37:173-184. [PMID: 28783625 DOI: 10.1109/tmi.2017.2734169] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
The analysis of the pure motion of subnuclear structures without influence of the cell nucleus motion and deformation is essential in live cell imaging. In this paper, we propose a 2-D contour-based image registration approach for compensation of nucleus motion and deformation in fluorescence microscopy time-lapse sequences. The proposed approach extends our previous approach, which uses a static elasticity model to register cell images. Compared with that scheme, the new approach employs a dynamic elasticity model for the forward simulation of nucleus motion and deformation based on the motion of its contours. The contour matching process is embedded as a constraint into the system of equations describing the elastic behavior of the nucleus. This results in better performance in terms of the registration accuracy. Our approach was successfully applied to real live cell microscopy image sequences of different types of cells including image data that was specifically designed and acquired for evaluation of cell image registration methods. An experimental comparison with the existing contour-based registration methods and an intensity-based registration method has been performed. We also studied the dependence of the results on the choice of method parameters.
Collapse
|
4
|
Hattab G, Schlüter JP, Becker A, Nattkemper TW. ViCAR: An Adaptive and Landmark-Free Registration of Time Lapse Image Data from Microfluidics Experiments. Front Genet 2017; 8:69. [PMID: 28620411 PMCID: PMC5449445 DOI: 10.3389/fgene.2017.00069] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2017] [Accepted: 05/12/2017] [Indexed: 11/25/2022] Open
Abstract
In order to understand gene function in bacterial life cycles, time lapse bioimaging is applied in combination with different marker protocols in so called microfluidics chambers (i.e., a multi-well plate). In one experiment, a series of T images is recorded for one visual field, with a pixel resolution of 60 nm/px. Any (semi-)automatic analysis of the data is hampered by a strong image noise, low contrast and, last but not least, considerable irregular shifts during the acquisition. Image registration corrects such shifts enabling next steps of the analysis (e.g., feature extraction or tracking). Image alignment faces two obstacles in this microscopic context: (a) highly dynamic structural changes in the sample (i.e., colony growth) and (b) an individual data set-specific sample environment which makes the application of landmarks-based alignments almost impossible. We present a computational image registration solution, we refer to as ViCAR: (Vi)sual (C)ues based (A)daptive (R)egistration, for such microfluidics experiments, consisting of (1) the detection of particular polygons (outlined and segmented ones, referred to as visual cues), (2) the adaptive retrieval of three coordinates throughout different sets of frames, and finally (3) an image registration based on the relation of these points correcting both rotation and translation. We tested ViCAR with different data sets and have found that it provides an effective spatial alignment thereby paving the way to extract temporal features pertinent to each resulting bacterial colony. By using ViCAR, we achieved an image registration with 99.9% of image closeness, based on the average rmsd of 4.10−2 pixels, and superior results compared to a state of the art algorithm.
Collapse
Affiliation(s)
- Georges Hattab
- International Research Training Group 1906, Computational Methods for the Analysis of the Diversity and Dynamics of Genomes, Faculty of Technology, Bielefeld UniversityBielefeld, Germany.,Biodata Mining Group, Faculty of Technology, Center for Biotechnology, Bielefeld UniversityBielefeld, Germany
| | - Jan-Philip Schlüter
- SYNMIKRO, LOEWE-Center for Synthetic Microbiology, Philipps University of MarburgMarburg, Germany
| | - Anke Becker
- SYNMIKRO, LOEWE-Center for Synthetic Microbiology, Philipps University of MarburgMarburg, Germany
| | - Tim W Nattkemper
- Biodata Mining Group, Faculty of Technology, Center for Biotechnology, Bielefeld UniversityBielefeld, Germany
| |
Collapse
|
5
|
Tektonidis M, Rohr K. Diffeomorphic Multi-Frame Non-Rigid Registration of Cell Nuclei in 2D and 3D Live Cell Images. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2017; 26:1405-1417. [PMID: 28092560 DOI: 10.1109/tip.2017.2653360] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
To gain a better understanding of cellular and molecular processes, it is important to quantitatively analyze the motion of subcellular particles in live cell microscopy image sequences. Since, generally, the subcellular particles move and cell nuclei move as well as deform, it is important to decouple the movement of particles from that of the cell nuclei using non-rigid registration methods. We have developed a diffeomorphic multi-frame approach for non-rigid registration of cell nuclei in 2D and 3D live cell fluorescence microscopy images. Our non-rigid registration approach is based on local optic flow estimation, exploits information from multiple consecutive image frames, and determines diffeomorphic transformations in the log-domain, which allows efficient computation of the inverse transformations. To register single images of an image sequence to a reference image, we use a temporally weighted mean image, which is constructed based on inverse transformations and multiple consecutive frames. Using multiple consecutive frames improves the registration accuracy compared to pairwise registration, and using a temporally weighted mean image significantly reduces the computation time compared with previous work. In addition, we use a flow boundary preserving method for regularization of computed deformation vector fields, which prevents from over-smoothing compared to standard Gaussian filtering. Our approach has been successfully applied to 2D and 3D synthetic as well as real live cell microscopy image sequences, and an experimental comparison with non-rigid pairwise, multi-frame, and temporal groupwise registration has been carried out.
Collapse
|
6
|
Ahmed Raza SE, Langenkämper D, Sirinukunwattana K, Epstein D, Nattkemper TW, Rajpoot NM. Robust normalization protocols for multiplexed fluorescence bioimage analysis. BioData Min 2016; 9:11. [PMID: 26949415 PMCID: PMC4779207 DOI: 10.1186/s13040-016-0088-2] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2015] [Accepted: 02/02/2016] [Indexed: 12/18/2022] Open
Abstract
study of mapping and interaction of co-localized proteins at a sub-cellular level is important for understanding complex biological phenomena. One of the recent techniques to map co-localized proteins is to use the standard immuno-fluorescence microscopy in a cyclic manner (Nat Biotechnol 24:1270–8, 2006; Proc Natl Acad Sci 110:11982–7, 2013). Unfortunately, these techniques suffer from variability in intensity and positioning of signals from protein markers within a run and across different runs. Therefore, it is necessary to standardize protocols for preprocessing of the multiplexed bioimaging (MBI) data from multiple runs to a comparable scale before any further analysis can be performed on the data. In this paper, we compare various normalization protocols and propose on the basis of the obtained results, a robust normalization technique that produces consistent results on the MBI data collected from different runs using the Toponome Imaging System (TIS). Normalization results produced by the proposed method on a sample TIS data set for colorectal cancer patients were ranked favorably by two pathologists and two biologists. We show that the proposed method produces higher between class Kullback-Leibler (KL) divergence and lower within class KL divergence on a distribution of cell phenotypes from colorectal cancer and histologically normal samples.
Collapse
Affiliation(s)
- Shan E Ahmed Raza
- Department of Computer Science, University of Warwick, Coventry, CV4 7AL UK
| | | | | | - David Epstein
- Mathematics Institute, University of Warwick, Coventry, CV4 7AL UK
| | | | - Nasir M Rajpoot
- Department of Computer Science, University of Warwick, Coventry, CV4 7AL UK ; Department of Computer Science and Engineering, Qatar University, Doha, Qatar
| |
Collapse
|
7
|
Tektonidis M, Kim IH, Chen YCM, Eils R, Spector DL, Rohr K. Non-rigid multi-frame registration of cell nuclei in live cell fluorescence microscopy image data. Med Image Anal 2015; 19:1-14. [DOI: 10.1016/j.media.2014.07.006] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2014] [Revised: 05/30/2014] [Accepted: 07/28/2014] [Indexed: 01/10/2023]
|
8
|
|
9
|
Choi JM, Eom K, Hwang S, Lee Y, Jun SB, Byun KM, Kim SJ. Multi-color fluorescence imaging based on plasmonic wavelength selection and double illumination by white light. OPTICS EXPRESS 2014; 22:5977-5985. [PMID: 24663934 DOI: 10.1364/oe.22.005977] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
We demonstrate the proof-of-concept for developing a multi-color fluorescence imaging system based on plasmonic wavelength selection and double illumination by white light source. This technique is associated with fluorescence excitation by transmitted light via a diffraction of propagating surface plasmons. Since double illumination through both sides of isosceles triangle prism in the Kretschmann configuration enables multiple transmission beams of different wavelengths to interact with the specimen, our approach can be an alternative to conventional fluorescence detection owing to alignment stability and functional expandability. After fabricating a plasmonic wavelength splitter and integrating it with microscopic imaging system, we successfully confirm the performance by visualizing in vitro neuron cells labeled with green and red fluorescence dyes. The suggested method has a potential that it could be combined with plasmonic biosensor scheme to realize a multi-functional platform which allows imaging and sensing of biological samples at the same time.
Collapse
|
10
|
Kovacheva VN, Khan AM, Khan M, Epstein DBA, Rajpoot NM. DiSWOP: a novel measure for cell-level protein network analysis in localized proteomics image data. ACTA ACUST UNITED AC 2013; 30:420-7. [PMID: 24273247 DOI: 10.1093/bioinformatics/btt676] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
MOTIVATION New bioimaging techniques have recently been proposed to visualize the colocation or interaction of several proteins within individual cells, displaying the heterogeneity of neighbouring cells within the same tissue specimen. Such techniques could hold the key to understanding complex biological systems such as the protein interactions involved in cancer. However, there is a need for new algorithmic approaches that analyze the large amounts of multi-tag bioimage data from cancerous and normal tissue specimens to begin to infer protein networks and unravel the cellular heterogeneity at a molecular level. RESULTS The proposed approach analyzes cell phenotypes in normal and cancerous colon tissue imaged using the robotically controlled Toponome Imaging System microscope. It involves segmenting the 4',6-diamidino-2-phenylindole-labelled image into cells and determining the cell phenotypes according to their protein-protein dependence profile. These were analyzed using two new measures, Difference in Sums of Weighted cO-dependence/Anti-co-dependence profiles (DiSWOP and DiSWAP) for overall co-expression and anti-co-expression, respectively. These novel quantities were extracted using 11 Toponome Imaging System image stacks from either cancerous or normal human colorectal specimens. This approach enables one to easily identify protein pairs that have significantly higher/lower co-expression levels in cancerous tissue samples when compared with normal colon tissue. AVAILABILITY AND IMPLEMENTATION http://www2.warwick.ac.uk/fac/sci/dcs/research/combi/research/bic/diswop.
Collapse
Affiliation(s)
- Violeta N Kovacheva
- Department of Systems Biology, Department of Computer Science, School of Life Science, Mathematics Institute, The University of Warwick, Coventry CV4 7AL, UK and Department of Computer Science and Engineering, Qatar University, Doha, Qatar
| | | | | | | | | |
Collapse
|
11
|
Toponome imaging system: multiplex biomarkers in oncology. Trends Mol Med 2012; 18:723-31. [DOI: 10.1016/j.molmed.2012.10.003] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2012] [Revised: 10/03/2012] [Accepted: 10/09/2012] [Indexed: 12/30/2022]
|
12
|
Kölling J, Langenkämper D, Abouna S, Khan M, Nattkemper TW. WHIDE--a web tool for visual data mining colocation patterns in multivariate bioimages. Bioinformatics 2012; 28:1143-50. [PMID: 22390938 PMCID: PMC3324520 DOI: 10.1093/bioinformatics/bts104] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022] Open
Abstract
Motivation: Bioimaging techniques rapidly develop toward higher resolution and dimension. The increase in dimension is achieved by different techniques such as multitag fluorescence imaging, Matrix Assisted Laser Desorption / Ionization (MALDI) imaging or Raman imaging, which record for each pixel an N-dimensional intensity array, representing local abundances of molecules, residues or interaction patterns. The analysis of such multivariate bioimages (MBIs) calls for new approaches to support users in the analysis of both feature domains: space (i.e. sample morphology) and molecular colocation or interaction. In this article, we present our approach WHIDE (Web-based Hyperbolic Image Data Explorer) that combines principles from computational learning, dimension reduction and visualization in a free web application. Results: We applied WHIDE to a set of MBI recorded using the multitag fluorescence imaging Toponome Imaging System. The MBI show field of view in tissue sections from a colon cancer study and we compare tissue from normal/healthy colon with tissue classified as tumor. Our results show, that WHIDE efficiently reduces the complexity of the data by mapping each of the pixels to a cluster, referred to as Molecular Co-Expression Phenotypes and provides a structural basis for a sophisticated multimodal visualization, which combines topology preserving pseudocoloring with information visualization. The wide range of WHIDE's applicability is demonstrated with examples from toponome imaging, high content screens and MALDI imaging (shown in the Supplementary Material). Availability and implementation: The WHIDE tool can be accessed via the BioIMAX website http://ani.cebitec.uni-bielefeld.de/BioIMAX/; Login: whidetestuser; Password: whidetest. Supplementary information:Supplementary data are available at Bioinformatics online. Contact:tim.nattkemper@uni-bielefeld.de
Collapse
Affiliation(s)
- Jan Kölling
- Faculty of Technology, Bielefeld University, Bielefeld, Germany
| | | | | | | | | |
Collapse
|
13
|
Khan AM, Humayun A, Raza SEA, Khan M, Rajpoot NM. A Novel Paradigm for Mining Cell Phenotypes in Multi-tag Bioimages Using a Locality Preserving Nonlinear Embedding. NEURAL INFORMATION PROCESSING 2012. [DOI: 10.1007/978-3-642-34478-7_70] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
|