1
|
Pulfer A, Pizzagalli DU, Gagliardi PA, Hinderling L, Lopez P, Zayats R, Carrillo-Barberà P, Antonello P, Palomino-Segura M, Grädel B, Nicolai M, Giusti A, Thelen M, Gambardella LM, Murooka TT, Pertz O, Krause R, Gonzalez SF. Transformer-based spatial-temporal detection of apoptotic cell death in live-cell imaging. eLife 2024; 12:RP90502. [PMID: 38497754 PMCID: PMC10948145 DOI: 10.7554/elife.90502] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/19/2024] Open
Abstract
Intravital microscopy has revolutionized live-cell imaging by allowing the study of spatial-temporal cell dynamics in living animals. However, the complexity of the data generated by this technology has limited the development of effective computational tools to identify and quantify cell processes. Amongst them, apoptosis is a crucial form of regulated cell death involved in tissue homeostasis and host defense. Live-cell imaging enabled the study of apoptosis at the cellular level, enhancing our understanding of its spatial-temporal regulation. However, at present, no computational method can deliver robust detection of apoptosis in microscopy timelapses. To overcome this limitation, we developed ADeS, a deep learning-based apoptosis detection system that employs the principle of activity recognition. We trained ADeS on extensive datasets containing more than 10,000 apoptotic instances collected both in vitro and in vivo, achieving a classification accuracy above 98% and outperforming state-of-the-art solutions. ADeS is the first method capable of detecting the location and duration of multiple apoptotic events in full microscopy timelapses, surpassing human performance in the same task. We demonstrated the effectiveness and robustness of ADeS across various imaging modalities, cell types, and staining techniques. Finally, we employed ADeS to quantify cell survival in vitro and tissue damage in mice, demonstrating its potential application in toxicity assays, treatment evaluation, and inflammatory dynamics. Our findings suggest that ADeS is a valuable tool for the accurate detection and quantification of apoptosis in live-cell imaging and, in particular, intravital microscopy data, providing insights into the complex spatial-temporal regulation of this process.
Collapse
Affiliation(s)
- Alain Pulfer
- Institute for Research in Biomedicine, Faculty of Biomedical Sciences, USILuganoSwitzerland
- Department of Information Technology and Electrical Engineering, ETH ZurichZürichSwitzerland
| | - Diego Ulisse Pizzagalli
- Institute for Research in Biomedicine, Faculty of Biomedical Sciences, USILuganoSwitzerland
- Euler Institute, USILuganoSwitzerland
| | | | | | | | | | - Pau Carrillo-Barberà
- Institute for Research in Biomedicine, Faculty of Biomedical Sciences, USILuganoSwitzerland
- Instituto de Biotecnología y Biomedicina (BioTecMed), Universitat de ValènciaValenciaSpain
| | - Paola Antonello
- Institute for Research in Biomedicine, Faculty of Biomedical Sciences, USILuganoSwitzerland
- Institute of Cell Biology, University of BernBernSwitzerland
| | | | - Benjamin Grädel
- Institute of Cell Biology, University of BernBernSwitzerland
| | | | - Alessandro Giusti
- Dalle Molle Institute for Artificial Intelligence, IDSIALuganoSwitzerland
| | - Marcus Thelen
- Institute for Research in Biomedicine, Faculty of Biomedical Sciences, USILuganoSwitzerland
| | | | | | - Olivier Pertz
- Institute of Cell Biology, University of BernBernSwitzerland
| | | | | |
Collapse
|
2
|
Pizzagalli DU, Bordini J, Morone D, Pulfer A, Carrillo-Barberà P, Thelen B, Ceni K, Thelen M, Krause R, Gonzalez SF. CANCOL, a Computer-Assisted Annotation Tool to Facilitate Colocalization and Tracking of Immune Cells in Intravital Microscopy. J Immunol 2022; 208:1493-1499. [PMID: 35181636 DOI: 10.4049/jimmunol.2100811] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/23/2021] [Accepted: 12/30/2021] [Indexed: 06/14/2023]
Abstract
Two-photon intravital microscopy (2P-IVM) has become a widely used technique to study cell-to-cell interactions in living organisms. Four-dimensional imaging data obtained via 2P-IVM are classically analyzed by performing automated cell tracking, a procedure that computes the trajectories followed by each cell. However, technical artifacts, such as brightness shifts, the presence of autofluorescent objects, and channel crosstalking, affect the specificity of imaging channels for the cells of interest, thus hampering cell detection. Recently, machine learning has been applied to overcome a variety of obstacles in biomedical imaging. However, existing methods are not tailored for the specific problems of intravital imaging of immune cells. Moreover, results are highly dependent on the quality of the annotations provided by the user. In this study, we developed CANCOL, a tool that facilitates the application of machine learning for automated tracking of immune cells in 2P-IVM. CANCOL guides the user during the annotation of specific objects that are problematic for cell tracking when not properly annotated. Then, it computes a virtual colocalization channel that is specific for the cells of interest. We validated the use of CANCOL on challenging 2P-IVM videos from murine organs, obtaining a significant improvement in the accuracy of automated tracking while reducing the time required for manual track curation.
Collapse
Affiliation(s)
- Diego Ulisse Pizzagalli
- Euler Institute, Università della Svizzera Italiana, Lugano, Switzerland
- Institute for Research in Biomedicine, Faculty of Biomedical Sciences, Università della Svizzera Italiana, Ticino, Switzerland
| | - Joy Bordini
- Institute for Research in Biomedicine, Faculty of Biomedical Sciences, Università della Svizzera Italiana, Ticino, Switzerland
| | - Diego Morone
- Institute for Research in Biomedicine, Faculty of Biomedical Sciences, Università della Svizzera Italiana, Ticino, Switzerland
- Graduate School for Cellular and Biomedical Sciences, University of Bern, Switzerland; and
| | - Alain Pulfer
- Institute for Research in Biomedicine, Faculty of Biomedical Sciences, Università della Svizzera Italiana, Ticino, Switzerland
- Department of Information Technology and Electrical Engineering, ETH Zurich, Zurich, Switzerland
| | - Pau Carrillo-Barberà
- Institute for Research in Biomedicine, Faculty of Biomedical Sciences, Università della Svizzera Italiana, Ticino, Switzerland
| | - Benedikt Thelen
- Euler Institute, Università della Svizzera Italiana, Lugano, Switzerland
| | - Kevin Ceni
- Institute for Research in Biomedicine, Faculty of Biomedical Sciences, Università della Svizzera Italiana, Ticino, Switzerland
| | - Marcus Thelen
- Euler Institute, Università della Svizzera Italiana, Lugano, Switzerland
| | - Rolf Krause
- Euler Institute, Università della Svizzera Italiana, Lugano, Switzerland;
| | - Santiago Fernandez Gonzalez
- Institute for Research in Biomedicine, Faculty of Biomedical Sciences, Università della Svizzera Italiana, Ticino, Switzerland;
| |
Collapse
|
3
|
Pizzagalli DU, Gonzalez SF, Krause R. A trainable clustering algorithm based on shortest paths from density peaks. Sci Adv 2019; 5:eaax3770. [PMID: 32195334 PMCID: PMC7051829 DOI: 10.1126/sciadv.aax3770] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/18/2019] [Accepted: 09/14/2019] [Indexed: 06/10/2023]
Abstract
Clustering is a technique to analyze empirical data, with a major application for biomedical research. Essentially, clustering finds groups of related points in a dataset. However, results depend on both metrics for point-to-point similarity and rules for point-to-group association. Non-appropriate metrics and rules can lead to artifacts, especially in case of multiple groups with heterogeneous structure. In this work, we propose a clustering algorithm that evaluates the properties of paths between points (rather than point-to-point similarity) and solves a global optimization problem, finding solutions not obtainable by methods relying on local choices. Moreover, our algorithm is trainable. Hence, it can be adapted and adopted for specific datasets and applications by providing examples of valid and invalid paths to train a path classifier. We demonstrate its applicability to identify heterogeneous groups in challenging synthetic datasets, segment highly nonconvex immune cells in confocal microscopy images, and classify arrhythmic heartbeats in electrocardiographic signals.
Collapse
Affiliation(s)
- Diego Ulisse Pizzagalli
- Institute for Research in Biomedicine, Faculty of Biomedical Sciences, Università della Svizzera italiana, CH6500 Bellinzona, Switzerland
- Institute of Computational Science, Università della Svizzera italiana, CH6900 Lugano, Switzerland
| | | | - Rolf Krause
- Institute for Research in Biomedicine, Faculty of Biomedical Sciences, Università della Svizzera italiana, CH6500 Bellinzona, Switzerland
| |
Collapse
|
4
|
Pizzagalli DU, Farsakoglu Y, Palomino-Segura M, Palladino E, Sintes J, Marangoni F, Mempel TR, Koh WH, Murooka TT, Thelen F, Stein JV, Pozzi G, Thelen M, Krause R, Gonzalez SF. Leukocyte Tracking Database, a collection of immune cell tracks from intravital 2-photon microscopy videos. Sci Data 2018; 5:180129. [PMID: 30015806 PMCID: PMC6049032 DOI: 10.1038/sdata.2018.129] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2017] [Accepted: 04/16/2018] [Indexed: 11/09/2022] Open
Abstract
Recent advances in intravital video microscopy have allowed the visualization of leukocyte behavior in vivo, revealing unprecedented spatiotemporal dynamics of immune cell interaction. However, state-of-the-art software and methods for automatically measuring cell migration exhibit limitations in tracking the position of leukocytes over time. Challenges arise both from the complex migration patterns of these cells and from the experimental artifacts introduced during image acquisition. Additionally, the development of novel tracking tools is hampered by the lack of a sound ground truth for algorithm validation and benchmarking. Therefore, the objective of this work was to create a database, namely LTDB, with a significant number of manually tracked leukocytes. Broad experimental conditions, sites of imaging, types of immune cells and challenging case studies were included to foster the development of robust computer vision techniques for imaging-based immunological research. Lastly, LTDB represents a step towards the unravelling of biological mechanisms by video data mining in systems biology.
Collapse
Affiliation(s)
- Diego Ulisse Pizzagalli
- Institute for Research in Biomedicine (IRB), Università della Svizzera italiana. Via Vincenzo Vela 6, 6500 Bellinzona, Switzerland.,Institute of Computational Science (ICS), Università della Svizzera italiana. Via Giuseppe Buffi 13, 6900 Lugano, Switzerland
| | - Yagmur Farsakoglu
- Institute for Research in Biomedicine (IRB), Università della Svizzera italiana. Via Vincenzo Vela 6, 6500 Bellinzona, Switzerland
| | - Miguel Palomino-Segura
- Institute for Research in Biomedicine (IRB), Università della Svizzera italiana. Via Vincenzo Vela 6, 6500 Bellinzona, Switzerland
| | - Elisa Palladino
- Institute for Research in Biomedicine (IRB), Università della Svizzera italiana. Via Vincenzo Vela 6, 6500 Bellinzona, Switzerland
| | - Jordi Sintes
- IMIM Hospital del Mar Medical Research Institute. Dr. Aiguader, 88, 08003 Barcelona, Spain
| | - Francesco Marangoni
- Center for Immunology and Inflammatory Diseases, Massachusetts General Hospital. CNY 149-8 149 13th Street Charlestown, MA 02129, USA
| | - Thorsten R Mempel
- Center for Immunology and Inflammatory Diseases, Massachusetts General Hospital. CNY 149-8 149 13th Street Charlestown, MA 02129, USA
| | - Wan Hon Koh
- Department of Immunology, University of Manitoba. 471 Apotex Centre 750 McDermot Avenue, Winnipeg, MB R3E 0T5, Canada
| | - Thomas T Murooka
- Department of Immunology, University of Manitoba. 471 Apotex Centre 750 McDermot Avenue, Winnipeg, MB R3E 0T5, Canada
| | - Flavian Thelen
- Theodor Kocher Institute (TKI), University of Bern. Freiestrasse 1, 3012 Bern, Switzerland
| | - Jens V Stein
- Theodor Kocher Institute (TKI), University of Bern. Freiestrasse 1, 3012 Bern, Switzerland
| | - Giuseppe Pozzi
- Dipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano. P.za L da Vinci 32, I-20133 Milano, Italy
| | - Marcus Thelen
- Institute for Research in Biomedicine (IRB), Università della Svizzera italiana. Via Vincenzo Vela 6, 6500 Bellinzona, Switzerland
| | - Rolf Krause
- Institute of Computational Science (ICS), Università della Svizzera italiana. Via Giuseppe Buffi 13, 6900 Lugano, Switzerland
| | - Santiago Fernandez Gonzalez
- Institute for Research in Biomedicine (IRB), Università della Svizzera italiana. Via Vincenzo Vela 6, 6500 Bellinzona, Switzerland
| |
Collapse
|
5
|
Fernandez Gonzalez S, Jayasekera JP, Carroll MC. Complement and natural antibody are required in the long-term memory response to influenza virus. Vaccine 2009; 26 Suppl 8:I86-93. [PMID: 19388171 DOI: 10.1016/j.vaccine.2008.11.057] [Citation(s) in RCA: 29] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
Complement, complement receptors and natural antibody (IgM) are important factors in the immune response against pathogens. Previous studies have indicated a role for C3, the complement receptors CD35/CD21 (CR1/CR2), and IgM in the immune response to influenza virus. Nevertheless, their contribution to the long-term memory response to this pathogen remains unknown. To elucidate this role, we characterized the secondary response on mice deficient of CR1/CR2 (Cr2-/-), C3 (C3-/-), secreted IgM (micros-/-) and the double knockout C3-/-micros-/-. Overall, our results suggest that C3, IgM and CR1/CR2 play crucial roles in the maintenance of long-term memory to influenza virus, possibly through the development of memory B cells and long-term antibody secretion.
Collapse
Affiliation(s)
- Santiago Fernandez Gonzalez
- Immune Disease Institute and Department of Pediatrics and Pathology, Harvard Medical School, 800 Huntington Avenue, Boston, MA 02115, USA
| | | | | |
Collapse
|
6
|
Gonzalez SF, Chatziandreou N, Nielsen ME, Li W, Rogers J, Taylor R, Santos Y, Cossins A. Cutaneous immune responses in the common carp detected using transcript analysis. Mol Immunol 2007; 44:1664-79. [PMID: 17049603 DOI: 10.1016/j.molimm.2006.08.016] [Citation(s) in RCA: 59] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2006] [Revised: 08/03/2006] [Accepted: 08/03/2006] [Indexed: 11/17/2022]
Abstract
In order to detect new immune-related genes in common carp (Cyprinus carpio L.) challenged by an ectoparasitic infection, two cDNA libraries were constructed from carp skin sampled at 3 and 72h after infection with Ichthyophthirius multifiliis. In a total of 3500 expressed sequence tags (ESTs) we identified 82 orthologues of genes of immune relevance previously described in other organisms. Of these, 61 have never been described before in C. carpio, thus shedding light on some key components of the defence mechanisms of this species. Among the newly described genes, full-length molecules of prostaglandin D2 synthase (PGDS), the CC chemokine molecule SCYA103, and a second gene for the carp beta(2)-microglobulin (beta(2)m), beta(2)m-2, were described. Transcript amounts of the genes PGDS, interferon (IFN), SCYA103, complement factor 7 (C7), complement factor P (FP), complement factor D (FD) and beta(2)m-2 were evaluated by real-time quantitative PCR (RQ-PCR). Samples from skin, blood and liver from fish challenged with I. multifiliis were taken at 3, 12, 24, 36 and 48h post infection. Higher expression levels of most of these transcripts were observed in skin from uninfected fish, compared to the transcript levels detected in blood and liver from the same animals. Also, there was significant down-regulation of the genes PGDS and beta(2)m-2 in skin, whilst significant up-regulation was observed for the C7 and SCYA103 genes in liver of fish infected with the parasite. These results confirm the active role of fish skin in the immune response against infections, acting as an important site of expression of immune-related molecules.
Collapse
Affiliation(s)
- Santiago Fernandez Gonzalez
- Department of Veterinary Pathobiology, Laboratory for Fish Diseases, The Royal Veterinary and Agricultural University, Stigbøjlen 7, DK-1870 Frederiksberg C, Denmark.
| | | | | | | | | | | | | | | |
Collapse
|
7
|
Gonzalez SF, Osorio CR, Santos Y. Evaluation of the AQUARAPID-Va, AQUAEIA-Va and dot-blot assays for the detection of Vibrio anguillarum in fish tissues. J Fish Dis 2004; 27:617-621. [PMID: 15509256 DOI: 10.1111/j.1365-2761.2004.00571.x] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
The comparative accuracy of the serological assays AQUARAPID-Va, AQUAEIA-Va (BIONOR AS), and dot-blot for a rapid diagnosis of vibriosis in fish was evaluated. Twenty-one Vibrio anguillarum strains, representative of pathogenic and environmental serotypes, and 13 strains of other fish pathogenic bacteria were used to assess the sensitivity and specificity of the detection methods. The serological assays tested detected all the strains of V. anguillarum serotypes O1 and O2. The dot-blot assay was the most specific and sensitive method, detecting almost all isolates from serotypes O1, O2 and O3, with an average sensitivity of 1 x 10(6) bacteria g(-1) of fish tissue. The AQUARAPID-Va and the AQUAEIA-Va systems were able to detect 5 x 10(6) and 5 x 10(7) bacteria g(-1) of fish tissue, respectively. The simplicity, effectiveness and speed of the AQUARAPID-Va system confirmed this method as the most suitable serological test for the detection of V. anguillarum in field analysis and small-scale laboratory studies.
Collapse
Affiliation(s)
- S F Gonzalez
- Departmento de Microbiologìa y Parasitología, Facultad de Biología, Instituto de Acuicultura, Universidad de Santiago de Compostela, Santiago de Compostela, Spain.
| | | | | |
Collapse
|