1
|
Leventhal S, Gyulassy A, Heimann M, Pascucci V. Exploring Classification of Topological Priors With Machine Learning for Feature Extraction. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2024; 30:3959-3972. [PMID: 37027638 DOI: 10.1109/tvcg.2023.3248632] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
In many scientific endeavors, increasingly abstract representations of data allow for new interpretive methodologies and conceptualization of phenomena. For example, moving from raw imaged pixels to segmented and reconstructed objects allows researchers new insights and means to direct their studies toward relevant areas. Thus, the development of new and improved methods for segmentation remains an active area of research. With advances in machine learning and neural networks, scientists have been focused on employing deep neural networks such as U-Net to obtain pixel-level segmentations, namely, defining associations between pixels and corresponding/referent objects and gathering those objects afterward. Topological analysis, such as the use of the Morse-Smale complex to encode regions of uniform gradient flow behavior, offers an alternative approach: first, create geometric priors, and then apply machine learning to classify. This approach is empirically motivated since phenomena of interest often appear as subsets of topological priors in many applications. Using topological elements not only reduces the learning space but also introduces the ability to use learnable geometries and connectivity to aid the classification of the segmentation target. In this article, we describe an approach to creating learnable topological elements, explore the application of ML techniques to classification tasks in a number of areas, and demonstrate this approach as a viable alternative to pixel-level classification, with similar accuracy, improved execution time, and requiring marginal training data.
Collapse
|
2
|
Zehtabian A, Fuchs J, Eickholt BJ, Ewers H. Automated Analysis of Neuronal Morphology in 2D Fluorescence Micrographs through an Unsupervised Semantic Segmentation of Neurons. Neuroscience 2024; 551:333-344. [PMID: 38838980 DOI: 10.1016/j.neuroscience.2024.05.024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2023] [Revised: 05/17/2024] [Accepted: 05/20/2024] [Indexed: 06/07/2024]
Abstract
Brain function emerges from a highly complex network of specialized cells that are interlinked by billions of synapses. The synaptic connectivity between neurons is established between the elongated processes of their axons and dendrites or, together, neurites. To establish these connections, cellular neurites have to grow in highly specialized, cell-type dependent patterns covering extensive distances and connecting with thousands of other neurons. The outgrowth and branching of neurites are tightly controlled during development and are a commonly used functional readout of imaging in the neurosciences. Manual analysis of neuronal morphology from microscopy images, however, is very time intensive and prone to bias. Most automated analyses of neurons rely on reconstruction of the neuron as a whole without a semantic analysis of each neurite. A fully-automated classification of all neurites still remains unavailable in open-source software. Here we present a standalone, GUI-based software for batch-quantification of neuronal morphology in two-dimensional fluorescence micrographs of cultured neurons with minimal requirements for user interaction. Single neurons are first reconstructed into binarized images using a Hessian-based segmentation algorithm to detect thin neurite structures combined with intensity- and shape-based reconstruction of the cell body. Neurites are then classified into axon, dendrites and their branches of increasing order using a geodesic distance transform of the cell skeleton. The software was benchmarked against a published dataset and reproduced the phenotype observed after manual annotation. Our tool promises accelerated and improved morphometric studies of neuronal morphology by allowing for consistent and automated analysis of large datasets.
Collapse
Affiliation(s)
- Amin Zehtabian
- Institute for Chemistry and Biochemistry, Freie Universität Berlin, Thielallee 63, 14195 Berlin, Germany.
| | - Joachim Fuchs
- Charité - Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Institute of Molecular Biology and Biochemistry, Virchowweg 6, 10117 Berlin, Germany
| | - Britta J Eickholt
- Charité - Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Institute of Molecular Biology and Biochemistry, Virchowweg 6, 10117 Berlin, Germany
| | - Helge Ewers
- Institute for Chemistry and Biochemistry, Freie Universität Berlin, Thielallee 63, 14195 Berlin, Germany
| |
Collapse
|
3
|
Nourollah AM, Hassanpour H, Zehtabian A. Quantifying morphologies of developing neuronal cells using deep learning with imperfect annotations. IBRO Neurosci Rep 2024; 16:118-126. [PMID: 38282758 PMCID: PMC10820797 DOI: 10.1016/j.ibneur.2023.12.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2023] [Accepted: 12/29/2023] [Indexed: 01/30/2024] Open
Abstract
The functionality of human intelligence relies on the interaction and health of neurons, hence, quantifying neuronal morphologies can be crucial for investigating the functionality of the human brain. This paper proposes a deep learning (DL) based method for segmenting and quantifying neuronal structures in fluorescence microscopy images of developing neuronal cells cultured in vitro. Compared to the majority of supervised DL-based segmentation methods that heavily rely on creating exact corresponding masks of neuronal structures for the preparation of training samples, the proposed approach allows for imperfect annotation of neurons, as it only requires tracing the centrelines of the neurites. This ability accelerates the preparation of training data by several folds. Our proposed framework is built on a modified version of PSPNet with an EfficientNet backbone pre-trained on the CityScapes dataset. To handle the imperfectness of training samples, we incorporated a weighted combination of two loss functions, namely the Dice loss and Lovász loss functions, into our network. We evaluated the proposed framework and several other state-of-the-art methods on a published dataset of approximately 900 manually quantified cultured mouse neurons. Our results indicate a close correlation between the proposed method and manual quantification in terms of neuron length and the number of branches while demonstrating improved analysis speed. Furthermore, the proposed method achieved high accuracy in neuron segmentation, as evidenced by the evaluation of the neurons' length and number of branches.
Collapse
Affiliation(s)
- Amir Masoud Nourollah
- Department of Computer Engineering and Information Technology, Shahrood University of Technology, Iran
| | - Hamid Hassanpour
- Department of Computer Engineering and Information Technology, Shahrood University of Technology, Iran
| | - Amin Zehtabian
- Institute for Chemistry and Biochemistry, Freie Universität Berlin, Germany
| |
Collapse
|
4
|
Caznok Silveira AC, Antunes ASLM, Athié MCP, da Silva BF, Ribeiro dos Santos JV, Canateli C, Fontoura MA, Pinto A, Pimentel-Silva LR, Avansini SH, de Carvalho M. Between neurons and networks: investigating mesoscale brain connectivity in neurological and psychiatric disorders. Front Neurosci 2024; 18:1340345. [PMID: 38445254 PMCID: PMC10912403 DOI: 10.3389/fnins.2024.1340345] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2023] [Accepted: 01/29/2024] [Indexed: 03/07/2024] Open
Abstract
The study of brain connectivity has been a cornerstone in understanding the complexities of neurological and psychiatric disorders. It has provided invaluable insights into the functional architecture of the brain and how it is perturbed in disorders. However, a persistent challenge has been achieving the proper spatial resolution, and developing computational algorithms to address biological questions at the multi-cellular level, a scale often referred to as the mesoscale. Historically, neuroimaging studies of brain connectivity have predominantly focused on the macroscale, providing insights into inter-regional brain connections but often falling short of resolving the intricacies of neural circuitry at the cellular or mesoscale level. This limitation has hindered our ability to fully comprehend the underlying mechanisms of neurological and psychiatric disorders and to develop targeted interventions. In light of this issue, our review manuscript seeks to bridge this critical gap by delving into the domain of mesoscale neuroimaging. We aim to provide a comprehensive overview of conditions affected by aberrant neural connections, image acquisition techniques, feature extraction, and data analysis methods that are specifically tailored to the mesoscale. We further delineate the potential of brain connectivity research to elucidate complex biological questions, with a particular focus on schizophrenia and epilepsy. This review encompasses topics such as dendritic spine quantification, single neuron morphology, and brain region connectivity. We aim to showcase the applicability and significance of mesoscale neuroimaging techniques in the field of neuroscience, highlighting their potential for gaining insights into the complexities of neurological and psychiatric disorders.
Collapse
Affiliation(s)
- Ana Clara Caznok Silveira
- National Laboratory of Biosciences, Brazilian Center for Research in Energy and Materials, Campinas, Brazil
- School of Electrical and Computer Engineering, University of Campinas, Campinas, Brazil
| | | | - Maria Carolina Pedro Athié
- National Laboratory of Biosciences, Brazilian Center for Research in Energy and Materials, Campinas, Brazil
| | - Bárbara Filomena da Silva
- National Laboratory of Biosciences, Brazilian Center for Research in Energy and Materials, Campinas, Brazil
| | | | - Camila Canateli
- National Laboratory of Biosciences, Brazilian Center for Research in Energy and Materials, Campinas, Brazil
| | - Marina Alves Fontoura
- National Laboratory of Biosciences, Brazilian Center for Research in Energy and Materials, Campinas, Brazil
| | - Allan Pinto
- Brazilian Synchrotron Light Laboratory, Brazilian Center for Research in Energy and Materials, Campinas, Brazil
| | | | - Simoni Helena Avansini
- National Laboratory of Biosciences, Brazilian Center for Research in Energy and Materials, Campinas, Brazil
| | - Murilo de Carvalho
- National Laboratory of Biosciences, Brazilian Center for Research in Energy and Materials, Campinas, Brazil
- Brazilian Synchrotron Light Laboratory, Brazilian Center for Research in Energy and Materials, Campinas, Brazil
| |
Collapse
|