1
|
Miedema R, Strydis C. ExaFlexHH: an exascale-ready, flexible multi-FPGA library for biologically plausible brain simulations. Front Neuroinform 2024; 18:1330875. [PMID: 38680548 PMCID: PMC11045893 DOI: 10.3389/fninf.2024.1330875] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Accepted: 02/05/2024] [Indexed: 05/01/2024] Open
Abstract
Introduction In-silico simulations are a powerful tool in modern neuroscience for enhancing our understanding of complex brain systems at various physiological levels. To model biologically realistic and detailed systems, an ideal simulation platform must possess: (1) high performance and performance scalability, (2) flexibility, and (3) ease of use for non-technical users. However, most existing platforms and libraries do not meet all three criteria, particularly for complex models such as the Hodgkin-Huxley (HH) model or for complex neuron-connectivity modeling such as gap junctions. Methods This work introduces ExaFlexHH, an exascale-ready, flexible library for simulating HH models on multi-FPGA platforms. Utilizing FPGA-based Data-Flow Engines (DFEs) and the dataflow programming paradigm, ExaFlexHH addresses all three requirements. The library is also parameterizable and compliant with NeuroML, a prominent brain-description language in computational neuroscience. We demonstrate the performance scalability of the platform by implementing a highly demanding extended-Hodgkin-Huxley (eHH) model of the Inferior Olive using ExaFlexHH. Results Model simulation results show linear scalability for unconnected networks and near-linear scalability for networks with complex synaptic plasticity, with a 1.99 × performance increase using two FPGAs compared to a single FPGA simulation, and 7.96 × when using eight FPGAs in a scalable ring topology. Notably, our results also reveal consistent performance efficiency in GFLOPS per watt, further facilitating exascale-ready computing speeds and pushing the boundaries of future brain-simulation platforms. Discussion The ExaFlexHH library shows superior resource efficiency, quantified in FLOPS per hardware resources, benchmarked against other competitive FPGA-based brain simulation implementations.
Collapse
Affiliation(s)
- Rene Miedema
- Department of Neuroscience, Erasmus Medical Center, Rotterdam, Netherlands
| | - Christos Strydis
- Department of Neuroscience, Erasmus Medical Center, Rotterdam, Netherlands
- Quantum and Computer Engineering Department, Delft University of Technology, Delft, Netherlands
| |
Collapse
|
2
|
Zhang Y, He G, Ma L, Liu X, Hjorth JJJ, Kozlov A, He Y, Zhang S, Kotaleski JH, Tian Y, Grillner S, Du K, Huang T. A GPU-based computational framework that bridges neuron simulation and artificial intelligence. Nat Commun 2023; 14:5798. [PMID: 37723170 PMCID: PMC10507119 DOI: 10.1038/s41467-023-41553-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 09/08/2023] [Indexed: 09/20/2023] Open
Abstract
Biophysically detailed multi-compartment models are powerful tools to explore computational principles of the brain and also serve as a theoretical framework to generate algorithms for artificial intelligence (AI) systems. However, the expensive computational cost severely limits the applications in both the neuroscience and AI fields. The major bottleneck during simulating detailed compartment models is the ability of a simulator to solve large systems of linear equations. Here, we present a novel Dendritic Hierarchical Scheduling (DHS) method to markedly accelerate such a process. We theoretically prove that the DHS implementation is computationally optimal and accurate. This GPU-based method performs with 2-3 orders of magnitude higher speed than that of the classic serial Hines method in the conventional CPU platform. We build a DeepDendrite framework, which integrates the DHS method and the GPU computing engine of the NEURON simulator and demonstrate applications of DeepDendrite in neuroscience tasks. We investigate how spatial patterns of spine inputs affect neuronal excitability in a detailed human pyramidal neuron model with 25,000 spines. Furthermore, we provide a brief discussion on the potential of DeepDendrite for AI, specifically highlighting its ability to enable the efficient training of biophysically detailed models in typical image classification tasks.
Collapse
Affiliation(s)
- Yichen Zhang
- National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University, Beijing, 100871, China
| | - Gan He
- National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University, Beijing, 100871, China
| | - Lei Ma
- National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University, Beijing, 100871, China
- Beijing Academy of Artificial Intelligence (BAAI), Beijing, 100084, China
| | - Xiaofei Liu
- National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University, Beijing, 100871, China
- School of Information Science and Engineering, Yunnan University, Kunming, 650500, China
| | - J J Johannes Hjorth
- Science for Life Laboratory, School of Electrical Engineering and Computer Science, Royal Institute of Technology KTH, Stockholm, SE-10044, Sweden
| | - Alexander Kozlov
- Science for Life Laboratory, School of Electrical Engineering and Computer Science, Royal Institute of Technology KTH, Stockholm, SE-10044, Sweden
- Department of Neuroscience, Karolinska Institute, Stockholm, SE-17165, Sweden
| | - Yutao He
- National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University, Beijing, 100871, China
| | - Shenjian Zhang
- National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University, Beijing, 100871, China
| | - Jeanette Hellgren Kotaleski
- Science for Life Laboratory, School of Electrical Engineering and Computer Science, Royal Institute of Technology KTH, Stockholm, SE-10044, Sweden
- Department of Neuroscience, Karolinska Institute, Stockholm, SE-17165, Sweden
| | - Yonghong Tian
- National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University, Beijing, 100871, China
- School of Electrical and Computer Engineering, Shenzhen Graduate School, Peking University, Shenzhen, 518055, China
| | - Sten Grillner
- Department of Neuroscience, Karolinska Institute, Stockholm, SE-17165, Sweden
| | - Kai Du
- Institute for Artificial Intelligence, Peking University, Beijing, 100871, China.
| | - Tiejun Huang
- National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University, Beijing, 100871, China
- Beijing Academy of Artificial Intelligence (BAAI), Beijing, 100084, China
- Institute for Artificial Intelligence, Peking University, Beijing, 100871, China
| |
Collapse
|
3
|
Zhang Y, Du K, Huang T. Heuristic Tree-Partition-Based Parallel Method for Biophysically Detailed Neuron Simulation. Neural Comput 2023; 35:627-644. [PMID: 36746142 DOI: 10.1162/neco_a_01565] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2022] [Accepted: 10/20/2022] [Indexed: 02/08/2023]
Abstract
Biophysically detailed neuron simulation is a powerful tool to explore the mechanisms behind biological experiments and bridge the gap between various scales in neuroscience research. However, the extremely high computational complexity of detailed neuron simulation restricts the modeling and exploration of detailed network models. The bottleneck is solving the system of linear equations. To accelerate detailed simulation, we propose a heuristic tree-partition-based parallel method (HTP) to parallelize the computation of the Hines algorithm, the kernel for solving linear equations, and leverage the strong parallel capability of the graphic processing unit (GPU) to achieve further speedup. We formulate the problem of how to get a fine parallel process as a tree-partition problem. Next, we present a heuristic partition algorithm to obtain an effective partition to efficiently parallelize the equation-solving process in detailed simulation. With further optimization on GPU, our HTP method achieves 2.2 to 8.5 folds speedup compared to the state-of-the-art GPU method and 36 to 660 folds speedup compared to the typical Hines algorithm.
Collapse
Affiliation(s)
- Yichen Zhang
- School of Computer Science, Peking University, Beijing 100871, China
| | - Kai Du
- School of Computer Science and Institute for Artificial Intelligence, Peking University, Beijing 100871, China
| | - Tiejun Huang
- School of Computer Science and Institute for Artificial Intelligence, Peking University, Beijing 100871, China
| |
Collapse
|
4
|
Humble J, Kozloski JR. Cannabinoid signaling and risk in Huntington's disease. Front Comput Neurosci 2022; 16:903947. [PMID: 36118134 PMCID: PMC9479462 DOI: 10.3389/fncom.2022.903947] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2022] [Accepted: 07/26/2022] [Indexed: 11/13/2022] Open
Abstract
Dysregulated endocannabinoid (eCB) signaling and the loss of cannabinoid receptors (CB1Rs) are important phenotypes of Huntington's disease (HD) but the precise contribution that eCB signaling has at the circuit level is unknown. Using a computational model of spiking neurons, synapses, and eCB signaling, we demonstrate that eCB signaling functions as a homeostatic control mechanism, minimizing excess glutamate. Furthermore, our model demonstrates that metabolic risk, quantified by excess glutamate, increases with cortico-striatal long-term depression (LTD) and/or increased cortico-striatal activity, and replicates a progressive loss of cannabinoid receptors on inhibitory terminals as a function of the excitatory/inhibitory ratio.
Collapse
|
5
|
Allam SL, Rumbell TH, Hoang-Trong T, Parikh J, Kozloski JR. Neuronal population models reveal specific linear conductance controllers sufficient to rescue preclinical disease phenotypes. iScience 2021; 24:103279. [PMID: 34778727 PMCID: PMC8577087 DOI: 10.1016/j.isci.2021.103279] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2020] [Revised: 08/05/2021] [Accepted: 10/13/2021] [Indexed: 12/23/2022] Open
Abstract
Preclinical drug candidates are screened for their ability to ameliorate in vitro neuronal electrophysiology, and go/no-go decisions progress drugs to clinical trials based on population means across cells and animals. However, these measures do not mitigate clinical endpoint risk. Population-based modeling captures variability across multiple electrophysiological measures from healthy, disease, and drug phenotypes. We pursued optimizing therapeutic targets by identifying coherent sets of ion channel target modulations for recovering heterogeneous wild-type (WT) population excitability profiles from a heterogeneous Huntington's disease (HD) population. Our approach combines mechanistic simulations with population modeling of striatal neurons using evolutionary optimization algorithms to design 'virtual drugs'. We introduce efficacy metrics to score populations and rank virtual drug candidates. We found virtual drugs using heuristic approaches that performed better than single target modulators and standard classification methods. We compare a real drug to virtual candidates and demonstrate a novel in silico triaging method.
Collapse
Affiliation(s)
- Sushmita L. Allam
- IBM T.J. Watson Research Center, 13-158B, P.O. Box 218, 1101 Kitchawan Road, Yorktown Heights, NY 10598, USA
| | - Timothy H. Rumbell
- IBM T.J. Watson Research Center, 13-158B, P.O. Box 218, 1101 Kitchawan Road, Yorktown Heights, NY 10598, USA
| | - Tuan Hoang-Trong
- IBM T.J. Watson Research Center, 13-158B, P.O. Box 218, 1101 Kitchawan Road, Yorktown Heights, NY 10598, USA
| | - Jaimit Parikh
- IBM T.J. Watson Research Center, 13-158B, P.O. Box 218, 1101 Kitchawan Road, Yorktown Heights, NY 10598, USA
| | - James R. Kozloski
- IBM T.J. Watson Research Center, 13-158B, P.O. Box 218, 1101 Kitchawan Road, Yorktown Heights, NY 10598, USA
| |
Collapse
|
6
|
Octeau JC, Gangwani MR, Allam SL, Tran D, Huang S, Hoang-Trong TM, Golshani P, Rumbell TH, Kozloski JR, Khakh BS. Transient, Consequential Increases in Extracellular Potassium Ions Accompany Channelrhodopsin2 Excitation. Cell Rep 2020; 27:2249-2261.e7. [PMID: 31116972 PMCID: PMC6582980 DOI: 10.1016/j.celrep.2019.04.078] [Citation(s) in RCA: 57] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2018] [Revised: 03/04/2019] [Accepted: 04/17/2019] [Indexed: 12/13/2022] Open
Abstract
Channelrhodopsin2 (ChR2) optogenetic excitation is widely used to study neurons, astrocytes, and circuits. Using complementary approaches in situ and in vivo, we found that ChR2 stimulation leads to significant transient elevation of extracellular potassium ions by ~5 mM. Such elevations were detected in ChR2-expressing mice, following local in vivo expression of ChR2(H134R) with adeno-associated viruses (AAVs), in different brain areas and when ChR2 was expressed in neurons or astrocytes. In particular, ChR2-mediated excitation of striatal astrocytes was sufficient to increase medium spiny neuron (MSN) excitability and immediate early gene expression. The effects on MSN excitability were recapitulated in silico with a computational MSN model and detected in vivo as increased action potential firing in awake, behaving mice. We show that transient, physiologically consequential increases in extracellular potassium ions accompany ChR2 optogenetic excitation. This coincidental effect may be important to consider during astrocyte studies employing ChR2 to interrogate neural circuits and animal behavior. Using multiple approaches, Octeau et al. discover that optogenetic excitation of ChR2-expressing cells leads to significant transient extracellular potassium ion elevations that increase neuronal excitability and immediate early gene expression in neurons following in vivo stimulation.
Collapse
Affiliation(s)
- J Christopher Octeau
- Department of Physiology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA 90095-1751, USA
| | - Mohitkumar R Gangwani
- Department of Physiology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA 90095-1751, USA
| | - Sushmita L Allam
- IBM T.J. Watson Research Center, P.O. Box 218, 1101 Kitchawan Road, Yorktown Heights, NY 10598, USA
| | - Duy Tran
- Department of Neurology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA 90095-1751, USA
| | - Shuhan Huang
- Department of Physiology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA 90095-1751, USA
| | - Tuan M Hoang-Trong
- IBM T.J. Watson Research Center, P.O. Box 218, 1101 Kitchawan Road, Yorktown Heights, NY 10598, USA
| | - Peyman Golshani
- Department of Neurology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA 90095-1751, USA; Department of Psychiatry and Biobehavioral Sciences, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA 90095-1751, USA; Intellectual and Developmental Disabilities Research Center, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA 90095-1751, USA; Center for Neurobehavioral Genetics, Semel Institute for Neuroscience and Human Behavior, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA 90095-1751, USA
| | - Timothy H Rumbell
- IBM T.J. Watson Research Center, P.O. Box 218, 1101 Kitchawan Road, Yorktown Heights, NY 10598, USA
| | - James R Kozloski
- IBM T.J. Watson Research Center, P.O. Box 218, 1101 Kitchawan Road, Yorktown Heights, NY 10598, USA
| | - Baljit S Khakh
- Department of Physiology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA 90095-1751, USA; Department of Neurobiology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA 90095-1751, USA.
| |
Collapse
|
7
|
Cremonesi F, Schürmann F. Understanding Computational Costs of Cellular-Level Brain Tissue Simulations Through Analytical Performance Models. Neuroinformatics 2020; 18:407-428. [PMID: 32056104 PMCID: PMC7338826 DOI: 10.1007/s12021-019-09451-w] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Abstract
Computational modeling and simulation have become essential tools in the quest to better understand the brain's makeup and to decipher the causal interrelations of its components. The breadth of biochemical and biophysical processes and structures in the brain has led to the development of a large variety of model abstractions and specialized tools, often times requiring high performance computing resources for their timely execution. What has been missing so far was an in-depth analysis of the complexity of the computational kernels, hindering a systematic approach to identifying bottlenecks of algorithms and hardware. If whole brain models are to be achieved on emerging computer generations, models and simulation engines will have to be carefully co-designed for the intrinsic hardware tradeoffs. For the first time, we present a systematic exploration based on analytic performance modeling. We base our analysis on three in silico models, chosen as representative examples of the most widely employed modeling abstractions: current-based point neurons, conductance-based point neurons and conductance-based detailed neurons. We identify that the synaptic modeling formalism, i.e. current or conductance-based representation, and not the level of morphological detail, is the most significant factor in determining the properties of memory bandwidth saturation and shared-memory scaling of in silico models. Even though general purpose computing has, until now, largely been able to deliver high performance, we find that for all types of abstractions, network latency and memory bandwidth will become severe bottlenecks as the number of neurons to be simulated grows. By adapting and extending a performance modeling approach, we deliver a first characterization of the performance landscape of brain tissue simulations, allowing us to pinpoint current bottlenecks for state-of-the-art in silico models, and make projections for future hardware and software requirements.
Collapse
Affiliation(s)
- Francesco Cremonesi
- Blue Brain Project, Brain Mind Institute, École polytechnique fédérale de Lausanne (EPFL), Campus Biotech, 1202, Geneva, Switzerland
| | - Felix Schürmann
- Blue Brain Project, Brain Mind Institute, École polytechnique fédérale de Lausanne (EPFL), Campus Biotech, 1202, Geneva, Switzerland.
| |
Collapse
|
8
|
Jordan J, Helias M, Diesmann M, Kunkel S. Efficient Communication in Distributed Simulations of Spiking Neuronal Networks With Gap Junctions. Front Neuroinform 2020; 14:12. [PMID: 32431602 PMCID: PMC7214808 DOI: 10.3389/fninf.2020.00012] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2020] [Accepted: 03/06/2020] [Indexed: 12/01/2022] Open
Abstract
Investigating the dynamics and function of large-scale spiking neuronal networks with realistic numbers of synapses is made possible today by state-of-the-art simulation code that scales to the largest contemporary supercomputers. However, simulations that involve electrical interactions, also called gap junctions, besides chemical synapses scale only poorly due to a communication scheme that collects global data on each compute node. In comparison to chemical synapses, gap junctions are far less abundant. To improve scalability we exploit this sparsity by integrating an existing framework for continuous interactions with a recently proposed directed communication scheme for spikes. Using a reference implementation in the NEST simulator we demonstrate excellent scalability of the integrated framework, accelerating large-scale simulations with gap junctions by more than an order of magnitude. This allows, for the first time, the efficient exploration of the interactions of chemical and electrical coupling in large-scale neuronal networks models with natural synapse density distributed across thousands of compute nodes.
Collapse
Affiliation(s)
- Jakob Jordan
- Department of Physiology, University of Bern, Bern, Switzerland.,Institute of Neuroscience and Medicine (INM-6), Jülich Research Centre, Jülich, Germany.,Institute for Advanced Simulation (IAS-6), Jülich Research Centre, Jülich, Germany.,JARA Institute Brain Structure Function Relationship (INM-10), Jülich Research Centre, Jülich, Germany
| | - Moritz Helias
- Institute of Neuroscience and Medicine (INM-6), Jülich Research Centre, Jülich, Germany.,Institute for Advanced Simulation (IAS-6), Jülich Research Centre, Jülich, Germany.,JARA Institute Brain Structure Function Relationship (INM-10), Jülich Research Centre, Jülich, Germany.,Department of Physics, Faculty 1, RWTH Aachen University, Aachen, Germany
| | - Markus Diesmann
- Institute of Neuroscience and Medicine (INM-6), Jülich Research Centre, Jülich, Germany.,Institute for Advanced Simulation (IAS-6), Jülich Research Centre, Jülich, Germany.,JARA Institute Brain Structure Function Relationship (INM-10), Jülich Research Centre, Jülich, Germany.,Department of Physics, Faculty 1, RWTH Aachen University, Aachen, Germany.,Department of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University, Aachen, Germany
| | - Susanne Kunkel
- Faculty of Science and Technology, Norwegian University of Life Sciences, Ås, Norway
| |
Collapse
|
9
|
Ponzi A, Barton SJ, Bunner KD, Rangel-Barajas C, Zhang ES, Miller BR, Rebec GV, Kozloski J. Striatal network modeling in Huntington's Disease. PLoS Comput Biol 2020; 16:e1007648. [PMID: 32302302 PMCID: PMC7197869 DOI: 10.1371/journal.pcbi.1007648] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2019] [Revised: 05/04/2020] [Accepted: 01/09/2020] [Indexed: 12/26/2022] Open
Abstract
Medium spiny neurons (MSNs) comprise over 90% of cells in the striatum. In vivo MSNs display coherent burst firing cell assembly activity patterns, even though isolated MSNs do not burst fire intrinsically. This activity is important for the learning and execution of action sequences and is characteristically dysregulated in Huntington's Disease (HD). However, how dysregulation is caused by the various neural pathologies affecting MSNs in HD is unknown. Previous modeling work using simple cell models has shown that cell assembly activity patterns can emerge as a result of MSN inhibitory network interactions. Here, by directly estimating MSN network model parameters from single unit spiking data, we show that a network composed of much more physiologically detailed MSNs provides an excellent quantitative fit to wild type (WT) mouse spiking data, but only when network parameters are appropriate for the striatum. We find the WT MSN network is situated in a regime close to a transition from stable to strongly fluctuating network dynamics. This regime facilitates the generation of low-dimensional slowly varying coherent activity patterns and confers high sensitivity to variations in cortical driving. By re-estimating the model on HD spiking data we discover network parameter modifications are consistent across three very different types of HD mutant mouse models (YAC128, Q175, R6/2). In striking agreement with the known pathophysiology we find feedforward excitatory drive is reduced in HD compared to WT mice, while recurrent inhibition also shows phenotype dependency. We show that these modifications shift the HD MSN network to a sub-optimal regime where higher dimensional incoherent rapidly fluctuating activity predominates. Our results provide insight into a diverse range of experimental findings in HD, including cognitive and motor symptoms, and may suggest new avenues for treatment.
Collapse
Affiliation(s)
- Adam Ponzi
- IBM Research, Computational Biology Center, Thomas J. Watson Research Laboratories, Yorktown Heights, New York, United States of America
- * E-mail:
| | - Scott J. Barton
- Program in Neuroscience, Department of Psychological and Brain Sciences, Indiana University, Bloomington, Indiana, United States of America
| | - Kendra D. Bunner
- Program in Neuroscience, Department of Psychological and Brain Sciences, Indiana University, Bloomington, Indiana, United States of America
| | - Claudia Rangel-Barajas
- Program in Neuroscience, Department of Psychological and Brain Sciences, Indiana University, Bloomington, Indiana, United States of America
| | - Emily S. Zhang
- Program in Neuroscience, Department of Psychological and Brain Sciences, Indiana University, Bloomington, Indiana, United States of America
| | - Benjamin R. Miller
- Program in Neuroscience, Department of Psychological and Brain Sciences, Indiana University, Bloomington, Indiana, United States of America
| | - George V. Rebec
- Program in Neuroscience, Department of Psychological and Brain Sciences, Indiana University, Bloomington, Indiana, United States of America
| | - James Kozloski
- IBM Research, Computational Biology Center, Thomas J. Watson Research Laboratories, Yorktown Heights, New York, United States of America
| |
Collapse
|
10
|
Amsalem O, Eyal G, Rogozinski N, Gevaert M, Kumbhar P, Schürmann F, Segev I. An efficient analytical reduction of detailed nonlinear neuron models. Nat Commun 2020; 11:288. [PMID: 31941884 PMCID: PMC6962154 DOI: 10.1038/s41467-019-13932-6] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2019] [Accepted: 12/09/2019] [Indexed: 12/31/2022] Open
Abstract
Detailed conductance-based nonlinear neuron models consisting of thousands of synapses are key for understanding of the computational properties of single neurons and large neuronal networks, and for interpreting experimental results. Simulations of these models are computationally expensive, considerably curtailing their utility. Neuron_Reduce is a new analytical approach to reduce the morphological complexity and computational time of nonlinear neuron models. Synapses and active membrane channels are mapped to the reduced model preserving their transfer impedance to the soma; synapses with identical transfer impedance are merged into one NEURON process still retaining their individual activation times. Neuron_Reduce accelerates the simulations by 40-250 folds for a variety of cell types and realistic number (10,000-100,000) of synapses while closely replicating voltage dynamics and specific dendritic computations. The reduced neuron-models will enable realistic simulations of neural networks at unprecedented scale, including networks emerging from micro-connectomics efforts and biologically-inspired "deep networks". Neuron_Reduce is publicly available and is straightforward to implement.
Collapse
Affiliation(s)
- Oren Amsalem
- Department of Neurobiology, Hebrew University of Jerusalem, 9190401, Jerusalem, Israel.
| | - Guy Eyal
- Department of Neurobiology, Hebrew University of Jerusalem, 9190401, Jerusalem, Israel
| | - Noa Rogozinski
- Department of Neurobiology, Hebrew University of Jerusalem, 9190401, Jerusalem, Israel
| | - Michael Gevaert
- Blue Brain Project, École polytechnique fédérale de Lausanne (EPFL), Campus Biotech, 1202, Geneva, Switzerland
| | - Pramod Kumbhar
- Blue Brain Project, École polytechnique fédérale de Lausanne (EPFL), Campus Biotech, 1202, Geneva, Switzerland
| | - Felix Schürmann
- Blue Brain Project, École polytechnique fédérale de Lausanne (EPFL), Campus Biotech, 1202, Geneva, Switzerland
| | - Idan Segev
- Department of Neurobiology, Hebrew University of Jerusalem, 9190401, Jerusalem, Israel
- Edmond and Lily Safra Center for Brain Sciences, Hebrew University of Jerusalem, 9190401, Jerusalem, Israel
| |
Collapse
|
11
|
Igarashi J, Yamaura H, Yamazaki T. Large-Scale Simulation of a Layered Cortical Sheet of Spiking Network Model Using a Tile Partitioning Method. Front Neuroinform 2019; 13:71. [PMID: 31849631 PMCID: PMC6895031 DOI: 10.3389/fninf.2019.00071] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2019] [Accepted: 11/12/2019] [Indexed: 11/13/2022] Open
Abstract
One of the grand challenges for computational neuroscience and high-performance computing is computer simulation of a human-scale whole brain model with spiking neurons and synaptic plasticity using supercomputers. To achieve such a simulation, the target network model must be partitioned onto a number of computational nodes, and the sub-network models are executed in parallel while communicating spike information across different nodes. However, it remains unclear how the target network model should be partitioned for efficient computing on next generation of supercomputers. Specifically, reducing the communication of spike information across compute nodes is essential, because of the relatively slower network performance than processor and memory. From the viewpoint of biological features, the cerebral cortex and cerebellum contain 99% of neurons and synapses and form layered sheet structures. Therefore, an efficient method to split the network should exploit the layered sheet structures. In this study, we indicate that a tile partitioning method leads to efficient communication. To demonstrate it, a simulation software called MONET (Millefeuille-like Organization NEural neTwork simulator) that partitions a network model as described above was developed. The MONET simulator was implemented on the Japanese flagship supercomputer K, which is composed of 82,944 computational nodes. We examined a performance of calculation, communication and memory consumption in the tile partitioning method for a cortical model with realistic anatomical and physiological parameters. The result showed that the tile partitioning method drastically reduced communication data amount by replacing network communication with DRAM access and sharing the communication data with neighboring neurons. We confirmed the scalability and efficiency of the tile partitioning method on up to 63,504 compute nodes of the K computer for the cortical model. In the companion paper by Yamaura et al., the performance for a cerebellar model was examined. These results suggest that the tile partitioning method will have advantage for a human-scale whole-brain simulation on exascale computers.
Collapse
Affiliation(s)
- Jun Igarashi
- Computational Engineering Applications Unit, Head Office for Information Systems and Cybersecurity, RIKEN, Saitama, Japan
| | - Hiroshi Yamaura
- Graduate School of Informatics and Engineering, The University of Electro-Communications, Tokyo, Japan
| | - Tadashi Yamazaki
- Graduate School of Informatics and Engineering, The University of Electro-Communications, Tokyo, Japan
| |
Collapse
|
12
|
de la Vega L, Lee C, Sharma R, Amereh M, Willerth SM. 3D bioprinting models of neural tissues: The current state of the field and future directions. Brain Res Bull 2019; 150:240-249. [DOI: 10.1016/j.brainresbull.2019.06.007] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2018] [Revised: 05/30/2019] [Accepted: 06/06/2019] [Indexed: 01/01/2023]
|
13
|
Magalhães BRC, Sterling T, Hines M, Schürmann F. Asynchronous Branch-Parallel Simulation of Detailed Neuron Models. Front Neuroinform 2019; 13:54. [PMID: 31396069 PMCID: PMC6664068 DOI: 10.3389/fninf.2019.00054] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2019] [Accepted: 07/05/2019] [Indexed: 11/13/2022] Open
Abstract
Simulations of electrical activity of networks of morphologically detailed neuron models allow for a better understanding of the brain. State-of-the-art simulations describe the dynamics of ionic currents and biochemical processes within branching topological representations of the neurons. Acceleration of such simulation is possible in the weak scaling limit by modeling neurons as indivisible computation units and increasing the computing power. Strong scaling and simulations close to biological time are difficult, yet required, for the study of synaptic plasticity and other use cases requiring simulation of neurons for long periods of time. Current methods rely on parallel Gaussian Elimination, computing triangulation and substitution of many branches simultaneously. Existing limitations are: (a) high heterogeneity of compute time per neuron leads to high computational load imbalance; and (b) difficulty in providing a computation model that fully utilizes the computing resources on distributed multi-core architectures with Single Instruction Multiple Data (SIMD) capabilities. To address these issues, we present a strategy that extracts flow-dependencies between parameters of the ODEs and the algebraic solver of individual neurons. Based on the resulting map of dependencies, we provide three techniques for memory, communication, and computation reorganization that yield a load-balanced distributed asynchronous execution. The new computation model distributes datasets and balances computational workload across a distributed memory space, exposing a tree-based parallelism of neuron topological structure, an embarrassingly parallel execution model of neuron subtrees, and a SIMD acceleration of subtree state updates. The capabilities of our methods are demonstrated on a prototype implementation developed on the core compute kernel of the NEURON scientific application, built on the HPX runtime system for the ParalleX execution model. Our implementation yields an asynchronous distributed and parallel simulation that accelerates single neuron to medium-sized neural networks. Benchmark results display better strong scaling properties, finer-grained parallelism, and lower time to solution compared to the state of the art, on a wide range of distributed multi-core compute architectures.
Collapse
Affiliation(s)
- Bruno R. C. Magalhães
- Blue Brain Project, École Polytechnique Fédérale de Lausanne (EPFL), Biotech, Geneva, Switzerland
| | - Thomas Sterling
- Department of Intelligent Systems Engineering, CCA Laboratory, Indiana University, Bloomington, IN, United States
| | - Michael Hines
- Department of Neuroscience, Yale University, New Haven, CT, United States
| | - Felix Schürmann
- Blue Brain Project, École Polytechnique Fédérale de Lausanne (EPFL), Biotech, Geneva, Switzerland
| |
Collapse
|
14
|
Cortico-Striatal Cross-Frequency Coupling and Gamma Genesis Disruptions in Huntington's Disease Mouse and Computational Models. eNeuro 2018; 5:eN-NWR-0210-18. [PMID: 30627632 PMCID: PMC6325534 DOI: 10.1523/eneuro.0210-18.2018] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2018] [Revised: 10/19/2018] [Accepted: 11/12/2018] [Indexed: 12/16/2022] Open
Abstract
Abnormal gamma band power across cortex and striatum is an important phenotype of Huntington's disease (HD) in both patients and animal models, but neither the origin nor the functional relevance of this phenotype is well understood. Here, we analyzed local field potential (LFP) activity in freely behaving, symptomatic R6/2 and Q175 mouse models and corresponding wild-type (WT) controls. We focused on periods of quiet rest, which show strong γ activity in HD mice. Simultaneous recording from motor cortex and its target area in dorsal striatum in the R6/2 model revealed exaggerated functional coupling over that observed in WT between the phase of delta frequencies (1-4 Hz) in cortex and striatum and striatal amplitude modulation of low γ frequencies (25-55 Hz; i.e., phase-amplitude coupling, PAC), but no evidence that abnormal cortical activity alone can account for the increase in striatal γ power. Both HD mouse models had stronger coupling of γ amplitude to δ phase and more unimodal phase distributions than their WT counterparts. To assess the possible role of striatal fast-spiking interneurons (FSIs) in these phenomena, we developed a computational model based on additional striatal recordings from Q175 mice. Changes in peak γ frequency and power ratio were readily reproduced by our computational model, accounting for several experimental findings reported in the literature. Our results suggest that HD is characterized by both a reorganization of cortico-striatal drive and specific population changes related to intrastriatal synaptic coupling.
Collapse
|
15
|
Jordan J, Ippen T, Helias M, Kitayama I, Sato M, Igarashi J, Diesmann M, Kunkel S. Extremely Scalable Spiking Neuronal Network Simulation Code: From Laptops to Exascale Computers. Front Neuroinform 2018; 12:2. [PMID: 29503613 PMCID: PMC5820465 DOI: 10.3389/fninf.2018.00002] [Citation(s) in RCA: 42] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2017] [Accepted: 01/18/2018] [Indexed: 11/13/2022] Open
Abstract
State-of-the-art software tools for neuronal network simulations scale to the largest computing systems available today and enable investigations of large-scale networks of up to 10 % of the human cortex at a resolution of individual neurons and synapses. Due to an upper limit on the number of incoming connections of a single neuron, network connectivity becomes extremely sparse at this scale. To manage computational costs, simulation software ultimately targeting the brain scale needs to fully exploit this sparsity. Here we present a two-tier connection infrastructure and a framework for directed communication among compute nodes accounting for the sparsity of brain-scale networks. We demonstrate the feasibility of this approach by implementing the technology in the NEST simulation code and we investigate its performance in different scaling scenarios of typical network simulations. Our results show that the new data structures and communication scheme prepare the simulation kernel for post-petascale high-performance computing facilities without sacrificing performance in smaller systems.
Collapse
Affiliation(s)
- Jakob Jordan
- Institute of Neuroscience and Medicine (INM-6) and Institute for Advanced Simulation (IAS-6) and JARA Institute Brain Structure-Function Relationships (INM-10), Jülich Research Centre, Jülich, Germany
| | - Tammo Ippen
- Institute of Neuroscience and Medicine (INM-6) and Institute for Advanced Simulation (IAS-6) and JARA Institute Brain Structure-Function Relationships (INM-10), Jülich Research Centre, Jülich, Germany.,Faculty of Science and Technology, Norwegian University of Life Sciences, Ås, Norway
| | - Moritz Helias
- Institute of Neuroscience and Medicine (INM-6) and Institute for Advanced Simulation (IAS-6) and JARA Institute Brain Structure-Function Relationships (INM-10), Jülich Research Centre, Jülich, Germany.,Department of Physics, Faculty 1, RWTH Aachen University, Aachen, Germany
| | - Itaru Kitayama
- Advanced Institute for Computational Science, RIKEN, Kobe, Japan
| | - Mitsuhisa Sato
- Advanced Institute for Computational Science, RIKEN, Kobe, Japan
| | - Jun Igarashi
- Computational Engineering Applications Unit, RIKEN, Wako, Japan
| | - Markus Diesmann
- Institute of Neuroscience and Medicine (INM-6) and Institute for Advanced Simulation (IAS-6) and JARA Institute Brain Structure-Function Relationships (INM-10), Jülich Research Centre, Jülich, Germany.,Department of Physics, Faculty 1, RWTH Aachen University, Aachen, Germany.,Department of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University, Aachen, Germany
| | - Susanne Kunkel
- Department of Computational Science and Technology, School of Computer Science and Communication, KTH Royal Institute of Technology, Stockholm, Sweden.,Simulation Laboratory Neuroscience - Bernstein Facility for Simulation and Database Technology, Jülich Research Centre, Jülich, Germany
| |
Collapse
|
16
|
Somayaji MR, Przekwas AJ, Gupta RK. Combination Therapy for Multi-Target Manipulation of Secondary Brain Injury Mechanisms. Curr Neuropharmacol 2018; 16:484-504. [PMID: 28847295 PMCID: PMC6018188 DOI: 10.2174/1570159x15666170828165711] [Citation(s) in RCA: 26] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2016] [Revised: 02/10/2017] [Accepted: 03/28/2017] [Indexed: 12/14/2022] Open
Abstract
Traumatic brain injury (TBI) is a major healthcare problem that affects millions of people worldwide. Despite advances in understanding and developing preventative and treatment strategies using preclinical animal models, clinical trials to date have failed, and a 'magic bullet' for effectively treating TBI-induced damage does not exist. Thus, novel pharmacological strategies to effectively manipulate the complex and heterogeneous pathophysiology of secondary injury mechanisms are needed. Given that goal, this paper discusses the relevance and advantages of combination therapies (COMTs) for 'multi-target manipulation' of the secondary injury cascade by administering multiple drugs to achieve an optimal therapeutic window of opportunity (e.g., temporally broad window) and compares these regimens to monotherapies that manipulate a single target with a single drug at a given time. Furthermore, we posit that integrated mechanistic multiscale models that combine primary injury biomechanics, secondary injury mechanobiology/neurobiology, physiology, pharmacology and mathematical programming techniques could account for vast differences in the biological space and time scales and help to accelerate drug development, to optimize pharmacological COMT protocols and to improve treatment outcomes.
Collapse
Affiliation(s)
| | | | - Raj K. Gupta
- Department of Defense Blast Injury Research Program Coordinating Office, U.S. Army Medical Research and Materiel Command, Fort Detrick, MD, USA
| |
Collapse
|
17
|
Shillcock JC, Hawrylycz M, Hill S, Peng H. Reconstructing the brain: from image stacks to neuron synthesis. Brain Inform 2016; 3:205-209. [PMID: 27747813 PMCID: PMC5106405 DOI: 10.1007/s40708-016-0041-7] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2015] [Accepted: 02/08/2016] [Indexed: 11/28/2022] Open
Abstract
Large-scale brain initiatives such as the US BRAIN initiative and the European Human Brain Project aim to marshall a vast amount of data and tools for the purpose of furthering our understanding of brains. Fundamental to this goal is that neuronal morphologies must be seamlessly reconstructed and aggregated on scales up to the whole rodent brain. The experimental labor needed to manually produce this number of digital morphologies is prohibitively large. The BigNeuron initiative is assembling community-generated, open-source, automated reconstruction algorithms into an open platform, and is beginning to generate an increasing flow of high-quality reconstructed neurons. We propose a novel extension of this workflow to use this data stream to generate an unlimited number of statistically equivalent, yet distinct, digital morphologies. This will bring automated processing of reconstructed cells into digital neurons to the wider neuroscience community, and enable a range of morphologically accurate computational models.
Collapse
Affiliation(s)
| | | | - Sean Hill
- Blue Brain Project, EPFL, 1211, Geneva, Switzerland
| | - Hanchuan Peng
- Allen Institute for Brain Science, Seattle, WA, 98109, USA
| |
Collapse
|
18
|
Kozloski J. Closed-Loop Brain Model of Neocortical Information-Based Exchange. Front Neuroanat 2016; 10:3. [PMID: 26834573 PMCID: PMC4716663 DOI: 10.3389/fnana.2016.00003] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2015] [Accepted: 01/02/2016] [Indexed: 11/25/2022] Open
Abstract
Here we describe an “information-based exchange” model of brain function that ascribes to neocortex, basal ganglia, and thalamus distinct network functions. The model allows us to analyze whole brain system set point measures, such as the rate and heterogeneity of transitions in striatum and neocortex, in the context of neuromodulation and other perturbations. Our closed-loop model is grounded in neuroanatomical observations, proposing a novel “Grand Loop” through neocortex, and invokes different forms of plasticity at specific tissue interfaces and their principle cell synapses to achieve these transitions. By implementing a system for maximum information-based exchange of action potentials between modeled neocortical areas, we observe changes to these measures in simulation. We hypothesize that similar dynamic set points and modulations exist in the brain's resting state activity, and that different modifications to information-based exchange may shift the risk profile of different component tissues, resulting in different neurodegenerative diseases. This model is targeted for further development using IBM's Neural Tissue Simulator, which allows scalable elaboration of networks, tissues, and their neural and synaptic components toward ever greater complexity and biological realism.
Collapse
Affiliation(s)
- James Kozloski
- IBM Research Division, Computational Biology Center, IBM T.J. Watson Research Center Yorktown Heights, NY, USA
| |
Collapse
|
19
|
Hahne J, Helias M, Kunkel S, Igarashi J, Bolten M, Frommer A, Diesmann M. A unified framework for spiking and gap-junction interactions in distributed neuronal network simulations. Front Neuroinform 2015; 9:22. [PMID: 26441628 PMCID: PMC4563270 DOI: 10.3389/fninf.2015.00022] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2015] [Accepted: 08/20/2015] [Indexed: 11/30/2022] Open
Abstract
Contemporary simulators for networks of point and few-compartment model neurons come with a plethora of ready-to-use neuron and synapse models and support complex network topologies. Recent technological advancements have broadened the spectrum of application further to the efficient simulation of brain-scale networks on supercomputers. In distributed network simulations the amount of spike data that accrues per millisecond and process is typically low, such that a common optimization strategy is to communicate spikes at relatively long intervals, where the upper limit is given by the shortest synaptic transmission delay in the network. This approach is well-suited for simulations that employ only chemical synapses but it has so far impeded the incorporation of gap-junction models, which require instantaneous neuronal interactions. Here, we present a numerical algorithm based on a waveform-relaxation technique which allows for network simulations with gap junctions in a way that is compatible with the delayed communication strategy. Using a reference implementation in the NEST simulator, we demonstrate that the algorithm and the required data structures can be smoothly integrated with existing code such that they complement the infrastructure for spiking connections. To show that the unified framework for gap-junction and spiking interactions achieves high performance and delivers high accuracy in the presence of gap junctions, we present benchmarks for workstations, clusters, and supercomputers. Finally, we discuss limitations of the novel technology.
Collapse
Affiliation(s)
- Jan Hahne
- Department of Mathematics and Science, Bergische Universität Wuppertal Wuppertal, Germany
| | - Moritz Helias
- Institute of Neuroscience and Medicine (INM-6), Institute for Advanced Simulation (IAS-6), JARA BRAIN Institute I, Jülich Research Centre Jülich, Germany ; Programming Environment Research Team, RIKEN Advanced Institute for Computational Science Kobe, Japan
| | - Susanne Kunkel
- Programming Environment Research Team, RIKEN Advanced Institute for Computational Science Kobe, Japan ; Simulation Laboratory Neuroscience, Bernstein Facility for Simulation and Database Technology, Institute for Advanced Simulation, Jülich Aachen Research Alliance, Jülich Research Centre Jülich, Germany
| | - Jun Igarashi
- Neural Computation Unit, Okinawa Institute of Science and Technology Okinawa, Japan ; Laboratory for Neural Circuit Theory, RIKEN Brain Science Institute Wako, Japan
| | - Matthias Bolten
- Department of Mathematics and Science, Bergische Universität Wuppertal Wuppertal, Germany
| | - Andreas Frommer
- Department of Mathematics and Science, Bergische Universität Wuppertal Wuppertal, Germany
| | - Markus Diesmann
- Institute of Neuroscience and Medicine (INM-6), Institute for Advanced Simulation (IAS-6), JARA BRAIN Institute I, Jülich Research Centre Jülich, Germany ; Department of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University Aachen, Germany ; Department of Physics, Faculty 1, RWTH Aachen University Aachen, Germany
| |
Collapse
|
20
|
Dahlem MA, Schmidt B, Bojak I, Boie S, Kneer F, Hadjikhani N, Kurths J. Cortical hot spots and labyrinths: why cortical neuromodulation for episodic migraine with aura should be personalized. Front Comput Neurosci 2015; 9:29. [PMID: 25798103 PMCID: PMC4350394 DOI: 10.3389/fncom.2015.00029] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2014] [Accepted: 02/18/2015] [Indexed: 12/26/2022] Open
Abstract
Stimulation protocols for medical devices should be rationally designed. For episodic migraine with aura we outline model-based design strategies toward preventive and acute therapies using stereotactic cortical neuromodulation. To this end, we regard a localized spreading depression (SD) wave segment as a central element in migraine pathophysiology. To describe nucleation and propagation features of the SD wave segment, we define the new concepts of cortical hot spots and labyrinths, respectively. In particular, we firstly focus exclusively on curvature-induced dynamical properties by studying a generic reaction-diffusion model of SD on the folded cortical surface. This surface is described with increasing level of details, including finally personalized simulations using patient's magnetic resonance imaging (MRI) scanner readings. At this stage, the only relevant factor that can modulate nucleation and propagation paths is the Gaussian curvature, which has the advantage of being rather readily accessible by MRI. We conclude with discussing further anatomical factors, such as areal, laminar, and cellular heterogeneity, that in addition to and in relation to Gaussian curvature determine the generalized concept of cortical hot spots and labyrinths as target structures for neuromodulation. Our numerical simulations suggest that these target structures are like fingerprints, they are individual features of each migraine sufferer. The goal in the future will be to provide individualized neural tissue simulations. These simulations should predict the clinical data and therefore can also serve as a test bed for exploring stereotactic cortical neuromodulation.
Collapse
Affiliation(s)
- Markus A Dahlem
- Department of Physics, Humboldt-Universität zu Berlin Berlin, Germany ; Department of Biological Physik, Max Planck Institute for the Physics of Complex Systems Dresden, Germany
| | - Bernd Schmidt
- Department of Physics, Humboldt-Universität zu Berlin Berlin, Germany
| | - Ingo Bojak
- Cybernetics Research Group, School of Systems Engineering, University of Reading Reading, UK
| | - Sebastian Boie
- Department of Mathematics, The University of Auckland Auckland, New Zealand
| | - Frederike Kneer
- Department of Software Engineering and Theoretical Computer Science, Technische Universität Berlin Berlin, Germany
| | - Nouchine Hadjikhani
- Martinos Center for Biomedical Imaging, Harvard Medical School, Massachusetts General Hospital Charlestown, MA, USA
| | - Jürgen Kurths
- Department of Physics, Humboldt-Universität zu Berlin Berlin, Germany ; Potsdam Institute for Climate Impact Research Potsdam, Germany ; Institute for Complex Systems and Mathematical Biology, University of Aberdeen Aberdeen, UK
| |
Collapse
|
21
|
Du B, Sorensen D, Cox SJ. Model reduction of strong-weak neurons. Front Comput Neurosci 2015; 8:164. [PMID: 25566048 PMCID: PMC4267280 DOI: 10.3389/fncom.2014.00164] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2014] [Accepted: 11/27/2014] [Indexed: 12/04/2022] Open
Abstract
We consider neurons with large dendritic trees that are weakly excitable in the sense that back propagating action potentials are severly attenuated as they travel from the small, strongly excitable, spike initiation zone. In previous work we have shown that the computational size of weakly excitable cell models may be reduced by two or more orders of magnitude, and that the size of strongly excitable models may be reduced by at least one order of magnitude, without sacrificing the spatio–temporal nature of its inputs (in the sense we reproduce the cell's precise mapping of inputs to outputs). We combine the best of these two strategies via a predictor-corrector decomposition scheme and achieve a drastically reduced highly accurate model of a caricature of the neuron responsible for collision detection in the locust.
Collapse
Affiliation(s)
- Bosen Du
- Department of Computational and Applied Mathematics, Rice University Houston, TX, USA
| | - Danny Sorensen
- Department of Computational and Applied Mathematics, Rice University Houston, TX, USA
| | - Steven J Cox
- Department of Computational and Applied Mathematics, Rice University Houston, TX, USA
| |
Collapse
|
22
|
Kunkel S, Schmidt M, Eppler JM, Plesser HE, Masumoto G, Igarashi J, Ishii S, Fukai T, Morrison A, Diesmann M, Helias M. Spiking network simulation code for petascale computers. Front Neuroinform 2014; 8:78. [PMID: 25346682 PMCID: PMC4193238 DOI: 10.3389/fninf.2014.00078] [Citation(s) in RCA: 45] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2014] [Accepted: 08/27/2014] [Indexed: 11/13/2022] Open
Abstract
Brain-scale networks exhibit a breathtaking heterogeneity in the dynamical properties and parameters of their constituents. At cellular resolution, the entities of theory are neurons and synapses and over the past decade researchers have learned to manage the heterogeneity of neurons and synapses with efficient data structures. Already early parallel simulation codes stored synapses in a distributed fashion such that a synapse solely consumes memory on the compute node harboring the target neuron. As petaflop computers with some 100,000 nodes become increasingly available for neuroscience, new challenges arise for neuronal network simulation software: Each neuron contacts on the order of 10,000 other neurons and thus has targets only on a fraction of all compute nodes; furthermore, for any given source neuron, at most a single synapse is typically created on any compute node. From the viewpoint of an individual compute node, the heterogeneity in the synaptic target lists thus collapses along two dimensions: the dimension of the types of synapses and the dimension of the number of synapses of a given type. Here we present a data structure taking advantage of this double collapse using metaprogramming techniques. After introducing the relevant scaling scenario for brain-scale simulations, we quantitatively discuss the performance on two supercomputers. We show that the novel architecture scales to the largest petascale supercomputers available today.
Collapse
Affiliation(s)
- Susanne Kunkel
- Simulation Laboratory Neuroscience - Bernstein Facility for Simulation and Database Technology, Institute for Advanced Simulation, Jülich Aachen Research Alliance, Jülich Research Centre Jülich, Germany ; Programming Environment Research Team, RIKEN Advanced Institute for Computational Science Kobe, Japan
| | - Maximilian Schmidt
- Institute of Neuroscience and Medicine (INM-6), Institute for Advanced Simulation (IAS-6), Jülich Research Centre and JARA Jülich, Germany
| | - Jochen M Eppler
- Institute of Neuroscience and Medicine (INM-6), Institute for Advanced Simulation (IAS-6), Jülich Research Centre and JARA Jülich, Germany
| | - Hans E Plesser
- Institute of Neuroscience and Medicine (INM-6), Institute for Advanced Simulation (IAS-6), Jülich Research Centre and JARA Jülich, Germany ; Department of Mathematical Sciences and Technology, Norwegian University of Life Sciences Aas, Norway
| | - Gen Masumoto
- Advanced Center for Computing and Communication, RIKEN Wako, Japan
| | - Jun Igarashi
- Neural Computation Unit, Okinawa Institute of Science and Technology Okinawa, Japan ; Laboratory for Neural Circuit Theory, RIKEN Brain Science Institute Wako, Japan
| | - Shin Ishii
- Integrated Systems Biology Laboratory, Department of Systems Science, Graduate School of Informatics, Kyoto University Kyoto, Japan
| | - Tomoki Fukai
- Laboratory for Neural Circuit Theory, RIKEN Brain Science Institute Wako, Japan
| | - Abigail Morrison
- Simulation Laboratory Neuroscience - Bernstein Facility for Simulation and Database Technology, Institute for Advanced Simulation, Jülich Aachen Research Alliance, Jülich Research Centre Jülich, Germany ; Institute of Neuroscience and Medicine (INM-6), Institute for Advanced Simulation (IAS-6), Jülich Research Centre and JARA Jülich, Germany ; Faculty of Psychology, Institute of Cognitive Neuroscience, Ruhr-University Bochum Bochum, Germany
| | - Markus Diesmann
- Institute of Neuroscience and Medicine (INM-6), Institute for Advanced Simulation (IAS-6), Jülich Research Centre and JARA Jülich, Germany ; Laboratory for Neural Circuit Theory, RIKEN Brain Science Institute Wako, Japan ; Medical Faculty, RWTH University Aachen, Germany
| | - Moritz Helias
- Programming Environment Research Team, RIKEN Advanced Institute for Computational Science Kobe, Japan ; Institute of Neuroscience and Medicine (INM-6), Institute for Advanced Simulation (IAS-6), Jülich Research Centre and JARA Jülich, Germany
| |
Collapse
|
23
|
Gupta RK, Przekwas A. Mathematical Models of Blast-Induced TBI: Current Status, Challenges, and Prospects. Front Neurol 2013; 4:59. [PMID: 23755039 PMCID: PMC3667273 DOI: 10.3389/fneur.2013.00059] [Citation(s) in RCA: 68] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2012] [Accepted: 05/09/2013] [Indexed: 01/13/2023] Open
Abstract
Blast-induced traumatic brain injury (TBI) has become a signature wound of recent military activities and is the leading cause of death and long-term disability among U.S. soldiers. The current limited understanding of brain injury mechanisms impedes the development of protection, diagnostic, and treatment strategies. We believe mathematical models of blast wave brain injury biomechanics and neurobiology, complemented with in vitro and in vivo experimental studies, will enable a better understanding of injury mechanisms and accelerate the development of both protective and treatment strategies. The goal of this paper is to review the current state of the art in mathematical and computational modeling of blast-induced TBI, identify research gaps, and recommend future developments. A brief overview of blast wave physics, injury biomechanics, and the neurobiology of brain injury is used as a foundation for a more detailed discussion of multiscale mathematical models of primary biomechanics and secondary injury and repair mechanisms. The paper also presents a discussion of model development strategies, experimental approaches to generate benchmark data for model validation, and potential applications of the model for prevention and protection against blast wave TBI.
Collapse
Affiliation(s)
- Raj K Gupta
- Department of Defense Blast Injury Research Program Coordinating Office, U.S. Army Medical Research and Materiel Command , Fort Detrick, MD , USA
| | | |
Collapse
|
24
|
Application of a "staggered walk" algorithm for generating large-scale morphological neuronal networks. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2012; 2012:876357. [PMID: 23056037 PMCID: PMC3465897 DOI: 10.1155/2012/876357] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/21/2012] [Revised: 08/14/2012] [Accepted: 08/26/2012] [Indexed: 11/23/2022]
Abstract
Large-scale models of neuronal structures are needed to explore emergent properties of mammalian brains. Because these models have trillions of synapses, a major problem in their creation is synapse placement. Here we present a novel method for exploiting consistent fiber orientation in a neural tissue to perform a highly efficient modified plane-sweep algorithm, which identifies all regions of 3D overlaps between dendritic and axonal projection fields. The first step in placing synapses in physiological models is neurite-overlap detection, at large scales a computationally intensive task. We have developed an efficient “Staggered Walk” algorithm that can find all 3D overlaps of neurites where trillions of synapses connect billions of neurons.
Collapse
|
25
|
Kunkel S, Potjans TC, Eppler JM, Plesser HE, Morrison A, Diesmann M. Meeting the memory challenges of brain-scale network simulation. Front Neuroinform 2012; 5:35. [PMID: 22291636 PMCID: PMC3264885 DOI: 10.3389/fninf.2011.00035] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2011] [Accepted: 12/09/2011] [Indexed: 11/13/2022] Open
Abstract
The development of high-performance simulation software is crucial for studying the brain connectome. Using connectome data to generate neurocomputational models requires software capable of coping with models on a variety of scales: from the microscale, investigating plasticity, and dynamics of circuits in local networks, to the macroscale, investigating the interactions between distinct brain regions. Prior to any serious dynamical investigation, the first task of network simulations is to check the consistency of data integrated in the connectome and constrain ranges for yet unknown parameters. Thanks to distributed computing techniques, it is possible today to routinely simulate local cortical networks of around 10(5) neurons with up to 10(9) synapses on clusters and multi-processor shared-memory machines. However, brain-scale networks are orders of magnitude larger than such local networks, in terms of numbers of neurons and synapses as well as in terms of computational load. Such networks have been investigated in individual studies, but the underlying simulation technologies have neither been described in sufficient detail to be reproducible nor made publicly available. Here, we discover that as the network model sizes approach the regime of meso- and macroscale simulations, memory consumption on individual compute nodes becomes a critical bottleneck. This is especially relevant on modern supercomputers such as the Blue Gene/P architecture where the available working memory per CPU core is rather limited. We develop a simple linear model to analyze the memory consumption of the constituent components of neuronal simulators as a function of network size and the number of cores used. This approach has multiple benefits. The model enables identification of key contributing components to memory saturation and prediction of the effects of potential improvements to code before any implementation takes place. As a consequence, development cycles can be shorter and less expensive. Applying the model to our freely available Neural Simulation Tool (NEST), we identify the software components dominant at different scales, and develop general strategies for reducing the memory consumption, in particular by using data structures that exploit the sparseness of the local representation of the network. We show that these adaptations enable our simulation software to scale up to the order of 10,000 processors and beyond. As memory consumption issues are likely to be relevant for any software dealing with complex connectome data on such architectures, our approach and our findings should be useful for researchers developing novel neuroinformatics solutions to the challenges posed by the connectome project.
Collapse
Affiliation(s)
- Susanne Kunkel
- Functional Neural Circuits Group, Albert-Ludwig University of Freiburg Freiburg im Breisgau, Germany
| | | | | | | | | | | |
Collapse
|