Sharing Neuron Data: Carrots, Sticks, and Digital Records

Accelerating the continuous community sharing of digital neuromorphology data

The tree-like morphology of neurons and glia is a key cellular determinant of circuit connectivity and metabolic function in the nervous system of essentially all animals. To elucidate the contribution of specific cell types to both physiological and pathological brain states, it is important to access detailed neuroanatomy data for quantitative analysis and computational modeling. NeuroMorpho.Org is the largest online collection of freely available digital neural reconstructions and related metadata and is continuously updated with new uploads. Earlier in the project, we released multiple datasets together yearly, but this process caused an average delay of several months in making the data public. Moreover, in the past 5 years, >80% of invited authors agreed to share their data with the community via NeuroMorpho.Org, up from <20% in the first 5 years of the project. In the same period, the average number of reconstructions per publication increased 600%, creating the need for automatic processing to release more reconstructions in less time. The progressive automation of our pipeline enabled the transition to agile releases of individual datasets as soon as they are ready. The overall time from data identification to public sharing decreased by 63.7%; 78% of the datasets are now released in less than 3 months with an average workflow duration below 40 days. Furthermore, the mean processing time per reconstruction dropped from 3 h to 2 min. With these continuous improvements, NeuroMorpho.Org strives to forge a positive culture of open data. Most importantly, the new, original research enabled through reuse of datasets across the world has a multiplicative effect on science discovery, benefiting both authors and users.

Automating literature screening and curation with applications to computational neuroscience

OBJECTIVE

ModelDB (https://modeldb.science) is a discovery platform for computational neuroscience, containing over 1850 published model codes with standardized metadata. These codes were mainly supplied from unsolicited model author submissions, but this approach is inherently limited. For example, we estimate we have captured only around one-third of NEURON models, the most common type of models in ModelDB. To more completely characterize the state of computational neuroscience modeling work, we aim to identify works containing results derived from computational neuroscience approaches and their standardized associated metadata (eg, cell types, research topics).

MATERIALS AND METHODS

Known computational neuroscience work from ModelDB and identified neuroscience work queried from PubMed were included in our study. After pre-screening with SPECTER2 (a free document embedding method), GPT-3.5, and GPT-4 were used to identify likely computational neuroscience work and relevant metadata.

RESULTS

SPECTER2, GPT-4, and GPT-3.5 demonstrated varied but high abilities in identification of computational neuroscience work. GPT-4 achieved 96.9% accuracy and GPT-3.5 improved from 54.2% to 85.5% through instruction-tuning and Chain of Thought. GPT-4 also showed high potential in identifying relevant metadata annotations.

DISCUSSION

Accuracy in identification and extraction might further be improved by dealing with ambiguity of what are computational elements, including more information from papers (eg, Methods section), improving prompts, etc.

CONCLUSION

Natural language processing and large language model techniques can be added to ModelDB to facilitate further model discovery, and will contribute to a more standardized and comprehensive framework for establishing domain-specific resources.

German funders' data sharing policies-A qualitative interview study

BACKGROUND

Data sharing is commonly seen as beneficial for science but is not yet common practice. Research funding agencies are known to play a key role in promoting data sharing, but German funders' data sharing policies appear to lag behind in international comparison. This study aims to answer the question of how German data sharing experts inside and outside funding agencies perceive and evaluate German funders' data sharing policies and overall efforts to promote data sharing.

METHODS

This study is based on sixteen guided expert interviews with representatives of German funders and German research data experts from stakeholder organisations, who shared their perceptions of German' funders efforts to promote data sharing. By applying the method of qualitative content analysis to our interview data, we categorise and describe noteworthy aspects of the German data sharing policy landscape and illustrate our findings with interview passages.

RESULTS

We present our findings in five sections to distinguish our interviewees' perceptions on a) the status quo of German funders' data sharing policies, b) the role of funders in promoting data sharing, c) current and potential measures by funders to promote data sharing, d) general barriers to those measures, and e) the implementation of more binding data sharing requirements.

DISCUSSION AND CONCLUSION

Although funders are perceived to be important promoters and facilitators of data sharing throughout our interviews, only few German funding agencies have data sharing policies in place. Several interviewees stated that funders could do more, for example by providing incentives for data sharing or by introducing more concrete policies. Our interviews suggest the academic freedom of grantees is widely perceived as an obstacle for German funders in introducing mandatory data sharing requirements. However, some interviewees stated that stricter data sharing requirements could be justified if data sharing is a part of good scientific practice.

Bibliometric analysis of neuroscience publications quantifies the impact of data sharing

SUMMARY

Neural morphology, the branching geometry of brain cells, is an essential cellular substrate of nervous system function and pathology. Despite the accelerating production of digital reconstructions of neural morphology, the public accessibility of data remains a core issue in neuroscience. Deficiencies in the availability of existing data create redundancy of research efforts and limit synergy. We carried out a comprehensive bibliometric analysis of neural morphology publications to quantify the impact of data sharing in the neuroscience community. Our findings demonstrate that sharing digital reconstructions of neural morphology via NeuroMorpho.Org leads to a significant increase of citations to the original article, thus directly benefiting authors. The rate of data reusage remains constant for at least 16 years after sharing (the whole period analyzed), altogether nearly doubling the peer-reviewed discoveries in the field. Furthermore, the recent availability of larger and more numerous datasets fostered integrative applications, which accrue on average twice the citations of re-analyses of individual datasets. We also released an open-source citation tracking web-service allowing researchers to monitor reusage of their datasets in independent peer-reviewed reports. These results and tools can facilitate the recognition of shared data reuse for merit evaluations and funding decisions.

AVAILABILITY AND IMPLEMENTATION

The application is available at: http://cng-nmo-dev3.orc.gmu.edu:8181/. The source code at https://github.com/HerveEmissah/nmo-authors-app and https://github.com/HerveEmissah/nmo-bibliometric-analysis.

Bibliometric analysis of neuroscience publications quantifies the impact of data sharing

Motivation

Neural morphology, the branching geometry of neurons and glia in the nervous system, is an essential cellular substrate of brain function and pathology. Despite the accelerating production of digital reconstructions of neural morphology in laboratories worldwide, the public accessibility of data remains a core issue in neuroscience. Deficiencies in the availability of existing data create redundancy of research efforts and prevent researchers from building on others' work. Data sharing complements the development of computational resources and literature mining tools to accelerate scientific discovery.

Results

We carried out a comprehensive bibliometric analysis of neural morphology publications to quantify the impact of data sharing in the neuroscience community. Our findings demonstrate that sharing digital reconstructions of neural morphology via the NeuroMorpho.Org online repository leads to a significant increase of citations to the original article, thus directly benefiting the authors. Moreover, the rate of data reusage remains constant for at least 16 years after sharing (the whole period analyzed), altogether nearly doubling the peer-reviewed discoveries in the field. Furthermore, the recent availability of larger and more numerous datasets fostered integrative meta-analysis applications, which accrue on average twice the citations of re-analyses of individual datasets. We also designed and deployed an open-source citation tracking web-service that allows researchers to monitor reusage of their datasets in independent peer-reviewed reports. These results and the released tool can facilitate the recognition of shared data reuse for promotion and tenure considerations, merit evaluations, and funding decisions.

Automatic identification of scientific publications describing digital reconstructions of neural morphology

The increasing number of peer-reviewed publications constitutes a challenge for biocuration. For example, NeuroMorpho.Org, a sharing platform for digital reconstructions of neural morphology, must evaluate more than 6000 potentially relevant articles per year to identify data of interest. Here, we describe a tool that uses natural language processing and deep learning to assess the likelihood of a publication to be relevant for the project. The tool automatically identifies articles describing digitally reconstructed neural morphologies with high accuracy. Its processing rate of 900 publications per hour is not only amply sufficient to autonomously track new research, but also allowed the successful evaluation of older publications backlogged due to limited human resources. The number of bio-entities found since launching the tool almost doubled while greatly reducing manual labor. The classification tool is open source, configurable, and simple to use, making it extensible to other biocuration projects.

Automatic identification of scientific publications describing digital reconstructions of neural morphology

Motivation

The increasing number of peer-reviewed publications constitutes a challenge for biocuration. For example, NeuroMorpho.Org, a sharing platform for digital reconstructions of neural morphology, must evaluate more than 6000 potentially relevant articles per year to identify data of interest. Here, we describe a tool that uses natural language processing and deep learning to assess the likelihood of a publication to be relevant for the project.

Results

The tool automatically identifies articles describing digitally reconstructed neural morphologies with high accuracy. Its processing rate of 900 publications per hour is not only amply sufficient to autonomously track new research, but also allowed the successful evaluation of older publications backlogged due to limited human resources. The number of bio-entities found since launching the tool almost doubled while greatly reducing manual labor. The classification tool is open source, configurable, and simple to use, making it extensible to other biocuration projects.

Availability

https://github.com/Joindbre/TextRelevancy.

Contact

ascoli@gmu.edu.

Supplementary information

Supplementary information, tool installation, and API usage are available at https://docs.joindbre.com.

Survey of Investigators About Sharing Human Research Data in the Neurosciences

BACKGROUND AND OBJECTIVES

In the neurosciences, significant opportunities for sharing individual-level data are underexploited. Commentators suggest various barriers to data sharing, which may need to be addressed. Investigators' perspectives on the main barriers are unclear. Furthermore, bioethicists have raised concerns about the potential misuse of neuroscience data, although discussions are hampered by uncertainty about the potential risks. It is unclear how common sensitive data are obtained and whether investigators judge them as sensitive.

METHODS

An online survey was disseminated among 1,190 principal investigators (PIs) of active National Institute of Neurological Disorders and Stroke, National Institute of Mental Health, or NIH Brain Research Through Advancing Innovative Neurotechnologies Initiative grants involving human subject research.

RESULTS

A total of 397 investigators responded to the survey (response rate 33%). Most investigators (84%) support efforts to increase sharing of deidentified individual-level data. However, investigators perceive many barriers to data sharing. The largest barriers were costs and time; limited interpretation of the data without understanding the context of data collection; lack of incentives; limited standardization and norms for data acquisition, formatting, and description; and heterogeneity of data types. Several types of data described as sensitive in the literature are common among neuroscience studies, for example, neural correlates of behavior, emotions, or decision making (71%) and/or predictive data (54%). Although most investigators consider it unlikely or extremely unlikely for their research data to be misused to harm individual research participants (82%), the majority were at least slightly concerned about potential harm to individuals if their research data were misused (65%). Investigators with more easily reidentifiable data, data from vulnerable groups, and neural data were more concerned about the likelihood of misuse and/or magnitude of harm of misuse of their research data.

DISCUSSION

We hope these data help prioritize the development of tools and strategies to overcome the main barriers to data sharing. Furthermore, these data provide input on what may be sensitive data for which additional safeguards should be considered.

Neither carrots nor sticks? Challenges surrounding data sharing from the perspective of research funding agencies—A qualitative expert interview study

Background

Data Sharing is widely recognised as crucial for accelerating scientific research and improving its quality. However, data sharing is still not a common practice. Funding agencies tend to facilitate the sharing of research data by both providing incentives and requiring data sharing as part of their policies and conditions for awarding grants. The goal of our article is to answer the following question: What challenges do international funding agencies see when it comes to their own efforts to foster and implement data sharing through their policies?

Methods

We conducted a series of sixteen guideline-based expert interviews with representatives of leading international funding agencies. As contact persons for open science at their respective agencies, they offered their perspectives and experiences concerning their organisations’ data sharing policies. We performed a qualitative content analysis of the interviews and categorised the challenges perceived by funding agencies.

Results

We identify and illustrate six challenges surrounding data sharing policies as perceived by leading funding agencies: The design of clear policies, monitoring of compliance, sanctions for non-compliance, incentives, support, and limitations for funders’ own capabilities. However, our interviews also show how funders approach potential solutions to overcome these challenges, for example by coordinating with other agencies or adjusting grant evaluation metrics to incentivise data sharing.

Discussion and conclusion

Our interviews point to existing flaws in funders’ data sharing policies, such as a lack of clarity, a lack of monitoring of funded researchers’ data sharing behaviour, and a lack of incentives. A number of agencies could suggest potential solutions but often struggle with the overall complexity of data sharing and the implementation of these measures. Funders cannot solve each challenge by themselves, but they can play an active role and lead joint efforts towards a culture of data sharing.

Efficient metadata mining of web-accessible neural morphologies

Advancements in neuroscience research have led to steadily accelerating data production and sharing. The online community repository of neural reconstructions NeuroMorpho.Org grew from fewer than 1000 digitally traced neurons in 2006 to more than 140,000 cells today, including glia that now constitute 10.1% of the content. Every reconstruction consists of a detailed 3D representation of branch geometry and connectivity in a standardized format, from which a collection of morphometric features is extracted and stored. Moreover, each entry in the database is accompanied by rich metadata annotation describing the animal subject, anatomy, and experimental details. The rapid expansion of this resource in the past decade was accompanied by a parallel rise in the complexity of the available information, creating both opportunities and challenges for knowledge mining. Here, we introduce a new summary reporting functionality, allowing NeuroMorpho.Org users to efficiently download digests of metadata and morphometrics from multiple groups of similar cells for further analysis. We demonstrate the capabilities of the tool for both glia and neurons and present an illustrative statistical analysis of the resulting data.

Prediction of Neural Diameter From Morphology to Enable Accurate Simulation

Accurate neuron morphologies are paramount for computational model simulations of realistic neural responses. Over the last decade, the online repository NeuroMorpho.Org has collected over 140,000 available neuron morphologies to understand brain function and promote interaction between experimental and computational research. Neuron morphologies describe spatial aspects of neural structure; however, many of the available morphologies do not contain accurate diameters that are essential for computational simulations of electrical activity. To best utilize available neuron morphologies, we present a set of equations that predict dendritic diameter from other morphological features. To derive the equations, we used a set of NeuroMorpho.org archives with realistic neuron diameters, representing hippocampal pyramidal, cerebellar Purkinje, and striatal spiny projection neurons. Each morphology is separated into initial, branching children, and continuing nodes. Our analysis reveals that the diameter of preceding nodes, Parent Diameter, is correlated to diameter of subsequent nodes for all cell types. Branching children and initial nodes each required additional morphological features to predict diameter, such as path length to soma, total dendritic length, and longest path to terminal end. Model simulations reveal that membrane potential response with predicted diameters is similar to the original response for several tested morphologies. We provide our open source software to extend the utility of available NeuroMorpho.org morphologies, and suggest predictive equations may supplement morphologies that lack dendritic diameter and improve model simulations with realistic dendritic diameter.

Connectivity characterization of the mouse basolateral amygdalar complex

The basolateral amygdalar complex (BLA) is implicated in behaviors ranging from fear acquisition to addiction. Optogenetic methods have enabled the association of circuit-specific functions to uniquely connected BLA cell types. Thus, a systematic and detailed connectivity profile of BLA projection neurons to inform granular, cell type-specific interrogations is warranted. Here, we apply machine-learning based computational and informatics analysis techniques to the results of circuit-tracing experiments to create a foundational, comprehensive BLA connectivity map. The analyses identify three distinct domains within the anterior BLA (BLAa) that house target-specific projection neurons with distinguishable morphological features. We identify brain-wide targets of projection neurons in the three BLAa domains, as well as in the posterior BLA, ventral BLA, posterior basomedial, and lateral amygdalar nuclei. Inputs to each nucleus also are identified via retrograde tracing. The data suggests that connectionally unique, domain-specific BLAa neurons are associated with distinct behavior networks.

Data Sharing in Biomedical Sciences: A Systematic Review of Incentives

Background: The lack of incentives has been described as the rate-limiting step for data sharing. Currently, the evaluation of scientific productivity by academic institutions and funders has been heavily reliant upon the number of publications and citations, raising questions about the adequacy of such mechanisms to reward data generation and sharing. This article provides a systematic review of the current and proposed incentive mechanisms for researchers in biomedical sciences and discusses their strengths and weaknesses. Methods: PubMed, Web of Science, and Google Scholar were queried for original research articles, editorials, and opinion articles on incentives for data sharing. Articles were included if they discussed incentive mechanisms for data sharing, were applicable to biomedical sciences, and were written in English. Results: Although coauthorship in return for the sharing of data is common, this might be incompatible with authorship guidelines and raise concerns over the ability of secondary analysts to contest the proposed research methods or conclusions that are drawn. Data publication, citation, and altmetrics have been proposed as alternative routes to credit data generators, which could address these disadvantages. Their primary downsides are that they are not well-established, it is difficult to acquire evidence to support their implementation, and that they could be gamed or give rise to novel forms of research misconduct. Conclusions: Alternative recognition mechanisms need to be more commonly used to generate evidence on their power to stimulate data sharing, and to assess where they fall short. There is ample discussion in policy documents on alternative crediting systems to work toward Open Science, which indicates that that there is an interest in working out more elaborate metascience programs.

Highlights from the Era of Open Source Web-Based Tools

High digital connectivity and a focus on reproducibility are contributing to an open science revolution in neuroscience. Repositories and platforms have emerged across the whole spectrum of subdisciplines, paving the way for a paradigm shift in the way we share, analyze, and reuse vast amounts of data collected across many laboratories. Here, we describe how open access web-based tools are changing the landscape and culture of neuroscience, highlighting six free resources that span subdisciplines from behavior to whole-brain mapping, circuits, neurons, and gene variants.

Single-neuron dynamical effects of dendritic pruning implicated in aging and neurodegeneration: towards a measure of neuronal reserve

Aging is a main risk factor for neurodegenerative disorders including Alzheimer's disease. It is often accompanied by reduced cognitive functions, gray-matter volume, and dendritic integrity. Although age-related brain structural changes have been observed across multiple scales, their functional implications remain largely unknown. Here we simulate the aging effects on neuronal morphology as dendritic pruning and characterize its dynamical implications. Utilizing a detailed computational modeling approach, we simulate the dynamics of digitally reconstructed neurons obtained from Neuromorpho.org. We show that dendritic pruning affects neuronal integrity: firing rate is reduced, causing a reduction in energy consumption, energy efficiency, and dynamic range. Pruned neurons require less energy but their function is often impaired, which can explain the diminished ability to distinguish between similar experiences (pattern separation) in older people. Our measures indicate that the resilience of neuronal dynamics is neuron-specific, heterogeneous, and strongly affected by dendritic topology and the position of the soma. Based on the emergent neuronal dynamics, we propose to classify the effects of dendritic deterioration, and put forward a topological measure of “neuronal reserve” that quantifies the resilience of neuronal dynamics to dendritic pruning. Moreover, our findings suggest that increasing dendritic excitability could partially mitigate the dynamical effects of aging.

Spatially resolved dendritic integration: towards a functional classification of neurons

The vast tree-like dendritic structure of neurons allows them to receive and integrate input from many neurons. A wide variety of neuronal morphologies exist, however, their role in dendritic integration, and how it shapes the response of the neuron, is not yet fully understood. Here, we study the evolution and interactions of dendritic spikes in excitable neurons with complex real branch structures. We focus on dozens of digitally reconstructed illustrative neurons from the online repository NeuroMorpho.org, which contains over 130,000 neurons. Yet, our methods can be promptly extended to any other neuron. This approach allows us to estimate and map specific and heterogeneous patterns of activity observed across extensive dendritic trees with thousands of compartments. We propose a classification of neurons based on the location of the soma (centrality) and the number of branches connected to the soma. These are key topological factors in determining the neuron's energy consumption, firing rate, and the dynamic range, which quantifies the range in synaptic input rate that can be reliably encoded by the neuron's firing rate. Moreover, we find that bifurcations, the structural building blocks of complex dendrites, play a major role in increasing the dynamic range of neurons. Our results provide a better understanding of the effects of neuronal morphology in the diversity of neuronal dynamics and function.

Genetic Analyses of Alzheimer's Disease in China: Achievements and Perspectives

Since 2010, the Chinese have become one of the most aged populations in the world, leading to a severe burden of neurodegenerative disorders. Alzheimer's disease (AD) is the most prevalent neurodegenerative disease and has a high genetic heritability. In the past two decades, numerous genetic analyses, from linkage analyses and candidate gene studies to genome-wide association studies (GWASs) and next-generation sequencing studies, have identified dozens of AD susceptibility or causal genes. These studies have provided a comprehensive genetic view and contributed to the understanding of the pathological and molecular mechanisms of the disease. However, most of the recognized AD genetic risk factors have been reported in studies based on European populations or populations of European ancestry, and data about the genetics of AD from other populations has been very limited. As China has the largest AD population in the world and because of the remarkable genetic differences between the East and the West, deciphering the genetic basis and molecular mechanism in Chinese patients with AD may add key points to the full characterization of AD. In this review, we present an overview of the current state of AD genetic research in China, with an emphasis on genome-level studies. We also describe the challenges and opportunities for future advances, especially for in-depth collaborations, brain bank construction, and primate animal modeling. There is an urgent need to promote public awareness and increase our collaborations and data sharing.

Automated Metadata Suggestion During Repository Submission

Knowledge discovery via an informatics resource is constrained by the completeness of the resource, both in terms of the amount of data it contains and in terms of the metadata that exists to describe the data. Increasing completeness in one of these categories risks reducing completeness in the other because manually curating metadata is time consuming and is restricted by familiarity with both the data and the metadata annotation scheme. The diverse interests of a research community may drive a resource to have hundreds of metadata tags with few examples for each making it challenging for humans or machine learning algorithms to learn how to assign metadata tags properly. We demonstrate with ModelDB, a computational neuroscience model discovery resource, that using manually-curated regular-expression based rules can overcome this challenge by parsing existing texts from data providers during user data entry to suggest metadata annotations and prompt them to suggest other related metadata annotations rather than leaving the task to a curator. In the ModelDB implementation, analyzing the abstract identified 6.4 metadata tags per abstract at 79% precision. Using the full-text produced higher recall with low precision (41%), and the title alone produced few (1.3) metadata annotations per entry; we thus recommend data providers use their abstract during upload. Grouping the possible metadata annotations into categories (e.g. cell type, biological topic) revealed that precision and recall for the different text sources varies by category. Given this proof-of-concept, other bioinformatics resources can likewise improve the quality of their metadata by adopting our approach of prompting data uploaders with relevant metadata at the minimal cost of formalizing rules for each potential metadata annotation.

An open repository for single-cell reconstructions of the brain forest

NeuroMorpho.Org was launched in 2006 to provide unhindered access to any and all digital tracings of neuronal morphology that researchers were willing to share freely upon request. Today this database is the largest public inventory of cellular reconstructions in neuroscience with a content of over 80,000 neurons and glia from a representative diversity of animal species, anatomical regions, and experimental methods. Datasets continuously contributed by hundreds of laboratories worldwide are centrally curated, converted into a common non-proprietary format, morphometrically quantified, and annotated with comprehensive metadata. Users download digital reconstructions for a variety of scientific applications including visualization, classification, analysis, and simulations. With more than 1,000 peer-reviewed publications describing data stored in or utilizing data retrieved from NeuroMorpho.Org, this ever-growing repository can already be considered a mature resource for neuroscience.

Track structure model of microscopic energy deposition by protons and heavy ions in segments of neuronal cell dendrites represented by cylinders or spheres

Changes to cognition, including memory, following radiation exposure are a concern for cosmic ray exposures to astronauts and in Hadron therapy with proton and heavy ion beams. The purpose of the present work is to develop computational methods to evaluate microscopic energy deposition (ED) in volumes representative of neuron cell structures, including segments of dendrites and spines, using a stochastic track structure model. A challenge for biophysical models of neuronal damage is the large sizes (> 100µm) and variability in volumes of possible dendritic segments and pre-synaptic elements (spines and filopodia). We consider cylindrical and spherical microscopic volumes of varying geometric parameters and aspect ratios from 0.5 to 5 irradiated by protons, and ³He and ¹²C particles at energies corresponding to a distance of 1cm to the Bragg peak, which represent particles of interest in Hadron therapy as well as space radiation exposure. We investigate the optimal axis length of dendritic segments to evaluate microscopic ED and hit probabilities along the dendritic branches at a given macroscopic dose. Because of large computation times to analyze ED in volumes of varying sizes, we developed an analytical method to find the mean primary dose in spheres that can guide numerical methods to find the primary dose distribution for cylinders. Considering cylindrical segments of varying aspect ratio at constant volume, we assess the chord length distribution, mean number of hits and ED profiles by primary particles and secondary electrons (δ-rays). For biophysical modeling applications, segments on dendritic branches are proposed to have equal diameters and axes lengths along the varying diameter of a dendritic branch.

An ontology-based search engine for digital reconstructions of neuronal morphology

Neuronal morphology is extremely diverse across and within animal species, developmental stages, brain regions, and cell types. This diversity is functionally important because neuronal structure strongly affects synaptic integration, spiking dynamics, and network connectivity. Digital reconstructions of axonal and dendritic arbors are thus essential to quantify and model information processing in the nervous system. NeuroMorpho.Org is an established repository containing tens of thousands of digitally reconstructed neurons shared by several hundred laboratories worldwide. Each neuron is annotated with specific metadata based on the published references and additional details provided by data owners. The number of represented metadata concepts has grown over the years in parallel with the increase of available data. Until now, however, the lack of standardized terminologies and of an adequately structured metadata schema limited the effectiveness of user searches. Here we present a new organization of NeuroMorpho.Org metadata grounded on a set of interconnected hierarchies focusing on the main dimensions of animal species, anatomical regions, and cell types. We have comprehensively mapped each metadata term in NeuroMorpho.Org to this formal ontology, explicitly resolving all ambiguities caused by synonymy and homonymy. Leveraging this consistent framework, we introduce OntoSearch, a powerful functionality that seamlessly enables retrieval of morphological data based on expert knowledge and logical inferences through an intuitive string-based user interface with auto-complete capability. In addition to returning the data directly matching the search criteria, OntoSearch also identifies a pool of possible hits by taking into consideration incomplete metadata annotation.

Twenty years of ModelDB and beyond: building essential modeling tools for the future of neuroscience

Neuron modeling may be said to have originated with the Hodgkin and Huxley action potential model in 1952 and Rall's models of integrative activity of dendrites in 1964. Over the ensuing decades, these approaches have led to a massive development of increasingly accurate and complex data-based models of neurons and neuronal circuits. ModelDB was founded in 1996 to support this new field and enhance the scientific credibility and utility of computational neuroscience models by providing a convenient venue for sharing them. It has grown to include over 1100 published models covering more than 130 research topics. It is actively curated and developed to help researchers discover and understand models of interest. ModelDB also provides mechanisms to assist running models both locally and remotely, and has a graphical tool that enables users to explore the anatomical and biophysical properties that are represented in a model. Each of its capabilities is undergoing continued refinement and improvement in response to user experience. Large research groups (Allen Brain Institute, EU Human Brain Project, etc.) are emerging that collect data across multiple scales and integrate that data into many complex models, presenting new challenges of scale. We end by predicting a future for neuroscience increasingly fueled by new technology and high performance computation, and increasingly in need of comprehensive user-friendly databases such as ModelDB to provide the means to integrate the data for deeper insights into brain function in health and disease.

Win-win data sharing in neuroscience

Most neuroscientists have yet to embrace a culture of data sharing. Using our decade-long experience at NeuroMorpho.Org as an example, we discuss how publicly available repositories may benefit data producers and end-users alike. We outline practical recipes for resource developers to maximize the research impact of data sharing platforms for both contributors and users.

Reproducibility in Computational Neuroscience Models and Simulations

OBJECTIVE

Like all scientific research, computational neuroscience research must be reproducible. Big data science, including simulation research, cannot depend exclusively on journal articles as the method to provide the sharing and transparency required for reproducibility.

METHODS

Ensuring model reproducibility requires the use of multiple standard software practices and tools, including version control, strong commenting and documentation, and code modularity.

RESULTS

Building on these standard practices, model-sharing sites and tools have been developed that fit into several categories: 1) standardized neural simulators; 2) shared computational resources; 3) declarative model descriptors, ontologies, and standardized annotations; and 4) model-sharing repositories and sharing standards.

CONCLUSION

A number of complementary innovations have been proposed to enhance sharing, transparency, and reproducibility. The individual user can be encouraged to make use of version control, commenting, documentation, and modularity in development of models. The community can help by requiring model sharing as a condition of publication and funding.

SIGNIFICANCE

Model management will become increasingly important as multiscale models become larger, more detailed, and correspondingly more difficult to manage by any single investigator or single laboratory. Additional big data management complexity will come as the models become more useful in interpreting experiments, thus increasing the need to ensure clear alignment between modeling data, both parameters and results, and experiment.