1
|
Kobayashi R, Shinomoto S. Inference of monosynaptic connections from parallel spike trains: A review. Neurosci Res 2024:S0168-0102(24)00097-X. [PMID: 39098768 DOI: 10.1016/j.neures.2024.07.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2024] [Revised: 07/12/2024] [Accepted: 07/19/2024] [Indexed: 08/06/2024]
Abstract
This article presents a mini-review about the progress in inferring monosynaptic connections from spike trains of multiple neurons over the past twenty years. First, we explain a variety of meanings of "neuronal connectivity" in different research areas of neuroscience, such as structural connectivity, monosynaptic connectivity, and functional connectivity. Among these, we focus on the methods used to infer the monosynaptic connectivity from spike data. We then summarize the inference methods based on two main approaches, i.e., correlation-based and model-based approaches. Finally, we describe available source codes for connectivity inference and future challenges. Although inference will never be perfect, the accuracy of identifying the monosynaptic connections has improved dramatically in recent years due to continuous efforts.
Collapse
Affiliation(s)
- Ryota Kobayashi
- Graduate School of Frontier Sciences, The University of Tokyo, Chiba 277-8561, Japan; Mathematics and Informatics Center, The University of Tokyo, Tokyo 113-8656, Japan.
| | - Shigeru Shinomoto
- Graduate School of Biostudies, Kyoto University, Kyoto 606-8501, Japan; Research Organization of Open Innovation and Collaboration, Ritsumeikan University, Osaka 567-8570, Japan
| |
Collapse
|
2
|
Chen Y, Chien J, Dai B, Lin D, Chen ZS. Identifying behavioral links to neural dynamics of multifiber photometry recordings in a mouse social behavior network. J Neural Eng 2024; 21:10.1088/1741-2552/ad5702. [PMID: 38861996 PMCID: PMC11246699 DOI: 10.1088/1741-2552/ad5702] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2024] [Accepted: 06/11/2024] [Indexed: 06/13/2024]
Abstract
Objective.Distributed hypothalamic-midbrain neural circuits help orchestrate complex behavioral responses during social interactions. Given rapid advances in optical imaging, it is a fundamental question how population-averaged neural activity measured by multi-fiber photometry (MFP) for calcium fluorescence signals correlates with social behaviors is a fundamental question. This paper aims to investigate the correspondence between MFP data and social behaviors.Approach:We propose a state-space analysis framework to characterize mouse MFP data based on dynamic latent variable models, which include a continuous-state linear dynamical system and a discrete-state hidden semi-Markov model. We validate these models on extensive MFP recordings during aggressive and mating behaviors in male-male and male-female interactions, respectively.Main results:Our results show that these models are capable of capturing both temporal behavioral structure and associated neural states, and produce interpretable latent states. Our approach is also validated in computer simulations in the presence of known ground truth.Significance:Overall, these analysis approaches provide a state-space framework to examine neural dynamics underlying social behaviors and reveals mechanistic insights into the relevant networks.
Collapse
Affiliation(s)
- Yibo Chen
- Department of Psychiatry, Department of Neuroscience and Physiology, New York University School of Medicine, New York, NY, USA
- Program in Artificial Intelligence, University of Science and Technology of China, Hefei, Anhui, China
- Equal contributions (Y.C. and J.C.)
| | - Jonathan Chien
- Department of Psychiatry, Department of Neuroscience and Physiology, New York University School of Medicine, New York, NY, USA
- Equal contributions (Y.C. and J.C.)
| | - Bing Dai
- Neuroscience Institute, New York University Grossman School of Medicine, New York, NY, USA
| | - Dayu Lin
- Department of Psychiatry, Department of Neuroscience and Physiology, New York University School of Medicine, New York, NY, USA
- Neuroscience Institute, New York University Grossman School of Medicine, New York, NY, USA
- Center for Neural Science, New York University, New York, NY, USA
| | - Zhe Sage Chen
- Department of Psychiatry, Department of Neuroscience and Physiology, New York University School of Medicine, New York, NY, USA
- Neuroscience Institute, New York University Grossman School of Medicine, New York, NY, USA
- Department of Biomedical Engineering, NYU Tandon School of Engineering, Brooklyn, NY, USA
| |
Collapse
|
3
|
Wang R, Chen ZS. Large-scale foundation models and generative AI for BigData neuroscience. Neurosci Res 2024:S0168-0102(24)00075-0. [PMID: 38897235 DOI: 10.1016/j.neures.2024.06.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2023] [Revised: 04/15/2024] [Accepted: 05/15/2024] [Indexed: 06/21/2024]
Abstract
Recent advances in machine learning have led to revolutionary breakthroughs in computer games, image and natural language understanding, and scientific discovery. Foundation models and large-scale language models (LLMs) have recently achieved human-like intelligence thanks to BigData. With the help of self-supervised learning (SSL) and transfer learning, these models may potentially reshape the landscapes of neuroscience research and make a significant impact on the future. Here we present a mini-review on recent advances in foundation models and generative AI models as well as their applications in neuroscience, including natural language and speech, semantic memory, brain-machine interfaces (BMIs), and data augmentation. We argue that this paradigm-shift framework will open new avenues for many neuroscience research directions and discuss the accompanying challenges and opportunities.
Collapse
Affiliation(s)
- Ran Wang
- Department of Psychiatry, New York University Grossman School of Medicine, New York, NY 10016, USA
| | - Zhe Sage Chen
- Department of Psychiatry, New York University Grossman School of Medicine, New York, NY 10016, USA; Department of Neuroscience and Physiology, Neuroscience Institute, New York University Grossman School of Medicine, New York, NY 10016, USA; Department of Biomedical Engineering, New York University Tandon School of Engineering, Brooklyn, NY 11201, USA.
| |
Collapse
|
4
|
Shang CF, Wang YF, Zhao MT, Fan QX, Zhao S, Qian Y, Xu SJ, Mu Y, Hao J, Du JL. Real-time analysis of large-scale neuronal imaging enables closed-loop investigation of neural dynamics. Nat Neurosci 2024; 27:1014-1018. [PMID: 38467902 DOI: 10.1038/s41593-024-01595-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2022] [Accepted: 02/07/2024] [Indexed: 03/13/2024]
Abstract
Large-scale imaging of neuronal activities is crucial for understanding brain functions. However, it is challenging to analyze large-scale imaging data in real time, preventing closed-loop investigation of neural circuitry. Here we develop a real-time analysis system with a field programmable gate array-graphics processing unit design for an up to 500-megabyte-per-second image stream. Adapted to whole-brain imaging of awake larval zebrafish, the system timely extracts activity from up to 100,000 neurons and enables closed-loop perturbations of neural dynamics.
Collapse
Affiliation(s)
- Chun-Feng Shang
- Institute of Neuroscience, State Key Laboratory of Neuroscience, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China
- Guangdong-Hongkong-Macau Institute of CNS Regeneration, Ministry of Education CNS Regeneration Collaborative Joint Laboratory, Jinan University, Guangzhou, China
- Shenzhen Institute of Neuroscience, Shenzhen, China
| | - Yu-Fan Wang
- Institute of Neuroscience, State Key Laboratory of Neuroscience, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Mei-Ting Zhao
- Institute of Automation, Chinese Academy of Sciences, Beijing, China
- Guangdong Institute of Artificial Intelligence and Advanced Computing, Guangzhou, China
| | - Qiu-Xiang Fan
- Institute of Automation, Chinese Academy of Sciences, Beijing, China
- Guangdong Institute of Artificial Intelligence and Advanced Computing, Guangzhou, China
| | - Shan Zhao
- Institute of Neuroscience, State Key Laboratory of Neuroscience, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Yu Qian
- Institute of Neuroscience, State Key Laboratory of Neuroscience, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China
| | - Sheng-Jin Xu
- Institute of Neuroscience, State Key Laboratory of Neuroscience, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Yu Mu
- Institute of Neuroscience, State Key Laboratory of Neuroscience, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China.
- University of Chinese Academy of Sciences, Beijing, China.
| | - Jie Hao
- University of Chinese Academy of Sciences, Beijing, China.
- Institute of Automation, Chinese Academy of Sciences, Beijing, China.
- Guangdong Institute of Artificial Intelligence and Advanced Computing, Guangzhou, China.
| | - Jiu-Lin Du
- Institute of Neuroscience, State Key Laboratory of Neuroscience, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China.
- University of Chinese Academy of Sciences, Beijing, China.
- School of Life Science and Technology, ShanghaiTech University, Shanghai, China.
| |
Collapse
|
5
|
Eskandari R, Sawan M. Challenges and Perspectives on Impulse Radio-Ultra-Wideband Transceivers for Neural Recording Applications. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2024; 18:369-382. [PMID: 37938944 DOI: 10.1109/tbcas.2023.3331049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2023]
Abstract
Brain-machine interfaces (BMI) are widely adopted in neuroscience investigations and neural prosthetics, with sensing channel counts constantly increasing. These Investigations place increasing demands for high data rates and low-power implantable devices despite high tissue losses. The Impulse radio ultra-wideband (IR-UWB), a revived wireless technology for short-range radios, has been widely used in various applications. Since the requirements and solutions are application-oriented, in this review paper we focus on neural recording implants with high-data rates and ultra-low power requirements. We examine in detail the working principle, design methodology, performance, and implementations of different architectures of IR-UWB transceivers in a quantitative manner to draw a deep comparison and extract the bottlenecks and possible solutions concerning the dedicated application. Our analysis shows that current solutions rely on enhanced or combined modulation techniques to improve link margin. An in-depth study of prior-art publications that achieved Gbps data rates concludes that edge-combination architecture and non-coherent detectors are remarkable for transmitter and receiver, respectively. Although the aim to minimize power and improve data rate - defined as energy efficiency (pJ/b) - extending communication distance despite high tissue losses and limited power budget, good narrow-band interference (NBI) tolerance coexisted in the same frequency band of UWB systems, and compatibility with energy harvesting designs are among the critical challenges remained unsolved. Furthermore, we expect that the combination of artificial intelligence (AI) and the inherent advantages of UWB radios will pave the way for future improvements in BMIs.
Collapse
|
6
|
Jia Q, Liu Y, Lv S, Wang Y, Jiao P, Xu W, Xu Z, Wang M, Cai X. Wireless closed-loop deep brain stimulation using microelectrode array probes. J Zhejiang Univ Sci B 2024:1-21. [PMID: 38423536 DOI: 10.1631/jzus.b2300400] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2023] [Accepted: 08/25/2023] [Indexed: 03/02/2024]
Abstract
Deep brain stimulation (DBS), including optical stimulation and electrical stimulation, has been demonstrated considerable value in exploring pathological brain activity and developing treatments for neural disorders. Advances in DBS microsystems based on implantable microelectrode array (MEA) probes have opened up new opportunities for closed-loop DBS (CL-DBS) in situ. This technology can be used to detect damaged brain circuits and test the therapeutic potential for modulating the output of these circuits in a variety of diseases simultaneously. Despite the success and rapid utilization of MEA probe-based CL-DBS microsystems, key challenges, including excessive wired communication, need to be urgently resolved. In this review, we considered recent advances in MEA probe-based wireless CL-DBS microsystems and outlined the major issues and promising prospects in this field. This technology has the potential to offer novel therapeutic options for psychiatric disorders in the future.
Collapse
Affiliation(s)
- Qianli Jia
- State Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China
- School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Yaoyao Liu
- State Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China
- School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Shiya Lv
- State Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China
- School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Yiding Wang
- State Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China
- School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Peiyao Jiao
- State Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China
- School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Wei Xu
- State Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China
- School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Zhaojie Xu
- State Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China
- School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Mixia Wang
- State Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China.
- School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China.
| | - Xinxia Cai
- State Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China. ,
- School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China. ,
| |
Collapse
|
7
|
Chen Y, Chien J, Dai B, Lin D, Chen ZS. Identifying behavioral links to neural dynamics of multifiber photometry recordings in a mouse social behavior network. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.12.25.573308. [PMID: 38234793 PMCID: PMC10793434 DOI: 10.1101/2023.12.25.573308] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/19/2024]
Abstract
Distributed hypothalamic-midbrain neural circuits orchestrate complex behavioral responses during social interactions. How population-averaged neural activity measured by multi-fiber photometry (MFP) for calcium fluorescence signals correlates with social behaviors is a fundamental question. We propose a state-space analysis framework to characterize mouse MFP data based on dynamic latent variable models, which include continuous-state linear dynamical system (LDS) and discrete-state hidden semi-Markov model (HSMM). We validate these models on extensive MFP recordings during aggressive and mating behaviors in male-male and male-female interactions, respectively. Our results show that these models are capable of capturing both temporal behavioral structure and associated neural states. Overall, these analysis approaches provide an unbiased strategy to examine neural dynamics underlying social behaviors and reveals mechanistic insights into the relevant networks.
Collapse
Affiliation(s)
- Yibo Chen
- Department of Psychiatry, Department of Neuroscience and Physiology, New York University School of Medicine, New York, NY, USA
- Program in Artificial Intelligence, University of Science and Technology of China, Hefei, Anhui, China
| | - Jonathan Chien
- Department of Psychiatry, Department of Neuroscience and Physiology, New York University School of Medicine, New York, NY, USA
| | - Bing Dai
- Neuroscience Institute, New York University Grossman School of Medicine, New York, NY, USA
| | - Dayu Lin
- Department of Psychiatry, Department of Neuroscience and Physiology, New York University School of Medicine, New York, NY, USA
- Neuroscience Institute, New York University Grossman School of Medicine, New York, NY, USA
- Center for Neural Science, New York University, New York, NY, USA
| | - Zhe Sage Chen
- Department of Psychiatry, Department of Neuroscience and Physiology, New York University School of Medicine, New York, NY, USA
- Neuroscience Institute, New York University Grossman School of Medicine, New York, NY, USA
- Department of Biomedical Engineering, NYU Tandon School of Engineering, Brooklyn, NY, USA
| |
Collapse
|
8
|
Yang M, Wang J, Li S, Wang K, Yue W, Liu C. Adaptive closed-loop paradigm of electrophysiology for neuron models. Neural Netw 2023; 165:406-419. [PMID: 37329784 DOI: 10.1016/j.neunet.2023.05.050] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2022] [Revised: 12/15/2022] [Accepted: 05/27/2023] [Indexed: 06/19/2023]
Abstract
The traditional electrophysiological experiments based on an open-loop paradigm are relatively complicated and limited when facing an individual neuron with uncertain nonlinear factors. Emerging neural technologies enable tremendous growth in experimental data leading to the curse of high-dimensional data, which obstructs the mechanism exploration of spiking activities in the neurons. In this work, we propose an adaptive closed-loop electrophysiology simulation experimental paradigm based on a Radial Basis Function neural network and a highly nonlinear unscented Kalman filter. On account of the complex nonlinear dynamic characteristics of the real neurons, the proposed simulation experimental paradigm could fit the unknown neuron models with different channel parameters and different structures (i.e. single or multiple compartments), and further compute the injected stimulus in time according to the arbitrary desired spiking activities of the neurons. However, the hidden electrophysiological states of the neurons are difficult to be measured directly. Thus, an extra Unscented Kalman filter modular is incorporated in the closed-loop electrophysiology experimental paradigm. The numerical results and theoretical analyses demonstrate that the proposed adaptive closed-loop electrophysiology simulation experimental paradigm achieves desired spiking activities arbitrarily and the hidden dynamics of the neurons are visualized by the unscented Kalman filter modular. The proposed adaptive closed-loop simulation experimental paradigm can avoid the inefficiency of data at increasingly greater scales and enhance the scalability of electrophysiological experiments, thus speeding up the discovery cycle on neuroscience.
Collapse
Affiliation(s)
- Ming Yang
- School of Electrical and Information Engineering, Tianjin University, Tianjin, China
| | - Jiang Wang
- School of Electrical and Information Engineering, Tianjin University, Tianjin, China
| | - Shanshan Li
- School of Electrical and Automation Engineering, Tianjin University of Technology and Education, Tianjin, China
| | - Kuanchuan Wang
- School of Electrical and Information Engineering, Tianjin University, Tianjin, China
| | - Wei Yue
- Tianjin Key Laboratory of Cerebral Vascular and Neurodegenerative Diseases, Tianjin Huanhu Hospital, Tianjin, China
| | - Chen Liu
- School of Electrical and Information Engineering, Tianjin University, Tianjin, China.
| |
Collapse
|
9
|
Suzuki I, Matsuda N, Han X, Noji S, Shibata M, Nagafuku N, Ishibashi Y. Large-Area Field Potential Imaging Having Single Neuron Resolution Using 236 880 Electrodes CMOS-MEA Technology. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2023:e2207732. [PMID: 37088859 PMCID: PMC10369302 DOI: 10.1002/advs.202207732] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/29/2022] [Revised: 03/21/2023] [Indexed: 05/03/2023]
Abstract
The electrophysiological technology having a high spatiotemporal resolution at the single-cell level and noninvasive measurements of large areas provide insights on underlying neuronal function. Here, a complementary metal-oxide semiconductor (CMOS)-microelectrode array (MEA) is used that uses 236 880 electrodes each with an electrode size of 11.22 × 11.22 µm and 236 880 covering a wide area of 5.5 × 5.9 mm in presenting a detailed and single-cell-level neural activity analysis platform for brain slices, human iPS cell-derived cortical networks, peripheral neurons, and human brain organoids. Propagation pattern characteristics between brain regions changes the synaptic propagation into compounds based on single-cell time-series patterns, classification based on single DRG neuron firing patterns and compound responses, axonal conduction characteristics and changes to anticancer drugs, and network activities and transition to compounds in brain organoids are extracted. This detailed analysis of neural activity at the single-cell level using the CMOS-MEA provides a new understanding of the basic mechanisms of brain circuits in vitro and ex vivo, on human neurological diseases for drug discovery, and compound toxicity assessment.
Collapse
Affiliation(s)
- Ikuro Suzuki
- Department of Electronics, Graduate School of Engineering, Tohoku Institute of Technology, 35-1 Yagiyama Kasumicho, Taihaku-ku, Sendai, Miyagi, 982-8577, Japan
| | - Naoki Matsuda
- Department of Electronics, Graduate School of Engineering, Tohoku Institute of Technology, 35-1 Yagiyama Kasumicho, Taihaku-ku, Sendai, Miyagi, 982-8577, Japan
| | - Xiaobo Han
- Department of Electronics, Graduate School of Engineering, Tohoku Institute of Technology, 35-1 Yagiyama Kasumicho, Taihaku-ku, Sendai, Miyagi, 982-8577, Japan
| | - Shuhei Noji
- Department of Electronics, Graduate School of Engineering, Tohoku Institute of Technology, 35-1 Yagiyama Kasumicho, Taihaku-ku, Sendai, Miyagi, 982-8577, Japan
| | - Mikako Shibata
- Department of Electronics, Graduate School of Engineering, Tohoku Institute of Technology, 35-1 Yagiyama Kasumicho, Taihaku-ku, Sendai, Miyagi, 982-8577, Japan
| | - Nami Nagafuku
- Department of Electronics, Graduate School of Engineering, Tohoku Institute of Technology, 35-1 Yagiyama Kasumicho, Taihaku-ku, Sendai, Miyagi, 982-8577, Japan
| | - Yuto Ishibashi
- Department of Electronics, Graduate School of Engineering, Tohoku Institute of Technology, 35-1 Yagiyama Kasumicho, Taihaku-ku, Sendai, Miyagi, 982-8577, Japan
| |
Collapse
|
10
|
Chen ZS, Wilson MA. How our understanding of memory replay evolves. J Neurophysiol 2023; 129:552-580. [PMID: 36752404 PMCID: PMC9988534 DOI: 10.1152/jn.00454.2022] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2022] [Revised: 01/20/2023] [Accepted: 01/20/2023] [Indexed: 02/09/2023] Open
Abstract
Memory reactivations and replay, widely reported in the hippocampus and cortex across species, have been implicated in memory consolidation, planning, and spatial and skill learning. Technological advances in electrophysiology, calcium imaging, and human neuroimaging techniques have enabled neuroscientists to measure large-scale neural activity with increasing spatiotemporal resolution and have provided opportunities for developing robust analytic methods to identify memory replay. In this article, we first review a large body of historically important and representative memory replay studies from the animal and human literature. We then discuss our current understanding of memory replay functions in learning, planning, and memory consolidation and further discuss the progress in computational modeling that has contributed to these improvements. Next, we review past and present analytic methods for replay analyses and discuss their limitations and challenges. Finally, looking ahead, we discuss some promising analytic methods for detecting nonstereotypical, behaviorally nondecodable structures from large-scale neural recordings. We argue that seamless integration of multisite recordings, real-time replay decoding, and closed-loop manipulation experiments will be essential for delineating the role of memory replay in a wide range of cognitive and motor functions.
Collapse
Affiliation(s)
- Zhe Sage Chen
- Department of Psychiatry, New York University Grossman School of Medicine, New York, New York, United States
- Department of Neuroscience and Physiology, New York University Grossman School of Medicine, New York, New York, United States
- Neuroscience Institute, New York University Grossman School of Medicine, New York, New York, United States
- Department of Biomedical Engineering, New York University Tandon School of Engineering, Brooklyn, New York, United States
| | - Matthew A Wilson
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States
- Picower Institute for Learning and Memory, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States
| |
Collapse
|
11
|
Chen ZS, Kulkarni P(P, Galatzer-Levy IR, Bigio B, Nasca C, Zhang Y. Modern views of machine learning for precision psychiatry. PATTERNS (NEW YORK, N.Y.) 2022; 3:100602. [PMID: 36419447 PMCID: PMC9676543 DOI: 10.1016/j.patter.2022.100602] [Citation(s) in RCA: 21] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Abstract
In light of the National Institute of Mental Health (NIMH)'s Research Domain Criteria (RDoC), the advent of functional neuroimaging, novel technologies and methods provide new opportunities to develop precise and personalized prognosis and diagnosis of mental disorders. Machine learning (ML) and artificial intelligence (AI) technologies are playing an increasingly critical role in the new era of precision psychiatry. Combining ML/AI with neuromodulation technologies can potentially provide explainable solutions in clinical practice and effective therapeutic treatment. Advanced wearable and mobile technologies also call for the new role of ML/AI for digital phenotyping in mobile mental health. In this review, we provide a comprehensive review of ML methodologies and applications by combining neuroimaging, neuromodulation, and advanced mobile technologies in psychiatry practice. We further review the role of ML in molecular phenotyping and cross-species biomarker identification in precision psychiatry. We also discuss explainable AI (XAI) and neuromodulation in a closed human-in-the-loop manner and highlight the ML potential in multi-media information extraction and multi-modal data fusion. Finally, we discuss conceptual and practical challenges in precision psychiatry and highlight ML opportunities in future research.
Collapse
Affiliation(s)
- Zhe Sage Chen
- Department of Psychiatry, New York University Grossman School of Medicine, New York, NY 10016, USA
- Department of Neuroscience and Physiology, New York University Grossman School of Medicine, New York, NY 10016, USA
- The Neuroscience Institute, New York University Grossman School of Medicine, New York, NY 10016, USA
- Department of Biomedical Engineering, New York University Tandon School of Engineering, Brooklyn, NY 11201, USA
| | | | - Isaac R. Galatzer-Levy
- Department of Psychiatry, New York University Grossman School of Medicine, New York, NY 10016, USA
- Meta Reality Lab, New York, NY, USA
| | - Benedetta Bigio
- Department of Psychiatry, New York University Grossman School of Medicine, New York, NY 10016, USA
| | - Carla Nasca
- Department of Psychiatry, New York University Grossman School of Medicine, New York, NY 10016, USA
- The Neuroscience Institute, New York University Grossman School of Medicine, New York, NY 10016, USA
| | - Yu Zhang
- Department of Bioengineering, Lehigh University, Bethlehem, PA 18015, USA
- Department of Electrical and Computer Engineering, Lehigh University, Bethlehem, PA 18015, USA
| |
Collapse
|
12
|
Chung JE, Sellers KK, Leonard MK, Gwilliams L, Xu D, Dougherty ME, Kharazia V, Metzger SL, Welkenhuysen M, Dutta B, Chang EF. High-density single-unit human cortical recordings using the Neuropixels probe. Neuron 2022; 110:2409-2421.e3. [PMID: 35679860 DOI: 10.1016/j.neuron.2022.05.007] [Citation(s) in RCA: 25] [Impact Index Per Article: 12.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2022] [Revised: 04/10/2022] [Accepted: 05/10/2022] [Indexed: 10/18/2022]
Abstract
The action potential is a fundamental unit of neural computation. Even though significant advances have been made in recording large numbers of individual neurons in animal models, translation of these methodologies to humans has been limited because of clinical constraints and electrode reliability. Here, we present a reliable method for intraoperative recording of dozens of neurons in humans using the Neuropixels probe, yielding up to ∼100 simultaneously recorded single units. Most single units were active within 1 min of reaching target depth. The motion of the electrode array had a strong inverse correlation with yield, identifying a major challenge and opportunity to further increase the probe utility. Cell pairs active close in time were spatially closer in most recordings, demonstrating the power to resolve complex cortical dynamics. Altogether, this approach provides access to population single-unit activity across the depth of human neocortex at scales previously only accessible in animal models.
Collapse
Affiliation(s)
- Jason E Chung
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA 94143, USA
| | - Kristin K Sellers
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA 94143, USA; Weill Institute for Neuroscience, University of California, San Francisco, San Francisco, CA 94158, USA
| | - Matthew K Leonard
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA 94143, USA; Weill Institute for Neuroscience, University of California, San Francisco, San Francisco, CA 94158, USA
| | - Laura Gwilliams
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA 94143, USA; Weill Institute for Neuroscience, University of California, San Francisco, San Francisco, CA 94158, USA
| | - Duo Xu
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA 94143, USA; Weill Institute for Neuroscience, University of California, San Francisco, San Francisco, CA 94158, USA
| | - Maximilian E Dougherty
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA 94143, USA; Weill Institute for Neuroscience, University of California, San Francisco, San Francisco, CA 94158, USA
| | - Viktor Kharazia
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA 94143, USA
| | - Sean L Metzger
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA 94143, USA; Weill Institute for Neuroscience, University of California, San Francisco, San Francisco, CA 94158, USA; University of California Berkeley, University of California, San Francisco Graduate Program in Bioengineering, Berkeley, CA 94720, USA
| | | | | | - Edward F Chang
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA 94143, USA; Weill Institute for Neuroscience, University of California, San Francisco, San Francisco, CA 94158, USA.
| |
Collapse
|
13
|
Ouyang G, Dien J, Lorenz R. Handling EEG artifacts and searching individually optimal experimental parameter in real time: a system development and demonstration. J Neural Eng 2022; 19. [PMID: 34902847 DOI: 10.1088/1741-2552/ac42b6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2021] [Accepted: 12/13/2021] [Indexed: 02/02/2023]
Abstract
Objective.Neuroadaptive paradigms that systematically assess event-related potential (ERP) features across many different experimental parameters have the potential to improve the generalizability of ERP findings and may help to accelerate ERP-based biomarker discovery by identifying the exact experimental conditions for which ERPs differ most for a certain clinical population. Obtaining robust and reliable ERPs online is a prerequisite for ERP-based neuroadaptive research. One of the key steps involved is to correctly isolate electroencephalography artifacts in real time because they contribute a large amount of variance that, if not removed, will greatly distort the ERP obtained. Another key factor of concern is the computational cost of the online artifact handling method. This work aims to develop and validate a cost-efficient system to support ERP-based neuroadaptive research.Approach.We developed a simple online artifact handling method, single trial PCA-based artifact removal (SPA), based on variance distribution dichotomies to distinguish between artifacts and neural activity. We then applied this method in an ERP-based neuroadaptive paradigm in which Bayesian optimization was used to search individually optimal inter-stimulus-interval (ISI) that generates ERP with the highest signal-to-noise ratio.Main results.SPA was compared to other offline and online algorithms. The results showed that SPA exhibited good performance in both computational efficiency and preservation of ERP pattern. Based on SPA, the Bayesian optimization procedure was able to quickly find individually optimal ISI.Significance.The current work presents a simple yet highly cost-efficient method that has been validated in its ability to extract ERP, preserve ERP effects, and better support ERP-based neuroadaptive paradigm.
Collapse
Affiliation(s)
- Guang Ouyang
- Faculty of Education, The University of Hong Kong, Hong Kong, People's Republic of China
| | - Joseph Dien
- Department of Human Development and Quantitative Methodology, University of Maryland, College Park, MD, United States of America
| | - Romy Lorenz
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, United Kingdom.,Department of Neurophysics, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.,Department of Psychology, Stanford University, Stanford, CA, United States of America
| |
Collapse
|
14
|
Cao L, Varga V, Chen ZS. Uncovering spatial representations from spatiotemporal patterns of rodent hippocampal field potentials. CELL REPORTS METHODS 2021; 1:100101. [PMID: 34888543 PMCID: PMC8654278 DOI: 10.1016/j.crmeth.2021.100101] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/09/2021] [Revised: 07/27/2021] [Accepted: 09/28/2021] [Indexed: 12/23/2022]
Abstract
Spatiotemporal patterns of large-scale spiking and field potentials of the rodent hippocampus encode spatial representations during maze runs, immobility, and sleep. Here, we show that multisite hippocampal field potential amplitude at ultra-high-frequency band (FPAuhf), a generalized form of multiunit activity, provides not only a fast and reliable reconstruction of the rodent's position when awake, but also a readout of replay content during sharp-wave ripples. This FPAuhf feature may serve as a robust real-time decoding strategy from large-scale recordings in closed-loop experiments. Furthermore, we develop unsupervised learning approaches to extract low-dimensional spatiotemporal FPAuhf features during run and ripple periods and to infer latent dynamical structures from lower-rank FPAuhf features. We also develop an optical flow-based method to identify propagating spatiotemporal LFP patterns from multisite array recordings, which can be used as a decoding application. Finally, we develop a prospective decoding strategy to predict an animal's future decision in goal-directed navigation.
Collapse
Affiliation(s)
- Liang Cao
- The Neuroscience Institute, New York University Grossman School of Medicine, New York, NY 10016, USA
- Department of Physics, East China Normal University, Shanghai 200241, China
| | - Viktor Varga
- The Neuroscience Institute, New York University Grossman School of Medicine, New York, NY 10016, USA
- Institute of Experimental Medicine, 43 Szigony Street, 1083 Budapest, Hungary
| | - Zhe S. Chen
- The Neuroscience Institute, New York University Grossman School of Medicine, New York, NY 10016, USA
- Department of Psychiatry, Department of Neuroscience and Physiology, New York University Grossman School of Medicine, New York, NY 10016, USA
| |
Collapse
|
15
|
Chen ZS. Decoding pain from brain activity. J Neural Eng 2021; 18. [PMID: 34608868 DOI: 10.1088/1741-2552/ac28d4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2021] [Accepted: 09/21/2021] [Indexed: 11/12/2022]
Abstract
Pain is a dynamic, complex and multidimensional experience. The identification of pain from brain activity as neural readout may effectively provide a neural code for pain, and further provide useful information for pain diagnosis and treatment. Advances in neuroimaging and large-scale electrophysiology have enabled us to examine neural activity with improved spatial and temporal resolution, providing opportunities to decode pain in humans and freely behaving animals. This topical review provides a systematical overview of state-of-the-art methods for decoding pain from brain signals, with special emphasis on electrophysiological and neuroimaging modalities. We show how pain decoding analyses can help pain diagnosis and discovery of neurobiomarkers for chronic pain. Finally, we discuss the challenges in the research field and point to several important future research directions.
Collapse
Affiliation(s)
- Zhe Sage Chen
- Department of Psychiatry, Department of Neuroscience and Physiology, Neuroscience Institute, Interdisciplinary Pain Research Program, New York University Grossman School of Medicine, New York, NY 10016, United States of America
| |
Collapse
|