1
|
Kay K, Bonnen K, Denison RN, Arcaro MJ, Barack DL. Tasks and their role in visual neuroscience. Neuron 2023; 111:1697-1713. [PMID: 37040765 DOI: 10.1016/j.neuron.2023.03.022] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2023] [Revised: 03/13/2023] [Accepted: 03/15/2023] [Indexed: 04/13/2023]
Abstract
Vision is widely used as a model system to gain insights into how sensory inputs are processed and interpreted by the brain. Historically, careful quantification and control of visual stimuli have served as the backbone of visual neuroscience. There has been less emphasis, however, on how an observer's task influences the processing of sensory inputs. Motivated by diverse observations of task-dependent activity in the visual system, we propose a framework for thinking about tasks, their role in sensory processing, and how we might formally incorporate tasks into our models of vision.
Collapse
Affiliation(s)
- Kendrick Kay
- Center for Magnetic Resonance Research, Department of Radiology, University of Minnesota, Minneapolis, MN 55455, USA.
| | - Kathryn Bonnen
- School of Optometry, Indiana University, Bloomington, IN 47405, USA
| | - Rachel N Denison
- Department of Psychological and Brain Sciences, Boston University, Boston, MA 02215, USA
| | - Mike J Arcaro
- Department of Psychology, University of Pennsylvania, Philadelphia, PA 19146, USA
| | - David L Barack
- Departments of Neuroscience and Philosophy, University of Pennsylvania, Philadelphia, PA 19146, USA
| |
Collapse
|
2
|
Yang X, Chen Q, Jian T, Du H, Jin W, Liang M, Wang R, Chen X, Liao X, Qin H. Optrode recording of an entorhinal-cortical circuit in freely moving mice. BIOMEDICAL OPTICS EXPRESS 2023; 14:1911-1922. [PMID: 37206131 PMCID: PMC10191667 DOI: 10.1364/boe.487191] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/08/2023] [Revised: 03/20/2023] [Accepted: 03/21/2023] [Indexed: 05/21/2023]
Abstract
The deep layers of medial entorhinal cortex (MEC) are considered a crucial station for spatial cognition and memory. The deep sublayer Va of MEC (MECVa) serves as the output stage of the entorhinal-hippocampal system and sends extensive projections to brain cortical areas. However, the functional heterogeneity of these efferent neurons in MECVa is poorly understood, due to the difficulty of performing single-neuron activity recording from the narrow band of cell population while the animals are behaving. In the current study, we combined multi-electrode electrophysiological recording and optical stimulation to record cortical-projecting MECVa neurons at single-neuron resolution in freely moving mice. First, injection of a viral Cre-LoxP system was used to express channelrhodopsin-2 specifically in MECVa neurons that project to the medial part of the secondary visual cortex (V2M-projecting MECVa neurons). Then, a lightweight, self-made optrode was implanted into MECVa to identify the V2M-projecting MECVa neurons and to enable single-neuron activity recordings in mice performing the open field test and 8-arm radial maze. Our results demonstrate that optrode approach is an accessible and reliable method for single-neuron recording of V2M-projecting MECVa neurons in freely moving mice, paving the way for future circuit studies designed to characterize the activity of MECVa neurons during specific tasks.
Collapse
Affiliation(s)
- Xinyu Yang
- Center for Neurointelligence, School of Medicine, Chongqing University, Chongqing 400044, China
| | - Qianwei Chen
- Brain Research Center and State Key Laboratory of Trauma, Burns, and Combined Injury, Third Military Medical University, Chongqing 400038, China
| | - Tingliang Jian
- Brain Research Center and State Key Laboratory of Trauma, Burns, and Combined Injury, Third Military Medical University, Chongqing 400038, China
- Farm Animal Genetic Resources Exploration and Innovation Key Laboratory of Sichuan Province, Sichuan Agricultural University, China
| | - Haoran Du
- Center for Neurointelligence, School of Medicine, Chongqing University, Chongqing 400044, China
| | - Wenjun Jin
- Brain Research Center and State Key Laboratory of Trauma, Burns, and Combined Injury, Third Military Medical University, Chongqing 400038, China
| | - Mengru Liang
- Department of Anatomy, School of Basic Medical Sciences, Anhui Medical University, Hefei 230032, China
| | - Rui Wang
- Brain Research Center and State Key Laboratory of Trauma, Burns, and Combined Injury, Third Military Medical University, Chongqing 400038, China
| | - Xiaowei Chen
- Brain Research Center and State Key Laboratory of Trauma, Burns, and Combined Injury, Third Military Medical University, Chongqing 400038, China
- Chongqing Institute for Brain and Intelligence, Guangyang Bay Laboratory, Chongqing 400064, China
| | - Xiang Liao
- Center for Neurointelligence, School of Medicine, Chongqing University, Chongqing 400044, China
| | - Han Qin
- Center for Neurointelligence, School of Medicine, Chongqing University, Chongqing 400044, China
| |
Collapse
|
3
|
Zaraza D, Chernov MM, Yang Y, Rogers JA, Roe AW, Friedman RM. Head-mounted optical imaging and optogenetic stimulation system for use in behaving primates. CELL REPORTS METHODS 2022; 2:100351. [PMID: 36590689 PMCID: PMC9795332 DOI: 10.1016/j.crmeth.2022.100351] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/25/2022] [Revised: 08/25/2022] [Accepted: 10/27/2022] [Indexed: 11/23/2022]
Abstract
Advances in optical technology have revolutionized studies of brain function in freely behaving mice. Here, we describe an optical imaging and stimulation device for use in primates that easily attaches to an intracranial chamber. It consists of affordable commercially available or 3D-printed components: a monochromatic camera, a small standard lens, a wireless μLED stimulator powered by an induction coil, and an LED array for illumination. We show that the intrinsic imaging performance of this device is comparable to a standard benchtop system in revealing the functional organization of the visual cortex for awake macaques in a primate chair or under anesthesia. Imaging revealed neural modulatory effects of wireless focal optogenetic stimulation aimed at identified functional domains. With a 1 to 2 cm field of view, 100× larger than previously used in primates without head restraint, our device permits widefield optical imaging and optogenetic stimulation for ethological studies in primates.
Collapse
Affiliation(s)
- Derek Zaraza
- Division of Neuroscience, Oregon National Primate Research Center, Oregon Health and Science University, Beaverton, OR 97006, USA
| | - Mykyta M. Chernov
- Division of Neuroscience, Oregon National Primate Research Center, Oregon Health and Science University, Beaverton, OR 97006, USA
| | - Yiyuan Yang
- Department of Materials Science and Engineering, Northwestern University, Evanston, IL 60208, USA
| | - John A. Rogers
- Department of Materials Science and Engineering, Northwestern University, Evanston, IL 60208, USA
| | - Anna W. Roe
- Division of Neuroscience, Oregon National Primate Research Center, Oregon Health and Science University, Beaverton, OR 97006, USA
| | - Robert M. Friedman
- Division of Neuroscience, Oregon National Primate Research Center, Oregon Health and Science University, Beaverton, OR 97006, USA
| |
Collapse
|
4
|
Silvernagel MP, Ling AS, Nuyujukian P. A markerless platform for ambulatory systems neuroscience. Sci Robot 2021; 6:eabj7045. [PMID: 34516749 DOI: 10.1126/scirobotics.abj7045] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2023]
Abstract
Motor systems neuroscience seeks to understand how the brain controls movement. To minimize confounding variables, large-animal studies typically constrain body movement from areas not under observation, ensuring consistent, repeatable behaviors. Such studies have fueled decades of research, but they may be artificially limiting the richness of neural data observed, preventing generalization to more natural movements and settings. Neuroscience studies of unconstrained movement would capture a greater range of behavior and a more complete view of neuronal activity, but instrumenting an experimental rig suitable for large animals presents substantial engineering challenges. Here, we present a markerless, full-body motion tracking and synchronized wireless neural electrophysiology platform for large, ambulatory animals. Composed of four depth (RGB-D) cameras that provide a 360° view of a 4.5-square-meters enclosed area, this system is designed to record a diverse range of neuroethologically relevant behaviors. This platform also allows for the simultaneous acquisition of hundreds of wireless neural recording channels in multiple brain regions. As behavioral and neuronal data are generated at rates below 200 megabytes per second, a single desktop can facilitate hours of continuous recording. This setup is designed for systems neuroscience and neuroengineering research, where synchronized kinematic behavior and neural data are the foundation for investigation. By enabling the study of previously unexplored movement tasks, this system can generate insights into the functioning of the mammalian motor system and provide a platform to develop brain-machine interfaces for unconstrained applications.
Collapse
Affiliation(s)
| | - Alissa S Ling
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
| | - Paul Nuyujukian
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA.,Department of Bioengineering, Stanford University, Stanford, CA, USA.,Department of Neurosurgery, Stanford University, Stanford, CA, USA.,Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA.,Stanford Bio-X, Stanford University, Stanford, CA, USA
| | | |
Collapse
|
5
|
Bollimunta A, Santacruz SR, Eaton RW, Xu PS, Morrison JH, Moxon KA, Carmena JM, Nassi JJ. Head-mounted microendoscopic calcium imaging in dorsal premotor cortex of behaving rhesus macaque. Cell Rep 2021; 35:109239. [PMID: 34133921 PMCID: PMC8236375 DOI: 10.1016/j.celrep.2021.109239] [Citation(s) in RCA: 26] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2020] [Revised: 04/07/2021] [Accepted: 05/18/2021] [Indexed: 01/07/2023] Open
Abstract
Microendoscopic calcium imaging with one-photon miniature microscopes enables unprecedented readout of neural circuit dynamics during active behavior in rodents. In this study, we describe successful application of this technology in the rhesus macaque, demonstrating plug-and-play, head-mounted recordings of cellular-resolution calcium dynamics from large populations of neurons simultaneously in bilateral dorsal premotor cortices during performance of a naturalistic motor reach task. Imaging is stable over several months, allowing us to longitudinally track individual neurons and monitor their relationship to motor behavior over time. We observe neuronal calcium dynamics selective for reach direction, which we could use to decode the animal's trial-by-trial motor behavior. This work establishes head-mounted microendoscopic calcium imaging in macaques as a powerful approach for studying the neural circuit mechanisms underlying complex and clinically relevant behaviors, and it promises to greatly advance our understanding of human brain function, as well as its dysfunction in neurological disease.
Collapse
Affiliation(s)
- Anil Bollimunta
- Inscopix, Inc., 2462 Embarcadero Way, Palo Alto, CA 94303, USA,These authors contributed equally
| | - Samantha R. Santacruz
- Department of Electrical Engineering and Computer Science, Helen Wills Neuroscience Institute, University of California, Berkeley, 286 Li Ka Shing, MC #3370, Berkeley, CA 94720, USA,Department of Biomedical Engineering, Institute for Neuroscience, The University of Texas at Austin, 107 W. Dean Keeton Street, Stop C0800, Austin, TX 78712, USA,These authors contributed equally
| | - Ryan W. Eaton
- Department of Biomedical Engineering, University of California, Davis, 3141 Health Sciences Drive, Davis, CA 95616, USA,California National Primate Research Center, University of California, Davis, One Shields Avenue, Davis, CA 95616, USA
| | - Pei S. Xu
- Inscopix, Inc., 2462 Embarcadero Way, Palo Alto, CA 94303, USA
| | - John H. Morrison
- California National Primate Research Center, University of California, Davis, One Shields Avenue, Davis, CA 95616, USA,Department of Neurology, School of Medicine, University of California Davis, Davis, One Shields Avenue, Davis, CA 95616, USA
| | - Karen A. Moxon
- Department of Biomedical Engineering, University of California, Davis, 3141 Health Sciences Drive, Davis, CA 95616, USA,California National Primate Research Center, University of California, Davis, One Shields Avenue, Davis, CA 95616, USA
| | - Jose M. Carmena
- Department of Electrical Engineering and Computer Science, Helen Wills Neuroscience Institute, University of California, Berkeley, 286 Li Ka Shing, MC #3370, Berkeley, CA 94720, USA,Senior author
| | - Jonathan J. Nassi
- Inscopix, Inc., 2462 Embarcadero Way, Palo Alto, CA 94303, USA,Senior author,Lead contact,Correspondence:
| |
Collapse
|
6
|
Berger M, Agha NS, Gail A. Wireless recording from unrestrained monkeys reveals motor goal encoding beyond immediate reach in frontoparietal cortex. eLife 2020; 9:e51322. [PMID: 32364495 PMCID: PMC7228770 DOI: 10.7554/elife.51322] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2019] [Accepted: 05/02/2020] [Indexed: 11/25/2022] Open
Abstract
System neuroscience of motor cognition regarding the space beyond immediate reach mandates free, yet experimentally controlled movements. We present an experimental environment (Reach Cage) and a versatile visuo-haptic interaction system (MaCaQuE) for investigating goal-directed whole-body movements of unrestrained monkeys. Two rhesus monkeys conducted instructed walk-and-reach movements towards targets flexibly positioned in the cage. We tracked 3D multi-joint arm and head movements using markerless motion capture. Movements show small trial-to-trial variability despite being unrestrained. We wirelessly recorded 192 broad-band neural signals from three cortical sensorimotor areas simultaneously. Single unit activity is selective for different reach and walk-and-reach movements. Walk-and-reach targets could be decoded from premotor and parietal but not motor cortical activity during movement planning. The Reach Cage allows systems-level sensorimotor neuroscience studies with full-body movements in a configurable 3D spatial setting with unrestrained monkeys. We conclude that the primate frontoparietal network encodes reach goals beyond immediate reach during movement planning.
Collapse
Affiliation(s)
- Michael Berger
- Cognitive Neuroscience Laboratory, German Primate Center – Leibniz-Institute for Primate ResearchGoettingenGermany
- Faculty of Biology and Psychology, University of GoettingenGoettingenGermany
| | - Naubahar Shahryar Agha
- Cognitive Neuroscience Laboratory, German Primate Center – Leibniz-Institute for Primate ResearchGoettingenGermany
| | - Alexander Gail
- Cognitive Neuroscience Laboratory, German Primate Center – Leibniz-Institute for Primate ResearchGoettingenGermany
- Faculty of Biology and Psychology, University of GoettingenGoettingenGermany
- Leibniz-ScienceCampus Primate CognitionGoettingenGermany
- Bernstein Center for Computational NeuroscienceGoettingenGermany
| |
Collapse
|
7
|
The brain during free movement - What can we learn from the animal model. Brain Res 2017; 1716:3-15. [PMID: 28893579 DOI: 10.1016/j.brainres.2017.09.003] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2017] [Revised: 08/11/2017] [Accepted: 09/04/2017] [Indexed: 11/21/2022]
Abstract
Animals, just like humans, can freely move. They do so for various important reasons, such as finding food and escaping predators. Observing these behaviors can inform us about the underlying cognitive processes. In addition, while humans can convey complicated information easily through speaking, animals need to move their bodies to communicate. This has prompted many creative solutions by animal neuroscientists to enable studying the brain during movement. In this review, we first summarize how animal researchers record from the brain while an animal is moving, by describing the most common neural recording techniques in animals and how they were adapted to record during movement. We further discuss the challenge of controlling or monitoring sensory input during free movement. However, not only is free movement a necessity to reflect the outcome of certain internal cognitive processes in animals, it is also a fascinating field of research since certain crucial behavioral patterns can only be observed and studied during free movement. Therefore, in a second part of the review, we focus on some key findings in animal research that specifically address the interaction between free movement and brain activity. First, focusing on walking as a fundamental form of free movement, we discuss how important such intentional movements are for understanding processes as diverse as spatial navigation, active sensing, and complex motor planning. Second, we propose the idea of regarding free movement as the expression of a behavioral state. This view can help to understand the general influence of movement on brain function. Together, the technological advancements towards recording from the brain during movement, and the scientific questions asked about the brain engaged in movement, make animal research highly valuable to research into the human "moving brain".
Collapse
|
8
|
A Markerless 3D Computerized Motion Capture System Incorporating a Skeleton Model for Monkeys. PLoS One 2016; 11:e0166154. [PMID: 27812205 PMCID: PMC5094601 DOI: 10.1371/journal.pone.0166154] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2016] [Accepted: 10/04/2016] [Indexed: 12/27/2022] Open
Abstract
In this study, we propose a novel markerless motion capture system (MCS) for monkeys, in which 3D surface images of monkeys were reconstructed by integrating data from four depth cameras, and a skeleton model of the monkey was fitted onto 3D images of monkeys in each frame of the video. To validate the MCS, first, estimated 3D positions of body parts were compared between the 3D MCS-assisted estimation and manual estimation based on visual inspection when a monkey performed a shuttling behavior in which it had to avoid obstacles in various positions. The mean estimation error of the positions of body parts (3-14 cm) and of head rotation (35-43°) between the 3D MCS-assisted and manual estimation were comparable to the errors between two different experimenters performing manual estimation. Furthermore, the MCS could identify specific monkey actions, and there was no false positive nor false negative detection of actions compared with those in manual estimation. Second, to check the reproducibility of MCS-assisted estimation, the same analyses of the above experiments were repeated by a different user. The estimation errors of positions of most body parts between the two experimenters were significantly smaller in the MCS-assisted estimation than in the manual estimation. Third, effects of methamphetamine (MAP) administration on the spontaneous behaviors of four monkeys were analyzed using the MCS. MAP significantly increased head movements, tended to decrease locomotion speed, and had no significant effect on total path length. The results were comparable to previous human clinical data. Furthermore, estimated data following MAP injection (total path length, walking speed, and speed of head rotation) correlated significantly between the two experimenters in the MCS-assisted estimation (r = 0.863 to 0.999). The results suggest that the presented MCS in monkeys is useful in investigating neural mechanisms underlying various psychiatric disorders and developing pharmacological interventions.
Collapse
|
9
|
Abstract
Mirror neurons (MNs) are a fascinating class of cells originally discovered in the ventral premotor cortex (PMv) and, subsequently, in the inferior parietal lobule (IPL) of the macaque, which become active during both the execution and observation of actions. In this review, I will first highlight the mounting evidence indicating that mirroring others’ actions engages a broad system of reciprocally connected cortical areas, which extends well beyond the classical IPL-PMv circuit and might even include subcortical regions such as the basal ganglia. Then, I will present the most recent findings supporting the idea that the observation of one’s own actions, which might play a role in the ontogenetic origin and tuning of MNs, retains a particular relevance within the adult MN system. Finally, I will propose that both cortical and subcortical mechanisms do exist to decouple MN activity from the motor output, in order to render it exploitable for high-order perceptual, cognitive, and even social functions. The findings reviewed here provide an original framework for envisaging the main challenges and experimental directions of future neurophysiological and neuroanatomical studies of the monkey MN system.
Collapse
Affiliation(s)
- Luca Bonini
- Istituto Italiano di Tecnologia, Brain Center for Social and Motor Cognition, and Department of Neuroscience, Parma, Italy
| |
Collapse
|
10
|
White JJ, Lin T, Brown AM, Arancillo M, Lackey EP, Stay TL, Sillitoe RV. An optimized surgical approach for obtaining stable extracellular single-unit recordings from the cerebellum of head-fixed behaving mice. J Neurosci Methods 2016; 262:21-31. [PMID: 26777474 DOI: 10.1016/j.jneumeth.2016.01.010] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2015] [Revised: 12/16/2015] [Accepted: 01/06/2016] [Indexed: 11/29/2022]
Abstract
BACKGROUND Electrophysiological recording approaches are essential for understanding brain function. Among these approaches are various methods of performing single-unit recordings. However, a major hurdle to overcome when recording single units in vivo is stability. Poor stability results in a low signal-to-noise ratio, which makes it challenging to isolate neuronal signals. Proper isolation is needed for differentiating a signal from neighboring cells or the noise inherent to electrophysiology. Insufficient isolation makes it impossible to analyze full action potential waveforms. A common source of instability is an inadequate surgery. Problems during surgery cause blood loss, tissue damage and poor healing of the surrounding tissue, limited access to the target brain region, and, importantly, unreliable fixation points for holding the mouse's head. NEW METHOD We describe an optimized surgical procedure that ensures limited tissue damage and delineate a method for implanting head plates to hold the animal firmly in place. RESULTS Using the cerebellum as a model, we implement an extracellular recording technique to acquire single units from Purkinje cells and cerebellar nuclear neurons in behaving mice. We validate the stability of our method by holding single units after injecting the powerful tremorgenic drug harmaline. We performed multiple structural analyses after recording. COMPARISON WITH EXISTING METHODS Our approach is ideal for studying neuronal function in active mice and valuable for recording single-neuron activity when considerable motion is unavoidable. CONCLUSIONS The surgical principles we present for accessing the cerebellum can be easily adapted to examine the function of neurons in other brain regions.
Collapse
Affiliation(s)
- Joshua J White
- Department of Pathology and Immunology, Department of Neuroscience, Baylor College of Medicine, Jan and Dan Duncan Neurological Research Institute of Texas Children's Hospital, 1250 Moursund Street, Suite 1325, Houston, TX 77030, USA
| | - Tao Lin
- Department of Pathology and Immunology, Department of Neuroscience, Baylor College of Medicine, Jan and Dan Duncan Neurological Research Institute of Texas Children's Hospital, 1250 Moursund Street, Suite 1325, Houston, TX 77030, USA
| | - Amanda M Brown
- Department of Pathology and Immunology, Department of Neuroscience, Baylor College of Medicine, Jan and Dan Duncan Neurological Research Institute of Texas Children's Hospital, 1250 Moursund Street, Suite 1325, Houston, TX 77030, USA
| | - Marife Arancillo
- Department of Pathology and Immunology, Department of Neuroscience, Baylor College of Medicine, Jan and Dan Duncan Neurological Research Institute of Texas Children's Hospital, 1250 Moursund Street, Suite 1325, Houston, TX 77030, USA
| | - Elizabeth P Lackey
- Department of Pathology and Immunology, Department of Neuroscience, Baylor College of Medicine, Jan and Dan Duncan Neurological Research Institute of Texas Children's Hospital, 1250 Moursund Street, Suite 1325, Houston, TX 77030, USA
| | - Trace L Stay
- Department of Pathology and Immunology, Department of Neuroscience, Baylor College of Medicine, Jan and Dan Duncan Neurological Research Institute of Texas Children's Hospital, 1250 Moursund Street, Suite 1325, Houston, TX 77030, USA
| | - Roy V Sillitoe
- Department of Pathology and Immunology, Department of Neuroscience, Baylor College of Medicine, Jan and Dan Duncan Neurological Research Institute of Texas Children's Hospital, 1250 Moursund Street, Suite 1325, Houston, TX 77030, USA.
| |
Collapse
|
11
|
Fernandez-Leon JA, Parajuli A, Franklin R, Sorenson M, Felleman DJ, Hansen BJ, Hu M, Dragoi V. A wireless transmission neural interface system for unconstrained non-human primates. J Neural Eng 2015; 12:056005. [PMID: 26269496 DOI: 10.1088/1741-2560/12/5/056005] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Studying the brain in large animal models in a restrained laboratory rig severely limits our capacity to examine brain circuits in experimental and clinical applications. APPROACH To overcome these limitations, we developed a high-fidelity 96-channel wireless system to record extracellular spikes and local field potentials from the neocortex. A removable, external case of the wireless device is attached to a titanium pedestal placed in the animal skull. Broadband neural signals are amplified, multiplexed, and continuously transmitted as TCP/IP data at a sustained rate of 24 Mbps. A Xilinx Spartan 6 FPGA assembles the digital signals into serial data frames for transmission at 20 kHz though an 802.11n wireless data link on a frequency-shift key-modulated signal at 5.7-5.8 GHz to a receiver up to 10 m away. The system is powered by two CR123A, 3 V batteries for 2 h of operation. MAIN RESULTS We implanted a multi-electrode array in visual area V4 of one anesthetized monkey (Macaca fascicularis) and in the dorsolateral prefrontal cortex (dlPFC) of a freely moving monkey (Macaca mulatta). The implanted recording arrays were electrically stable and delivered broadband neural data over a year of testing. For the first time, we compared dlPFC neuronal responses to the same set of stimuli (food reward) in restrained and freely moving conditions. Although we did not find differences in neuronal responses as a function of reward type in the restrained and unrestrained conditions, there were significant differences in correlated activity. This demonstrates that measuring neural responses in freely moving animals can capture phenomena that are absent in the traditional head-fixed paradigm. SIGNIFICANCE We implemented a wireless neural interface for multi-electrode recordings in freely moving non-human primates, which can potentially move systems neuroscience to a new direction by allowing one to record neural signals while animals interact with their environment.
Collapse
Affiliation(s)
- Jose A Fernandez-Leon
- Department of Neurobiology and Anatomy, University of Texas-Houston Medical School, 6431 Fannin St., Houston, TX 77030, USA. Centre for Computational Neuroscience and Robotics, University of Sussex, Brighton BN1 9QG, UK
| | | | | | | | | | | | | | | |
Collapse
|
12
|
Yang Z, Mei L, Xia F, Luo Q, Fu L, Gong H. Dual-slit confocal light sheet microscopy for in vivo whole-brain imaging of zebrafish. BIOMEDICAL OPTICS EXPRESS 2015; 6:1797-811. [PMID: 26137381 PMCID: PMC4467708 DOI: 10.1364/boe.6.001797] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/11/2015] [Revised: 04/09/2015] [Accepted: 04/12/2015] [Indexed: 05/08/2023]
Abstract
In vivo functional imaging at single-neuron resolution is an important approach to visualize biological processes in neuroscience. Light sheet microscopy (LSM) is a cutting edge in vivo imaging technique that provides micron-scale spatial resolution at high frame rate. Due to the scattering and absorption of tissue, however, conventional LSM is inadequate to resolve cells because of the attenuated signal to noise ratio (SNR). Using dual-beam illumination and confocal dual-slit detection, here a dual-slit confocal LSM is demonstrated to obtain the SNR enhanced images with frame rate twice as high as line confocal LSM method. Through theoretical calculations and experiments, the correlation between the slit's width and SNR was determined to optimize the image quality. In vivo whole brain structural imaging stacks and the functional imaging sequences of single slice were obtained for analysis of calcium activities at single-cell resolution. A two-fold increase in imaging speed of conventional confocal LSM makes it possible to capture the sequence of the neurons' activities and help reveal the potential functional connections in the whole zebrafish's brain.
Collapse
Affiliation(s)
- Zhe Yang
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics-Huazhong University of Science and Technology, Wuhan 430074,
China
- MoE Key Laboratory for Biomedical Photonics, Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan 430074,
China
| | - Li Mei
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics-Huazhong University of Science and Technology, Wuhan 430074,
China
- MoE Key Laboratory for Biomedical Photonics, Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan 430074,
China
| | - Fei Xia
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics-Huazhong University of Science and Technology, Wuhan 430074,
China
- MoE Key Laboratory for Biomedical Photonics, Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan 430074,
China
| | - Qingming Luo
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics-Huazhong University of Science and Technology, Wuhan 430074,
China
- MoE Key Laboratory for Biomedical Photonics, Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan 430074,
China
| | - Ling Fu
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics-Huazhong University of Science and Technology, Wuhan 430074,
China
- MoE Key Laboratory for Biomedical Photonics, Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan 430074,
China
- Correspondence:
| | - Hui Gong
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics-Huazhong University of Science and Technology, Wuhan 430074,
China
- MoE Key Laboratory for Biomedical Photonics, Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan 430074,
China
| |
Collapse
|
13
|
Fan JM, Nuyujukian P, Kao JC, Chestek CA, Ryu SI, Shenoy KV. Intention estimation in brain-machine interfaces. J Neural Eng 2014; 11:016004. [PMID: 24654266 DOI: 10.1088/1741-2560/11/1/016004] [Citation(s) in RCA: 52] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
Abstract
OBJECTIVE The objective of this work was to quantitatively investigate the mechanisms underlying the performance gains of the recently reported 'recalibrated feedback intention-trained Kalman Filter' (ReFIT-KF). APPROACH This was accomplished by designing variants of the ReFIT-KF algorithm and evaluating training and online data to understand the neural basis of this improvement. We focused on assessing the contribution of two training set innovations of the ReFIT-KF algorithm: intention estimation and the two-stage training paradigm. MAIN RESULTS Within the two-stage training paradigm, we found that intention estimation independently increased target acquisition rates by 37% and 59%, respectively, across two monkeys implanted with multiunit intracortical arrays. Intention estimation improved performance by enhancing the tuning properties and the mutual information between the kinematic and neural training data. Furthermore, intention estimation led to fewer shifts in channel tuning between the training set and online control, suggesting that less adaptation was required during online control. Retraining the decoder with online BMI training data also reduced shifts in tuning, suggesting a benefit of training a decoder in the same behavioral context; however, retraining also led to slower online decode velocities. Finally, we demonstrated that one- and two-stage training paradigms performed comparably when intention estimation is applied. SIGNIFICANCE These findings highlight the utility of intention estimation in reducing the need for adaptive strategies and improving the online performance of BMIs, helping to guide future BMI design decisions.
Collapse
|
14
|
Foster JD, Nuyujukian P, Freifeld O, Gao H, Walker R, I Ryu S, H Meng T, Murmann B, J Black M, Shenoy KV. A freely-moving monkey treadmill model. J Neural Eng 2014; 11:046020. [PMID: 24995476 DOI: 10.1088/1741-2560/11/4/046020] [Citation(s) in RCA: 47] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Motor neuroscience and brain-machine interface (BMI) design is based on examining how the brain controls voluntary movement, typically by recording neural activity and behavior from animal models. Recording technologies used with these animal models have traditionally limited the range of behaviors that can be studied, and thus the generality of science and engineering research. We aim to design a freely-moving animal model using neural and behavioral recording technologies that do not constrain movement. APPROACH We have established a freely-moving rhesus monkey model employing technology that transmits neural activity from an intracortical array using a head-mounted device and records behavior through computer vision using markerless motion capture. We demonstrate the flexibility and utility of this new monkey model, including the first recordings from motor cortex while rhesus monkeys walk quadrupedally on a treadmill. MAIN RESULTS Using this monkey model, we show that multi-unit threshold-crossing neural activity encodes the phase of walking and that the average firing rate of the threshold crossings covaries with the speed of individual steps. On a population level, we find that neural state-space trajectories of walking at different speeds have similar rotational dynamics in some dimensions that evolve at the step rate of walking, yet robustly separate by speed in other state-space dimensions. SIGNIFICANCE Freely-moving animal models may allow neuroscientists to examine a wider range of behaviors and can provide a flexible experimental paradigm for examining the neural mechanisms that underlie movement generation across behaviors and environments. For BMIs, freely-moving animal models have the potential to aid prosthetic design by examining how neural encoding changes with posture, environment and other real-world context changes. Understanding this new realm of behavior in more naturalistic settings is essential for overall progress of basic motor neuroscience and for the successful translation of BMIs to people with paralysis.
Collapse
Affiliation(s)
- Justin D Foster
- Department of Electrical Engineering, Stanford University, Stanford, CA 94305, USA
| | | | | | | | | | | | | | | | | | | |
Collapse
|
15
|
Shenoy KV, Sahani M, Churchland MM. Cortical control of arm movements: a dynamical systems perspective. Annu Rev Neurosci 2013; 36:337-59. [PMID: 23725001 DOI: 10.1146/annurev-neuro-062111-150509] [Citation(s) in RCA: 438] [Impact Index Per Article: 39.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Our ability to move is central to everyday life. Investigating the neural control of movement in general, and the cortical control of volitional arm movements in particular, has been a major research focus in recent decades. Studies have involved primarily either attempts to account for single-neuron responses in terms of tuning for movement parameters or attempts to decode movement parameters from populations of tuned neurons. Even though this focus on encoding and decoding has led to many seminal advances, it has not produced an agreed-upon conceptual framework. Interest in understanding the underlying neural dynamics has recently increased, leading to questions such as how does the current population response determine the future population response, and to what purpose? We review how a dynamical systems perspective may help us understand why neural activity evolves the way it does, how neural activity relates to movement parameters, and how a unified conceptual framework may result.
Collapse
Affiliation(s)
- Krishna V Shenoy
- Department of Electrical Engineering, Stanford Institute for Neuro-Innovation and TranslationalNeuroscience, Stanford University, Stanford, CA 94305, USA.
| | | | | |
Collapse
|
16
|
Dethier J, Nuyujukian P, Ryu SI, Shenoy KV, Boahen K. Design and validation of a real-time spiking-neural-network decoder for brain-machine interfaces. J Neural Eng 2013; 10:036008. [PMID: 23574919 DOI: 10.1088/1741-2560/10/3/036008] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
OBJECTIVE Cortically-controlled motor prostheses aim to restore functions lost to neurological disease and injury. Several proof of concept demonstrations have shown encouraging results, but barriers to clinical translation still remain. In particular, intracortical prostheses must satisfy stringent power dissipation constraints so as not to damage cortex. APPROACH One possible solution is to use ultra-low power neuromorphic chips to decode neural signals for these intracortical implants. The first step is to explore in simulation the feasibility of translating decoding algorithms for brain-machine interface (BMI) applications into spiking neural networks (SNNs). MAIN RESULTS Here we demonstrate the validity of the approach by implementing an existing Kalman-filter-based decoder in a simulated SNN using the Neural Engineering Framework (NEF), a general method for mapping control algorithms onto SNNs. To measure this system's robustness and generalization, we tested it online in closed-loop BMI experiments with two rhesus monkeys. Across both monkeys, a Kalman filter implemented using a 2000-neuron SNN has comparable performance to that of a Kalman filter implemented using standard floating point techniques. SIGNIFICANCE These results demonstrate the tractability of SNN implementations of statistical signal processing algorithms on different monkeys and for several tasks, suggesting that a SNN decoder, implemented on a neuromorphic chip, may be a feasible computational platform for low-power fully-implanted prostheses. The validation of this closed-loop decoder system and the demonstration of its robustness and generalization hold promise for SNN implementations on an ultra-low power neuromorphic chip using the NEF.
Collapse
Affiliation(s)
- Julie Dethier
- Department of Bioengineering, Stanford University, Stanford, CA 94305, USA
| | | | | | | | | |
Collapse
|
17
|
Churchland MM, Cunningham JP, Kaufman MT, Foster JD, Nuyujukian P, Ryu SI, Shenoy KV. Neural population dynamics during reaching. Nature 2012; 487:51-6. [PMID: 22722855 PMCID: PMC3393826 DOI: 10.1038/nature11129] [Citation(s) in RCA: 799] [Impact Index Per Article: 66.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2011] [Accepted: 04/05/2012] [Indexed: 11/25/2022]
Abstract
Most theories of motor cortex have assumed that neural activity represents movement parameters. This view derives from what is known about primary visual cortex, where neural activity represents patterns of light. Yet it is unclear how well the analogy between motor and visual cortex holds. Single-neuron responses in motor cortex are complex, and there is marked disagreement regarding which movement parameters are represented. A better analogy might be with other motor systems, where a common principle is rhythmic neural activity. Here we find that motor cortex responses during reaching contain a brief but strong oscillatory component, something quite unexpected for a non-periodic behaviour. Oscillation amplitude and phase followed naturally from the preparatory state, suggesting a mechanistic role for preparatory neural activity. These results demonstrate an unexpected yet surprisingly simple structure in the population response. This underlying structure explains many of the confusing features of individual neural responses.
Collapse
Affiliation(s)
- Mark M Churchland
- Department of Neuroscience, Kavli Institute for Brain Science, David Mahoney Center, Columbia University Medical Center, New York, New York 10032, USA.
| | | | | | | | | | | | | |
Collapse
|
18
|
Nuyujukian P, Fan JM, Gilja V, Kalanithi PS, Chestek CA, Shenoy KV. Monkey models for brain-machine interfaces: the need for maintaining diversity. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2012; 2011:1301-5. [PMID: 22254555 DOI: 10.1109/iembs.2011.6090306] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Brain-machine interfaces (BMIs) aim to help disabled patients by translating neural signals from the brain into control signals for guiding prosthetic arms, computer cursors, and other assistive devices. Animal models are central to the development of these systems and have helped enable the successful translation of the first generation of BMIs. As we move toward next-generation systems, we face the question of which animal models will aid broader patient populations and achieve even higher performance, robustness, and functionality. We review here four general types of rhesus monkey models employed in BMI research, and describe two additional, complementary models. Given the physiological diversity of neurological injury and disease, we suggest a need to maintain the current diversity of animal models and to explore additional alternatives, as each mimic different aspects of injury or disease.
Collapse
Affiliation(s)
- Paul Nuyujukian
- Department of Bioengineering and Stanford Medical School, Stanford University, Stanford, CA 94305, USA.
| | | | | | | | | | | |
Collapse
|
19
|
Delp SL, Ku JP, Pande VS, Sherman MA, Altman RB. Simbios: an NIH national center for physics-based simulation of biological structures. J Am Med Inform Assoc 2011; 19:186-9. [PMID: 22081222 DOI: 10.1136/amiajnl-2011-000488] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022] Open
Abstract
Physics-based simulation provides a powerful framework for understanding biological form and function. Simulations can be used by biologists to study macromolecular assemblies and by clinicians to design treatments for diseases. Simulations help biomedical researchers understand the physical constraints on biological systems as they engineer novel drugs, synthetic tissues, medical devices, and surgical interventions. Although individual biomedical investigators make outstanding contributions to physics-based simulation, the field has been fragmented. Applications are typically limited to a single physical scale, and individual investigators usually must create their own software. These conditions created a major barrier to advancing simulation capabilities. In 2004, we established a National Center for Physics-Based Simulation of Biological Structures (Simbios) to help integrate the field and accelerate biomedical research. In 6 years, Simbios has become a vibrant national center, with collaborators in 16 states and eight countries. Simbios focuses on problems at both the molecular scale and the organismal level, with a long-term goal of uniting these in accurate multiscale simulations.
Collapse
Affiliation(s)
- Scott L Delp
- Department of Bioengineering, Stanford University, Stanford, California 94305-5444, USA
| | | | | | | | | |
Collapse
|
20
|
Roy S, Wang X. Wireless multi-channel single unit recording in freely moving and vocalizing primates. J Neurosci Methods 2011; 203:28-40. [PMID: 21933683 DOI: 10.1016/j.jneumeth.2011.09.004] [Citation(s) in RCA: 52] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2011] [Revised: 08/31/2011] [Accepted: 09/06/2011] [Indexed: 11/29/2022]
Abstract
The ability to record well-isolated action potentials from individual neurons in naturally behaving animals is crucial for understanding neural mechanisms underlying natural behaviors. Traditional neurophysiology techniques, however, require the animal to be restrained which often restricts natural behavior. An example is the common marmoset (Callithrix jacchus), a highly vocal New World primate species, used in our laboratory to study the neural correlates of vocal production and sensory feedback. When restrained by traditional neurophysiological techniques marmoset vocal behavior is severely inhibited. Tethered recording systems, while proven effective in rodents pose limitations in arboreal animals such as the marmoset that typically roam in a three-dimensional environment. To overcome these obstacles, we have developed a wireless neural recording technique that is capable of collecting single-unit data from chronically implanted multi-electrodes in freely moving marmosets. A lightweight, low power and low noise wireless transmitter (headstage) is attached to a multi-electrode array placed in the premotor cortex of the marmoset. The wireless headstage is capable of transmitting 15 channels of neural data with signal-to-noise ratio (SNR) comparable to a tethered system. To minimize radio-frequency (RF) and electro-magnetic interference (EMI), the experiments were conducted within a custom designed RF/EMI and acoustically shielded chamber. The individual electrodes of the multi-electrode array were periodically advanced to densely sample the cortical layers. We recorded single-unit data over a period of several months from the frontal cortex of two marmosets. These recordings demonstrate the feasibility of using our wireless recording method to study single neuron activity in freely roaming primates.
Collapse
Affiliation(s)
- Sabyasachi Roy
- Laboratory of Auditory Neurophysiology, Department of Biomedical Engineering, Johns Hopkins University School of Medicine, Baltimore, MD 21205, USA
| | | |
Collapse
|
21
|
Chestek CA, Gilja V, Nuyujukian P, Foster JD, Fan JM, Kaufman MT, Churchland MM, Rivera-Alvidrez Z, Cunningham JP, Ryu SI, Shenoy KV. Long-term stability of neural prosthetic control signals from silicon cortical arrays in rhesus macaque motor cortex. J Neural Eng 2011; 8:045005. [PMID: 21775782 DOI: 10.1088/1741-2560/8/4/045005] [Citation(s) in RCA: 223] [Impact Index Per Article: 17.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Cortically-controlled prosthetic systems aim to help disabled patients by translating neural signals from the brain into control signals for guiding prosthetic devices. Recent reports have demonstrated reasonably high levels of performance and control of computer cursors and prosthetic limbs, but to achieve true clinical viability, the long-term operation of these systems must be better understood. In particular, the quality and stability of the electrically-recorded neural signals require further characterization. Here, we quantify action potential changes and offline neural decoder performance over 382 days of recording from four intracortical arrays in three animals. Action potential amplitude decreased by 2.4% per month on average over the course of 9.4, 10.4, and 31.7 months in three animals. During most time periods, decoder performance was not well correlated with action potential amplitude (p > 0.05 for three of four arrays). In two arrays from one animal, action potential amplitude declined by an average of 37% over the first 2 months after implant. However, when using simple threshold-crossing events rather than well-isolated action potentials, no corresponding performance loss was observed during this time using an offline decoder. One of these arrays was effectively used for online prosthetic experiments over the following year. Substantial short-term variations in waveforms were quantified using a wireless system for contiguous recording in one animal, and compared within and between days for all three animals. Overall, this study suggests that action potential amplitude declines more slowly than previously supposed, and performance can be maintained over the course of multiple years when decoding from threshold-crossing events rather than isolated action potentials. This suggests that neural prosthetic systems may provide high performance over multiple years in human clinical trials.
Collapse
Affiliation(s)
- Cynthia A Chestek
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
22
|
Thompson CL, Donley EM, Stimpson CD, Horne WI, Vinyard CJ. The influence of experimental manipulations on chewing speed during in vivo laboratory research in tufted capuchins (Cebus apella). AMERICAN JOURNAL OF PHYSICAL ANTHROPOLOGY 2011; 145:402-14. [PMID: 21469081 DOI: 10.1002/ajpa.21514] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/20/2010] [Accepted: 01/30/2011] [Indexed: 11/09/2022]
Abstract
Even though in vivo studies of mastication in living primates are often used to test functional and adaptive hypotheses explaining primate masticatory behavior, we currently have little data addressing how experimental procedures performed in the laboratory influence mastication. The obvious logistical issue in assessing how animal manipulation impacts feeding physiology reflects the difficulty in quantifying mechanical parameters without handling the animal. In this study, we measured chewing cycle duration as a mechanical variable that can be collected remotely to: 1) assess how experimental manipulations affect chewing speed in Cebus apella, 2) compare captive chewing cycle durations to that of wild conspecifics, and 3) document sources of variation (beyond experimental manipulation) impacting captive chewing cycle durations. We find that experimental manipulations do increase chewing cycle durations in C. apella by as much as 152 milliseconds (ms) on average. These slower chewing speeds are mainly an effect of anesthesia (and/or restraint), rather than electrode implantation or more invasive surgical procedures. Comparison of captive and wild C. apella suggest there is no novel effect of captivity on chewing speed, although this cannot unequivocally demonstrate that masticatory mechanics are similar in captive and wild individuals. Furthermore, we document significant differences in cycle durations due to inter-individual variation and food type, although duration did not always significantly correlate with mechanical properties of foods. We advocate that the significant reduction in chewing speed be considered as an appropriate qualification when applying the results of laboratory-based feeding studies to adaptive explanations of primate feeding behaviors.
Collapse
Affiliation(s)
- C L Thompson
- Department of Anthropology, Kent State University, OH 44242, USA.
| | | | | | | | | |
Collapse
|
23
|
Foster JD, Freifeld O, Nuyujukian P, Ryu SI, Black MJ, Shenoy KV. Combining Wireless Neural Recording and Video Capture for the Analysis of Natural Gait. INTERNATIONAL IEEE/EMBS CONFERENCE ON NEURAL ENGINEERING : [PROCEEDINGS]. INTERNATIONAL IEEE EMBS CONFERENCE ON NEURAL ENGINEERING 2011; 2011:613-616. [PMID: 26019730 PMCID: PMC4442696 DOI: 10.1109/ner.2011.5910623] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
Neural control of movement is typically studied in constrained environments where there is a reduced set of possible behaviors. This constraint may unintentionally limit the applicability of findings to the generalized case of unconstrained behavior. We hypothesize that examining the unconstrained state across multiple behavioral contexts will lead to new insights into the neural control of movement and help advance the design of neural prosthetic decode algorithms. However, to pursue electrophysiological studies in such a manner requires a more flexible framework for experimentation. We propose that head-mounted neural recording systems with wireless data transmission, combined with markerless computer-vision based motion tracking, will enable new, less constrained experiments. As a proof-of-concept, we recorded and wirelessly transmitted broadband neural data from 32 electrodes in premotor cortex while acquiring single-camera video of a rhesus macaque walking on a treadmill. We demonstrate the ability to extract behavioral kinematics using an automated computer vision algorithm without use of markers and to predict kinematics from the neural data. Together these advances suggest that a new class of "freely moving monkey" experiments should be possible and should help broaden our understanding of the neural control of movement.
Collapse
Affiliation(s)
- Justin D. Foster
- Department of Electrical Engineering, Stanford University, Stanford, CA 94305 USA
| | - Oren Freifeld
- Division of Applied Mathematics, Brown University, Providence, RI 02912 USA
| | - Paul Nuyujukian
- Bioengineering and Stanford Medical School, Stanford University, Stanford, CA 94305 USA
| | - Stephen I. Ryu
- Department of Neurosurgery, Palo Alto Medical Foundation, Palo Alto, CA 94301 USA
| | | | | |
Collapse
|
24
|
Gilja V, Chestek CA, Diester I, Henderson JM, Deisseroth K, Shenoy KV. Challenges and opportunities for next-generation intracortically based neural prostheses. IEEE Trans Biomed Eng 2011; 58:1891-9. [PMID: 21257365 DOI: 10.1109/tbme.2011.2107553] [Citation(s) in RCA: 120] [Impact Index Per Article: 9.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
Neural prosthetic systems aim to help disabled patients by translating neural signals from the brain into control signals for guiding computer cursors, prosthetic arms, and other assistive devices. Intracortical electrode arrays measure action potentials and local field potentials from individual neurons, or small populations of neurons, in the motor cortices and can provide considerable information for controlling prostheses. Despite several compelling proof-of-concept laboratory animal experiments and an initial human clinical trial, at least three key challenges remain which, if left unaddressed, may hamper the translation of these systems into widespread clinical use. We review these challenges: achieving able-bodied levels of performance across tasks and across environments, achieving robustness across multiple decades, and restoring able-bodied quality proprioception and somatosensation. We also describe some emerging opportunities for meeting these challenges. If these challenges can be largely or fully met, intracortically based neural prostheses may achieve true clinical viability and help increasing numbers of disabled patients.
Collapse
Affiliation(s)
- Vikash Gilja
- Department of Computer Science and SINTN, Stanford University, Stanford, CA 94305, USA.
| | | | | | | | | | | |
Collapse
|
25
|
Shenoy KV, Kaufman MT, Sahani M, Churchland MM. A dynamical systems view of motor preparation: implications for neural prosthetic system design. PROGRESS IN BRAIN RESEARCH 2011; 192:33-58. [PMID: 21763517 DOI: 10.1016/b978-0-444-53355-5.00003-8] [Citation(s) in RCA: 55] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
Neural prosthetic systems aim to help disabled patients suffering from a range of neurological injuries and disease by using neural activity from the brain to directly control assistive devices. This approach in effect bypasses the dysfunctional neural circuitry, such as an injured spinal cord. To do so, neural prostheses depend critically on a scientific understanding of the neural activity that drives them. We review here several recent studies aimed at understanding the neural processes in premotor cortex that precede arm movements and lead to the initiation of movement. These studies were motivated by hypotheses and predictions conceived of within a dynamical systems perspective. This perspective concentrates on describing the neural state using as few degrees of freedom as possible and on inferring the rules that govern the motion of that neural state. Although quite general, this perspective has led to a number of specific predictions that have been addressed experimentally. It is hoped that the resulting picture of the dynamical role of preparatory and movement-related neural activity will be particularly helpful to the development of neural prostheses, which can themselves be viewed as dynamical systems under the control of the larger dynamical system to which they are attached.
Collapse
Affiliation(s)
- Krishna V Shenoy
- Department of Electrical Engineering, Stanford University, Stanford, California, USA.
| | | | | | | |
Collapse
|