Chronic multiunit recordings in behaving animals: advantages and limitations

Correlated activity of cortical neurons survives extensive removal of feedforward sensory input

A fundamental property of brain function is that the spiking activity of cortical neurons is variable and that some of this variability is correlated between neurons. Correlated activity not due to the stimulus arises from shared input but the neuronal circuit mechanisms that result in these noise correlations are not fully understood. Here we tested in the visual system if correlated variability in mid-level area V4 of visual cortex is altered following extensive lesions of primary visual cortex (V1). To this end we recorded longitudinally the neuronal correlations in area V4 of two behaving macaque monkeys before and after a V1 lesion while the monkeys fixated a grey screen. We found that the correlations of neuronal activity survived the lesions in both monkeys. In one monkey, the correlation of multi-unit spiking signals was strongly increased in the first week post-lesion, while in the second monkey, correlated activity was slightly increased, but not greater than some week-by-week fluctuations observed. The typical drop-off of inter-neuronal correlations with cortical distance was preserved after the lesion. Therefore, as V4 noise correlations remain without feedforward input from V1, these results suggest instead that local and/or feedback input seem to be necessary for correlated activity.

Mice Can Use Second-Order, Contrast-Modulated Stimuli to Guide Visual Perception

Visual processing along the primate ventral stream takes place in a hierarchy of areas, characterized by an increase in both complexity of neuronal preferences and invariance to changes of low-level stimulus attributes. A basic type of invariance is form-cue invariance, where neurons have similar preferences in response to first-order stimuli, defined by changes in luminance, and global features of second-order stimuli, defined by changes in texture or contrast. Whether in mice, a now popular model system for early visual processing, visual perception can be guided by second-order stimuli is currently unknown. Here, we probed mouse visual perception and neural responses in areas V1 and LM using various types of second-order, contrast-modulated gratings with static noise carriers. These gratings differ in their spatial frequency composition and thus in their ability to invoke first-order mechanisms exploiting local luminance features. We show that mice can transfer learning of a coarse orientation discrimination task involving first-order, luminance-modulated gratings to the contrast-modulated gratings, albeit with markedly reduced discrimination performance. Consistent with these behavioral results, we demonstrate that neurons in area V1 and LM are less responsive and less selective to contrast-modulated than to luminance-modulated gratings, but respond with broadly similar preferred orientations. We conclude that mice can, at least in a rudimentary form, use second-order stimuli to guide visual perception.

SIGNIFICANCE STATEMENT

To extract object boundaries in natural scenes, the primate visual system does not only rely on differences in local luminance but can also take into account differences in texture or contrast. Whether the mouse, which has a much simpler visual system, can use such second-order information to guide visual perception is unknown. Here we tested mouse perception of second-order, contrast-defined stimuli and measured their neural representations in two areas of visual cortex. We find that mice can use contrast-defined stimuli to guide visual perception, although behavioral performance and neural representations were less robust than for luminance-defined stimuli. These findings shed light on basic steps of feature extraction along the mouse visual cortical hierarchy, which may ultimately lead to object recognition.

Texture Segregation Causes Early Figure Enhancement and Later Ground Suppression in Areas V1 and V4 of Visual Cortex

Segregation of images into figures and background is fundamental for visual perception. Cortical neurons respond more strongly to figural image elements than to background elements, but the mechanisms of figure–ground modulation (FGM) are only partially understood. It is unclear whether FGM in early and mid-level visual cortex is caused by an enhanced response to the figure, a suppressed response to the background, or both.

We studied neuronal activity in areas V1 and V4 in monkeys performing a texture segregation task. We compared texture-defined figures with homogeneous textures and found an early enhancement of the figure representation, and a later suppression of the background. Across neurons, the strength of figure enhancement was independent of the strength of background suppression.

We also examined activity in the different V1 layers. Both figure enhancement and ground suppression were strongest in superficial and deep layers and weaker in layer 4. The current–source density profiles suggested that figure enhancement was caused by stronger synaptic inputs in feedback-recipient layers 1, 2, and 5 and ground suppression by weaker inputs in these layers, suggesting an important role for feedback connections from higher level areas. These results provide new insights into the mechanisms for figure–ground organization.

Simulation of a Real-Time Brain Computer Interface for Detecting a Self-Paced Hitting Task

OBJECTIVES

An invasive brain-computer interface (BCI) is a promising neurorehabilitation device for severely disabled patients. Although some systems have been shown to work well in restricted laboratory settings, their utility must be tested in less controlled, real-time environments. Our objective was to investigate whether a specific motor task could be reliably detected from multiunit intracortical signals from freely moving animals in a simulated, real-time setting.

MATERIALS AND METHODS

Intracortical signals were first obtained from electrodes placed in the primary motor cortex of four rats that were trained to hit a retractable paddle (defined as a "Hit"). In the simulated real-time setting, the signal-to-noise-ratio was first increased by wavelet denoising. Action potentials were detected, and features were extracted (spike count, mean absolute values, entropy, and combination of these features) within pre-defined time windows (200 ms, 300 ms, and 400 ms) to classify the occurrence of a "Hit."

RESULTS

We found higher detection accuracy of a "Hit" (73.1%, 73.4%, and 67.9% for the three window sizes, respectively) when the decision was made based on a combination of features rather than on a single feature. However, the duration of the window length was not statistically significant (p = 0.5).

CONCLUSION

Our results showed the feasibility of detecting a motor task in real time in a less restricted environment compared to environments commonly applied within invasive BCI research, and they showed the feasibility of using information extracted from multiunit recordings, thereby avoiding the time-consuming and complex task of extracting and sorting single units.

Global oscillation regime change by gated inhibition

The role of sensory inputs in the modelling of synchrony regimes is exhibited by means of networks of spiking cells where the relative strength of the inhibitory interaction is controlled by the activation of a linear unit working as a gating variable. Adaptation to stimulus size is determined by the value of a changing length scale, modelled by the time-varying radius of a circular receptive field. In this set-up, 'consolidation' time intervals relevant to attentional effects are shown to depend on the dynamics governing the evolution of the introduced length scale.

Neural Representation of Concurrent Vowels in Macaque Primary Auditory Cortex

Successful speech perception in real-world environments requires that the auditory system segregate competing voices that overlap in frequency and time into separate streams. Vowels are major constituents of speech and are comprised of frequencies (harmonics) that are integer multiples of a common fundamental frequency (F0). The pitch and identity of a vowel are determined by its F0 and spectral envelope (formant structure), respectively. When two spectrally overlapping vowels differing in F0 are presented concurrently, they can be readily perceived as two separate “auditory objects” with pitches at their respective F0s. A difference in pitch between two simultaneous vowels provides a powerful cue for their segregation, which in turn, facilitates their individual identification. The neural mechanisms underlying the segregation of concurrent vowels based on pitch differences are poorly understood. Here, we examine neural population responses in macaque primary auditory cortex (A1) to single and double concurrent vowels (/a/ and /i/) that differ in F0 such that they are heard as two separate auditory objects with distinct pitches. We find that neural population responses in A1 can resolve, via a rate-place code, lower harmonics of both single and double concurrent vowels. Furthermore, we show that the formant structures, and hence the identities, of single vowels can be reliably recovered from the neural representation of double concurrent vowels. We conclude that A1 contains sufficient spectral information to enable concurrent vowel segregation and identification by downstream cortical areas.

Learning a New Selection Rule in Visual and Frontal Cortex

How do you make a decision if you do not know the rules of the game? Models of sensory decision-making suggest that choices are slow if evidence is weak, but they may only apply if the subject knows the task rules. Here, we asked how the learning of a new rule influences neuronal activity in the visual (area V1) and frontal cortex (area FEF) of monkeys. We devised a new icon-selection task. On each day, the monkeys saw 2 new icons (small pictures) and learned which one was relevant. We rewarded eye movements to a saccade target connected to the relevant icon with a curve. Neurons in visual and frontal cortex coded the monkey's choice, because the representation of the selected curve was enhanced. Learning delayed the neuronal selection signals and we uncovered the cause of this delay in V1, where learning to select the relevant icon caused an early suppression of surrounding image elements. These results demonstrate that the learning of a new rule causes a transition from fast and random decisions to a more considerate strategy that takes additional time and they reveal the contribution of visual and frontal cortex to the learning process.

The Effects of Context and Attention on Spiking Activity in Human Early Visual Cortex

Here we report the first quantitative analysis of spiking activity in human early visual cortex. We recorded multi-unit activity from two electrodes in area V2/V3 of a human patient implanted with depth electrodes as part of her treatment for epilepsy. We observed well-localized multi-unit receptive fields with tunings for contrast, orientation, spatial frequency, and size, similar to those reported in the macaque. We also observed pronounced gamma oscillations in the local-field potential that could be used to estimate the underlying spiking response properties. Spiking responses were modulated by visual context and attention. We observed orientation-tuned surround suppression: responses were suppressed by image regions with a uniform orientation and enhanced by orientation contrast. Additionally, responses were enhanced on regions that perceptually segregated from the background, indicating that neurons in the human visual cortex are sensitive to figure-ground structure. Spiking responses were also modulated by object-based attention. When the patient mentally traced a curve through the neurons' receptive fields, the accompanying shift of attention enhanced neuronal activity. These results demonstrate that the tuning properties of cells in the human early visual cortex are similar to those in the macaque and that responses can be modulated by both contextual factors and behavioral relevance. Our results, therefore, imply that the macaque visual system is an excellent model for the human visual cortex.

Testing the assumptions underlying fMRI adaptation using intracortical recordings in area MT

We investigated how neural activity in the middle temporal area of the macaque monkey changes after 3 sec of exposure to a visual stimulus and used this to gain insight into the assumptions underlying the fMRI adaptation method (fMRIa). We studied both changes in tuning curves following weak and strong motion stimuli (adaptation) and the differences between a first and second exposure to the same stimulus (repetition suppression). Typically, tuning curves had smaller amplitudes and narrower tuning widths after strong adaptation; this was true for single neurons, multi-unit activity (MUA), the evoked local field potential (LFP), as well as gamma band activity. Repetition typically led to reduced responses. This reduction was correlated with direction selectivity and not explained by neural fatigue. Our data, however, warn against a simplistic view of the consequences of adaptation. First, a considerable fraction of neurons and sites showed response enhancements after adaptation, especially when probed with a stimulus that moved opposite to the direction of the adapting stimulus. Second, adaptation was stimulus selective only on a time scale of ∼100 msec. Third, aggregate measures of neural activity (MUA, LFPs) had substantially different adaptation effects. Fourth, there were qualitative differences between our findings in MT and earlier findings in IT cortex. We conclude that selective adaptation effects in fMRIa are relatively easy to miss even when they exist (for instance by presenting stimuli for too long, or because neurons that enhance after adaptation cancel out the effect of neurons that suppress). Moreover, we argue that adaptation should be understood in the context of the computations that a neural circuit perform. Using fMRIa as a tool to uncover neural selectivity requires a better understanding of this circuitry and its consequences for adaptation.

Biofunctionalized Conducting Polymer/Carbon Microfiber Electrodes for Ultrasensitive Neural Recordings

Carbon microfibers (MFs) coated with conducting polymers may provide a solution for long-term recording of activity from individual or small groups of neurons. Attaching cell adhesion molecules to the electro-sensitive surface might further improve electrode-neuron contact, thus enhancing signal stability and fidelity. We fabricated biofunctionalized microelectrodes consisting of 7-μm diameter carbon MFs coated with poly(3,4-ethylenedioxythiophene) doped with poly[(4-styrenesulfonic acid)-co-(maleic acid)] (

PEDOT

PSS-co-MA), and linked N-Cadherin to the polymer surface. These electrodes were tested for recording artificially generated electric potentials, as well as multiunit activity (MUA), sharp wave-ripple complexes (SWRs), and field excitatory postsynaptic potentials (fEPSPs) in rat hippocampal slices. The effects of electrode length and functionalization were compared.

PEDOT

PSS-co-MA coating improved electric current detection and reduced the electrical noise but had no significant effect on the amplitude of recorded biopotentials. Surface biofunctionalization lowered the electric current flow, and further reduced the electrical noise. Additionally, it increased the amplitude of the recorded MUA, finally doubling the signal-to-noise ratio achieved with bare carbon MFs. Biofunctionalization benefits were apparent only for potentials from cells putatively adjacent to the microelectrode. Analysis of fEPSPs excluded adverse effects of functionalized electrodes in basal synaptic transmission. These results demonstrate the possibility of enhancing the amplitude and signal-to-noise ratio of neural recordings by coating the microelectrodes with conducting polymers modified with neural cell adhesion molecules, and support the use of biofunctionalized MFs in advanced neuroprosthetic devices.

The Formation of Hierarchical Decisions in the Visual Cortex

Intelligence relies on our ability to find appropriate sequences of decisions in complex problem spaces. The efficiency of a problem solver depends on the speed of its individual decisions and the number of decisions it can explore in parallel. It remains unknown whether the primate brain can consider multiple decisions at the same time. We therefore trained monkeys to navigate through a decision tree with stochastic sensory evidence at multiple branching points and recorded neuronal activity in visual cortical areas V1 and V4. We found a first phase of decision making in which neuronal activity increased in parallel along multiple branches of the decision tree. This was followed by an integration phase where the optimal overall strategy crystallized as the result of interactions between local decisions. The results reveal how sensory evidence is integrated efficiently for hierarchical decisions and contribute to our understanding of the brain mechanisms that implement complex mental programs.

Microstimulation of area V4 has little effect on spatial attention and on perception of phosphenes evoked in area V1

Previous transcranial magnetic stimulation (TMS) studies suggested that feedback from higher to lower areas of the visual cortex is important for the access of visual information to awareness. However, the influence of cortico-cortical feedback on awareness and the nature of the feedback effects are not yet completely understood. In the present study, we used electrical microstimulation in the visual cortex of monkeys to test the hypothesis that cortico-cortical feedback plays a role in visual awareness. We investigated the interactions between the primary visual cortex (V1) and area V4 by applying microstimulation in both cortical areas at various delays. We report that the monkeys detected the phosphenes produced by V1 microstimulation but subthreshold V4 microstimulation did not influence V1 phosphene detection thresholds. A second experiment examined the influence of V4 microstimulation on the monkeys' ability to detect the dimming of one of three peripheral visual stimuli. Again, microstimulation of a group of V4 neurons failed to modulate the monkeys' perception of a stimulus in their receptive field. We conclude that conditions exist where microstimulation of area V4 has only a limited influence on visual perception.

Synchronization patterns suggest different functional organization in parietal reach region and dorsal premotor cortex

The parietal reach region (PRR) and dorsal premotor cortex (PMd) form part of the fronto-parietal reach network. While neural selectivity profiles of single-cell activity in these areas can be remarkably similar, other data suggest that both areas serve different computational functions in visually guided reaching. Here we test the hypothesis that different neural functional organizations characterized by different neural synchronization patterns might be underlying the putatively different functional roles. We use cross-correlation analysis on single-unit activity (SUA) and multiunit activity (MUA) to determine the prevalence of synchronized neural ensembles within each area. First, we reliably find synchronization in PRR but not in PMd. Second, we demonstrate that synchronization in PRR is present in different cognitive states, including "idle" states prior to task-relevant instructions and without neural tuning. Third, we show that local field potentials (LFPs) in PRR but not PMd are characterized by an increased power and spike field coherence in the beta frequency range (12-30 Hz), further indicating stronger synchrony in PRR compared with PMd. Finally, we show that neurons with similar tuning properties tend to be correlated in their random spike rate fluctuations in PRR but not in PMd. Our data support the idea that PRR and PMd, despite striking similarity in single-cell tuning properties, are characterized by unequal local functional organization, which likely reflects different network architectures to support different functional roles within the fronto-parietal reach network.

Neural representation of concurrent harmonic sounds in monkey primary auditory cortex: implications for models of auditory scene analysis

The ability to attend to a particular sound in a noisy environment is an essential aspect of hearing. To accomplish this feat, the auditory system must segregate sounds that overlap in frequency and time. Many natural sounds, such as human voices, consist of harmonics of a common fundamental frequency (F0). Such harmonic complex tones (HCTs) evoke a pitch corresponding to their F0. A difference in pitch between simultaneous HCTs provides a powerful cue for their segregation. The neural mechanisms underlying concurrent sound segregation based on pitch differences are poorly understood. Here, we examined neural responses in monkey primary auditory cortex (A1) to two concurrent HCTs that differed in F0 such that they are heard as two separate "auditory objects" with distinct pitches. We found that A1 can resolve, via a rate-place code, the lower harmonics of both HCTs, a prerequisite for deriving their pitches and for their perceptual segregation. Onset asynchrony between the HCTs enhanced the neural representation of their harmonics, paralleling their improved perceptual segregation in humans. Pitches of the concurrent HCTs could also be temporally represented by neuronal phase-locking at their respective F0s. Furthermore, a model of A1 responses using harmonic templates could qualitatively reproduce psychophysical data on concurrent sound segregation in humans. Finally, we identified a possible intracortical homolog of the "object-related negativity" recorded noninvasively in humans, which correlates with the perceptual segregation of concurrent sounds. Findings indicate that A1 contains sufficient spectral and temporal information for segregating concurrent sounds based on differences in pitch.

Orientation-tuned surround suppression in mouse visual cortex

The firing rates of neurons in primary visual cortex (V1) are suppressed by large stimuli, an effect known as surround suppression. In cats and monkeys, the strength of suppression is sensitive to orientation; responses to regions containing uniform orientations are more suppressed than those containing orientation contrast. This effect is thought to be important for scene segmentation, but the underlying neural mechanisms are poorly understood. We asked whether it is possible to study these mechanisms in the visual cortex of mice, because of recent advances in technology for studying the cortical circuitry in mice. It is unknown whether neurons in mouse V1 are sensitive to orientation contrast. We measured the orientation selectivity of surround suppression in the different layers of mouse V1. We found strong surround suppression in layer 4 and the superficial layers, part of which was orientation tuned: iso-oriented surrounds caused more suppression than cross-oriented surrounds. Surround suppression was delayed relative to the visual response and orientation-tuned suppression was delayed further, suggesting two separate suppressive mechanisms. Previous studies proposed that surround suppression depends on the activity of inhibitory somatostatin-positive interneurons in the superficial layers. To test the involvement of the superficial layers we topically applied lidocaine. Silencing of the superficial layers did not prevent orientation-tuned suppression in layer 4. These results show that neurons in mouse V1, which lacks orientation columns, show orientation-dependent surround suppression in layer 4 and the superficial layers and that surround suppression in layer 4 does not require contributions from neurons in the superficial layers.

Fast transmission from the dopaminergic ventral midbrain to the sensory cortex of awake primates

Motivated by the increasing evidence that auditory cortex is under control of dopaminergic cell structures of the ventral midbrain, we studied how the ventral tegmental area and substantia nigra affect neuronal activity in auditory cortex. We electrically stimulated 567 deep brain sites in total within and in the vicinity of the two dopaminergic ventral midbrain structures and at the same time, recorded local field potentials and neuronal discharges in cortex. In experiments conducted on three awake macaque monkeys, we found that electrical stimulation of the dopaminergic ventral midbrain resulted in short-latency (~35 ms) phasic activations in all cortical layers of auditory cortex. We were also able to demonstrate similar activations in secondary somatosensory cortex and superior temporal polysensory cortex. The electrically evoked responses in these parts of sensory cortex were similar to those previously described for prefrontal cortex. Moreover, these phasic responses could be reversibly altered by the dopamine D1-receptor antagonist SCH23390 for several tens of minutes. Thus, we speculate that the dopaminergic ventral midbrain exerts a temporally precise, phasic influence on sensory cortex using fast-acting non-dopaminergic transmitters and that their effects are modulated by dopamine on a longer timescale. Our findings suggest that some of the information carried by the neuronal discharges in the dopaminergic ventral midbrain, such as the motivational value or the motivational salience, is transmitted to auditory cortex and other parts of sensory cortex. The mesocortical pathway may thus contribute to the representation of non-auditory events in the auditory cortex and to its associative functions.

Change in network connectivity during fictive-gasping generation in hypoxia: prevention by a metabolic intermediate

The neuronal circuit in charge of generating the respiratory rhythms, localized in the pre-Bötzinger complex (preBötC), is configured to produce fictive-eupnea during normoxia and reconfigures to produce fictive-gasping during hypoxic conditions in vitro. The mechanisms involved in such reconfiguration have been extensively investigated by cell-focused studies, but the actual changes at the network level remain elusive. Since a failure to generate gasping has been linked to Sudden Infant Death Syndrome (SIDS), the study of gasping generation and pharmacological approaches to promote it may have clinical relevance. Here, we study the changes in network dynamics and circuit reconfiguration that occur during the transition to fictive-gasping generation in the brainstem slice preparation by recording the preBötC with multi-electrode arrays and assessing correlated firing among respiratory neurons or clusters of respiratory neurons (multiunits). We studied whether the respiratory network reconfiguration in hypoxia involves changes in either the number of active respiratory elements, the number of functional connections among elements, or the strength of these connections. Moreover, we tested the influence of isocitrate, a Krebs cycle intermediate that has recently been shown to promote breathing, on the configuration of the preBötC circuit during normoxia and on its reconfiguration during hypoxia. We found that, in contrast to previous suggestions based on cell-focused studies, the number and the overall activity of respiratory neurons change only slightly during hypoxia. However, hypoxia induces a reduction in the strength of functional connectivity within the circuit without reducing the number of connections. Isocitrate prevented this reduction during hypoxia while increasing the strength of network connectivity. In conclusion, we provide an overview of the configuration of the respiratory network under control conditions and how it is reconfigured during fictive-gasping. Additionally, our data support the use of isocitrate to favor respiratory rhythm generation under normoxia and to prevent some of the changes in the respiratory network under hypoxic conditions.

Space-dependent representation of objects and other's action in monkey ventral premotor grasping neurons

The macaque ventral premotor area F5 hosts two types of visuomotor grasping neurons: "canonical" neurons, which respond to visually presented objects and underlie visuomotor transformation for grasping, and "mirror" neurons, which respond during the observation of others' action, likely playing a role in action understanding. Some previous evidence suggested that canonical and mirror neurons could be anatomically segregated in different sectors of area F5. Here we investigated the functional properties of single neurons in the hand field of area F5 using various tasks similar to those originally designed to investigate visual responses to objects and actions. By using linear multielectrode probes, we were able to simultaneously record different types of neurons and to precisely localize their cortical depth. We recorded 464 neurons, of which 243 showed visuomotor properties. Canonical and mirror neurons were often present in the same cortical sites; and, most interestingly, a set of neurons showed both canonical and mirror properties, discharging to object presentation as well as during the observation of experimenter's goal-directed acts (canonical-mirror neurons). Typically, visual responses to objects were constrained to the monkey peripersonal space, whereas action observation responses were less space-selective. Control experiments showed that space-constrained coding of objects mostly relies on an operational (action possibility) rather than metric (absolute distance) reference frame. Interestingly, canonical-mirror neurons appear to code object as target for both one's own and other's action, suggesting that they could play a role in predictive representation of others' impending actions.

Sensory and cognitive neurophysiology in rats. Part 2: Validation and demonstration

BACKGROUND

We have developed a novel setup for rats that allows for controlled sensory input to an animal engaged in a task while recording both electrophysiological signals and behavioral output.

NEW METHOD

Our setup is described in a companion paper.

RESULTS

We validate our setup by replicating (1) the functionally nonspecific spread of neural activity following tactile stimulation, and (2) the effects of anesthesia on the tactile evoked responses. We also demonstrate for the first time that the ECoG can be used to record evoked responses in a signal that reflects neural output (spiking activity), and illustrate the usefulness of our setup by demonstrating that these evoked responses are modulated by both the phase of pre-stimulus oscillations and by expectation.

COMPARISON WITH EXISTING METHODS

Compared with high-density wire recordings, micro-ECoG offers a much more stable signal without readjustments, and a much better scalability. Compared with extracranial and regular ECoG recordings, micro-ECoG allows us to measure signals that reflect both neural input and neural output.

CONCLUSIONS

For sensory and cognitive research, our setup provides a unique combination of possibilities that cannot be achieved in other setups for rodents.

Chronic, wireless recordings of large-scale brain activity in freely moving rhesus monkeys

Advances in techniques for recording large-scale brain activity contribute to both the elucidation of neurophysiological principles and the development of brain-machine interfaces (BMIs). Here we describe a neurophysiological paradigm for performing tethered and wireless large-scale recordings based on movable volumetric three-dimensional (3D) multielectrode implants. This approach allowed us to isolate up to 1,800 units per animal and simultaneously record the extracellular activity of close to 500 cortical neurons, distributed across multiple cortical areas, in freely behaving rhesus monkeys. The method is expandable, in principle, to thousands of simultaneously recorded channels. It also allows increased recording longevity (5 consecutive years), and recording of a broad range of behaviors, e.g. social interactions, and BMI paradigms in freely moving primates. We propose that wireless large-scale recordings could have a profound impact on basic primate neurophysiology research, while providing a framework for the development and testing of clinically relevant neuroprostheses.

Representation of speech in human auditory cortex: is it special?

Successful categorization of phonemes in speech requires that the brain analyze the acoustic signal along both spectral and temporal dimensions. Neural encoding of the stimulus amplitude envelope is critical for parsing the speech stream into syllabic units. Encoding of voice onset time (VOT) and place of articulation (POA), cues necessary for determining phonemic identity, occurs within shorter time frames. An unresolved question is whether the neural representation of speech is based on processing mechanisms that are unique to humans and shaped by learning and experience, or is based on rules governing general auditory processing that are also present in non-human animals. This question was examined by comparing the neural activity elicited by speech and other complex vocalizations in primary auditory cortex of macaques, who are limited vocal learners, with that in Heschl's gyrus, the putative location of primary auditory cortex in humans. Entrainment to the amplitude envelope is neither specific to humans nor to human speech. VOT is represented by responses time-locked to consonant release and voicing onset in both humans and monkeys. Temporal representation of VOT is observed both for isolated syllables and for syllables embedded in the more naturalistic context of running speech. The fundamental frequency of male speakers is represented by more rapid neural activity phase-locked to the glottal pulsation rate in both humans and monkeys. In both species, the differential representation of stop consonants varying in their POA can be predicted by the relationship between the frequency selectivity of neurons and the onset spectra of the speech sounds. These findings indicate that the neurophysiology of primary auditory cortex is similar in monkeys and humans despite their vastly different experience with human speech, and that Heschl's gyrus is engaged in general auditory, and not language-specific, processing. This article is part of a Special Issue entitled "Communication Sounds and the Brain: New Directions and Perspectives".

Neural representation of ambiguous visual objects in the inferior temporal cortex

Inferior temporal (IT) cortex as the final stage of the ventral visual pathway is involved in visual object recognition. In our everyday life we need to recognize visual objects that are degraded by noise. Psychophysical studies have shown that the accuracy and speed of the object recognition decreases as the amount of visual noise increases. However, the neural representation of ambiguous visual objects and the underlying neural mechanisms of such changes in the behavior are not known. Here, by recording the neuronal spiking activity of macaque monkeys’ IT we explored the relationship between stimulus ambiguity and the IT neural activity. We found smaller amplitude, later onset, earlier offset and shorter duration of the response as visual ambiguity increased. All of these modulations were gradual and correlated with the level of stimulus ambiguity. We found that while category selectivity of IT neurons decreased with noise, it was preserved for a large extent of visual ambiguity. This noise tolerance for category selectivity in IT was lost at 60% noise level. Interestingly, while the response of the IT neurons to visual stimuli at 60% noise level was significantly larger than their baseline activity and full (100%) noise, it was not category selective anymore. The latter finding shows a neural representation that signals the presence of visual stimulus without signaling what it is. In general these findings, in the context of a drift diffusion model, explain the neural mechanisms of perceptual accuracy and speed changes in the process of recognizing ambiguous objects.

Neural representation of harmonic complex tones in primary auditory cortex of the awake monkey

Many natural sounds are periodic and consist of frequencies (harmonics) that are integer multiples of a common fundamental frequency (F0). Such harmonic complex tones (HCTs) evoke a pitch corresponding to their F0, which plays a key role in the perception of speech and music. "Pitch-selective" neurons have been identified in non-primary auditory cortex of marmoset monkeys. Noninvasive studies point to a putative "pitch center" located in a homologous cortical region in humans. It remains unclear whether there is sufficient spectral and temporal information available at the level of primary auditory cortex (A1) to enable reliable pitch extraction in non-primary auditory cortex. Here we evaluated multiunit responses to HCTs in A1 of awake macaques using a stimulus design employed in auditory nerve studies of pitch encoding. The F0 of the HCTs was varied in small increments, such that harmonics of the HCTs fell either on the peak or on the sides of the neuronal pure tone tuning functions. Resultant response-amplitude-versus-harmonic-number functions ("rate-place profiles") displayed a periodic pattern reflecting the neuronal representation of individual HCT harmonics. Consistent with psychoacoustic findings in humans, lower harmonics were better resolved in rate-place profiles than higher harmonics. Lower F0s were also temporally represented by neuronal phase-locking to the periodic waveform of the HCTs. Findings indicate that population responses in A1 contain sufficient spectral and temporal information for extracting the pitch of HCTs by neurons in downstream cortical areas that receive their input from A1.

Local field potentials reflect multiple spatial scales in V4

Local field potentials (LFP) reflect the properties of neuronal circuits or columns recorded in a volume around a microelectrode (Buzsáki et al., 2012). The extent of this integration volume has been a subject of some debate, with estimates ranging from a few hundred microns (Katzner et al., 2009; Xing et al., 2009) to several millimeters (Kreiman et al., 2006). We estimated receptive fields (RFs) of multi-unit activity (MUA) and LFPs at an intermediate level of visual processing, in area V4 of two macaques. The spatial structure of LFP receptive fields varied greatly as a function of time lag following stimulus onset, with the retinotopy of LFPs matching that of MUAs at a restricted set of time lags. A model-based analysis of the LFPs allowed us to recover two distinct stimulus-triggered components: an MUA-like retinotopic component that originated in a small volume around the microelectrodes (~350 μm), and a second component that was shared across the entire V4 region; this second component had tuning properties unrelated to those of the MUAs. Our results suggest that the LFP reflects neural activity across multiple spatial scales, which both complicates its interpretation and offers new opportunities for investigating the large-scale structure of network processing.

Searching for the mismatch negativity in primary auditory cortex of the awake monkey: deviance detection or stimulus specific adaptation?

The mismatch negativity (MMN) is a preattentive component of the auditory event-related potential that is elicited by a change in a repetitive acoustic pattern. While MMN has been extensively used in human electrophysiological studies of auditory processing, the neural mechanisms and brain regions underlying its generation remain unclear. We investigate possible homologs of the MMN in macaque primary auditory cortex (A1) using a frequency oddball paradigm in which rare "deviant" tones are randomly interspersed among frequent "standard" tones. Standards and deviants had frequencies equal to the best frequency (BF) of the recorded neural population or to a frequency that evoked a response half the amplitude of the BF response. Early and later field potentials, current source density components, multiunit activity, and induced high-gamma band responses were larger when elicited by deviants than by standards of the same frequency. Laminar analysis indicated that differences between deviant and standard responses were more prominent in later activity, thus suggesting cortical amplification of initial responses driven by thalamocortical inputs. However, unlike the human MMN, larger deviant responses were characterized by the enhancement of "obligatory" responses rather than the introduction of new components. Furthermore, a control condition wherein deviants were interspersed among many tones of variable frequency replicated the larger responses to deviants under the oddball condition. Results suggest that differential responses under the oddball condition in macaque A1 reflect stimulus-specific adaptation rather than deviance detection per se. We conclude that neural mechanisms of deviance detection likely reside in cortical areas outside of A1.

Closed-Loop, Multichannel Experimentation Using the Open-Source NeuroRighter Electrophysiology Platform

Single neuron feedback control techniques, such as voltage clamp and dynamic clamp, have enabled numerous advances in our understanding of ion channels, electrochemical signaling, and neural dynamics. Although commercially available multichannel recording and stimulation systems are commonly used for studying neural processing at the network level, they provide little native support for real-time feedback. We developed the open-source NeuroRighter multichannel electrophysiology hardware and software platform for closed-loop multichannel control with a focus on accessibility and low cost. NeuroRighter allows 64 channels of stimulation and recording for around US $10,000, along with the ability to integrate with other software and hardware. Here, we present substantial enhancements to the NeuroRighter platform, including a redesigned desktop application, a new stimulation subsystem allowing arbitrary stimulation patterns, low-latency data servers for accessing data streams, and a new application programming interface (API) for creating closed-loop protocols that can be inserted into NeuroRighter as plugin programs. This greatly simplifies the design of sophisticated real-time experiments without sacrificing the power and speed of a compiled programming language. Here we present a detailed description of NeuroRighter as a stand-alone application, its plugin API, and an extensive set of case studies that highlight the system’s abilities for conducting closed-loop, multichannel interfacing experiments.

Different glutamate receptors convey feedforward and recurrent processing in macaque V1

Neurons in the primary visual cortex (V1) receive feedforward input from the thalamus, which shapes receptive-field properties. They additionally receive recurrent inputs via horizontal connections within V1 and feedback from higher visual areas that are thought to be important for conscious visual perception. Here, we investigated what roles different glutamate receptors play in conveying feedforward and recurrent inputs in macaque V1. As a measure of recurrent processing, we used figure-ground modulation (FGM), the increased activity of neurons representing figures compared with background, which depends on feedback from higher areas. We found that feedforward-driven activity was strongly reduced by the AMPA receptor antagonist 6-cyano-7-nitroquinoxaline-2,3-dione (CNQX), whereas this drug had no effect on FGM. In contrast, blockers of the NMDA receptor reduced FGM, whereas their effect on visually driven activity varied with the subunit specificity of the drug. The NMDA receptor blocker 2-amino-5-phosphonovalerate (APV) caused a slight reduction of the visual response, whereas ifenprodil, which targets NMDA receptors containing the NMDA receptor NR2B subunit, increased the visual response. These findings demonstrate that glutamate receptors contribute differently to feedforward and recurrent processing in V1 and suggest ways to selectively disrupt recurrent processing so that its role in visual perception can be elucidated.

Activity related to perceptual judgment and action in primary auditory cortex

Recent evidence is reshaping the view of primary auditory cortex (A1) from a unisensory area to one more involved in dynamically integrating multisensory- and task-related information. We found A1 single- (SU) and multiple-unit (MU) activity correlated with macaques' choices in an amplitude modulation (AM) discrimination task. Animals were trained to discriminate AM noise from unmodulated noise by releasing a lever for AM noise and holding down the lever for unmodulated noise. Activity for identical stimuli was compared between trials where the animals reported AM and trials where they did not. We found 47.4% of MUs and 22.8% of SUs significantly increased firing shortly before the animal's behavioral response to report AM when compared to the equivalent time period on trials where AM was not reported. Activity was also linked to lever release in a different task context, suggesting A1 modulation by somatosensory, or efference copy, input. When spikes were counted only during the stimulus, 19.6% of MUs and 13.8% of SUs increased firing rate when animals reported AM compared to when they did not, suggesting an attentional effect, or that A1 activity can be used by higher decision areas, or that such areas provide feedback to A1. Activity associated with AM reporting was correlated with a unit's AM sensitivity, suggesting AM sensitive neurons' involvement in task performance. A1 neurons' phase locking to AM correlated more weakly (compared to firing rate) with the animals' report of AM, suggesting a preferential role for rate-codes in A1 for this AM discrimination task.

Neural mechanisms of rhythmic masking release in monkey primary auditory cortex: implications for models of auditory scene analysis

The ability to detect and track relevant acoustic signals embedded in a background of other sounds is crucial for hearing in complex acoustic environments. This ability is exemplified by a perceptual phenomenon known as "rhythmic masking release" (RMR). To demonstrate RMR, a sequence of tones forming a target rhythm is intermingled with physically identical "Distracter" sounds that perceptually mask the rhythm. The rhythm can be "released from masking" by adding "Flanker" tones in adjacent frequency channels that are synchronous with the Distracters. RMR represents a special case of auditory stream segregation, whereby the target rhythm is perceptually segregated from the background of Distracters when they are accompanied by the synchronous Flankers. The neural basis of RMR is unknown. Previous studies suggest the involvement of primary auditory cortex (A1) in the perceptual organization of sound patterns. Here, we recorded neural responses to RMR sequences in A1 of awake monkeys in order to identify neural correlates and potential mechanisms of RMR. We also tested whether two current models of stream segregation, when applied to these responses, could account for the perceptual organization of RMR sequences. Results suggest a key role for suppression of Distracter-evoked responses by the simultaneous Flankers in the perceptual restoration of the target rhythm in RMR. Furthermore, predictions of stream segregation models paralleled the psychoacoustics of RMR in humans. These findings reinforce the view that preattentive or "primitive" aspects of auditory scene analysis may be explained by relatively basic neural mechanisms at the cortical level.

Grasp movement decoding from premotor and parietal cortex

Despite recent advances in harnessing cortical motor-related activity to control computer cursors and robotic devices, the ability to decode and execute different grasping patterns remains a major obstacle. Here we demonstrate a simple Bayesian decoder for real-time classification of grip type and wrist orientation in macaque monkeys that uses higher-order planning signals from anterior intraparietal cortex (AIP) and ventral premotor cortex (area F5). Real-time decoding was based on multiunit signals, which had similar tuning properties to cells in previous single-unit recording studies. Maximum decoding accuracy for two grasp types (power and precision grip) and five wrist orientations was 63% (chance level, 10%). Analysis of decoder performance showed that grip type decoding was highly accurate (90.6%), with most errors occurring during orientation classification. In a subsequent off-line analysis, we found small but significant performance improvements (mean, 6.25 percentage points) when using an optimized spike-sorting method (superparamagnetic clustering). Furthermore, we observed significant differences in the contributions of F5 and AIP for grasp decoding, with F5 being better suited for classification of the grip type and AIP contributing more toward decoding of object orientation. However, optimum decoding performance was maximal when using neural activity simultaneously from both areas. Overall, these results highlight quantitative differences in the functional representation of grasp movements in AIP and F5 and represent a first step toward using these signals for developing functional neural interfaces for hand grasping.

The effects of pooling on spike train correlations

Neurons integrate inputs from thousands of afferents. Similarly, some experimental techniques record the pooled activity of large populations of cells. When cells in these populations are correlated, the correlation coefficient between the collective activity of two subpopulations is typically much larger than the correlation coefficient between individual cells: The act of pooling individual cell signals amplifies correlations. We give an overview of this phenomenon and present several implications. In particular, we show that pooling leads to synchronization in feedforward networks and that it can amplify and otherwise distort correlations between recorded signals.

A new type of recording chamber with an easy-to-exchange microdrive array for chronic recordings in macaque monkeys

In monkeys, long-term recordings with chronically implanted microelectrodes frequently suffer from a continuously decreasing probability to record single units or even small multiunit clusters. This problem is associated with two technical limitations of the available devices: first, restrictions for electrode movement, and second, absent possibility to exchange electrodes easily on a regular basis. Permitting to adjust the recording site and to use new recording tracks with proper electrodes may avoid these problems and make chronic more similar to acute recordings. Here, we describe a novel type of implant tackling this issue. It consists of a new type of recording chamber combined with an exchangeable multielectrode array that precisely fits into it. The multielectrode array is reversibly fixed to the chamber, and within a minute it can be exchanged against another array equipped with new electrodes at the awake animal. The array allows for bidirectional movement of six electrodes for a distance of up to 12 mm. The recording chamber enables hermetical isolation of the intracranial space, resulting in long-lasting aseptic conditions and reducing dural thickening to a minimum, as confirmed by microbiological and histopathological analysis. The device has a simple design and is both easy to produce and low in cost. Functionality has been tested in primary and secondary visual cortex of three macaque monkeys over a period of up to 15 mo. The results show that even after more than a year, single and multiunit responses can be obtained with high incidence.

Neuronal activity in the visual cortex reveals the temporal order of cognitive operations

Most mental processes consist of a number of processing steps that are executed sequentially. The timing of the individual mental operations can usually only be estimated indirectly, from the pattern of reaction times. In vision, however, many processing steps are associated with the modulation of neuronal activity in early visual areas. Here we exploited this association to elucidate the time course of neuronal activity related to each of the self-paced mental processing steps in complex visual tasks. We trained monkeys to perform two tasks, search-trace and trace-search, which required performing a sequence of two operations: a visual search for a specific color and the mental tracing of a curve. We used multielectrode recording techniques to monitor the representations of multiple visual items in area V1 at the same time and found that the relevant curve as well as the target of visual search evoked enhanced neuronal activity with a timing that depended on the order of operations. This modulation of neuronal activity in early visual areas could allow these areas to (1) act as a cognitive blackboard that permits the exchange of information between successive processing steps of a sequential visual task and to (2) contribute to the orderly progression of task-dependent endogenous attention shifts that are driven by task structure and evolve over hundreds of milliseconds.

Neural correlates of auditory scene analysis based on inharmonicity in monkey primary auditory cortex

Segregation of concurrent sounds in complex acoustic environments is a fundamental feature of auditory scene analysis. A powerful cue used by the auditory system to segregate concurrent sounds, such as speakers' voices at a cocktail party, is inharmonicity. This can be demonstrated when a component of a harmonic complex tone is perceived as a separate tone "popping out" from the complex as a whole when it is sufficiently mistuned from its harmonic value. The neural bases of perceptual "pop out" of mistuned harmonics are unclear. We recorded multiunit activity from primary auditory cortex (A1) of behaving monkeys elicited by harmonic complex tones that were either "in tune" or that contained a mistuned third harmonic set at the best frequency of the neural populations. Responses to mistuned sounds were enhanced relative to responses to "in-tune" sounds, thus correlating with the enhanced perceptual salience of the mistuned component. Consistent with human psychophysics of "pop out," response enhancements increased with the degree of mistuning, were maximal for neural populations tuned to the frequency of the mistuned component, and were not observed under comparable stimulus conditions that do not elicit perceptual "pop out." Mistuning was also associated with changes in neuronal temporal response patterns phase locked to "beats" in the stimuli. Intracortical auditory evoked potentials paralleled noninvasive neurophysiological correlates of perceptual "pop out" in humans, further augmenting the translational relevance of the results. Findings suggest two complementary neural mechanisms for "pop out," based on the detection of local differences in activation level or coherence of temporal response patterns across A1.

Separable codes for attention and luminance contrast in the primary visual cortex

The visual system encodes the features of visual stimuli as well as their behavioral relevance. Stimuli with a high luminance contrast evoke more activity in the visual cortex than stimuli with a low contrast. At the same time, attended stimuli evoke more activity than nonattended stimuli. There is a debate about how visual features and attention jointly determine neuronal activity in the visual cortex. Some studies suggested that attention increases apparent contrast (Reynolds et al., 2000), others that attention amplifies responses by a constant factor (Williford and Maunsell, 2006), and yet others that attention and contrast have largely additive effects (Buracas and Boynton, 2007; Thiele et al., 2009). The influence of attention on contrast sensitivity differs between neurons, raising the possibility that attention and contrast could be coded conjointly in a population of neurons. Here we investigate this possibility by recording neuronal activity at multiple sites in the primary visual cortex of macaque monkeys using multielectrode recording techniques and support vector machines to decode attended stimuli as well as stimulus contrast. We find that many, but not all, V1 neurons are influenced by attention and that the effects of attention and contrast are additive on average. Stimulus contrast can be decoded from neuronal responses not strongly modulated by attention, whereas the attended stimulus can be decoded as the difference in activity of cells that are influenced by attention and cells that are not. The success of the approach suggests that visual attention and stimulus contrast are represented by largely separable codes.

Suppressive lateral interactions at parafoveal representations in primary visual cortex

The perceptual salience and visibility of image elements is influenced by other elements in their vicinity. The perceptual effect of image elements on an adjacent target element depends on their relative orientation. Collinear flanking elements usually improve sensitivity for the target element, whereas orthogonal elements have a weaker effect. It is believed that the collinear flankers exert these effects through lateral interactions between neurons in the primary visual cortex (area V1), but the precise mechanisms underlying these contextual interactions remain unknown. Here, we directly examined this question by recording the effects of flankers on the responses of V1 neurons at parafoveal representations while monkeys performed a fixation task or a contrast detection task. We found, unexpectedly, that collinear flankers reduce the monkeys' perceptual sensitivity for a central target element. This behavioral effect was explained by a flanker-induced increase in the activity of V1 neurons in the absence of the central target stimulus, which reduced the amplitude of the target response. Our results indicate that the dominant effect of collinear flankers in parafoveal vision is suppression and suggest that these suppressive effects are caused by a decrease in the dynamic range of neurons coding the central target.

Multiunit recording of the cerebellar cortex, inferior olive, and fastigial nucleus during copulation in naive and sexually experienced male rats

The sexual behavior of male rats constitutes a natural model to study learning of motor skills at the level of the central nervous system. We previously showed that sexual behavior increases Fos expression in granule cells at lobules 6 to 9 of the vermis cerebellum. Herein, we obtained multiunit recordings of lobules 6a and 7 during the training period of naive subjects, and during consecutive ejaculations of expert males. Recordings from both lobules and the inferior olive showed that the maximum amplitude of mount, intromission, and ejaculation signals were similar, but sexual behavior during training tests produced a decrease in the amplitude for mount and intromission signals. The fastigial nucleus showed an inverse mirror-like response. Thus, the cerebellum is involved in the neural basis of sexual behavior and the learning of appropriate behavioral displays during copulation, with a wiring that involves the cerebellar cortex, inferior olive, and fastigial nucleus.

Quantifying time-varying multiunit neural activity using entropy based measures

Modern micro-electrode arrays make it possible to simultaneously record population neural activity. However, methods to analyze multiunit activity (MUA), which reflects the aggregate spiking activity of a population of neurons, have remained underdeveloped in comparison to those used for studying single unit activity (SUA). In scenarios where SUA is hard to record and maintain or is not representative of brains response, MUA is informative in deciphering the brains complex time-varying response to stimuli or to clinical insults. Here, we present two quantitative methods of analysis of the time-varying dynamics of MUA without spike detection. These methods are based on the multiresolution discrete wavelet transform (DWT) of an envelope of MUA followed by information theoretic measures: multiresolution entropy (MRE) and the multiresolution Kullback-Leibler distance (MRKLD). We test the proposed quantifiers on both simulated and experimental MUA recorded from rodent cortex in an experimental model of global hypoxic-ischemic brain injury. First, our results validate the use of the envelope of MUA as an alternative to detecting and analyzing transient and complex spike activity. Second, the MRE and MRKLD are shown to respond to dynamic changes due to the brains response to global injury and to identify the transient changes in the MUA.

Enhanced physiologic discriminability of stop consonants with prolonged formant transitions in awake monkeys based on the tonotopic organization of primary auditory cortex

Many children with specific language impairment (SLI) have difficulty in perceiving stop consonant-vowel syllables (e.g., /ba/, /ga/, /da/) with rapid formant transitions, but perform normally when formant transitions are extended in time. This influential observation has helped lead to the development of the auditory temporal processing hypothesis, which posits that SLI is causally related to the processing of rapidly changing sounds in aberrantly expanded windows of temporal integration. We tested a potential physiological basis for this observation by examining whether syllables varying in their consonant place of articulation (POA) with prolonged formant transitions would evoke better differentiated patterns of activation along the tonotopic axis of A1 in awake monkeys when compared to syllables with short formant transitions, especially for more prolonged windows of temporal integration. Amplitudes of multi-unit activity evoked by /ba/, /ga/, and /da/ were ranked according to predictions based on responses to tones centered at the spectral maxima of frication at syllable onset. Population responses representing consonant POA were predicted by the tone responses. Predictions were stronger for syllables with prolonged formant transitions, especially for longer windows of temporal integration. Relevance of findings to normal perception and that occurring in SLI are discussed.

Bilateral multielectrode neurophysiological recordings coupled to local pharmacology in awake songbirds

Here we describe a protocol for bilateral multielectrode neurophysiological recordings during intracerebral pharmacological manipulations in awake songbirds. This protocol encompasses fitting adult animals with head-posts and recording chambers, and acclimating them to periods of restraint. The adaptation period is followed by bilateral penetrations of multiple electrodes to obtain acute, sensory-driven neurophysiological responses before versus during the application of pharmacological agents of interest. These local manipulations are achieved by simultaneous and restricted drug infusions carried out independently for each hemisphere. We have used this protocol to elucidate how neurotransmitter and neuroendocrine systems shape the auditory and perceptual processing of natural, learned communication signals. However, this protocol can be used to explore the neurochemical basis of sensory processing in other small vertebrates. Representative results and troubleshooting of key steps of this protocol are presented. Following the animal's recovery from head-post and recording chamber implantation surgery, the length of the procedure is 2 d.

Temporally dynamic frequency tuning of population responses in monkey primary auditory cortex

Frequency tuning of auditory cortical neurons is typically determined by integrating spikes over the entire duration of a tone stimulus. However, this approach may mask functionally significant variations in tuning over the time course of the response. To explore this possibility, frequency response functions (FRFs) based on population multiunit activity evoked by pure tones of 175 or 200 ms duration were examined within four time windows relative to stimulus onset corresponding to "on" (10-30 ms), "early sustained" (30-100 ms), "late sustained" (100-175 ms), and "off" (185-235 or 210-260 ms) portions of responses in primary auditory cortex (A1) of 5 awake macaques. FRFs of "on" and "early sustained" responses displayed a good concordance, with best frequencies (BFs) differing, on average, by less than 0.25 octaves. In contrast, FRFs of "on" and "late sustained" responses differed considerably, with a mean difference in BF of 0.68 octaves. At many sites, tuning of "off" responses was inversely related to that of "on" responses, with "off" FRFs displaying a trough at the BF of "on" responses. Inversely correlated "on" and "off" FRFs were more common at sites with a higher "on" BF, thus suggesting functional differences between sites with low and high "on" BF. These results indicate that frequency tuning of population responses in A1 may vary considerably over the course of the response to a tone, thus revealing a temporal dimension to the representation of sound spectrum in A1.

Additive effects of attention and stimulus contrast in primary visual cortex

Previous studies have proposed a variety of mechanisms by which attention influences neuronal activity. Here we investigated the mechanisms of attention in the striate cortex of monkeys performing a spatial or an object-based attention task at various stimulus contrasts and compared neuronal contrast response functions with and without attention. Our data are best described by an “additive” interaction: The influence of attention on the neuronal response is relatively independent of the stimulus contrast, at least when the stimulus has enough contrast to become visible. This shows that attention adds to the neuronal responses in a largely contrast invariant manner. These data support recent functional magnetic resonance imaging studies and suggest that feedback from higher areas exerts a constant attentional drive that is mostly task not stimulus driven.

Time course of attentional modulation in the frontal eye field during curve tracing

Neurons in the frontal eye fields (FEFs) register incoming visual information and select visual stimuli that are relevant for behavior. Here we investigated the timing of the visual response and the timing of selection by recording from single FEF neurons in a curve-tracing task that requires shifts of attention followed by an oculomotor response. We found that the behavioral selection signal in area FEF had a latency of 147 ms and that it was delayed substantially relative to the visual response, which occurred 50 ms after stimulus presentation. We compared the FEF responses to activity previously recorded in the primary visual cortex (area V1) during the same task. Visual responses in area V1 preceded the FEF responses, but the latencies of selection signals in areas V1 and FEF were similar. The similarity of timing of selection signals in structures at opposite ends of the visual cortical processing hierarchy supports the view that stimulus selection occurs in an interaction between widely separated cortical regions.

Correlations between groups of premotor neurons carry information about prehension

How distinct parameters are bound together in brain activity is unknown. Combination coding by interneuronal interactions is one possibility, but, to coordinate parameters, interactions between neuronal pairs must carry information about them. To address this issue, we recorded neural activity from multiple sites in the premotor cortices of monkeys that memorized reach direction and grasp type followed by actual prehension. We found that correlations between individual spiking neurons are generally weak and carry little information about prehension. In contrast, correlations and synchronous interactions between small groups of neurons, quantified by multiunit activity (MUA), are an order of magnitude stronger. A substantial fraction of the information carried by pairwise interactions between MUAs is about combinations of reach and grasp. This contrasts with the information carried by individual neurons and individual MUAs, which is mainly about reach and/or grasp but much less about their combinations. The main contribution of pairwise interactions to the coding of reach-grasp combinations is when animals memorize prehension parameters, consistent with an internal composite representation. The informative interactions between neuronal groups may facilitate the coordination of reach and grasp into coherent prehension.

Neural stimulation and recording electrodes

Electrical stimulation of nerve tissue and recording of neural electrical activity are the basis of emerging prostheses and treatments for spinal cord injury, stroke, sensory deficits, and neurological disorders. An understanding of the electrochemical mechanisms underlying the behavior of neural stimulation and recording electrodes is important for the development of chronically implanted devices, particularly those employing large numbers of microelectrodes. For stimulation, materials that support charge injection by capacitive and faradaic mechanisms are available. These include titanium nitride, platinum, and iridium oxide, each with certain advantages and limitations. The use of charge-balanced waveforms and maximum electrochemical potential excursions as criteria for reversible charge injection with these electrode materials are described and critiqued. Techniques for characterizing electrochemical properties relevant to stimulation and recording are described with examples of differences in the in vitro and in vivo response of electrodes.

Task difficulty modulates the activity of specific neuronal populations in primary visual cortex

Spatial attention enhances our ability to detect stimuli at restricted regions of the visual field. This enhancement is thought to depend on the difficulty of the task being performed, but the underlying neuronal mechanisms for this dependency remain largely unknown. We found that task difficulty modulates neuronal firing rate at the earliest stages of cortical visual processing (area V1) in monkey (Macaca mulatta). These modulations were spatially specific: increasing task difficulty enhanced V1 neuronal firing rate at the focus of attention and suppressed it in regions surrounding the focus. Moreover, we found that response enhancement and suppression are mediated by distinct populations of neurons that differ in direction selectivity, spike width, interspike-interval distribution and contrast sensitivity. Our results provide strong support for center-surround models of spatial attention and suggest that task difficulty modulates the activity of specific populations of neurons in the primary visual cortex.

Noise correlations have little influence on the coding of selective attention in area V1

Neurons in the visual primary cortex (area V1) do not only code simple features but also whether image elements are attended or not. These attentional signals are weaker than the feature-selective responses, and their reliability may therefore be limited by the noisiness of neuronal responses. Here we show that it is possible to decode the locus of attention on a single trial from the activity of a small population of neurons in area V1. Previous studies suggested that correlations between the activities of neurons that are part of a population limit the information gain, but here we report that the impact of these noise correlations depends on the relative position of the neurons' receptive fields. Correlations reduce the benefit of pooling neuronal responses evoked by the same object but actually enhance the advantage of pooling responses evoked by different objects. These opposing effects cancelled each other at the population level, so that the net effect of the noise correlations was negligible and attention could be decoded reliably. Our results suggest that noise correlations are caused by large-scale fluctuations in cortical excitability, which can be removed by a comparison of the response strengths evoked by different objects.

BSMART: a Matlab/C toolbox for analysis of multichannel neural time series

We have developed a Matlab/C toolbox, Brain-SMART (System for Multivariate AutoRegressive Time series, or BSMART), for spectral analysis of continuous neural time series data recorded simultaneously from multiple sensors. Available functions include time series data importing/exporting, preprocessing (normalization and trend removal), AutoRegressive (AR) modeling (multivariate/bivariate model estimation and validation), spectral quantity estimation (auto power, coherence and Granger causality spectra), network analysis (including coherence and causality networks) and visualization (including data, power, coherence and causality views). The tools for investigating causal network structures in respect of frequency bands are unique functions provided by this toolbox. All functionality has been integrated into a simple and user-friendly graphical user interface (GUI) environment designed for easy accessibility. Although we have tested the toolbox only on Windows and Linux operating systems, BSMART itself is system independent. This toolbox is freely available (http://www.brain-smart.org) under the GNU public license for open source development.

Predicting movement from multiunit activity

Previous studies have shown that intracortical activity can be used to operate prosthetic devices such as an artificial limb. Previously used neuronal signals were either the activity of tens to hundreds of spiking neurons, which are difficult to record for long periods of time, or local field potentials, which are highly correlated with each other. Here, we show that by estimating multiunit activity (MUA), the superimposed activity of many neurons around a microelectrode, and using a small number of electrodes, an accurate prediction of the upcoming movement is obtained. Compared with single-unit spikes, single MUA recordings are obtained more easily and the recordings are more stable over time. Compared with local field potentials, pairs of MUA recordings are considerably less redundant. Compared with any other intracortical signal, single MUA recordings are more informative. MUA is informative even in the absence of spikes. By combining information from multielectrode recordings from the motor cortices of monkeys that performed either discrete prehension or continuous tracing movements, we demonstrate that predictions based on multichannel MUA are superior to those based on either spikes or local field potentials. These results demonstrate that considerable information is retained in the superimposed activity of multiple neurons, and therefore suggest that neurons within the same locality process similar information. They also illustrate that complex movements can be predicted using relatively simple signal processing without the detection of spikes and, thus, hold the potential to greatly expedite the development of motor-cortical prosthetic devices.