The adaptive trade-off between detection and discrimination in cortical representations and behavior

Imaging Cajal's neuronal avalanche: how wide-field optical imaging of the point-spread advanced the understanding of neocortical structure-function relationship

This review brings together a collection of studies that specifically use wide-field high-resolution mesoscopic level imaging techniques (intrinsic signal optical imaging; voltage-sensitive dye optical imaging) to image the cortical point spread (PS): the total spread of cortical activation comprising a large neuronal ensemble evoked by spatially restricted (point) stimulation of the sensory periphery (e.g., whisker, pure tone, point visual stimulation). The collective imaging findings, combined with supporting anatomical and electrophysiological findings, revealed some key aspects about the PS including its very large (radius of several mm) and relatively symmetrical spatial extent capable of crossing cytoarchitectural borders and trespassing into other cortical areas; its relationship with underlying evoked subthreshold activity and underlying anatomical system of long-range horizontal projections within gray matter, both also crossing borders; its contextual modulation and plasticity; the ability of its relative spatiotemporal profile to remain invariant to major changes in stimulation parameters; its potential role as a building block for integrative cortical activity; and its ubiquitous presence across various cortical areas and across mammalian species. Together, these findings advance our understanding about the neocortex at the mesoscopic level by underscoring that the cortical PS constitutes a fundamental motif of neocortical structure-function relationship.

Tactile Defensiveness and Impaired Adaptation of Neuronal Activity in the Fmr1 Knock-Out Mouse Model of Autism

Sensory hypersensitivity is a common symptom in autism spectrum disorders (ASDs), including fragile X syndrome (FXS), and frequently leads to tactile defensiveness. In mouse models of ASDs, there is mounting evidence of neuronal and circuit hyperexcitability in several brain regions, which could contribute to sensory hypersensitivity. However, it is not yet known whether or how sensory stimulation might trigger abnormal sensory processing at the circuit level or abnormal behavioral responses in ASD mouse models, especially during an early developmental time when experience-dependent plasticity shapes such circuits. Using a novel assay, we discovered exaggerated motor responses to whisker stimulation in young Fmr1 knock-out (KO) mice (postnatal days 14-16), a model of FXS. Adult Fmr1 KO mice actively avoided a stimulus that was innocuous to wild-type controls, a sign of tactile defensiveness. Using in vivo two-photon calcium imaging of layer 2/3 barrel cortex neurons expressing GCaMP6s, we found no differences between wild-type and Fmr1 KO mice in overall whisker-evoked activity, though 45% fewer neurons in young Fmr1 KO mice responded in a time-locked manner. Notably, we identified a pronounced deficit in neuronal adaptation to repetitive whisker stimulation in both young and adult Fmr1 KO mice. Thus, impaired adaptation in cortical sensory circuits is a potential cause of tactile defensiveness in autism.SIGNIFICANCE STATEMENT We use a novel paradigm of repetitive whisker stimulation and in vivo calcium imaging to assess tactile defensiveness and barrel cortex activity in young and adult Fmr1 knock-out mice, the mouse model of fragile X syndrome (FXS). We describe evidence of tactile defensiveness, as well as a lack of L2/3 neuronal adaptation in barrel cortex, during whisker stimulation. We propose that a defect in sensory adaptation within local neuronal networks, beginning at a young age and continuing into adulthood, likely contributes to sensory overreactivity in FXS and perhaps other ASDs.

Adaptation modulates correlated subthreshold response variability in visual cortex

Cortical sensory responses are highly variable across stimulus presentations. This variability can be correlated across neurons (due to some combination of dense intracortical connectivity, cortical activity level, and cortical state), with fundamental implications for population coding. Yet the interpretation of correlated response variability (or "noise correlation") has remained fraught with difficulty, in part because of the restriction to extracellular neuronal spike recordings. Here, we measured response variability and its correlation at the most microscopic level of electrical neural activity, the membrane potential, by obtaining dual whole cell recordings from pairs of cortical pyramidal neurons during visual processing in the turtle whole brain ex vivo preparation. We found that during visual stimulation, correlated variability adapts toward an intermediate level and that this correlation dynamic is likely mediated by intracortical mechanisms. A model network with external inputs, synaptic depression, and structure reproduced the observed dynamics of correlated variability. These results suggest that intracortical adaptation self-organizes cortical circuits toward a balanced regime at which correlated variability is maintained at an intermediate level.NEW & NOTEWORTHY Correlated response variability has profound implications for stimulus encoding, yet our understanding of this phenomenon is based largely on spike data. Here, we investigate the dynamics and mechanisms of membrane potential-correlated variability (CC) in visual cortex with a combined experimental and computational approach. We observe a visually evoked increase in CC, followed by a fast return to baseline. Our results further suggest a link between this observation and the adaptation-mediated dynamics of emergent network phenomena.

Adaptation towards scale-free dynamics improves cortical stimulus discrimination at the cost of reduced detection

Fundamental to the function of nervous systems is the ability to reorganize to cope with changing sensory input. Although well-studied in single neurons, how such adaptive versatility manifests in the collective population dynamics and function of cerebral cortex remains unknown. Here we measured population neural activity with microelectrode arrays in turtle visual cortex while visually stimulating the retina. First, we found that, following the onset of stimulation, adaptation tunes the collective population dynamics towards a special regime with scale-free spatiotemporal activity, after an initial large-scale transient response. Concurrently, we observed an adaptive tradeoff between two important aspects of population coding-sensory detection and discrimination. As adaptation tuned the cortex toward scale-free dynamics, stimulus discrimination was enhanced, while stimulus detection was reduced. Finally, we used a network-level computational model to show that short-term synaptic depression was sufficient to mechanistically explain our experimental results. In the model, scale-free dynamics emerge only when the model operates near a special regime called criticality. Together our model and experimental results suggest unanticipated functional benefits and costs of adaptation near criticality in visual cortex.

Variable Temporal Integration of Stimulus Patterns in the Mouse Barrel Cortex

Making sense of the world requires distinguishing temporal patterns and sequences lasting hundreds of milliseconds or more. How cortical circuits integrate over time to represent specific sensory sequences remains elusive. Here we assessed whether neurons in the barrel cortex (BC) integrate information about temporal patterns of whisker movements. We performed cell-attached recordings in anesthetized mice while delivering whisker deflections at variable intervals and compared the information carried by neurons about the latest interstimulus interval (reflecting sensitivity to instantaneous frequency) and earlier intervals (reflecting integration over timescales up to several hundred milliseconds). Neurons carried more information about the latest interval than earlier ones. The amount of temporal integration varied with neuronal responsiveness and with the cortical depth of the recording site, that is, with laminar location. A subset of neurons in the upper layers displayed the strongest integration. Highly responsive neurons in the deeper layers encoded the latest interval but integrated particularly weakly. Under these conditions, BC neurons act primarily as encoders of current stimulation parameters; however, our results suggest that temporal integration over hundreds of milliseconds can emerge in some neurons within BC.

Adaptive Value Normalization in the Prefrontal Cortex Is Reduced by Memory Load

Adaptation facilitates neural representation of a wide range of diverse inputs, including reward values. Adaptive value coding typically relies on contextual information either obtained from the environment or retrieved from and maintained in memory. However, it is unknown whether having to retrieve and maintain context information modulates the brain's capacity for value adaptation. To address this issue, we measured hemodynamic responses of the prefrontal cortex (PFC) in two studies on risky decision-making. In each trial, healthy human subjects chose between a risky and a safe alternative; half of the participants had to remember the risky alternatives, whereas for the other half they were presented visually. The value of safe alternatives varied across trials. PFC responses adapted to contextual risk information, with steeper coding of safe alternative value in lower-risk contexts. Importantly, this adaptation depended on working memory load, such that response functions relating PFC activity to safe values were steeper with presented versus remembered risk. An independent second study replicated the findings of the first study and showed that similar slope reductions also arose when memory maintenance demands were increased with a secondary working memory task. Formal model comparison showed that a divisive normalization model fitted effects of both risk context and working memory demands on PFC activity better than alternative models of value adaptation, and revealed that reduced suppression of background activity was the critical parameter impairing normalization with increased memory maintenance demand. Our findings suggest that mnemonic processes can constrain normalization of neural value representations.

High-velocity stimulation evokes "dense" population response in layer 2/3 vibrissal cortex

Supragranular layers of sensory cortex are known to exhibit sparse firing. In rodent vibrissal cortex, a small fraction of neurons in layer 2 and 3 (L2/3) respond to whisker stimulation. In this study, we combined whole cell recording and two-photon imaging in anesthetized mice and quantified the synaptic response and spiking profile of L2/3 neurons. Previous literature has shown that neurons across layers of vibrissal cortex are tuned to the velocity of whisker movement. We therefore used a broad range of stimuli that included the standard range of velocities (0-1.2 deg/ms) and extended to a "sharp" high-velocity deflection (3.8 deg/ms). Consistent with previous literature, whole cell recording revealed a sparse response to the standard range of velocities: although all recorded cells showed tuning to velocity in their postsynaptic potentials, only a small fraction produced stimulus-evoked spikes. In contrast, the sharp stimulus evoked reliable spiking in the majority of neurons. The action potential threshold of spikes evoked by the sharp stimulus was significantly lower than that of the spontaneous spikes. Juxtacellular recordings confirmed that application of sharp stimulus to single or multiple whiskers produced temporally precise spiking with minimal trial-to-trial spike count variability (Fano factors equal or close to the theoretical minimum). Two-photon imaging further confirmed that most neurons that were not responsive to the standard deflections responded to the sharp stimulus. Altogether, our results indicate that sparseness in L2/3 cortex depends on the choice of stimulus: strong single- or multiwhisker stimulation can induce the transition from sparse to "dense" population response.NEW & NOTEWORTHY In superficial layers of sensory cortex, only a small fraction of neurons fire most of the spontaneous and sensory evoked spikes. However, the functional relevance of such "sparse" activity remains unknown. We found that a "dense" population response is evoked by high-velocity micromotions applied to whiskers. Our results suggest that flashes of precisely timed population response on an almost silent background can provide a high capacity for coding of ecologically salient stimuli.

Key considerations in designing a somatosensory neuroprosthesis

In recent years, a consensus has emerged that somatosensory feedback needs to be provided for upper limb neuroprostheses to be useful. An increasingly promising approach to sensory restoration is to electrically stimulate neurons along the somatosensory neuraxis to convey information about the state of the prosthetic limb and about contact with objects. To date, efforts toward artificial sensory feedback have consisted mainly of demonstrating that some sensory information could be conveyed using a small number of stimulation patterns, generally delivered through single electrodes. However impressive these achievements are, results from different studies are hard to compare, as each research team implements different stimulation patterns and tests the elicited sensations differently. A critical question is whether different stimulation strategies will generalize from contrived laboratory settings to activities of daily living. Here, we lay out some key specifications that an artificial somatosensory channel should meet, discuss how different approaches should be evaluated, and caution about looming challenges that the field of sensory restoration will face.

Rapid Sensory Adaptation Redux: A Circuit Perspective

Adaptation is fundamental to life. All organisms adapt over timescales that span from evolution to generations and lifetimes to moment-by-moment interactions. The nervous system is particularly adept at rapidly adapting to change, and this in fact may be one of its fundamental principles of organization and function. Rapid forms of sensory adaptation have been well documented across all sensory modalities in a wide range of organisms, yet we do not have a comprehensive understanding of the adaptive cellular mechanisms that ultimately give rise to the corresponding percepts, due in part to the complexity of the circuitry. In this Perspective, we aim to build links between adaptation at multiple scales of neural circuitry by investigating the differential adaptation across brain regions and sub-regions and across specific cell types, for which the explosion of modern tools has just begun to enable. This investigation points to a set of challenges for the field to link functional observations to adaptive properties of the neural circuit that ultimately underlie percepts.

Adaptation to second order stimulus features by electrosensory neurons causes ambiguity

Understanding the coding strategies used to process sensory input remains a central problem in neuroscience. Growing evidence suggests that sensory systems process natural stimuli efficiently by ensuring a close match between neural tuning and stimulus statistics through adaptation. However, adaptation causes ambiguity as the same response can be elicited by different stimuli. The mechanisms by which the brain resolves ambiguity remain poorly understood. Here we investigated adaptation in electrosensory pyramidal neurons within different parallel maps in the weakly electric fish Apteronotus leptorhynchus. In response to step increases in stimulus variance, we found that pyramidal neurons within the lateral segment (LS) displayed strong scale invariant adaptation whereas those within the centromedial segment (CMS) instead displayed weaker degrees of scale invariant adaptation. Signal detection analysis revealed that strong adaptation in LS neurons significantly reduced stimulus discriminability. In contrast, weaker adaptation displayed by CMS neurons led to significantly lesser impairment of discriminability. Thus, while LS neurons display adaptation that is matched to natural scene statistics, thereby optimizing information transmission, CMS neurons instead display weaker adaptation and would instead provide information about the context in which these statistics occur. We propose that such a scheme is necessary for decoding by higher brain structures.

The Slip Hypothesis: Tactile Perception and its Neuronal Bases

The slip hypothesis of epicritic tactile perception interprets actively moving sensor and touched objects as a frictional system, known to lead to jerky relative movements called 'slips'. These slips depend on object geometry, forces, material properties, and environmental factors, and, thus, have the power to incorporate coding of the perceptual target, as well as perceptual strategies (sensor movement). Tactile information as transferred by slips will be encoded discontinuously in space and time, because slips sometimes engage only parts of the touching surfaces and appear as discrete and rare events in time. This discontinuity may have forced tactile systems of vibrissae and fingertips to evolve special ways to convert touch signals to a tactile percept.

Presynaptic Adenosine Receptor-Mediated Regulation of Diverse Thalamocortical Short-Term Plasticity in the Mouse Whisker Pathway

Short-term synaptic plasticity (STP) sets the sensitivity of a synapse to incoming activity and determines the temporal patterns that it best transmits. In “driver” thalamocortical (TC) synaptic populations, STP is dominated by depression during stimulation from rest. However, during ongoing stimulation, lemniscal TC connections onto layer 4 neurons in mouse barrel cortex express variable STP. Each synapse responds to input trains with a distinct pattern of depression or facilitation around its mean steady-state response. As a result, in common with other synaptic populations, lemniscal TC synapses express diverse rather than uniform dynamics, allowing for a rich representation of temporally varying stimuli. Here, we show that this STP diversity is regulated presynaptically. Presynaptic adenosine receptors of the A1R type, but not kainate receptors (KARs), modulate STP behavior. Blocking the receptors does not eliminate diversity, indicating that diversity is related to heterogeneous expression of multiple mechanisms in the pathway from presynaptic calcium influx to neurotransmitter release.

Response reliability observed with voltage-sensitive dye imaging of cortical layer 2/3: the probability of activation hypothesis

A central assertion in the study of neural processing is that our perception of the environment directly reflects the activity of our sensory neurons. This assertion reinforces the intuition that the strength of a sensory input directly modulates the amount of neural activity observed in response to that sensory feature: an increase in the strength of the input yields a graded increase in the amount of neural activity. However, cortical activity across a range of sensory pathways can be sparse, with individual neurons having remarkably low firing rates, often exhibiting suprathreshold activity on only a fraction of experimental trials. To compensate for this observed apparent unreliability, it is assumed that instead the local population of neurons, although not explicitly measured, does reliably represent the strength of the sensory input. This assumption, however, is largely untested. In this study, using wide-field voltage-sensitive dye (VSD) imaging of the somatosensory cortex in the anesthetized rat, we show that whisker deflection velocity, or stimulus strength, is not encoded by the magnitude of the population response at the level of cortex. Instead, modulation of whisker deflection velocity affects the likelihood of the cortical response, impacting the magnitude, rate of change, and spatial extent of the cortical response. An ideal observer analysis of the cortical response points to a probabilistic code based on repeated sampling across cortical columns and/or time, which we refer to as the probability of activation hypothesis. This hypothesis motivates a range of testable predictions for both future electrophysiological and future behavioral studies.

Information Coding through Adaptive Gating of Synchronized Thalamic Bursting

It has been posited that the regulation of burst/tonic firing in the thalamus could function as a mechanism for controlling not only how much but what kind of information is conveyed to downstream cortical targets. Yet how this gating mechanism is adaptively modulated on fast timescales by ongoing sensory inputs in rich sensory environments remains unknown. Using single-unit recordings in the rat vibrissa thalamus (VPm), we found that the degree of bottom-up adaptation modulated thalamic burst/tonic firing as well as the synchronization of bursting across the thalamic population along a continuum for which the extremes facilitate detection or discrimination of sensory inputs. Optogenetic control of baseline membrane potential in thalamus further suggests that this regulation may result from an interplay between adaptive changes in thalamic membrane potential and synaptic drive from inputs to thalamus, setting the stage for an intricate control strategy upon which cortical computation is built.

Altered resonance properties of somatosensory responses in mice deficient for the schizophrenia risk gene Neuregulin 1

To reveal the neuronal underpinnings of sensory processing deficits in patients with schizophrenia, previous studies have investigated brain activity in response to sustained sensory stimulation at various frequencies. This paradigm evoked neural activity at the stimulation frequency and harmonics thereof. During visual and auditory stimulation that elicited enhanced or 'resonant' responses in healthy controls, patients with schizophrenia displayed reduced activity. The present study sought to elucidate the cellular basis of disease-related deficits in sensory resonance properties using mice heterozygous for the schizophrenia susceptibility gene Neuregulin 1 (NRG1). We applied repetitive whisker stimulation at 1-15 Hz, a range relevant to whisking behavior in mice, and measured cellular activity in the primary somatosensory cortex. At frequencies where control mice displayed enhancements in measures of response magnitude and precision, NRG1 (+/-) mutants showed reductions. Our results demonstrate for the first time a link between a mutation of a schizophrenia risk gene and altered neuronal resonance properties in sensory cortex.

Origins of choice-related activity in mouse somatosensory cortex

During perceptual decisions about faint or ambiguous sensory stimuli, even identical stimuli can produce different choices. Spike trains from sensory cortex neurons can predict trial-to-trial variability in choice. Choice-related spiking is widely studied to link cortical activity to perception, but its origins remain unclear. Using imaging and electrophysiology, we found that mouse primary somatosensory cortex neurons showed robust choice-related activity during a tactile detection task. Spike trains from primary mechanoreceptive neurons did not predict choices about identical stimuli. Spike trains from thalamic relay neurons showed highly transient, weak choice-related activity. Intracellular recordings in cortex revealed a prolonged choice-related depolarization in most neurons that was not accounted for by feedforward thalamic input. Top-down axons projecting from secondary to primary somatosensory cortex signaled choice. An intracellular measure of stimulus sensitivity determined which neurons converted choice-related depolarization into spiking. Our results reveal how choice-related spiking emerges across neural circuits and within single neurons.

Support for the slip hypothesis from whisker-related tactile perception of rats in a noisy environment

Rodents use active whisker movements to explore their environment. The “slip hypothesis” of whisker-related tactile perception entails that short-lived kinematic events (abrupt whisker movements, called “slips”, due to bioelastic whisker properties that occur during active touch of textures) carry the decisive texture information. Supporting this hypothesis, previous studies have shown that slip amplitude and frequency occur in a texture-dependent way. Further, experiments employing passive pulsatile whisker deflections revealed that perceptual performance based on pulse kinematics (i.e., signatures that resemble slips) is far superior to the one based on time-integrated variables like frequency and intensity. So far, pulsatile stimuli were employed in a noise free environment. However, the realistic scenario involves background noise (e.g., evoked by rubbing across the texture). Therefore, if slips are used for tactile perception, the tactile neuronal system would need to differentiate slip-evoked spikes from those evoked by noise. To test the animals under these more realistic conditions, we presented passive whisker-deflections to head-fixed trained rats, consisting of “slip-like” events (waveforms mimicking slips occurring with touch of real textures) embedded into background noise. Varying the (i) shapes (ramp or pulse); (ii) kinematics (amplitude, velocity, etc.); and (iii) the probabilities of occurrence of slip-like events, we observed that rats could readily detect slip-like events of different shapes against noisy background. Psychophysical curves revealed that the difference of slip event and noise amplitude determined perception, while increased probability of occurrence (frequency) had barely any effect. These results strongly support the notion that encoding of kinematics dominantly determines whisker-related tactile perception while the computation of frequency or intensity plays a minor role.

Hour-long adaptation in the awake early visual system

Sensory adaptation serves to adjust awake brains to changing environments on different time scales. However, adaptation has been studied traditionally under anesthesia and for short time periods. Here, we demonstrate in awake rabbits a novel type of sensory adaptation that persists for >1 h and acts on visual thalamocortical neurons and their synapses in the input layers of the visual cortex. Following prolonged visual stimulation (10-30 min), cells in the dorsal lateral geniculate nucleus (LGN) show a severe and prolonged reduction in spontaneous firing rate. This effect is bidirectional, and prolonged visually induced response suppression is followed by a prolonged increase in spontaneous activity. The reduction in thalamic spontaneous activity following prolonged visual activation is accompanied by increases in 1) response reliability, 2) signal detectability, and 3) the ratio of visual signal/spontaneous activity. In addition, following such prolonged activation of an LGN neuron, the monosynaptic currents generated by thalamic impulses in layer 4 of the primary visual cortex are enhanced. These results demonstrate that in awake brains, prolonged sensory stimulation can have a profound, long-lasting effect on the information conveyed by thalamocortical inputs to the visual cortex.

Adaptive shaping of cortical response selectivity in the vibrissa pathway

One embodiment of context-dependent sensory processing is bottom-up adaptation, where persistent stimuli decrease neuronal firing rate over hundreds of milliseconds. Adaptation is not, however, simply the fatigue of the sensory pathway, but shapes the information flow and selectivity to stimulus features. Adaptation enhances spatial discriminability (distinguishing stimulus location) while degrading detectability (reporting presence of the stimulus), for both the ideal observer of the cortex and awake, behaving animals. However, how the dynamics of the adaptation shape the cortical response and this detection and discrimination tradeoff is unknown, as is to what degree this phenomenon occurs on a continuum as opposed to a switching of processing modes. Using voltage-sensitive dye imaging in anesthetized rats to capture the temporal and spatial characteristics of the cortical response to tactile inputs, we showed that the suppression of the cortical response, in both magnitude and spatial spread, is continuously modulated by the increasing amount of energy in the adapting stimulus, which is nonuniquely determined by its frequency and velocity. Single-trial ideal observer analysis demonstrated a tradeoff between detectability and spatial discriminability up to a moderate amount of adaptation, which corresponds to the frequency range in natural whisking. This was accompanied by a decrease in both detectability and discriminability with high-energy adaptation, which indicates a more complex coupling between detection and discrimination than a simple switching of modes. Taken together, the results suggest that adaptation operates on a continuum and modulates the tradeoff between detectability and discriminability that has implications for information processing in ethological contexts.