Arterial oxygen desaturation during moderate hypoxia hinders sensorimotor performance

INTRODUCTION

Moderate hypoxia may impact cognitive and sensorimotor performance prior to self-recognized impairments. Therefore, rapid and objective assessment tools to identify people at risk of impaired function during moderate hypoxia is needed.

PURPOSE

Test the hypothesis that reductions in arterial oxygen saturation during moderate normobaric hypoxia (FiO2 = 14%) decreases gamified sensorimotor performance as measured by alterations of motor acuity.

METHODS

Following three consecutive days of practice, thirty healthy adults (25 ± 5 y, 10 females) completed three bouts of the tablet-based gamified assessment (Statespace Labs, Inc.) of motor acuity at Baseline and 60 and 90 min after exposure to 13.8 ± 0.2% (hypoxia) and 20.1 ± 0.4% (normoxia) oxygen. The gamified assessment involved moving the tablet to aim and shoot at targets. Both conditions were completed on the same day and were administered in a single-blind, block randomized manner. Performance metrics included shot time and shot variability. Arterial oxyhemoglobin saturation estimated via forehead pulse oximetry (SpO2). Data were analyzed using linear mixed effects models.

RESULTS

Compared to normoxia (99±1%), SpO2 was lower (p<0.001) at 60 (89±3%) and 90 (90±2%) min of hypoxia. Shot time was unaffected by decreases in SpO2 (0.012, p = 0.19). Nor was shot time affected by the interaction between SpO2 decrease and baseline performance (0.006, p = 0.46). Shot variability was greater (i.e., less precision, worse performance) with decreases in SpO2 (0.023, p = 0.02) and depended on the interaction between SpO2 decrease and baseline performance (0.029, p< 0.01).

CONCLUSION

Decreases in SpO2 during moderate hypoxic exposure hinders sensorimotor performance via decreased motor acuity, i.e., greater variability (less precision) with no change in speed with differing decreases in SpO2. Thus, personnel who are exposed to moderate hypoxia and have greater decreases in SpO2 exhibit lower motor acuity, i.e., less precise movements even though decision time and movement speed are unaffected.

Gamified assessment of cognitive performance during moderate hypoxia

INTRODUCTION

There is a need for rapid and objective assessment tools to identify people at risk of impaired cognitive function during hypoxia.

PURPOSE

To test the hypotheses that performance on gamified cognitive tests examining the cognitive domains of executive function (Gridshot), working memory (Capacity) and spatial tracking (Multitracker) will be reduced during normobaric exposure to moderate normobaric hypoxia.

METHODS

Following three consecutive days of practice, twenty-one healthy adults (27 ± 5 y, 9 females) completed five 1-min rounds of the tablet-based games Gridshot, Capacity, and Multitracker (Statespace Labs, Inc.) at Baseline and 60 and 90 min after exposure to 14.0 ± 0.2% (hypoxia) and 20.6 ± 0.3% (normoxia) oxygen. Both conditions were completed on the same day and were administered in a single-blind, block randomized manner. Arterial oxyhemoglobin saturation was estimated via forehead pulse oximetry (SpO2). Data were analyzed using ANCOVA with a covariate of Baseline.

RESULTS

Compared to normoxia (98 ± 1%), SpO2 was lower (p < 0.001) at 60 (91 ± 3%) and 90 (91 ± 2%) min of hypoxia. No condition x time interaction effects were identified for any gamified cognitive tests (p ≥ 0.32). A main effect of condition was identified for Capacity (p = 0.05) and Multitracker (p = 0.04), but not Gridshot (p = 0.33). Post hoc analyses of the composite scores for both Capacity (p = 0.11) and Multitracker (p = 0.73) demonstrated no difference between conditions.

CONCLUSION

Performance on gamified cognitive tests was not consistently affected by acute normobaric moderate hypoxic exposure.

The visible gorilla: Unexpected fast-not physically salient-Objects are noticeable

It is widely believed that observers can fail to notice clearly visible unattended objects, even if they are moving. Here, we created parametric tasks to test this belief and report the results of three high-powered experiments (total n = 4,493) indicating that this effect is strongly modulated by the speed of the unattended object. Specifically, fast-but not slow-objects are readily noticeable, whether they are attended or not. These results suggest that fast motion serves as a potent exogenous cue that overrides task-focused attention, showing that fast speeds, not long exposure duration or physical salience, strongly diminish inattentional blindness effects.

Assessment of human expertise and movement kinematics in first-person shooter games

In contrast to traditional professional sports, there are few standardized metrics in professional esports (competitive multiplayer video games) for assessing a player's skill and ability. We assessed the performance of professional-level players in Aim LabTM, a first-person shooter training and assessment game, with two target-shooting tasks. These tasks differed primarily in target size: the task with large targets provided an incentive to be fast but imprecise and the task with large targets provided an incentive to be precise but slow. Each player's motor acuity was measured by characterizing the speed-accuracy trade-off in shot behavior: shot time (elapsed time for a player to shoot at a target) and shot spatial error (distance from center of a target). We also characterized the fine-grained kinematics of players' mouse movements. Our findings demonstrate that: 1) movement kinematics depended on task demands; 2) individual differences in motor acuity were significantly correlated with kinematics; and 3) performance, combined across the two target sizes, was poorly characterized by Fitts Law. Our approach to measuring motor acuity has widespread applications not only in esports assessment and training, but also in basic (motor psychophysics) and clinical (gamified rehabilitation) research.

A unified model of the task-evoked pupil response

The pupil dilates and reconstricts following task events. It is popular to model this task-evoked pupil response as a linear transformation of event-locked impulses, whose amplitudes are used as estimates of arousal. We show that this model is incorrect and propose an alternative model based on the physiological finding that a common neural input drives saccades and pupil size. The estimates of arousal from our model agreed with key predictions: Arousal scaled with task difficulty and behavioral performance but was invariant to small differences in trial duration. Moreover, the model offers a unified explanation for a wide range of phenomena: entrainment of pupil size and saccades to task timing, modulation of pupil response amplitude and noise with task difficulty, reaction time-dependent modulation of pupil response timing and amplitude, a constrictory pupil response time-locked to saccades, and task-dependent distortion of this saccade-locked pupil response.

Task-related hemodynamic responses in human early visual cortex are modulated by task difficulty and behavioral performance

Early visual cortex exhibits widespread hemodynamic responses in the absence of visual stimulation, which are entrained to the timing of a task and not predicted by local spiking or local field potential (LFP). Such task-related responses ('TRRs') covary with reward magnitude and physiological signatures of arousal. It is unknown, however, if TRRs change on a trial-to-trial basis according to behavioral performance and task difficulty. If so, this would suggest that TRRs reflect arousal on a trial-to-trial timescale and covary with critical task and behavioral variables. We measured fMRI-BOLD responses in the early visual cortex of human observers performing an orientation discrimination task consisting of separate easy and hard runs of trials. Stimuli were presented in a small portion of one hemifield, but the fMRI response was measured in the ipsilateral hemisphere, far from the stimulus representation and focus of spatial attention. TRRs scaled in amplitude with task difficulty, behavioral accuracy, reaction time, and lapses across trials. These modulations were not explained by the influence of respiration, cardiac activity, or head movement on the fMRI signal. Similar modulations with task difficulty and behavior were observed in pupil size. These results suggest that TRRs reflect arousal and behavior on the timescale of individual trials.

Long-Term Motor Learning in the "Wild" With High Volume Video Game Data

Motor learning occurs over long periods of practice during which motor acuity, the ability to execute actions more accurately, precisely, and in less time, improves. Laboratory-based studies of motor learning are typically limited to a small number of participants and a time frame of minutes to several hours per participant. There is a need to assess the generalizability of theories and findings from lab-based motor learning studies on larger samples and time scales. In addition, laboratory-based studies of motor learning use relatively simple motor tasks which participants are unlikely to be intrinsically motivated to learn, limiting the interpretation of their findings in more ecologically valid settings ("in the wild"). We studied the acquisition and longitudinal refinement of a complex sensorimotor skill embodied in a first-person shooter video game scenario, with a large sample size (N = 7174, 682,564 repeats of the 60 s game) over a period of months. Participants voluntarily practiced the gaming scenario for up to several hours per day up to 100 days. We found improvement in performance accuracy (quantified as hit rate) was modest over time but motor acuity (quantified as hits per second) improved considerably, with 40-60% retention from 1 day to the next. We observed steady improvements in motor acuity across multiple days of video game practice, unlike most motor learning tasks studied in the lab that hit a performance ceiling rather quickly. Learning rate was a non-linear function of baseline performance level, amount of daily practice, and to a lesser extent, number of days between practice sessions. In addition, we found that the benefit of additional practice on any given day was non-monotonic; the greatest improvements in motor acuity were evident with about an hour of practice and 90% of the learning benefit was achieved by practicing 30 min per day. Taken together, these results provide a proof-of-concept in studying motor skill acquisition outside the confines of the traditional laboratory, in the presence of unmeasured confounds, and provide new insights into how a complex motor skill is acquired in an ecologically valid setting and refined across much longer time scales than typically explored.

A dynamic normalization model of temporal attention

Vision is dynamic, handling a continuously changing stream of input, yet most models of visual attention are static. Here, we develop a dynamic normalization model of visual temporal attention and constrain it with new psychophysical human data. We manipulated temporal attention-the prioritization of visual information at specific points in time-to a sequence of two stimuli separated by a variable time interval. Voluntary temporal attention improved perceptual sensitivity only over a specific interval range. To explain these data, we modelled voluntary and involuntary attentional gain dynamics. Voluntary gain enhancement took the form of a limited resource over short time intervals, which recovered over time. Taken together, our theoretical and experimental results formalize and generalize the idea of limited attentional resources across space at a single moment to limited resources across time at a single location.

An image-computable model of how endogenous and exogenous attention differentially alter visual perception

Attention alters perception across the visual field. Typically, endogenous (voluntary) and exogenous (involuntary) attention similarly improve performance in many visual tasks, but they have differential effects in some tasks. Extant models of visual attention assume that the effects of these two types of attention are identical and consequently do not explain differences between them. Here, we develop a model of spatial resolution and attention that distinguishes between endogenous and exogenous attention. We focus on texture-based segmentation as a model system because it has revealed a clear dissociation between both attention types. For a texture for which performance peaks at parafoveal locations, endogenous attention improves performance across eccentricity, whereas exogenous attention improves performance where the resolution is low (peripheral locations) but impairs it where the resolution is high (foveal locations) for the scale of the texture. Our model emulates sensory encoding to segment figures from their background and predict behavioral performance. To explain attentional effects, endogenous and exogenous attention require separate operating regimes across visual detail (spatial frequency). Our model reproduces behavioral performance across several experiments and simultaneously resolves three unexplained phenomena: 1) the parafoveal advantage in segmentation, 2) the uniform improvements across eccentricity by endogenous attention, and 3) the peripheral improvements and foveal impairments by exogenous attention. Overall, we unveil a computational dissociation between each attention type and provide a generalizable framework for predicting their effects on perception across the visual field.

Heading perception depends on time-varying evolution of optic flow

There is considerable support for the hypothesis that perception of heading in the presence of rotation is mediated by instantaneous optic flow. This hypothesis, however, has never been tested. We introduce a method, termed "nonvarying phase motion," for generating a stimulus that conveys a single instantaneous optic flow field, even though the stimulus is presented for an extended period of time. In this experiment, observers viewed stimulus videos and performed a forced-choice heading discrimination task. For nonvarying phase motion, observers made large errors in heading judgments. This suggests that instantaneous optic flow is insufficient for heading perception in the presence of rotation. These errors were mostly eliminated when the velocity of phase motion was varied over time to convey the evolving sequence of optic flow fields corresponding to a particular heading. This demonstrates that heading perception in the presence of rotation relies on the time-varying evolution of optic flow. We hypothesize that the visual system accurately computes heading, despite rotation, based on optic acceleration, the temporal derivative of optic flow.

A recurrent circuit implements normalization, simulating the dynamics of V1 activity

The normalization model has been applied to explain neural activity in diverse neural systems including primary visual cortex (V1). The model's defining characteristic is that the response of each neuron is divided by a factor that includes a weighted sum of activity of a pool of neurons. Despite the success of the normalization model, there are three unresolved issues. 1) Experimental evidence supports the hypothesis that normalization in V1 operates via recurrent amplification, i.e., amplifying weak inputs more than strong inputs. It is unknown how normalization arises from recurrent amplification. 2) Experiments have demonstrated that normalization is weighted such that each weight specifies how one neuron contributes to another's normalization pool. It is unknown how weighted normalization arises from a recurrent circuit. 3) Neural activity in V1 exhibits complex dynamics, including gamma oscillations, linked to normalization. It is unknown how these dynamics emerge from normalization. Here, a family of recurrent circuit models is reported, each of which comprises coupled neural integrators to implement normalization via recurrent amplification with arbitrary normalization weights, some of which can recapitulate key experimental observations of the dynamics of neural activity in V1.

Contingent adaptation in masking and surround suppression

Adaptation is the process that changes a neuron's response based on recent inputs. In the traditional model, a neuron's state of adaptation depends on the recent input to that neuron alone, whereas in a recently introduced model (Hebbian normalization), adaptation depends on the structure of neural correlated firing. In particular, increased response products between pairs of neurons leads to increased mutual suppression. We test a psychophysical prediction of this model: adaptation should depend on 2nd-order statistics of input stimuli. That is, if two stimuli excite two distinct sub-populations of neurons, then presenting those stimuli simultaneously during adaptation should strengthen mutual suppression between those subpopulations. We confirm this prediction in two experiments. In the first, pairing two gratings synchronously during adaptation (i.e., a plaid) rather than asynchronously (interleaving the two gratings in time) leads to increased effectiveness of one pattern for masking the other. In the second, pairing the gratings in a center-surround configuration results in reduced apparent contrast for the central grating when paired with the same surround (as compared with a condition in which the central grating appears with a different surround at test than during adaptation). These results are consistent with the prediction that an increase in response covariance leads to greater mutual suppression between neurons. This effect is detectable both at threshold (masking) and well above threshold (apparent contrast).

Oscillatory recurrent gated neural integrator circuits (ORGaNICs), a unifying theoretical framework for neural dynamics

Working memory is an example of a cognitive and neural process that is not static but evolves dynamically with changing sensory inputs; another example is motor preparation and execution. We introduce a theoretical framework for neural dynamics, based on oscillatory recurrent gated neural integrator circuits (ORGaNICs), and apply it to simulate key phenomena of working memory and motor control. The model circuits simulate neural activity with complex dynamics, including sequential activity and traveling waves of activity, that manipulate (as well as maintain) information during working memory. The same circuits convert spatial patterns of premotor activity to temporal profiles of motor control activity and manipulate (e.g., time warp) the dynamics. Derivative-like recurrent connectivity, in particular, serves to manipulate and update internal models, an essential feature of working memory and motor execution. In addition, these circuits incorporate recurrent normalization, to ensure stability over time and robustness with respect to perturbations of synaptic weights.

Specific Visual Subregions of TPJ Mediate Reorienting of Spatial Attention

The temporo-parietal junction (TPJ) has been associated with various cognitive and social functions, and is critical for attentional reorienting. Attention affects early visual processing. Neuroimaging studies dealing with such processes have thus far concentrated on striate and extrastriate areas. Here, we investigated whether attention orienting or reorienting modulate activity in visually driven TPJ subregions. For each observer we identified 3 visually responsive subregions within TPJ: 2 bilateral (vTPJant and vTPJpost) and 1 right lateralized (vTPJcent). Cortical activity in these subregions was measured using fMRI while observers performed a 2-alternative forced-choice orientation discrimination task. Covert spatial endogenous (voluntary) or exogenous (involuntary) attention was manipulated using either a central or a peripheral cue with task, stimuli and observers constant. Both endogenous and exogenous attention increased activity for invalidly cued trials in right vTPJpost; only endogenous attention increased activity for invalidly cued trials in left vTPJpost and in right vTPJcent; and neither type of attention modulated either right or left vTPJant. These results demonstrate that vTPJpost and vTPJcent mediate the reorientation of covert attention to task relevant stimuli, thus playing a critical role in visual attention. These findings reveal a differential reorienting cortical response after observers' attention has been oriented to a given location voluntarily or involuntarily.

Analysis of Perceptual Expertise in Radiology - Current Knowledge and a New Perspective

Radiologists rely principally on visual inspection to detect, describe, and classify findings in medical images. As most interpretive errors in radiology are perceptual in nature, understanding the path to radiologic expertise during image analysis is essential to educate future generations of radiologists. We review the perceptual tasks and challenges in radiologic diagnosis, discuss models of radiologic image perception, consider the application of perceptual learning methods in medical training, and suggest a new approach to understanding perceptional expertise. Specific principled enhancements to educational practices in radiology promise to deepen perceptual expertise among radiologists with the goal of improving training and reducing medical error.

Temporal Contingencies Determine Whether Adaptation Strengthens or Weakens Normalization

A fundamental and nearly ubiquitous feature of sensory encoding is that neuronal responses are strongly influenced by recent experience, or adaptation. Theoretical and computational studies have proposed that many adaptation effects may result in part from changes in the strength of normalization signals. Normalization is a "canonical" computation in which a neuron's response is modulated (normalized) by the pooled activity of other neurons. Here, we test whether adaptation can alter the strength of cross-orientation suppression, or masking, a paradigmatic form of normalization evident in primary visual cortex (V1). We made extracellular recordings of V1 neurons in anesthetized male macaques and measured responses to plaid stimuli composed of two overlapping, orthogonal gratings before and after prolonged exposure to two distinct adapters. The first adapter was a plaid consisting of orthogonal gratings and led to stronger masking. The second adapter presented the same orthogonal gratings in an interleaved manner and led to weaker masking. The strength of adaptation's effects on masking depended on the orientation of the test stimuli relative to the orientation of the adapters, but was independent of neuronal orientation preference. Changes in masking could not be explained by altered neuronal responsivity. Our results suggest that normalization signals can be strengthened or weakened by adaptation depending on the temporal contingencies of the adapting stimuli. Our findings reveal an interplay between two widespread computations in cortical circuits, adaptation and normalization, that enables flexible adjustments to the structure of the environment, including the temporal relationships among sensory stimuli.SIGNIFICANCE STATEMENT Two fundamental features of sensory responses are that they are influenced by adaptation and that they are modulated by the activity of other nearby neurons via normalization. Our findings reveal a strong interaction between these two aspects of cortical computation. Specifically, we show that cross-orientation masking, a form of normalization, can be strengthened or weakened by adaptation depending on the temporal contingencies between sensory inputs. Our findings support theoretical proposals that some adaptation effects may involve altered normalization and offer a network-based explanation for how cortex adjusts to current sensory demands.

Stimulus vignetting and orientation selectivity in human visual cortex

Neural selectivity to orientation is one of the simplest and most thoroughly-studied cortical sensory features. Here, we show that a large body of research that purported to measure orientation tuning may have in fact been inadvertently measuring sensitivity to second-order changes in luminance, a phenomenon we term 'vignetting'. Using a computational model of neural responses in primary visual cortex (V1), we demonstrate the impact of vignetting on simulated V1 responses. We then used the model to generate a set of predictions, which we confirmed with functional MRI experiments in human observers. Our results demonstrate that stimulus vignetting can wholly determine the orientation selectivity of responses in visual cortex measured at a macroscopic scale, and suggest a reinterpretation of a well-established literature on orientation processing in visual cortex.

On spatial attention and its field size on the repulsion effect

We investigated the attentional repulsion effect-stimuli appear displaced further away from attended locations-in three experiments: one with exogenous (involuntary) attention, and two with endogenous (voluntary) attention with different attention-field sizes. It has been proposed that differences in attention-field size can account for qualitative differences in neural responses elicited by attended stimuli. We used psychophysical comparative judgments and manipulated either exogenous attention via peripheral cues or endogenous attention via central cues and a demanding rapid serial visual presentation task. We manipulated the attention field size of endogenous attention by presenting streams of letters at two specific locations or at two of many possible locations during each block. We found a robust attentional repulsion effect in all three experiments: with endogenous and exogenous attention and with both attention-field sizes. These findings advance our understanding of the influence of spatial attention on the perception of visual space and help relate this repulsion effect to possible neurophysiological correlates.

An Enduring Dialogue between Computational and Empirical Vision

In the late 1970s, key discoveries in neurophysiology, psychophysics, computer vision, and image processing had reached a tipping point that would shape visual science for decades to come. David Marr and Ellen Hildreth's 'Theory of edge detection', published in 1980, set out to integrate the newly available wealth of data from behavioral, physiological, and computational approaches in a unifying theory. Although their work had wide and enduring ramifications, their most important contribution may have been to consolidate the foundations of the ongoing dialogue between theoretical and empirical vision science.

A non-invasive, quantitative study of broadband spectral responses in human visual cortex

Currently, non-invasive methods for studying the human brain do not routinely and reliably measure spike-rate-dependent signals, independent of responses such as hemodynamic coupling (fMRI) and subthreshold neuronal synchrony (oscillations and event-related potentials). In contrast, invasive methods—microelectrode recordings and electrocorticography (ECoG)—have recently measured broadband power elevation in field potentials (~50–200 Hz) as a proxy for locally averaged spike rates. Here, we sought to detect and quantify stimulus-related broadband responses using magnetoencephalography (MEG). Extracranial measurements like MEG and EEG have multiple global noise sources and relatively low signal-to-noise ratios; moreover high frequency artifacts from eye movements can be confounded with stimulus design and mistaken for signals originating from brain activity. For these reasons, we developed an automated denoising technique that helps reveal the broadband signal of interest. Subjects viewed 12-Hz contrast-reversing patterns in the left, right, or bilateral visual field. Sensor time series were separated into evoked (12-Hz amplitude) and broadband components (60–150 Hz). In all subjects, denoised broadband responses were reliably measured in sensors over occipital cortex, even in trials without microsaccades. The broadband pattern was stimulus-dependent, with greater power contralateral to the stimulus. Because we obtain reliable broadband estimates with short experiments (~20 minutes), and with sufficient signal-to-noise to distinguish responses to different stimuli, we conclude that MEG broadband signals, denoised with our method, offer a practical, non-invasive means for characterizing spike-rate-dependent neural activity for addressing scientific questions about human brain function.

Vision as a Beachhead

When neural circuits develop abnormally due to different genetic deficits and/or environmental insults, neural computations and the behaviors that rely on them are altered. Computational theories that relate neural circuits with specific quantifiable behavioral and physiological phenomena, therefore, serve as extremely useful tools for elucidating the neuropathological mechanisms that underlie different disorders. The visual system is particularly well suited for characterizing differences in neural computations; computational theories of vision are well established, and empirical protocols for measuring the parameters of those theories are well developed. In this article, we examine how psychophysical and neuroimaging measurements from human subjects are being used to test hypotheses about abnormal neural computations in autism, with an emphasis on hypotheses regarding potential excitation/inhibition imbalances. We discuss the complexity of relating specific computational abnormalities to particular underlying mechanisms given the diversity of neural circuits that can generate the same computation, and we discuss areas of research in which computational theories need to be further developed to provide useful frameworks for interpreting existing results. A final emphasis is placed on the need to extend existing ideas into developmental frameworks that take into account the dramatic developmental changes in neurophysiology (e.g., changes in excitation/inhibition balance) that take place during the first years of life, when autism initially emerges.

Theory of cortical function

Most models of sensory processing in the brain have a feedforward architecture in which each stage comprises simple linear filtering operations and nonlinearities. Models of this form have been used to explain a wide range of neurophysiological and psychophysical data, and many recent successes in artificial intelligence (with deep convolutional neural nets) are based on this architecture. However, neocortex is not a feedforward architecture. This paper proposes a first step toward an alternative computational framework in which neural activity in each brain area depends on a combination of feedforward drive (bottom-up from the previous processing stage), feedback drive (top-down context from the next stage), and prior drive (expectation). The relative contributions of feedforward drive, feedback drive, and prior drive are controlled by a handful of state parameters, which I hypothesize correspond to neuromodulators and oscillatory activity. In some states, neural responses are dominated by the feedforward drive and the theory is identical to a conventional feedforward model, thereby preserving all of the desirable features of those models. In other states, the theory is a generative model that constructs a sensory representation from an abstract representation, like memory recall. In still other states, the theory combines prior expectation with sensory input, explores different possible perceptual interpretations of ambiguous sensory inputs, and predicts forward in time. The theory, therefore, offers an empirically testable framework for understanding how the cortex accomplishes inference, exploration, and prediction.

Differential sensory fMRI signatures in autism and schizophrenia: Analysis of amplitude and trial-to-trial variability

Autism and schizophrenia share multiple phenotypic and genotypic markers, and there is ongoing debate regarding the relationship of these two disorders. To examine whether cortical dynamics are similar across these disorders, we directly compared fMRI responses to visual, somatosensory and auditory stimuli in adults with autism (N=15), with schizophrenia (N=15), and matched controls (N=15). All participants completed a one-back letter detection task presented at fixation (to control attention) while task-irrelevant sensory stimulation was delivered to the different modalities. We focused specifically on the response amplitudes and the variability in sensory fMRI responses of the two groups, given the evidence of greater trial-to-trial variability in adults with autism. Both autism and schizophrenia individuals showed weaker signal-to-noise ratios (SNR) in sensory-evoked responses compared to controls (d>0.42), but for different reasons. For the autism group, the fMRI response amplitudes were indistinguishable from controls but were more variable trial-to-trial (d=0.47). For the schizophrenia group, response amplitudes were smaller compared to autism (d=0.44) and control groups (d=0.74), but were not significantly more variable (d<0.29). These differential group profiles suggest (1) that greater trial-to-trial variability in cortical responses may be specific to autism and is not a defining characteristic of schizophrenia, and (2) that blunted response amplitudes may be characteristic of schizophrenia. The relationship between the amplitude and the variability of cortical activity might serve as a specific signature differentiating these neurodevelopmental disorders. Identifying the neural basis of these responses and their relationship to the underlying genetic bases may substantially enlighten the understanding of both disorders.

Free Viewing Gaze Behavior in Infants and Adults

The current study investigated age differences in free viewing gaze behavior. Adults and 6-, 9-, 12-, and 24-month-old infants watched a 60-s Sesame Street video clip while their eye movements were recorded. Adults displayed high inter-subject consistency in eye movements; they tended to fixate the same places at the same. Infants showed weaker consistency between observers and inter-subject consistency increased with age. Across age groups, the influence of both bottom-up features (fixating visually-salient areas) and top-down features (looking at faces) increased. Moreover, individual differences in fixating bottom-up and top-down features predicted whether infants' eye movements were consistent with those of adults, even when controlling for age. However, this relation was moderated by the number of faces available in the scene, suggesting that the development of adult-like viewing involves learning when to prioritize looking at bottom-up and top-down features.

No difference in cross-modal attention or sensory discrimination thresholds in autism and matched controls

Autism has been associated with abnormalities in sensory and attentional processing. Here, we assessed these processes independently in the visual and auditory domains using a visual contrast-discrimination task and an auditory modulation-depth discrimination task. To evaluate changes in sensory function by attention, we measured behavioral performance (discrimination accuracy) when subjects were cued to attend and respond to the same stimulus (frequent valid cue) or cued to attend to one stimulus and respond to the non-cued stimulus (infrequent invalid cue). The stimuli were presented at threshold to ensure equal difficulty across participants and groups. Results from fifteen high-functioning adult individuals with autism and fifteen matched controls revealed no significant differences in visual or auditory discrimination thresholds across groups. Furthermore, attention robustly modulated performance accuracy (performance was better for valid than invalid cues) in both sensory modalities and to an equivalent extent in both groups. In conclusion, when using this well-controlled method, we found no evidence of atypical sensory function or atypical attentional modulation in a group of high functioning individuals with clear autism symptomatology.

Deconstructing Interocular Suppression: Attention and Divisive Normalization

In interocular suppression, a suprathreshold monocular target can be rendered invisible by a salient competitor stimulus presented in the other eye. Despite decades of research on interocular suppression and related phenomena (e.g., binocular rivalry, flash suppression, continuous flash suppression), the neural processing underlying interocular suppression is still unknown. We developed and tested a computational model of interocular suppression. The model included two processes that contributed to the strength of interocular suppression: divisive normalization and attentional modulation. According to the model, the salient competitor induced a stimulus-driven attentional modulation selective for the location and orientation of the competitor, thereby increasing the gain of neural responses to the competitor and reducing the gain of neural responses to the target. Additional suppression was induced by divisive normalization in the model, similar to other forms of visual masking. To test the model, we conducted psychophysics experiments in which both the size and the eye-of-origin of the competitor were manipulated. For small and medium competitors, behavioral performance was consonant with a change in the response gain of neurons that responded to the target. But large competitors induced a contrast-gain change, even when the competitor was split between the two eyes. The model correctly predicted these results and outperformed an alternative model in which the attentional modulation was eye specific. We conclude that both stimulus-driven attention (selective for location and feature) and divisive normalization contribute to interocular suppression.

In interocular suppression, a visible target presented in one eye can be rendered invisible by a competing image (the competitor) presented in the other eye. This phenomenon is a striking demonstration of the discrepancy between physical inputs to the visual system and perception, and it also allows neuroscientists to study how perceptual systems regulate competing information. Interocular suppression has been explained by mutually suppressive interactions (modeled by divisive normalization) between neurons that respond differentially to the two eyes. Attention, which selects relevant information in natural viewing condition, has also been found to play a role in interocular suppression. But the specific role of attentional modulation is still an open question. In this study, we proposed a computational model of interocular suppression integrating both attentional modulation and divisive normalization. By modeling the hypothetical neural responses and fitting the model to psychophysical data, we showed that interocular suppression involves an attentional modulation selective for the orientation of the competitor, and covering the spatial extent of the competitor. We conclude that both attention and divisive normalization contribute to interocular suppression, and that their impacts are distinguishable.

Perceptual learning in autism: over-specificity and possible remedies

Inflexible behavior is a core characteristic of autism spectrum disorder (ASD), but its underlying cause is unknown. Using a perceptual learning protocol, we observed initially efficient learning in ASD that was followed by anomalously poor learning when the location of the target was changed (over-specificity). Reducing stimulus repetition eliminated over-specificity. Our results indicate that inflexible behavior may be evident ubiquitously in ASD, even in sensory learning, but can be circumvented by specifically designed stimulation protocols.

Normalization in human somatosensory cortex

Functional magnetic resonance imaging (fMRI) was used to measure activity in human somatosensory cortex and to test for cross-digit suppression. Subjects received stimulation (vibration of varying amplitudes) to the right thumb (target) with or without concurrent stimulation of the right middle finger (mask). Subjects were less sensitive to target stimulation (psychophysical detection thresholds were higher) when target and mask digits were stimulated concurrently compared with when the target was stimulated in isolation. fMRI voxels in a region of the left postcentral gyrus each responded when either digit was stimulated. A regression model (called a forward model) was used to separate the fMRI measurements from these voxels into two hypothetical channels, each of which responded selectively to only one of the two digits. For the channel tuned to the target digit, responses in the left postcentral gyrus increased with target stimulus amplitude but were suppressed by concurrent stimulation to the mask digit, evident as a shift in the gain of the response functions. For the channel tuned to the mask digit, a constant baseline response was evoked for all target amplitudes when the mask was absent and responses decreased with increasing target amplitude when the mask was concurrently presented. A computational model based on divisive normalization provided a good fit to the measurements for both mask-absent and target + mask stimulation. We conclude that the normalization model can explain cross-digit suppression in human somatosensory cortex, supporting the hypothesis that normalization is a canonical neural computation.

Over-Responsiveness and Greater Variability in Roughness Perception in Autism

Although sensory problems, including tactile hypersensitivity and hyposensitivity (DSM-5) are commonly associated with autism, there is a dearth of systematic and rigorous research in this domain. Here, we report findings from a psychophysical experiment that explored differences in tactile perception between individuals with autism and typically developing control participants, who, using their index finger, rated a series of surfaces on the extent of their roughness. Each surface was rated multiple times and we calculated both the average rating and the variability across trials. Relative to controls, the individuals with autism perceived the surfaces as rougher overall and exhibited greater variability in their ratings across trials. These findings characterize altered tactile perception in autism and suggest that sensory problems in autism may be the product of overly responsive and variable sensory processing.

The neural processing of hierarchical structure in music and speech at different timescales

Music, like speech, is a complex auditory signal that contains structures at multiple timescales, and as such is a potentially powerful entry point into the question of how the brain integrates complex streams of information. Using an experimental design modeled after previous studies that used scrambled versions of a spoken story (Lerner et al., 2011) and a silent movie (Hasson et al., 2008), we investigate whether listeners perceive hierarchical structure in music beyond short (~6 s) time windows and whether there is cortical overlap between music and language processing at multiple timescales. Experienced pianists were presented with an extended musical excerpt scrambled at multiple timescales-by measure, phrase, and section-while measuring brain activity with functional magnetic resonance imaging (fMRI). The reliability of evoked activity, as quantified by inter-subject correlation of the fMRI responses, was measured. We found that response reliability depended systematically on musical structure coherence, revealing a topographically organized hierarchy of processing timescales. Early auditory areas (at the bottom of the hierarchy) responded reliably in all conditions. For brain areas at the top of the hierarchy, the original (unscrambled) excerpt evoked more reliable responses than any of the scrambled excerpts, indicating that these brain areas process long-timescale musical structures, on the order of minutes. The topography of processing timescales was analogous with that reported previously for speech, but the timescale gradients for music and speech overlapped with one another only partially, suggesting that temporally analogous structures-words/measures, sentences/musical phrases, paragraph/sections-are processed separately.

Suppressive interactions underlying visually evoked fixational saccades

Small saccades occur frequently during fixation, and are coupled to changes in visual stimulation and cognitive state. Neurophysiologically, fixational saccades reflect neural activity near the foveal region of a continuous visuomotor map. It is well known that competitive interactions between neurons within visuomotor maps contribute to target selection for large saccades. Here we asked how such interactions in visuomotor maps shape the rate and direction of small fixational saccades. We measured fixational saccades during periods of prolonged fixation while presenting pairs of visual stimuli (parafoveal: 0.8° eccentricity; peripheral: 5° eccentricity) of various contrasts. Fixational saccade direction was biased toward locations of parafoveal stimuli but not peripheral stimuli, ∼100-250ms following stimulus onset. The rate of fixational saccades toward parafoveal stimuli (congruent saccades) increased systematically with parafoveal stimulus contrast, and was suppressed by the simultaneous presentation of a peripheral stimulus. The suppression was best characterized as a combination of two processes: a subtractive suppression of the overall fixational saccade rate and a divisive suppression of the direction bias. These results reveal the nature of suppressive interactions within visuomotor maps and constrain models of the population code for fixational saccades.

Attention enhances contrast appearance via increased input baseline of neural responses

Covert spatial attention increases the perceived contrast of stimuli at attended locations, presumably via enhancement of visual neural responses. However, the relation between perceived contrast and the underlying neural responses has not been characterized. In this study, we systematically varied stimulus contrast, using a two-alternative, forced-choice comparison task to probe the effect of attention on appearance across the contrast range. We modeled performance in the task as a function of underlying neural contrast-response functions. Fitting this model to the observed data revealed that an increased input baseline in the neural responses accounted for the enhancement of apparent contrast with spatial attention.

Long-range traveling waves of activity triggered by local dichoptic stimulation in V1 of behaving monkeys

Traveling waves of cortical activity, in which local stimulation triggers lateral spread of activity to distal locations, have been hypothesized to play an important role in cortical function. However, there is conflicting physiological evidence for the existence of spreading traveling waves of neural activity triggered locally. Dichoptic stimulation, in which the two eyes view dissimilar monocular patterns, can lead to dynamic wave-like fluctuations in visual perception and therefore, provides a promising means for identifying and studying cortical traveling waves. Here, we used voltage-sensitive dye imaging to test for the existence of traveling waves of activity in the primary visual cortex of awake, fixating monkeys viewing dichoptic stimuli. We find clear traveling waves that are initiated by brief, localized contrast increments in one of the monocular patterns and then, propagate at speeds of ∼ 30 mm/s. These results demonstrate that under an appropriate visual context, circuitry in visual cortex in alert animals is capable of supporting long-range traveling waves triggered by local stimulation.

Motion-induced blindness and Troxler fading: common and different mechanisms

Extended stabilization of gaze leads to disappearance of dim visual targets presented peripherally. This phenomenon, known as Troxler fading, is thought to result from neuronal adaptation. Intense targets also disappear intermittently when surrounded by a moving pattern (the “mask”), a phenomenon known as motion-induced blindness (MIB). The similar phenomenology and dynamics of these disappearances may suggest that also MIB is, likewise, solely due to adaptation, which may be amplified by the presence of the mask. Here we directly compared the dependence of both phenomena on target contrast. Observers reported the disappearance and reappearance of a target of varying intensity (contrast levels: 8%–80%). MIB was induced by adding a mask that moved at one of various different speeds. The results revealed a lawful effect of contrast in both MIB and Troxler fading, but with opposite trends. Increasing target contrast increased (doubled) the rate of disappearance events for MIB, but decreased the disappearance rate to half in Troxler fading. The target mean invisible period decreased equally strongly with target contrast in MIB and in Troxler fading. The results suggest that both MIB and Troxler are equally affected by contrast adaptation, but that the rate of MIB is governed by an additional mechanism, possibly involving antagonistic processes between neuronal populations processing target and mask. Our results link MIB to other bi-stable visual phenomena that involve neuronal competition (such as binocular rivalry), which exhibit an analogous dependency on the strength of the competing stimulus components.

Can binocular rivalry reveal neural correlates of consciousness?

This essay critically examines the extent to which binocular rivalry can provide important clues about the neural correlates of conscious visual perception. Our ideas are presented within the framework of four questions about the use of rivalry for this purpose: (i) what constitutes an adequate comparison condition for gauging rivalry's impact on awareness, (ii) how can one distinguish abolished awareness from inattention, (iii) when one obtains unequivocal evidence for a causal link between a fluctuating measure of neural activity and fluctuating perceptual states during rivalry, will it generalize to other stimulus conditions and perceptual phenomena and (iv) does such evidence necessarily indicate that this neural activity constitutes a neural correlate of consciousness? While arriving at sceptical answers to these four questions, the essay nonetheless offers some ideas about how a more nuanced utilization of binocular rivalry may still provide fundamental insights about neural dynamics, and glimpses of at least some of the ingredients comprising neural correlates of consciousness, including those involved in perceptual decision-making.

Exogenous spatial attention: evidence for intact functioning in adults with autism spectrum disorder

Deficits or atypicalities in attention have been reported in individuals with autism spectrum disorder (ASD), yet no consensus on the nature of these deficits has emerged. We conducted three experiments that paired a peripheral precue with a covert discrimination task, using protocols for which the effects of covert exogenous spatial attention on early vision have been well established in typically developing populations. Experiment 1 assessed changes in contrast sensitivity, using orientation discrimination of a contrast-defined grating; Experiment 2 evaluated the reduction of crowding in the visual periphery, using discrimination of a letter-like figure with flanking stimuli at variable distances; and Experiment 3 assessed improvements in visual search, using discrimination of the same letter-like figure with a variable number of distractor elements. In all three experiments, we found that exogenous attention modulated visual discriminability in a group of high-functioning adults with ASD and that it did so in the same way and to the same extent as in a matched control group. We found no evidence to support the hypothesis that deficits in exogenous spatial attention underlie the emergence of core ASD symptomatology.

A functional and perceptual signature of the second visual area in primates

There is no generally accepted account of the function of the second visual cortical area (V2), partly because no simple response properties robustly distinguish V2 neurons from those in primary visual cortex (V1). We constructed synthetic stimuli replicating the higher-order statistical dependencies found in natural texture images and used them to stimulate macaque V1 and V2 neurons. Most V2 cells responded more vigorously to these textures than to control stimuli lacking naturalistic structure; V1 cells did not. Functional magnetic resonance imaging (fMRI) measurements in humans revealed differences between V1 and V2 that paralleled the neuronal measurements. The ability of human observers to detect naturalistic structure in different types of texture was well predicted by the strength of neuronal and fMRI responses in V2 but not in V1. Together, these results reveal a particular functional role for V2 in the representation of natural image structure.

Continuous flash suppression modulates cortical activity in early visual cortex

A salient visual stimulus can be rendered invisible by presenting it to one eye while flashing a mask to the other eye. This procedure, called continuous flash suppression (CFS), has been proposed as an ideal way of studying awareness as it can make a stimulus imperceptible for extended periods of time. Previous studies have reported robust suppression of cortical activity in higher visual areas during CFS, but the role of primary visual cortex (V1) is still controversial. In this study, we resolve this controversy on the role of V1 in CFS and also begin characterizing the computational processes underlying CFS. Early visual cortical activity was measured with functional magnetic resonance imaging while human subjects viewed stimuli composed of target and mask, presented to the same or different eyes. Functional MRI responses in early visual cortex were smaller when target and mask were in different eyes compared with the same eye, not only for the lowest contrast target rendered invisible by CFS, but also for higher contrast targets, which were visible even when presented to the eye opposite the mask. We infer that CFS is based on modulating the gain of neural responses, akin to reducing target contrast.

A model of binocular rivalry and cross-orientation suppression

Binocular rivalry and cross-orientation suppression are well-studied forms of competition in visual cortex, but models of these two types of competition are in tension with one another. Binocular rivalry occurs during the presentation of dichoptic grating stimuli, where two orthogonal gratings presented separately to the two eyes evoke strong alternations in perceptual dominance. Cross-orientation suppression occurs during the presentation of plaid stimuli, where the responses to a component grating presented to both eyes is weakened by the presence of a superimposed orthogonal grating. Conventional models of rivalry that rely on strong competition between orientation-selective neurons incorrectly predict rivalry between the components of plaids. Lowering the inhibitory weights in such models reduces rivalry for plaids, but also reduces it for dichoptic gratings. Using an exhaustive grid search, we show that this problem cannot be solved simply by adjusting the parameters of the model. Instead, we propose a robust class of models that rely on ocular opponency neurons, previously proposed as a mechanism for efficient stereo coding, to yield rivalry only for dichoptic gratings, not for plaids. This class of models reconciles models of binocular rivalry with the divisive normalization framework that has been used to explain cross-orientation. Our model makes novel predictions that we confirmed with psychophysical tests.

Binocular rivalry is a visual illusion that occurs when the two eyes are presented with incompatible images. Instead of perceiving a mixture of the two images, most people tend to experiences alternations in which they only see one image at a time. Binocular rivalry is more than just an interesting illusion: it reflects actual competition between neurons in the brain, and therefore provides a rare window into neural dynamics. To help us understand these mechanisms, researchers have developed several computational models of binocular rivalry. Yet surprisingly, as we show in this paper, previous computational models of rivalry make an incorrect prediction. They predict that certain types of images (similar to checkerboards) will cause strong perceptual alternations even when viewed normally. Since this prediction doesn't hold up, the existing models must not be telling the whole story. In this paper, we develop a new model of binocular rivalry that doesn't make this prediction. The model also makes novel predictions – not made by conventional models – that stand up to experimental test. Our model thus provides a better account of how neurons in the visual system interact with one another.

Endogenous spatial attention: evidence for intact functioning in adults with autism

Rapid manipulation of the attention field (i.e. the location and spread of visual spatial attention) is a critical aspect of human cognition, and previous research on spatial attention in individuals with autism spectrum disorders (ASD) has produced inconsistent results. In a series of three psychophysical experiments, we evaluated claims in the literature that individuals with ASD exhibit a deficit in voluntarily controlling the deployment and size of the spatial attention field. We measured the spatial distribution of performance accuracies and reaction times to quantify the sizes and locations of the attention field, with and without spatial uncertainty (i.e. the lack of predictability concerning the spatial position of the upcoming stimulus). We found that high-functioning adults with autism exhibited slower reaction times overall with spatial uncertainty, but the effects of attention on performance accuracies and reaction times were indistinguishable between individuals with autism and typically developing individuals in all three experiments. These results provide evidence of intact endogenous spatial attention function in high-functioning adults with ASD, suggesting that atypical endogenous attention cannot be a latent characteristic of autism in general.

Normal binocular rivalry in autism: implications for the excitation/inhibition imbalance hypothesis

Autism is characterized by disruption in multiple dimensions of perception, emotion, language and social cognition. Many hypotheses for the underlying neurophysiological basis have been proposed. Among these is the excitation/inhibition (E/I) imbalance hypothesis, which states that levels of cortical excitation and inhibition are disrupted in autism. We tested this theory in the visual system, because vision is one of the better understood systems in neuroscience, and because the E/I imbalance theory has been proposed to explain hypersensitivity to sensory stimuli in autism. We conducted two experiments on binocular rivalry, a well-studied psychophysical phenomenon that depends critically on excitation and inhibition levels in cortex. Using a computational model, we made specific predictions about how imbalances in excitation and inhibition levels would affect perception during two aspects of binocular rivalry: mixed perception (Experiment 1) and traveling waves (Experiment 2). We found no significant differences in either of these phenomena between high-functioning adults with autism and controls, and no evidence for a relationship between these measurements and the severity of autism. These results do not conclusively rule out an excitation/inhibition imbalance in the visual system of those with autism, but they suggest that such an imbalance, if it exists, is likely to be small in magnitude.

Slow cortical dynamics and the accumulation of information over long timescales

Making sense of the world requires us to process information over multiple timescales. We sought to identify brain regions that accumulate information over short and long timescales and to characterize the distinguishing features of their dynamics. We recorded electrocorticographic (ECoG) signals from individuals watching intact and scrambled movies. Within sensory regions, fluctuations of high-frequency (64-200 Hz) power reliably tracked instantaneous low-level properties of the intact and scrambled movies. Within higher order regions, the power fluctuations were more reliable for the intact movie than the scrambled movie, indicating that these regions accumulate information over relatively long time periods (several seconds or longer). Slow (<0.1 Hz) fluctuations of high-frequency power with time courses locked to the movies were observed throughout the cortex. Slow fluctuations were relatively larger in regions that accumulated information over longer time periods, suggesting a connection between slow neuronal population dynamics and temporally extended information processing.

Responses to second-order texture modulations undergo surround suppression

First-order (contrast) surround suppression has been well characterized both psychophysically and physiologically,but relatively little is known as to whether the perception of second-order visual stimuli exhibits analogous center–surround interactions. Second-order surround suppression was characterized by requiring subjects to detect second-order modulation in stimuli presented alone or embedded in a surround.Both contrast- (CM) and orientation-modulated (OM) stimuli were used. For most subjects and both OM and CM stimuli, second-order surrounds caused thresholds to be higher, indicative of second-order suppression. For CM stimuli, suppression was orientation-specific, i.e., higher thresholds for parallel than for orthogonal surrounds. However, the evidence for orientation specificity of suppression for OM stimuli was weaker. These results suggest that normalization, leading to surround suppression, operates at multiple stages in cortical processing.

Feature-based attention enhances performance by increasing response gain

Covert spatial attention can increase contrast sensitivity either by changes in contrast gain or by changes in response gain, depending on the size of the attention field and the size of the stimulus (Herrmann et al., 2010), as predicted by the normalization model of attention (Reynolds & Heeger, 2009). For feature-based attention, unlike spatial attention, the model predicts only changes in response gain, regardless of whether the featural extent of the attention field is small or large. To test this prediction, we measured the contrast dependence of feature-based attention. Observers performed an orientation-discrimination task on a spatial array of grating patches. The spatial locations of the gratings were varied randomly so that observers could not attend to specific locations. Feature-based attention was manipulated with a 75% valid and 25% invalid pre-cue, and the featural extent of the attention field was manipulated by introducing uncertainty about the upcoming grating orientation. Performance accuracy was better for valid than for invalid pre-cues, consistent with a change in response gain, when the featural extent of the attention field was small (low uncertainty) or when it was large (high uncertainty) relative to the featural extent of the stimulus. These results for feature-based attention clearly differ from results of analogous experiments with spatial attention, yet both support key predictions of the normalization model of attention.

Attentional enhancement via selection and pooling of early sensory responses in human visual cortex

The computational processes by which attention improves behavioral performance were characterized by measuring visual cortical activity with functional magnetic resonance imaging as humans performed a contrast-discrimination task with focal and distributed attention. Focal attention yielded robust improvements in behavioral performance accompanied by increases in cortical responses. Quantitative analysis revealed that if performance were limited only by the sensitivity of the measured sensory signals, the improvements in behavioral performance would have corresponded to an unrealistically large reduction in response variability. Instead, behavioral performance was well characterized by a pooling and selection process for which the largest sensory responses, those most strongly modulated by attention, dominated the perceptual decision. This characterization predicts that high-contrast distracters that evoke large responses should negatively impact behavioral performance. We tested and confirmed this prediction. We conclude that attention enhanced behavioral performance predominantly by enabling efficient selection of the behaviorally relevant sensory signals.

Syntactic structure building in the anterior temporal lobe during natural story listening

The neural basis of syntax is a matter of substantial debate. In particular, the inferior frontal gyrus (IFG), or Broca's area, has been prominently linked to syntactic processing, but the anterior temporal lobe has been reported to be activated instead of IFG when manipulating the presence of syntactic structure. These findings are difficult to reconcile because they rely on different laboratory tasks which tap into distinct computations, and may only indirectly relate to natural sentence processing. Here we assessed neural correlates of syntactic structure building in natural language comprehension, free from artificial task demands. Subjects passively listened to Alice in Wonderland during functional magnetic resonance imaging and we correlated brain activity with a word-by-word measure of the amount syntactic structure analyzed. Syntactic structure building correlated with activity in the left anterior temporal lobe, but there was no evidence for a correlation between syntactic structure building and activity in inferior frontal areas. Our results suggest that the anterior temporal lobe computes syntactic structure under natural conditions.