Saccade-related activity in the prefrontal cortex: its role in eye movement control and cognitive functions

Eye movements as predictor of cognitive improvement after cognitive remediation therapy in patients with schizophrenia

Aim

Baseline cognitive functions of patients predicted the efficacy of cognitive remediation therapy (CRT), but results are mixed. Eye movement is a more objective and advanced assessment of cognitive functions than neuropsychological testing. We aimed to investigate the applicability of eye movements in predicting cognitive improvement after patients with schizophrenia were treated with CRT.

Methods

We recruited 79 patients with schizophrenia to complete 8 weeks of CRT and assessed their cognitive improvement outcomes. Eye movements were assessed by prosaccades, antisaccades, and free-viewing tasks at baseline, and neuropsychological tests in four cognitive domains were assessed before and after treatment to calculate treatment outcomes. Predictors of demographic information, clinical characteristics, and eye movement measures at baseline on cognitive improvement outcomes were analyzed using logistic regression analysis. We further compared the predictive performance between eye movement measurements and neuropsychological test regarding the effect of CRT on cognitive improvement, and explored factors that could be affect the treatment outcomes in different cognitive domains.

Results

As operationally defined, 33 patients showed improved in cognition (improved group) and 46 patients did not (non-improved group) after CRT. Patients with schizophrenia being employed, lower directional error rate in antisaccade task, and lower the gap effect (i.e., the difference in saccadic latency between the gap condition and overlap condition) in prosaccade task at baseline predicted cognitive improvement in CRT. However, performance in the free-viewing task not associated with cognitive improvement in patients in CRT. Our results show that eye-movement prediction model predicted the effect of CRT on cognitive improvement in patients with schizophrenia better than neuropsychological prediction model in CRT. In addition, baseline eye-movements, cognitive reserve, antipsychotic medication dose, anticholinergic cognitive burden change, and number of training sessions were associated with improvements in four cognitive domains.

Conclusion

Eye movements as a non-invasiveness, objective, and sensitive method of evaluating cognitive function, and combined saccadic measurements in pro- and anti-saccades tasks could be more beneficial than free-viewing task in predicting the effect of CRT on cognitive improvement in patients with schizophrenia.

Visual, delay, and oculomotor timing and tuning in macaque dorsal pulvinar during instructed and free choice memory saccades

Causal perturbations suggest that primate dorsal pulvinar plays a crucial role in target selection and saccade planning, though its basic neuronal properties remain unclear. Some functional aspects of dorsal pulvinar and interconnected frontoparietal areas-e.g. ipsilesional choice bias after inactivation-are similar. But it is unknown if dorsal pulvinar shares oculomotor properties of cortical circuitry, in particular delay and choice-related activity. We investigated such properties in macaque dorsal pulvinar during instructed and free-choice memory saccades. Most recorded units showed visual (12%), saccade-related (30%), or both types of responses (22%). Visual responses were primarily contralateral; diverse saccade-related responses were predominantly post-saccadic with a weak contralateral bias. Memory delay and pre-saccadic enhancement was infrequent (11-9%)-instead, activity was often suppressed during saccade planning (25%) and further during execution (15%). Surprisingly, only few units exhibited classical visuomotor patterns combining cue and continuous delay activity or pre-saccadic ramping; moreover, most spatially-selective neurons did not encode the upcoming decision during free-choice delay. Thus, in absence of a visible goal, the dorsal pulvinar has a limited role in prospective saccade planning, with patterns partially complementing its frontoparietal partners. Conversely, prevalent visual and post-saccadic responses imply its participation in integrating spatial goals with processing across saccades.

Ventrolateral prefrontal neurons of the monkey encode instructions in the 'pragmatic' format of the associated behavioral outcomes

The prefrontal cortex plays an important role in coding rules and producing context-appropriate behaviors. These processes necessarily require the generation of goals based on current context. Indeed, instructing stimuli are prospectively encoded in prefrontal cortex in relation to behavioral demands, but the coding format of this neural representation is, to date, largely unknown. In order to study how instructions and behaviors are encoded in prefrontal cortex, we recorded the activity of monkeys (Macaca mulatta) ventrolateral prefrontal neurons in a task requiring to perform (Action condition) or withhold (Inaction condition) grasping actions on real objects. Our data show that there are neurons responding in different task phases, and that the neuronal population discharge is stronger in the Inaction condition when the instructing cue is presented, and in the Action condition in the subsequent phases, from object presentation to action execution. Decoding analyses performed on neuronal populations showed that the neural activity recorded during the initial phases of the task shares the same type of format with that recorded during the final phases. We propose that this format has a pragmatic nature, that is instructions and goals are encoded by prefrontal neurons as predictions of the behavioral outcome.

View cells in the hippocampus and prefrontal cortex of macaques during virtual navigation

Cells selectively activated by a particular view of an environment have been found in the primate hippocampus (HPC). Whether view cells are present in other brain areas, and how view selectivity interacts with other variables such as object features and place remain unclear. Here, we explore these issues by recording the responses of neurons in the HPC and the lateral prefrontal cortex (LPFC) of rhesus macaques performing a task in which they learn new context-object associations while navigating a virtual environment using a joystick. We measured neuronal responses at different locations in a virtual maze where animals freely directed gaze to different regions of the visual scenes. We show that specific views containing task relevant objects selectively activated a proportion of HPC units, and an even higher proportion of LPFC units. Place selectivity was scarce and generally dependent on view. Many view cells were not affected by changing the object color or the context cue, two task relevant features. However, a small proportion of view cells showed selectivity for these two features. Our results show that during navigation in a virtual environment with complex and dynamic visual stimuli, view cells are found in both the HPC and the LPFC. View cells may have developed as a multiarea specialization in diurnal primates to encode the complexities and layouts of the environment through gaze exploration which ultimately enables building cognitive maps of space that guide navigation.

Stable Working Memory and Perceptual Representations in Macaque Lateral Prefrontal Cortex during Naturalistic Vision

Primates use perceptual and mnemonic visuospatial representations to perform everyday functions. Neurons in the lateral prefrontal cortex (LPFC) have been shown to encode both of these representations during tasks where eye movements are strictly controlled and visual stimuli are reduced in complexity. This raises the question of whether perceptual and mnemonic representations encoded by LPFC neurons remain robust during naturalistic vision-in the presence of a rich visual scenery and during eye movements. Here we investigate this issue by training macaque monkeys to perform working memory and perception tasks in a visually complex virtual environment that requires navigation using a joystick and allows for free visual exploration of the scene. We recorded the activity of 3950 neurons in the LPFC (areas 8a and 9/46) of two male rhesus macaques using multielectrode arrays, and measured eye movements using video tracking. We found that navigation trajectories to target locations and eye movement behavior differed between the perception and working memory tasks, suggesting that animals used different behavioral strategies. Single neurons were tuned to target location during cue encoding and working memory delay, and neural ensemble activity was predictive of the behavior of the animals. Neural decoding of the target location was stable throughout the working memory delay epoch. However, neural representations of similar target locations differed between the working memory and perception tasks. These findings indicate that during naturalistic vision, LPFC neurons maintain robust and distinct neural codes for mnemonic and perceptual visuospatial representations.SIGNIFICANCE STATEMENT We show that lateral prefrontal cortex neurons encode working memory and perceptual representations during a naturalistic task set in a virtual environment. We show that despite eye movement and complex visual input, neurons maintain robust working memory representations of space, which are distinct from neuronal representations for perception. We further provide novel insight into the use of virtual environments to construct behavioral tasks for electrophysiological experiments.

Making a saccade enhances Stroop and Simon conflict control

Cognitive control is an important ability instantiated in many situations such as conflict control (e.g., Stroop/Simon task) and the control of eye movements (e.g., saccades). However, it is unclear whether eye movement control shares a common cognitive control system with the conflict control. In Experiment 1, we asked participants to make a prosaccade or antisaccade and then to identify the color of a lateralized color word (i.e., a Stroop-Simon stimulus). The stimulus onset asynchrony (SOA) between the saccadic cue and the Stroop-Simon stimulus was manipulated to be either short (200 ms) or long (600 ms). Results showed that the Stroop effect at the response level and the (negative) Simon effect were smaller when the SOA was short than long, demonstrating a decline of response control over time after making a saccade. Moreover, this temporal change of the Simon effect was more pronounced in the antisaccade session than in the prosaccade session. Furthermore, individuals who had better performance in the antisaccade task performed better in the response control of Stroop interference. When the saccade task was removed in Experiment 2, the temporal declines of the response control observed in Experiment 1 were absent. Experiment 3 replicated the key results of Experiment 1 by replacing the Stroop-Simon task with a typical Simon task and separately testing the typical Stroop and Simon tasks. Overall, our findings suggest that a common system is shared between the control of eye movements and the conflict control at the response level.

Chemogenetic inactivation reveals the inhibitory control function of the prefronto-striatal pathway in the macaque brain

The lateral prefrontal cortex (LPFC) has a strong monosynaptic connection with the caudate nucleus (CdN) of the striatum. Previous human MRI studies have suggested that this LPFC-CdN pathway plays an important role in inhibitory control and working memory. We aimed to validate the function of this pathway at a causal level by pathway-selective manipulation of neural activity in non-human primates. To this end, we trained macaque monkeys on a delayed oculomotor response task with reward asymmetry and expressed an inhibitory type of chemogenetic receptors selectively to LPFC neurons that project to the CdN. Ligand administration reduced the inhibitory control of impulsive behavior, as well as the task-related neuronal responses observed in the local field potentials from the LPFC and CdN. These results show that we successfully suppressed pathway-selective neural activity in the macaque brain, and the resulting behavioral changes suggest that the LPFC-CdN pathway is involved in inhibitory control.

Pupil dynamics: A potential proxy of neural preparation for goal-directed eye movement

The pupils reflexively constrict or dilate to regulate the influx of light on the retinae. Pupillary light reflex (PLR) is susceptible to many non-visual cognitive processes including covert orientation of attention and planning rapid saccadic eye movement. The frontal eye field (FEF) and superior colliculus (SC), which also send projections to the PLR pathway, are two important areas in primate's brain for planning saccade and orientation of attention. The saccadic reaction time (SRT) and the rate of increase in activity of movement neurons in these areas are inversely correlated. This study addressed how pupil dynamics, activity in the FEF and SC and SRT are related in a saccadic decision-making task. The rate of visually evoked pupil constriction was found inversely related to SRT. This was further verified by simulating a homeomorphic biomechanical model of pupillary muscle plants, wherein we projected signals similar to build-up activity in the FEF and SC to the parasympathetic (constriction) and sympathetic (dilation) division of the PLR pathway, respectively. A striking similarity between simulated and observed dynamics of pupil constriction suggests that PLR is a potential proxy of saccade planning by movement neurons in the FEF and SC. Indistinguishable pupil dynamics when planned saccades were elicited versus when they were cancelled eliminated the possibility that the obligatory pre-saccadic shift of attention alone influenced the rate of pupil constriction. Our study envisages a mechanism of how the oculomotor system influences the autonomic activity in an attempt to timely minimize saccadic visual transients by regulating the influx of light.

Visual response of ventrolateral prefrontal neurons and their behavior-related modulation

The ventral part of lateral prefrontal cortex (VLPF) of the monkey receives strong visual input, mainly from inferotemporal cortex. It has been shown that VLPF neurons can show visual responses during paradigms requiring to associate arbitrary visual cues to behavioral reactions. Further studies showed that there are also VLPF neurons responding to the presentation of specific visual stimuli, such as objects and faces. However, it is largely unknown whether VLPF neurons respond and differentiate between stimuli belonging to different categories, also in absence of a specific requirement to actively categorize or to exploit these stimuli for choosing a given behavior. The first aim of the present study is to evaluate and map the responses of neurons of a large sector of VLPF to a wide set of visual stimuli when monkeys simply observe them. Recent studies showed that visual responses to objects are also present in VLPF neurons coding action execution, when they are the target of the action. Thus, the second aim of the present study is to compare the visual responses of VLPF neurons when the same objects are simply observed or when they become the target of a grasping action. Our results indicate that: (1) part of VLPF visually responsive neurons respond specifically to one stimulus or to a small set of stimuli, but there is no indication of a “passive” categorical coding; (2) VLPF neuronal visual responses to objects are often modulated by the task conditions in which the object is observed, with the strongest response when the object is target of an action. These data indicate that VLPF performs an early passive description of several types of visual stimuli, that can then be used for organizing and planning behavior. This could explain the modulation of visual response both in associative learning and in natural behavior.

Ocular fixations and presaccadic potentials to explain pareidolias in Parkinson's disease

In Parkinson's disease, a precursor phenomenon to visual hallucinations presents as 'pareidolias' which make ambiguous forms appear meaningful. To evoke and detect pareidolias in patients, a noise pareidolia test was recently developed, although its task-dependent mechanisms are yet to be revealed. When subjected to this test, we hypothesized that patients exhibiting pareidolias would show altered top-down influence of visual processing allowing us to demonstrate the influence of pareidolic illusionary behaviour in Parkinson's disease patients. To that end, we evaluated eye-movement strategies and fixation-related presaccadic activity on scalp EEG when participants performed the test. Twelve healthy controls and 21 Parkinson's disease patients, evaluated for cognitive, visuo-spatial and executive functions, took a modified computer-based version of the noise pareidolia test in a free-viewing EEG eye-tracking experiment. Eye-tracking metrics (fixation-related durations and counts) documented the eye movement behaviour employed in correct responses (face/noise) and misperceptions (pareidolia/missed) during early and late visual search conditions. Simultaneously, EEG recorded the presaccadic activity in frontal and parietal areas of the brain. Based on the noise pareidolia test scores, we found certain Parkinson's disease patients exhibited pareidolias whereas others did not. ANOVA on eye-tracking data showed that patients dwelled significantly longer to detect faces and pareidolias which affected both global and local search dynamics depending on their visuo-perceptual status. Presaccadic activity in parietal electrodes for the groups was positive for faces and pareidolias, and negative for noise, though these results depended mainly on saccade size. However, patients sensitive to pareidolias showed a significantly higher presaccadic potential on frontal electrodes independent of saccade sizes, suggesting a stronger frontal activation for pareidolic stimuli. We concluded with the following interpretations (i) the noise pareidolia test specifically characterizes visuo-perceptual inadequacies in patients despite their wide range of cognitive scores, (ii) Parkinson's disease patients dwell longer to converge attention to pareidolic stimuli due to abnormal saccade generation proportional to their visuo-perceptual deficit during early search, and during late search, due to time-independent alteration of visual attentional network and (iii) patients with pareidolias show increased frontal activation reflecting the allocation of attention to irrelevant targets that express the pareidolic phenomenon. While the disease per se alters the visuo-perceptual and oculomotor dynamics, pareidolias occur in Parkinson's disease due to an abnormal top-down modulation of visual processing that affects visual attention and guidance to ambiguous stimuli.

Saccadic Eye Movements in Young-Onset Parkinson's Disease - A BOLD fMRI Study

The objective of the present study was to understand control of saccadic eye movements in patients with young onset Parkinson's disease (YOPD) where onset of disease symptoms appears early in life (<40 years of age). Functional magnetic resonance imaging (fMRI) was performed in patients with YOPD and control subjects while they performed saccadic tasks, which consisted of a reflexive task and another task that required inhibitory control of eye movements (Go-NoGo task). Functional imaging related to saccadic eye movements in this group of patients has not been widely reported. A 1.5T MR scanner was used for structural and functional imaging. Analysis of blood-oxygen-level-dependent (BOLD) fMRI was performed using Statistical Parametric Mapping (SPM) software and compared in patients and controls. In patients with YOPD greater activation was seen significantly in the middle frontal gyrus, medial frontal gyrus, angular gyrus, cingulate gyrus, precuneus and cerebellum, when compared with the control group, during the saccadic tasks. Gap and overlap protocols revealed differential activation patterns. The abnormal activation during reflexive saccades was observed in the overlap condition, while during Go-NoGo saccades in the gap condition. The results suggest that impaired circuitry in patients with YOPD results in recruitment of more cortical areas. This increased frontal and parietal cortical activity possibly reflects compensatory mechanisms for impaired cognitive and saccadic circuitry.

Hypomania and saccadic changes in Parkinson's disease: influence of D2 and D3 dopaminergic signalling

In order to understand the influence of two dopaminergic signalling pathways, TaqIA rs1800497 (influencing striatal D2 receptor density) and Ser9Gly rs6280 (influencing the striatal D3 dopamine-binding affinity), on saccade generation and psychiatric comorbidities in Parkinson’s disease, this study aimed to investigate the association of saccadic performance in hypomanic or impulsive behaviour in parkinsonian patients; besides we questioned whether variants of D2 (A1+/A1−) and D3 (B1+/B1−) receptor polymorphism influence saccadic parameters differently, and if clinical parameters or brain connectivity changes modulate this association in the nigro-caudatal and nigro-collicular tract. Initially, patients and controls were compared regarding saccadic performance and differed in the parameter duration in memory-guided saccades (MGS) and visually guided saccades (VGS) trials (p < 0.0001) and in the MGS trial (p < 0.03). We were able to find associations between hypomanic behaviour (HPS) and saccade parameters (duration, latency, gain and amplitude) for both conditions [MGS (p = 0.036); VGS (p = 0.033)], but not for impulsive behaviour. For the A1 variant duration was significantly associated with HPS [VGS (p = 0.024); MGS (p = 0.033)]. In patients with the B1 variant, HPS scores were more consistently associated with duration [VGS (p = 0.005); MGS (p = 0.015), latency [VGS (p = 0.022)]] and amplitude [MGS (p = 0.006); VGS (p = 0.005)]. The mediation analysis only revealed a significant indirect effect for amplitude in the MGS modality for the variable UPDRS-ON (p < 0.05). All other clinical scales and brain connectivity parameters were not associated with behavioural traits. Collectively, our findings stress the role of striatal D2 and D3 signalling mechanisms in saccade generation and suggest that saccadic performance is associated with the clinical psychiatric state in Parkinson’s disease.

Mapping neural dynamics underlying saccade preparation and execution and their relation to reaction time and direction errors

Our ability to control and inhibit automatic behaviors is crucial for negotiating complex environments, all of which require rapid communication between sensory, motor, and cognitive networks. Here, we measured neuromagnetic brain activity to investigate the neural timing of cortical areas needed for inhibitory control, while 14 healthy young adults performed an interleaved prosaccade (look at a peripheral visual stimulus) and antisaccade (look away from stimulus) task. Analysis of how neural activity relates to saccade reaction time (SRT) and occurrence of direction errors (look at stimulus on antisaccade trials) provides insight into inhibitory control. Neuromagnetic source activity was used to extract stimulus‐aligned and saccade‐aligned activity to examine temporal differences between prosaccade and antisaccade trials in brain regions associated with saccade control. For stimulus‐aligned antisaccade trials, a longer SRT was associated with delayed onset of neural activity within the ipsilateral parietal eye field (PEF) and bilateral frontal eye field (FEF). Saccade‐aligned activity demonstrated peak activation 10ms before saccade‐onset within the contralateral PEF for prosaccade trials and within the bilateral FEF for antisaccade trials. In addition, failure to inhibit prosaccades on anti‐saccade trials was associated with increased activity prior to saccade onset within the FEF contralateral to the peripheral stimulus. This work on dynamic activity adds to our knowledge that direction errors were due, at least in part, to a failure to inhibit automatic prosaccades. These findings provide novel evidence in humans regarding the temporal dynamics within oculomotor areas needed for saccade programming and the role frontal brain regions have on top‐down inhibitory control.

Should we pay attention to eye movements? The impact of bilateral eye movements on behavioral and neural responses during the Attention Network Test

Bilateral eye movements (EMs) have been associated with enhancements in episodic memory and creativity. We explored the influence of EMs on behavior and event related potential (ERP) responses during the Attention Network Test (ANT). Participants completed ANT trials after bilateral EMs or a center-fixation control manipulation. We examined condition (EM, control) and handedness (consistent, inconsistent) differences for overall task performance, as well as alerting, orienting, and executive attention networks. Behaviorally, there was a trend for inconsistent-handed participants to display faster RTs across cue types, and greater accuracy for no cue, double, and center cue trials when compared to consistent handers, yet consistent handers garnered greater improvements in behavior following altering and orienting cues than inconsistent handers. Although there were no behavioral differences between EM and control conditions, target-locked N100 and P200 ERPs were weaker in the EM than control condition for all cue types, except spatial cues for which there were no differences between groups. Because stronger N100 and P200 responses have been linked to increased selective attention, we speculate that ERP differences between EM and control conditions, in the absence of behavioral differences, may indicate that participants exposed to EMs required less selective attention to successfully complete the task.

Age-Dependent Performance on Pro-point and Anti-point Tasks

Changes in prefrontal cortex are thought to be responsible for many of the characteristic behavioral changes that are seen during adolescence and late adulthood. Disruption of prefrontal cortex is an early sign for many developmental, neurological, and psychiatric disorders. Goal directed eye movements, such as Anti-saccades, have been shown to have high sensitivity as a gross assessment of prefrontal lobe function. Previous studies on the developmental changes of saccades across age have shown that stimulus-driven and goal-directed eye movements follow a U-shaped trend with peaks in performance occuring during adolescence. Using novel tablet-based pointing tasks, modeled on eye movement tests, this study aims to provide a preliminary understanding of how age affects manual pointing performance, in order to more easily track behavioral changes of the prefrontal cortex. In this study, 82 participants between the ages of 10 and 63 were recruited to participate. Results show that similarly to saccades, manual pointing responses are age dependent with fastest response times found during late adolescence to early adulthood (U-shaped curves). Importantly, we also demonstrated significant differences in the effect of age in stimulus-driven (Pro-point) and goal-directed (Anti-point) pointing tasks. The effect of age on response time (RT) is greater on Anti-point compared to Pro-point task (with a 79 ms greater mean decrease during early development and a 148 ms greater mean increase during later aging). Further, for Pro-point task, the U-shaped curve flattens at about 45 years whereas for Anti-point task the U-shaped curve continues up to the maximum age tested (about 60 years). This dissociation between age-related changes in sensorimotor and cognitive performance suggests independent development of associated brain circuity. Thus, changes of performance in disease that are specific for age and task may be able to help identify brain circuitry involved. Finally, given that these tablet-based pointing tasks show similar age-related patterns reported previously with eye-tracking technology, our findings suggest that such tablet-based tasks may provide an inexpensive, quick, and more practical way of detecting neurological deficits or tracking cognitive changes.

The role of implicit perceptual-motor costs in the integration of information across graph and text

Strategies used to gather visual information are typically viewed as depending solely on the value of information gained from each action. A different approach may be required when actions entail cognitive effort or deliberate control. Integration of information across a graph and text is a resource-intensive task in which decisions to switch between graph and text may take into account the resources required to plan or execute the switches. Participants viewed a graph and text depicting attributes of two fictitious products and were asked to select the preferred product. Graph and text were presented: (1) simultaneously, side by side; (2) sequentially, where the appearance of graph or text was triggered by a button press, or (3) sequentially, where the appearance of graph or text was triggered by a saccade, thus requiring cognitive effort, memory, or controlled processing to access regions out of immediate view. Switches between graph and text were rare during initial readings, consistent with prior observations of perceptual "switch costs." Switches became more frequent during re-inspections (80% of time). Switches were twice as frequent in the simultaneous condition than in either sequential condition (button press or saccade-contingent), showing the importance of perceptual availability. These results show that strategies used to gather information while reading a graph and text are not based solely on information value, but also on implicit costs of switching, such as effort level, working memory load, or demand on controlled processing. Taking implicit costs into account is important for a complete understanding of strategies used to gather visual information.

Deep temporal models and active inference

How do we navigate a deeply structured world? Why are you reading this sentence first - and did you actually look at the fifth word? This review offers some answers by appealing to active inference based on deep temporal models. It builds on previous formulations of active inference to simulate behavioural and electrophysiological responses under hierarchical generative models of state transitions. Inverting these models corresponds to sequential inference, such that the state at any hierarchical level entails a sequence of transitions in the level below. The deep temporal aspect of these models means that evidence is accumulated over nested time scales, enabling inferences about narratives (i.e., temporal scenes). We illustrate this behaviour with Bayesian belief updating - and neuronal process theories - to simulate the epistemic foraging seen in reading. These simulations reproduce perisaccadic delay period activity and local field potentials seen empirically. Finally, we exploit the deep structure of these models to simulate responses to local (e.g., font type) and global (e.g., semantic) violations; reproducing mismatch negativity and P300 responses respectively.

Changes in brain connectivity following exposure to bilateral eye movements

The present research assessed how engaging in bilateral eye movements influences brain activity. Participants had their resting-state brain activity recorded with electroencephalography (EEG) before and after they performed 30 s of bilateral eye movements or a center-control manipulation. We assessed differences in change scores for absolute power and coherence between the eye-movement and center-control conditions. A main effect for handedness was present for EEG power in the theta and beta frequency bands, with inconsistent-handed participants displaying a greater increase than consistent-handed participants in both frequency bands. For theta, the increase in power for inconsistent handers was specific to participants in the bilateral eye-movement condition, whose increase in theta power exceeded the increase in theta power for consistent-handed participants regardless of condition. In contrast, for coherence, a main effect for condition was present for the delta frequency band, with participants in the control condition exhibiting a significant drop in posterior delta coherence pre to post. We suggest that the maintenance of posterior delta coherence over time may be an important factor in sustaining attention. Further, the malleability of EEG power for inconsistent-handed participants reveals the importance of individual-differences variables in the potential for behavioral manipulations to change brain activity.

Attentional Changes in Either Criterion or Sensitivity Are Associated with Robust Modulations in Lateral Prefrontal Cortex

Visual attention is associated with neuronal changes across the brain, and these widespread signals are generally assumed to underlie a unitary mechanism of attention. However, using signal detection theory, attention-related effects on performance can be partitioned into changes in either the subject's criterion or sensitivity. Neuronal modulations associated with only sensitivity changes were previously observed in visual cortex, raising questions about which structures mediate attention-related changes in criterion and whether individual neurons are involved in multiple components of attention. Here, we recorded from monkey lateral prefrontal cortex (LPFC) and found that, in contrast to visual cortex, neurons in LPFC changed their firing rates, pairwise correlation, and Fano factor when subjects changed either their criterion or their sensitivity. These results indicate that attention-related neuronal modulations in separate brain regions are not a monolithic signal and instead can be linked to distinct behavioral changes.

The graphical brain: Belief propagation and active inference

This paper considers functional integration in the brain from a computational perspective. We ask what sort of neuronal message passing is mandated by active inference-and what implications this has for context-sensitive connectivity at microscopic and macroscopic levels. In particular, we formulate neuronal processing as belief propagation under deep generative models. Crucially, these models can entertain both discrete and continuous states, leading to distinct schemes for belief updating that play out on the same (neuronal) architecture. Technically, we use Forney (normal) factor graphs to elucidate the requisite message passing in terms of its form and scheduling. To accommodate mixed generative models (of discrete and continuous states), one also has to consider link nodes or factors that enable discrete and continuous representations to talk to each other. When mapping the implicit computational architecture onto neuronal connectivity, several interesting features emerge. For example, Bayesian model averaging and comparison, which link discrete and continuous states, may be implemented in thalamocortical loops. These and other considerations speak to a computational connectome that is inherently state dependent and self-organizing in ways that yield to a principled (variational) account. We conclude with simulations of reading that illustrate the implicit neuronal message passing, with a special focus on how discrete (semantic) representations inform, and are informed by, continuous (visual) sampling of the sensorium.

AUTHOR SUMMARY

This paper considers functional integration in the brain from a computational perspective. We ask what sort of neuronal message passing is mandated by active inference-and what implications this has for context-sensitive connectivity at microscopic and macroscopic levels. In particular, we formulate neuronal processing as belief propagation under deep generative models that can entertain both discrete and continuous states. This leads to distinct schemes for belief updating that play out on the same (neuronal) architecture. Technically, we use Forney (normal) factor graphs to characterize the requisite message passing, and link this formal characterization to canonical microcircuits and extrinsic connectivity in the brain.

Prefrontal Contribution to Decision-Making under Free-Choice Conditions

Executive function is thought to be the coordinated operation of multiple neural processes and allows to accomplish a current goal flexibly. The most important function of the prefrontal cortex is the executive function. Among a variety of executive functions in which the prefrontal cortex participates, decision-making is one of the most important. Although the prefrontal contribution to decision-making has been examined using a variety of behavioral tasks, recent studies using fMRI have shown that the prefrontal cortex participates in decision-making under free-choice conditions. Since decision-making under free-choice conditions represents the very first stage for any kind of decision-making process, it is important that we understand its neural mechanism. Although few studies have examined this issue while a monkey performed a free-choice task, those studies showed that, when the monkey made a decision to subsequently choose one particular option, prefrontal neurons showing selectivity to that option exhibited transient activation just before presentation of the imperative cue. Further studies have suggested that this transient increase is caused by the irregular fluctuation of spontaneous firing just before cue presentation, which enhances the response to the cue and biases the strength of the neuron's selectivity to the option. In addition, this biasing effect was observed only in neurons that exhibited sustained delay-period activity, indicating that this biasing effect not only influences the animal's decision for an upcoming choice, but also is linked to working memory mechanisms in the prefrontal cortex.

Deep temporal models and active inference

How do we navigate a deeply structured world? Why are you reading this sentence first - and did you actually look at the fifth word? This review offers some answers by appealing to active inference based on deep temporal models. It builds on previous formulations of active inference to simulate behavioural and electrophysiological responses under hierarchical generative models of state transitions. Inverting these models corresponds to sequential inference, such that the state at any hierarchical level entails a sequence of transitions in the level below. The deep temporal aspect of these models means that evidence is accumulated over nested time scales, enabling inferences about narratives (i.e., temporal scenes). We illustrate this behaviour with Bayesian belief updating - and neuronal process theories - to simulate the epistemic foraging seen in reading. These simulations reproduce perisaccadic delay period activity and local field potentials seen empirically. Finally, we exploit the deep structure of these models to simulate responses to local (e.g., font type) and global (e.g., semantic) violations; reproducing mismatch negativity and P300 responses respectively.

Working Memory in the Prefrontal Cortex

The prefrontal cortex participates in a variety of higher cognitive functions. The concept of working memory is now widely used to understand prefrontal functions. Neurophysiological studies have revealed that stimulus-selective delay-period activity is a neural correlate of the mechanism for temporarily maintaining information in working memory processes. The central executive, which is the master component of Baddeley's working memory model and is thought to be a function of the prefrontal cortex, controls the performance of other components by allocating a limited capacity of memory resource to each component based on its demand. Recent neurophysiological studies have attempted to reveal how prefrontal neurons achieve the functions of the central executive. For example, the neural mechanisms of memory control have been examined using the interference effect in a dual-task paradigm. It has been shown that this interference effect is caused by the competitive and overloaded recruitment of overlapping neural populations in the prefrontal cortex by two concurrent tasks and that the information-processing capacity of a single neuron is limited to a fixed level, can be flexibly allocated or reallocated between two concurrent tasks based on their needs, and enhances behavioral performance when its allocation to one task is increased. Further, a metamemory task requiring spatial information has been used to understand the neural mechanism for monitoring its own operations, and it has been shown that monitoring the quality of spatial information represented by prefrontal activity is an important factor in the subject's choice and that the strength of spatially selective delay-period activity reflects confidence in decision-making. Although further studies are needed to elucidate how the prefrontal cortex controls memory resource and supervises other systems, some important mechanisms related to the central executive have been identified.

The graphical brain: Belief propagation and active inference

This paper considers functional integration in the brain from a computational perspective. We ask what sort of neuronal message passing is mandated by active inference-and what implications this has for context-sensitive connectivity at microscopic and macroscopic levels. In particular, we formulate neuronal processing as belief propagation under deep generative models. Crucially, these models can entertain both discrete and continuous states, leading to distinct schemes for belief updating that play out on the same (neuronal) architecture. Technically, we use Forney (normal) factor graphs to elucidate the requisite message passing in terms of its form and scheduling. To accommodate mixed generative models (of discrete and continuous states), one also has to consider link nodes or factors that enable discrete and continuous representations to talk to each other. When mapping the implicit computational architecture onto neuronal connectivity, several interesting features emerge. For example, Bayesian model averaging and comparison, which link discrete and continuous states, may be implemented in thalamocortical loops. These and other considerations speak to a computational connectome that is inherently state dependent and self-organizing in ways that yield to a principled (variational) account. We conclude with simulations of reading that illustrate the implicit neuronal message passing, with a special focus on how discrete (semantic) representations inform, and are informed by, continuous (visual) sampling of the sensorium.

AUTHOR SUMMARY

This paper considers functional integration in the brain from a computational perspective. We ask what sort of neuronal message passing is mandated by active inference-and what implications this has for context-sensitive connectivity at microscopic and macroscopic levels. In particular, we formulate neuronal processing as belief propagation under deep generative models that can entertain both discrete and continuous states. This leads to distinct schemes for belief updating that play out on the same (neuronal) architecture. Technically, we use Forney (normal) factor graphs to characterize the requisite message passing, and link this formal characterization to canonical microcircuits and extrinsic connectivity in the brain.

Dopamine D1 and D2 Receptors Make Dissociable Contributions to Dorsolateral Prefrontal Cortical Regulation of Rule-Guided Oculomotor Behavior

Studies of neuromodulation of spatial short-term memory have shown that dopamine D1 receptor (D1R) stimulation in dorsolateral prefrontal cortex (DLPFC) dose-dependently modulates memory activity, whereas D2 receptors (D2Rs) selectively modulate activity related to eye movements hypothesized to encode movement feedback. We examined localized stimulation of D1Rs and D2Rs on DLPFC neurons engaged in a task involving rule representation in memory to guide appropriate eye movements toward or away from a visual stimulus. We found dissociable effects of D1R and D2R on DLPFC physiology. D1R stimulation degrades memory activity for the task rule and increases stimulus-related selectivity. In contrast, D2R stimulation affects motor activity tuning only when eye movements are made to the stimulus. Only D1R stimulation degrades task performance and increases impulsive responding. Our results suggest that D1Rs regulate rule representation and impulse control, whereas D2Rs selectively modulate eye-movement-related dynamics and not rule representation in the DLPFC.

What Do Eye Gaze Metrics Tell Us about Motor Imagery?

Many of the brain structures involved in performing real movements also have increased activity during imagined movements or during motor observation, and this could be the neural substrate underlying the effects of motor imagery in motor learning or motor rehabilitation. In the absence of any objective physiological method of measurement, it is currently impossible to be sure that the patient is indeed performing the task as instructed. Eye gaze recording during a motor imagery task could be a possible way to "spy" on the activity an individual is really engaged in. The aim of the present study was to compare the pattern of eye movement metrics during motor observation, visual and kinesthetic motor imagery (VI, KI), target fixation, and mental calculation. Twenty-two healthy subjects (16 females and 6 males), were required to perform tests in five conditions using imagery in the Box and Block Test tasks following the procedure described by Liepert et al. Eye movements were analysed by a non-invasive oculometric measure (SMI RED250 system). Two parameters describing gaze pattern were calculated: the index of ocular mobility (saccade duration over saccade + fixation duration) and the number of midline crossings (i.e. the number of times the subjects gaze crossed the midline of the screen when performing the different tasks). Both parameters were significantly different between visual imagery and kinesthesic imagery, visual imagery and mental calculation, and visual imagery and target fixation. For the first time we were able to show that eye movement patterns are different during VI and KI tasks. Our results suggest gaze metric parameters could be used as an objective unobtrusive approach to assess engagement in a motor imagery task. Further studies should define how oculomotor parameters could be used as an indicator of the rehabilitation task a patient is engaged in.

Modulation of cognitive control levels via manipulation of saccade trial-type probability assessed with event-related BOLD fMRI

Cognitive control supports flexible behavior adapted to meet current goals and can be modeled through investigation of saccade tasks with varying cognitive demands. Basic prosaccades (rapid glances toward a newly appearing stimulus) are supported by neural circuitry, including occipital and posterior parietal cortex, frontal and supplementary eye fields, and basal ganglia. These trials can be contrasted with complex antisaccades (glances toward the mirror image location of a stimulus), which are characterized by greater functional magnetic resonance imaging (MRI) blood oxygenation level-dependent (BOLD) signal in the aforementioned regions and recruitment of additional regions such as dorsolateral prefrontal cortex. The current study manipulated the cognitive demands of these saccade tasks by presenting three rapid event-related runs of mixed saccades with a varying probability of antisaccade vs. prosaccade trials (25, 50, or 75%). Behavioral results showed an effect of trial-type probability on reaction time, with slower responses in runs with a high antisaccade probability. Imaging results exhibited an effect of probability in bilateral pre- and postcentral gyrus, bilateral superior temporal gyrus, and medial frontal gyrus. Additionally, the interaction between saccade trial type and probability revealed a strong probability effect for prosaccade trials, showing a linear increase in activation parallel to antisaccade probability in bilateral temporal/occipital, posterior parietal, medial frontal, and lateral prefrontal cortex. In contrast, antisaccade trials showed elevated activation across all runs. Overall, this study demonstrated that improbable performance of a typically simple prosaccade task led to augmented BOLD signal to support changing cognitive control demands, resulting in activation levels similar to the more complex antisaccade task.

Functions of delay-period activity in the prefrontal cortex and mnemonic scotomas revisited

Working memory (WM) is one of key concepts to understand functions of the prefrontal cortex. Delay-period activity is an important neural correlate to understand the role of WM in prefrontal functions. The importance of delay-period activity is that this activity can encode not only visuospatial information but also a variety of information including non-spatial visual features, auditory and tactile stimuli, task rules, expected reward, and numerical quantity. This activity also participates in a variety of information processing including sensory-to-motor information transformation. These mnemonic features of delay-period activity enable to perform various important operations that the prefrontal cortex participates in, such as executive controls, and therefore, support the notion that WM is an important function to understand prefrontal functions. On the other hand, although experiments using manual versions of the delayed-response task had revealed many important findings, an oculomotor version of this task enabled us to use multiple cue positions, exclude postural orientation during the delay period, and further prove the importance of mnemonic functions of the prefrontal cortex. In addition, monkeys with unilateral lesions exhibited specific impairment only in the performance of memory-guided saccades directed toward visual cues in the visual field contralateral to the lesioned hemisphere. This result indicates that memories for visuospatial coordinates in each hemifield are processed primarily in the contralateral prefrontal cortex. This result further strengthened the idea of mnemonic functions of the prefrontal cortex. Thus, the mnemonic functions of the prefrontal cortex and delay-period activity may not need to be reconsidered, but should be emphasized.

Evidence for a functional subdivision of Premotor Ear-Eye Field (Area 8B)

The Supplementary Eye Field (SEF) and the Frontal Eye Field (FEF) have been described as participating in gaze shift control. Recent evidence suggests, however, that other areas of the dorsomedial prefrontal cortex also influence gaze shift. Herein, we have investigated electrically evoked ear- and eye movements from the Premotor Ear-Eye Field, or PEEF (area 8B) of macaque monkeys. We stimulated PEEF during spontaneous condition (outside the task performance) and during the execution of a visual fixation task (VFT). In the first case, we functionally identified two regions within the PEEF: a core and a belt. In the core region, stimulation elicited forward ear movements; regarding the evoked eye movements, in some penetrations, stimulation elicited contraversive fixed-vectors with a mean amplitude of 5.14°; while in other penetrations, we observed prevalently contralateral goal-directed eye movements having end-points that fell within 15° in respect to the primary eye position. On the contrary, in the belt region, stimulation elicited backward ear movements; regarding the eye movements, in some penetrations stimulation elicited prevalently contralateral goal-directed eye movements having end-points that fell within 15° in respect to the primary eye position, while in the lateral edge of the investigated region, stimulation elicited contralateral goal-directed eye movements having end-points that fell beyond 15° in respect to the primary eye position. Stimulation during VFT either did not elicit eye movements or evoked saccades of only a few degrees. Finally, even though no head rotation movements were observed during the stimulation period, we viewed a relationship between the duration of stimulation and the neck forces exerted by the monkey's head. We propose an updated vision of the PEEF composed of two functional regions, core and belt, which may be involved in integrating auditory and visual information important to the programming of gaze orienting movements.

Educating the blind brain: a panorama of neural bases of vision and of training programs in organic neurovisual deficits

Vision is a complex function, which is achieved by movements of the eyes to properly foveate targets at any location in 3D space and to continuously refresh neural information in the different visual pathways. The visual system involves five main routes originating in the retinas but varying in their destination within the brain: the occipital cortex, but also the superior colliculus (SC), the pretectum, the supra-chiasmatic nucleus, the nucleus of the optic tract and terminal dorsal, medial and lateral nuclei. Visual pathway architecture obeys systematization in sagittal and transversal planes so that visual information from left/right and upper/lower hemi-retinas, corresponding respectively to right/left and lower/upper visual fields, is processed ipsilaterally and ipsialtitudinally to hemi-retinas in left/right hemispheres and upper/lower fibers. Organic neurovisual deficits may occur at any level of this circuitry from the optic nerve to subcortical and cortical destinations, resulting in low or high-level visual deficits. In this didactic review article, we provide a panorama of the neural bases of eye movements and visual systems, and of related neurovisual deficits. Additionally, we briefly review the different schools of rehabilitation of organic neurovisual deficits, and show that whatever the emphasis is put on action or perception, benefits may be observed at both motor and perceptual levels. Given the extent of its neural bases in the brain, vision in its motor and perceptual aspects is also a useful tool to assess and modulate central nervous system (CNS) in general.