Neural computations underlying arbitration between model-based and model-free learning

There is accumulating neural evidence to support the existence of two distinct systems for guiding action selection, a deliberative "model-based" and a reflexive "model-free" system. However, little is known about how the brain determines which of these systems controls behavior at one moment in time. We provide evidence for an arbitration mechanism that allocates the degree of control over behavior by model-based and model-free systems as a function of the reliability of their respective predictions. We show that the inferior lateral prefrontal and frontopolar cortex encode both reliability signals and the output of a comparison between those signals, implicating these regions in the arbitration process. Moreover, connectivity between these regions and model-free valuation areas is negatively modulated by the degree of model-based control in the arbitrator, suggesting that arbitration may work through modulation of the model-free valuation system when the arbitrator deems that the model-based system should drive behavior.

Postdiction: its implications on visual awareness, hindsight, and sense of agency

There are a few postdictive perceptual phenomena known, in which a stimulus presented later seems causally to affect the percept of another stimulus presented earlier. While backward masking provides a classical example, the flash lag effect stimulates theorists with a variety of intriguing findings. The TMS-triggered scotoma together with “backward filling-in” of it offer a unique neuroscientific case. Findings suggest that various visual attributes are reorganized in a postdictive fashion to be consistent with each other, or to be consistent in a causality framework. In terms of the underlying mechanisms, four prototypical models have been considered: the “catch up,” the “reentry,” the “different pathway” and the “memory revision” models. By extending the list of postdictive phenomena to memory, sensory-motor and higher-level cognition, one may note that such a postdictive reconstruction may be a general principle of neural computation, ranging from milliseconds to months in a time scale, from local neuronal interactions to long-range connectivity, in the complex brain. The operational definition of the “postdictive phenomenon” can be applicable to such a wide range of sensory/cognitive effects across a wide range of time scale, even though the underlying neural mechanisms may vary across them. This has significant implications in interpreting “free will” and “sense of agency” in functional, psychophysical and neuroscientific terms.

Changing the mind? Not really-activity and connectivity in the caudate correlates with changes of choice

Changes in preference are inherently subjective and internal psychological events. We have identified brain events that presage ultimate (rather than intervening) choices, and signal the finality of a choice. At the first exposure to a pair of faces, caudate activity reflected the face of final choice, even if an initial choice was different. Furthermore, the orbitofrontal cortex and hippocampus exhibited correlations only when the subject had made a choice that would not change.

Noninvasive remote activation of the ventral midbrain by transcranial direct current stimulation of prefrontal cortex

The midbrain lies deep within the brain and has an important role in reward, motivation, movement and the pathophysiology of various neuropsychiatric disorders such as Parkinson's disease, schizophrenia, depression and addiction. To date, the primary means of acting on this region has been with pharmacological interventions or implanted electrodes. Here we introduce a new noninvasive brain stimulation technique that exploits the highly interconnected nature of the midbrain and prefrontal cortex to stimulate deep brain regions. Using transcranial direct current stimulation (tDCS) of the prefrontal cortex, we were able to remotely activate the interconnected midbrain and cause increases in participants' appraisals of facial attractiveness. Participants with more enhanced prefrontal/midbrain connectivity following stimulation exhibited greater increases in attractiveness ratings. These results illustrate that noninvasive direct stimulation of prefrontal cortex can induce neural activity in the distally connected midbrain, which directly effects behavior. Furthermore, these results suggest that this tDCS protocol could provide a promising approach to modulate midbrain functions that are disrupted in neuropsychiatric disorders.

Happy faces are preferred regardless of familiarity--sad faces are preferred only when familiar

Familiarity leads to preference (e.g., the mere exposure effect), yet it remains unknown whether it is objective familiarity, that is, repetitive exposure, or subjective familiarity that contributes to preference. In addition, it is unexplored whether and how different emotions influence familiarity-related preference. The authors investigated whether happy or sad faces are preferred or perceived as more familiar and whether this subjective familiarity judgment correlates with preference for different emotional faces. An emotional face--happy or sad--was paired with a neutral face, and participants rated the relative preference and familiarity of each of the paired faces. For preference judgment, happy faces were preferred and sad faces were less preferred, compared with neutral faces. For familiarity judgment, happy faces did not show any bias, but sad faces were perceived as less familiar than neutral faces. Item-by-item correlational analyses show preference for sad faces--but not happy faces--positively correlate with familiarity. These results suggest a direct link between positive emotion and preference, and argue at least partly against a common cause for familiarity and preference. Instead, facial expression of different emotional valence modulates the link between familiarity and preference.

Interpersonal body and neural synchronization as a marker of implicit social interaction

One may have experienced his or her footsteps unconsciously synchronize with the footsteps of a friend while walking together, or heard an audience's clapping hands naturally synchronize into a steady rhythm. However, the mechanisms of body movement synchrony and the role of this phenomenon in implicit interpersonal interactions remain unclear. We aimed to evaluate unconscious body movement synchrony changes as an index of implicit interpersonal interaction between the participants, and also to assess the underlying neural correlates and functional connectivity among and within the brain regions. We found that synchrony of both fingertip movement and neural activity between the two participants increased after cooperative interaction. These results suggest that the increase of interpersonal body movement synchrony via interpersonal interaction can be a measurable basis of implicit social interaction. The paradigm provides a tool for identifying the behavioral and the neural correlates of implicit social interaction.

Shared Visual Attention Reduces Hindsight Bias

Hindsight bias is the tendency to retrospectively think of outcomes as being more foreseeable than they actually were. It is a robust judgment bias and is difficult to correct (or “debias”). In the experiments reported here, we used a visual paradigm in which performers decided whether blurred photos contained humans. Evaluators, who saw the photos unblurred and thus knew whether a human was present, estimated the proportion of participants who guessed whether a human was present. The evaluators exhibited visual hindsight bias in a way that matched earlier data from judgments of historical events surprisingly closely. Using eye tracking, we showed that a higher correlation between the gaze patterns of performers and evaluators (shared attention) is associated with lower hindsight bias. This association was validated by a causal method for debiasing: Showing the gaze patterns of the performers to the evaluators as they viewed the stimuli reduced the extent of hindsight bias.

How we choose one over another: predicting trial-by-trial preference decision

Preference formation is a complex problem as it is subjective, involves emotion, is led by implicit processes, and changes depending on the context even within the same individual. Thus, scientific attempts to predict preference are challenging, yet quite important for basic understanding of human decision making mechanisms, but prediction in a group-average sense has only a limited significance. In this study, we predicted preferential decisions on a trial by trial basis based on brain responses occurring before the individuals made their decisions explicit. Participants made a binary preference decision of approachability based on faces while their electrophysiological responses were recorded. An artificial neural network based pattern-classifier was used with time-frequency resolved patterns of a functional connectivity measure as features for the classifier. We were able to predict preference decisions with a mean accuracy of 74.3±2.79% at participant-independent level and of 91.4±3.8% at participant-dependent level. Further, we revealed a causal role of the first impression on final decision and demonstrated the temporal trajectory of preference decision formation.

Neural mechanisms underlying paradoxical performance for monetary incentives are driven by loss aversion

Employers often make payment contingent on performance in order to motivate workers. We used fMRI with a novel incentivized skill task to examine the neural processes underlying behavioral responses to performance-based pay. We found that individuals' performance increased with increasing incentives; however, very high incentive levels led to the paradoxical consequence of worse performance. Between initial incentive presentation and task execution, striatal activity rapidly switched between activation and deactivation in response to increasing incentives. Critically, decrements in performance and striatal deactivations were directly predicted by an independent measure of behavioral loss aversion. These results suggest that incentives associated with successful task performance are initially encoded as a potential gain; however, when actually performing a task, individuals encode the potential loss that would arise from failure.

Orbitofrontal cortical activity during repeated free choice

Neurons in the orbitofrontal cortex (OFC) have been shown to encode subjective values, suggesting a role in preference-based decision-making, although the precise relation to choice behavior is unclear. In a repeated two-choice task, subjective values of each choice can account for aggregate choice behavior, which is the overall likelihood of choosing one option over the other. Individual choices, however, are impossible to predict with knowledge of relative subjective values alone. In this study we investigated the role of internal factors in choice behavior with a simple but novel free-choice task and simultaneous recording from individual neurons in nonhuman primate OFC. We found that, first, the observed sequences of choice behavior included periods of exceptionally long runs of each of two available options and periods of frequent switching. Neither a satiety-based mechanism nor a random selection process could explain the observed choice behavior. Second, OFC neurons encode important features of the choice behavior. These features include activity selective for exceptionally long runs of a given choice (stay selectivity) as well as activity selective for switches between choices (switch selectivity). These results suggest that OFC neural activity, in addition to encoding subjective values on a long timescale that is sensitive to satiety, also encodes a signal that fluctuates on a shorter timescale and thereby reflects some of the statistically improbable aspects of free-choice behavior.

Mirror adaptation in sensory-motor simultaneity

Background

When one watches a sports game, one may feel her/his own muscles moving in synchrony with the player's. Such parallels between observed actions of others and one's own has been well supported in the latest progress in neuroscience, and coined “mirror system.” It is likely that due to such phenomena, we are able to learn motor skills just by observing an expert's performance. Yet it is unknown whether such indirect learning occurs only at higher cognitive levels, or also at basic sensorimotor levels where sensorimotor delay is compensated and the timing of sensory feedback is constantly calibrated.

Methodology/Principal Findings

Here, we show that the subject's passive observation of an actor manipulating a computer mouse with delayed auditory feedback led to shifts in subjective simultaneity of self mouse manipulation and auditory stimulus in the observing subjects. Likewise, self adaptation to the delayed feedback modulated the simultaneity judgment of the other subjects manipulating a mouse and an auditory stimulus. Meanwhile, subjective simultaneity of a simple visual disc and the auditory stimulus (flash test) was not affected by observation of an actor nor self-adaptation.

Conclusions/Significance

The lack of shift in the flash test for both conditions indicates that the recalibration transfer is specific to the action domain, and is not due to a general sensory adaptation. This points to the involvement of a system for the temporal monitoring of actions, one that processes both one's own actions and those of others.