Flawless visual short-term memory for facial emotional expressions

Effect of force-rate on continuous kinesthetic force discrimination

The effect of force-rate, i.e., rate of change of force stimuli, on continuous kinesthetic force perception has not been investigated and remains an open area for research. Previous studies do not account for the force-rate in the Weber fraction of kinesthetic force discrimination. However, this force-rate agnostic Weber fraction fails to explain continuous kinesthetic force discrimination fully. For example, if the signal changes very slowly, a participant may get accustomed to the change, and hence, a larger, just noticeable difference (JND) is expected. Conversely, for a fast-varying haptic force, a smaller JND is expected. In this work, we aim to explore the relationship between the Weber fraction and the force-rate. For this purpose, we designed an extensive psychophysical experiment where a participant is exposed to a linearly increasing kinesthetic force stimulus and is asked to react to the change. We utilize a machine learning-based approach to study the effect of force-rate on recorded haptic responses (perceived and non-perceived) of 10 participants while varying the force-rate stimuli in the range [1, 5] N/s. We determine the perceptual boundary between the perceived and non-perceived recorded responses using different classifiers based on linear and power functions of force-rate. The result indicates that the Weber fraction decreases significantly as the force-rate increases. The random forest classifier also confirms the significance of the utilized features in both perceptual boundaries. These findings may be useful in many virtual reality applications and telepresence and teleaction systems (TPTA).

Why do children with autism spectrum disorder have abnormal visual perception?

Autism spectrum disorder (ASD) is associated with severe impairment in social functioning. Visual information processing provides nonverbal cues that support social interactions. ASD children exhibit abnormalities in visual orientation, continuous visual exploration, and visual-spatial perception, causing social dysfunction, and mechanisms underlying these abnormalities remain unclear. Transmission of visual information depends on the retina-lateral geniculate nucleus-visual cortex pathway. In ASD, developmental abnormalities occur in rapid expansion of the visual cortex surface area with constant thickness during early life, causing abnormal transmission of the peak of the visual evoked potential (P100). We hypothesized that abnormal visual perception in ASD are related to the abnormal visual information transmission and abnormal development of visual cortex in early life, what's more, explored the mechanisms of abnormal visual symptoms to provide suggestions for future research.

Time Delay Affects Thermal Discrimination

Time order errors have been investigated in several fields, and the time delay between subsequent stimuli in discrimination tasks is one example of such errors. However, the effect of these types of errors in thermal discrimination tasks is understudied. To evaluate the effect of inter-stimulus interval (ISI) on thermal perception, we used a discrimination task with a staircase method between two non-zero thermal stimuli. We found that JND _ISI=0s was 3.10 and increased by 11.9% and 21.2% at JND _ISI=3s and JND _ISI=9s, respectively. Statistical analysis revealed that ISI was a statistically significant effect ( ) on thermal perception in our task. Future studies on thermal perception should keep the ISI consistent and report the time.

Evidence of gradual loss of precision for simple features and complex objects in visual working memory

Previous studies have suggested that people can maintain prioritized items in visual working memory for many seconds, with negligible loss of information over time. Such findings imply that working memory representations are robust to the potential contaminating effects of internal noise. However, once visual information is encoded into working memory, one might expect it to inevitably begin degrading over time, as this actively maintained information is no longer tethered to the original perceptual input. Here, we examined this issue by evaluating working memory for single central presentations of an oriented grating, color patch, or face stimulus, across a range of delay periods (1, 3, 6, or 12 s). We applied a mixture-model analysis to distinguish changes in memory precision over time from changes in the frequency of outlier responses that resemble random guesses. For all 3 types of stimuli, participants exhibited a clear and consistent decline in the precision of working memory as a function of temporal delay, as well as a modest increase in guessing-related responses for colored patches and face stimuli. We observed a similar loss of precision over time while controlling for temporal distinctiveness. Our results demonstrate that visual working memory is far from lossless: while basic visual features and complex objects can be maintained in a quite stable manner over time, these representations are still subject to noise accumulation and complete termination. (PsycINFO Database Record

Interhemispheric ERP asymmetries over inferior parietal cortex reveal differential visual working memory maintenance for fearful versus neutral facial identities

The goal of the present investigation was to discover whether visual working memory maintenance for faces is modulated by facial expression using event-related potentials (ERPs). Each trial consisted of two sequential arrays, a memory array and a test array, each including either two or four faces with neutral or fearful expressions. The faces were displayed to the left and to the right of a central fixation cross. Two central arrows cued participants to encode one face or two faces displayed on one side of the memory array. The sustained posterior contralateral negativity (SPCN) component of the ERP time-locked to the onset of the memory array was used as an index of visual working memory maintenance. Visual working memory performance was quantified using indexes of memory capacity (Cowan's K and K-iterative), a standard index of sensitivity (d'), and reaction times (RTs). Relative to neutral faces, superior memory and longer change-detection RTs to fearful face identities were observed when two faces were displayed on the cued side of the memory array. Fearful faces elicited an enhanced SPCN relative to neutral faces, especially when only one face was displayed on the cued side of the memory array. These findings suggest increased maintenance in visual working memory of faces with a fearful expression relative to faces with a neutral expression and that the representational format in which fearful faces are stored in memory may be characterized by enhanced resolution relative to that subtended in the maintenance of neutral faces.

The Effect of Fearful Expressions on Multiple Face Tracking

How does the visual system realize dynamic tracking? This topic has become popular within cognitive science in recent years. The classical theory argues that multiple object tracking is accomplished via pre-attention visual indexes as part of a cognitively impenetrable low-level visual system. The present research aimed to investigate whether and how tracking processes are influenced by facial expressions that convey abundant social information about one’s mental state and situated environment. The results showed that participants tracked fearful faces more effectively than neutral faces. However, this advantage was only present under the low-attentional load condition, and distractor face emotion did not impact tracking performance. These findings imply that visual tracking is not driven entirely by low-level vision and encapsulated by high-level representations; rather, that facial expressions, a kind of social information, are able to influence dynamic tracking. Furthermore, the effect of fearful expressions on multiple face tracking is mediated by the availability of attentional resources.

Phase noise reveals early category-specific modulation of the event-related potentials

Previous studies have found that the amplitude of the early event-related potential (ERP) components evoked by faces, such as N170 and P2, changes systematically as a function of noise added to the stimuli. This change has been linked to an increased perceptual processing demand and to enhanced difficulty in perceptual decision making about faces. However, to date it has not yet been tested whether noise manipulation affects the neural correlates of decisions about face and non-face stimuli similarly. To this end, we measured the ERPs for faces and cars at three different phase noise levels. Subjects performed the same two-alternative age-discrimination task on stimuli chosen from young–old morphing continua that were created from faces as well as cars and were calibrated to lead to similar performances at each noise-level. Adding phase noise to the stimuli reduced performance and enhanced response latency for the two categories to the same extent. Parallel to that, phase noise reduced the amplitude and prolonged the latency of the face-specific N170 component. The amplitude of the P1 showed category-specific noise dependence: it was enhanced over the right hemisphere for cars and over the left hemisphere for faces as a result of adding phase noise to the stimuli, but remained stable across noise levels for cars over the left and for faces over the right hemisphere. Moreover, noise modulation altered the category-selectivity of the N170, while the P2 ERP component, typically associated with task decision difficulty, was larger for the more noisy stimuli regardless of stimulus category. Our results suggest that the category-specificity of noise-induced modulations of ERP responses starts at around 100 ms post-stimulus.

A perception-based ERP reveals that the magnitude of delay matters for memory-guided reaching

Delayed action research has suggested that perceptual information about a visual stimulus decays over several seconds. With event-related potential (ERP) methodology, one should be able to track the time course of the electrophysiological processes associated with this decay. Recently, Cruikshank et al. (J Vis 12:29, 2012) found that the N170 ERP component reflected ventral stream processes linked to motor planning and perception for action. Specifically, the N170 was larger for actions that relied on perceptual-based information. However, the delay interval was very short (tens of ms). Behavioral and neuroimaging studies suggest that when longer delays are employed, reactivation of ventral areas is necessary in order to access a stored representation of the target's characteristics. Therefore, the N170 may reflect not only the perception-for-action processes, but also the accuracy of the representation. In order to test this, we traced the time course of the N170 in memory-guided reaching when 1-, 2-, and 3-s delays separated target occlusion and response initiation. During reach initiation, the N170 was more negative and peaked earlier for the 1 s than the 2- and 3-s delays and correlated significantly with performance at the longest delay. These results suggest that the neural mechanisms involved in movement planning change for delays beyond 1 s. The smaller N170 may reflect an impoverished visual perceptual representation in the ventral stream. To our knowledge, these are the first electrophysiological results to suggest that there is decay of visual perceptual information that occurs with increasing time.

Working memory deficits in high-functioning adolescents with autism spectrum disorders: neuropsychological and neuroimaging correlates

Working memory is a temporary storage system under attentional control. It is believed to play a central role in online processing of complex cognitive information and may also play a role in social cognition and interpersonal interactions. Adolescents with a disorder on the autism spectrum display problems in precisely these domains. Social impairments, communication difficulties, and repetitive interests and activities are core domains of autism spectrum disorders (ASD), and executive function problems are often seen throughout the spectrum. As the main cognitive theories of ASD, including the theory of mind deficit hypotheses, weak central coherence account, and the executive dysfunction theory, still fail to explain the broad spectrum of symptoms, a new perspective on the etiology of ASD is needed. Deficits in working memory are central to many theories of psychopathology, and are generally linked to frontal-lobe dysfunction. This article will review neuropsychological and (functional) brain imaging studies on working memory in adolescents with ASD. Although still disputed, it is concluded that within the working memory system specific problems of spatial working memory are often seen in adolescents with ASD. These problems increase when information is more complex and greater demands on working memory are made. Neuroimaging studies indicate a more global working memory processing or connectivity deficiency, rather than a focused deficit in the prefrontal cortex. More research is needed to relate these working memory difficulties and neuroimaging results in ASD to the behavioral difficulties as seen in individuals with a disorder on the autism spectrum.

The fidelity of visual memory for faces and non-face objects

The fidelity of visual working memory was assessed for faces and non-face objects. In two experiments, four levels of memory load (1, 2, 3, or 4 items) were combined with four perceptual distances between probe and study items, with maximum item confusability occurring for the minimum memory load. Under these conditions, recognition memory for multiple faces exceeded that of a single face. This result was primarily due to the higher false alarm rates for faces than non-face objects, even though the two classes of stimuli had been matched for perceptual discriminability. Control experiments revealed that this counterintuitive result emerged only for old-new recognition choices based on near-threshold image differences. For non-face objects, instead, recognition performance decreased with increasing memory load. It is speculated that the low memorial discriminability of the transient properties of a face may serve the purpose of enhancing recognition at the individual-exemplar level.

Dissociating the effect of noise on sensory processing and overall decision difficulty

It has been proposed that perceptual decision making involves a task-difficulty component, which detects perceptual uncertainty and guides allocation of attentional resources. It is thought to take place immediately after the early extraction of sensory information and is specifically reflected in a positive component of the event related potentials, peaking at ∼ 220 ms after stimulus onset. However, in the previous research, neural processes associated with the monitoring of overall task difficulty were confounded by those associated with the increased sensory processing demands as a result of adding noise to the stimuli. Here we dissociated the effect of phase noise on sensory processing and overall decision difficulty using a face gender categorization task. Task difficulty was manipulated either by adding noise to the stimuli or by adjusting the female/male characteristics of the face images. We found that it is the presence of noise and not the increased overall task difficulty that affects the electrophysiological responses in the first 300 ms following stimulus onset in humans. Furthermore, we also showed that processing of phase-randomized as compared to intact faces is associated with increased fMRI responses in the lateral occipital cortex. These results revealed that noise-induced modulation of the early electrophysiological responses reflects increased visual cortical processing demands and thus failed to provide support for a task-difficulty component taking place between the early sensory processing and the later sensory accumulation stages of perceptual decision making.

Individual differences in neural activity during a facial expression vs. identity working memory task

Facial expressions of emotion constitute a critical portion of our non-verbal social interactions. In addition, the identity of the individual displaying this expression is critical to these interactions as they embody the context in which these expressions will be interpreted. To identify any overlapping and/or unique brain circuitry involved in the processing of these two information streams in a laboratory setting, participants performed a working memory (WM) task (i.e., n-back) in which they were instructed to monitor either the expression (EMO) or the identity (ID) of the same set of face stimuli. Consistent with previous work, during both the EMO and ID tasks, we found a significant increase in activity in dorsolateral prefrontal cortex (DLPFC) supporting its generalized role in WM. Further, individuals that showed greater DLPFC activity during both tasks also showed increased amygdala activity during the EMO task and increased lateral fusiform gyrus activity during the ID task. Importantly, the level of activity in these regions significantly correlated with performance on the respective tasks. These findings provide support for two separate neural circuitries, both involving the DLPFC, supporting working memory for the faces and expressions of others.

Retention Interval Affects Visual Short-Term Memory Encoding

Humans can efficiently store fine-detailed facial emotional information in visual short-term memory for several seconds. However, an unresolved question is whether the same neural mechanisms underlie high-fidelity short-term memory for emotional expressions at different retention intervals. Here we show that retention interval affects the neural processes of short-term memory encoding using a delayed facial emotion discrimination task. The early sensory P100 component of the event-related potentials (ERP) was larger in the 1-s interstimulus interval (ISI) condition than in the 6-s ISI condition, whereas the face-specific N170 component was larger in the longer ISI condition. Furthermore, the memory-related late P3b component of the ERP responses was also modulated by retention interval: it was reduced in the 1-s ISI as compared with the 6-s condition. The present findings cannot be explained based on differences in sensory processing demands or overall task difficulty because there was no difference in the stimulus information and subjects' performance between the two different ISI conditions. These results reveal that encoding processes underlying high-precision short-term memory for facial emotional expressions are modulated depending on whether information has to be stored for one or for several seconds.