Time course of processes underlying picture and word evaluation: an event-related potential approach

Overt Word Reading and Visual Object Naming in Adults with Dyslexia: Electroencephalography Study in Transparent Orthography

The study aimed to investigate overt reading and naming processes in adult people with dyslexia (PDs) in shallow (transparent) language orthography. The results of adult PDs are compared with adult healthy controls HCs. Comparisons are made in three phases: pre-lexical (150-260 ms), lexical (280-700 ms), and post-lexical stage of processing (750-1000 ms) time window. Twelve PDs and HCs performed overt reading and naming tasks under EEG recording. The word reading and naming task consisted of sparse neighborhoods with closed phonemic onset (words/objects sharing the same onset). For the analysis of the mean ERP amplitude for pre-lexical, lexical, and post-lexical time window, a mixed design ANOVA was performed with the right (F4, FC2, FC6, C4, T8, CP2, CP6, P4) and left (F3, FC5, FC1, T7, C3, CP5, CP1, P7, P3) electrode sites, within-subject factors and group (PD vs. HC) as between-subject factor. Behavioral response latency results revealed significantly prolonged reading latency between HCs and PDs, while no difference was detected in naming response latency. ERP differences were found between PDs and HCs in the right hemisphere's pre-lexical time window (160-200 ms) for word reading aloud. For visual object naming aloud, ERP differences were found between PDs and HCs in the right hemisphere's post-lexical time window (900-1000 ms). The present study demonstrated different distributions of the electric field at the scalp in specific time windows between two groups in the right hemisphere in both word reading and visual object naming aloud, suggesting alternative processing strategies in adult PDs. These results indirectly support the view that adult PDs in shallow language orthography probably rely on the grapho-phonological route during overt word reading and have difficulties with phoneme and word retrieval during overt visual object naming in adulthood.

How list composition affects the emotional enhancement of memory in younger and older adults

Young adults show an immediate emotional enhancement of memory (EEM) when emotional and non-emotional information are presented in mixed lists but not pure lists, but it is unclear whether older adults' memories also benefit from the cognitive factors producing the list-composition effect. The present study examined whether the list-composition effect extended to older adults (55+), testing the following alternatives: (1) younger and older adults could show the list-composition effect, (2) due to age-related decreases in cognitive resources, older adults may show weaker effects of list-composition, or (3) due to age-related positivity effects, older adults' list-composition effect may vary by valence. Results supported the first alternative: the list-composition effect occurred for older as well as younger adults, when testing memory for pictures (Experiment 1) or words (Experiment 2). In a third experiment, we explored whether mixing information at only encoding or retrieval (and blocking in the other phase) would suffice for the list composition effect to occur. Results revealed that mixed encoding/blocked retrieval did not elicit the EEM in either age group. Overall, the results suggest age-related stability in the cognitive processes that give rise to the immediate EEM.

Executive function abilities in cognitively healthy young and older adults-A cross-sectional study

A prominent feature of cognitive aging is the decline of executive function (EF) abilities. Numerous studies have reported that older adults perform poorer than younger adults in such tasks. In this cross-sectional study, the effect of age on four EFs, inhibition, shifting, updating, and dual-tasking, was examined in 26 young adults (mean 21.18  years) and 25 older adults (mean 71.56  years) with the utilization of a pair of tasks for each EF. The tasks employed for DT were the Psychological Refractory Period paradigm (PRP) and a modified test for everyday attention, for inhibition the Stroop and Hayling sentence completion test (HSCT), for shifting a task switching paradigm and the trail making test (TMT), and for updating the backward digit span (BDS) task and a n-back paradigm. As all participants performed all tasks, a further aim was to compare the size of the age-related cognitive decline among the four EFs. Age-related decline was observed in all four EFs in one or both of the tasks employed. The results revealed significantly poorer performance in the older adults in the response times (RTs) of the PRP effect, interference score of the Stroop, RT inhibition costs of the HSCT, RT and error-rate shifting costs of the task switching paradigm, and the error-rate updating costs of the n-back paradigm. A comparison between the rates of decline revealed numerical and statistically significant differences between the four EFs, with inhibition showing the greatest decline, followed by shifting, updating, and dual-tasking. Thus, we conclude that with age, these four EFs decline at different rates.

From Abstract Symbols to Emotional (In-)Sights: An Eye Tracking Study on the Effects of Emotional Vignettes and Pictures

Reading is known to be a highly complex, emotion-inducing process, usually involving connected and cohesive sequences of sentences and paragraphs. However, most empirical results, especially from studies using eye tracking, are either restricted to simple linguistic materials (e.g., isolated words, single sentences) or disregard valence-driven effects. The present study addressed the need for ecologically valid stimuli by examining the emotion potential of and reading behavior in emotional vignettes, often used in applied psychological contexts and discourse comprehension. To allow for a cross-domain comparison in the area of emotion induction, negatively and positively valenced vignettes were constructed based on pre-selected emotional pictures from the Nencki Affective Picture System (NAPS; Marchewka et al., 2014). We collected ratings of perceived valence and arousal for both material groups and recorded eye movements of 42 participants during reading and picture viewing. Linear mixed-effects models were performed to analyze effects of valence (i.e., valence category, valence rating) and stimulus domain (i.e., textual, pictorial) on ratings of perceived valence and arousal, eye movements in reading, and eye movements in picture viewing. Results supported the success of our experimental manipulation: emotionally positive stimuli (i.e., vignettes, pictures) were perceived more positively and less arousing than emotionally negative ones. The cross-domain comparison indicated that vignettes are able to induce stronger valence effects than their pictorial counterparts, no differences between vignettes and pictures regarding effects on perceived arousal were found. Analyses of eye movements in reading replicated results from experiments using isolated words and sentences: perceived positive text valence attracted shorter reading times than perceived negative valence at both the supralexical and lexical level. In line with previous findings, no emotion effects on eye movements in picture viewing were found. This is the first eye tracking study reporting superior valence effects for vignettes compared to pictures and valence-specific effects on eye movements in reading at the supralexical level.

Chronic Pain Patients' Gaze Patterns toward Pain-Related Information: Comparison between Pictorial and Linguistic Stimuli

BACKGROUND AND OBJECTIVES

The attentional bias and information processing model explained that individuals who interpret pain stimuli as threatening may increase their attention toward pain-related information. Previous eye tracking studies found pain attentional bias among individuals with chronic pain; however, those studies investigated this phenomenon by using only one stimulus modality. Therefore, the present study investigated attentional engagement to pain-related information and the role of pain catastrophizing on pain attentional engagement to pain-related stimuli among chronic pain patients by utilizing both linguistic and visual stimulus.

MATERIALS AND METHODS

Forty chronic pain patients were recruited from the rehabilitation center, the back pain clinic, and the rheumatology department of Chung-Ang University Hospital in Seoul, Korea. Patients observed pictures of faces and words displaying pain, presented simultaneously with neutral expressions, while their eye movements were measured using the eye tracking system. A t-test and ANOVA were conducted to compare stimulus pairs for the total gaze duration. Results revealed that chronic pain patients demonstrated attentional preference toward pain words but not for pain faces. An ANOVA with bias scores was conducted to investigate the role of pain catastrophizing on attentional patterns. Results indicated that chronic pain patients with high pain catastrophizing scores gazed significantly longer at pain- and anger-related words than neutral words compared to those with low pain catastrophizing scores. The same patterns were not observed for the facial expression stimulus pairs.

CONCLUSIONS

The results of the present study revealed attentional preference toward pain-related words and the significant role of pain catastrophizing on pain attentional engagement to pain-related words. However, different patterns were observed between linguistic and visual stimuli. Clinical implications related to use in pain treatment and future research suggestions are discussed.

Facial Expression Enhances Emotion Perception Compared to Vocal Prosody: Behavioral and fMRI Studies

Facial and vocal expressions are essential modalities mediating the perception of emotion and social communication. Nonetheless, currently little is known about how emotion perception and its neural substrates differ across facial expression and vocal prosody. To clarify this issue, functional MRI scans were acquired in Study 1, in which participants were asked to discriminate the valence of emotional expression (angry, happy or neutral) from facial, vocal, or bimodal stimuli. In Study 2, we used an affective priming task (unimodal materials as primers and bimodal materials as target) and participants were asked to rate the intensity, valence, and arousal of the targets. Study 1 showed higher accuracy and shorter response latencies in the facial than in the vocal modality for a happy expression. Whole-brain analysis showed enhanced activation during facial compared to vocal emotions in the inferior temporal-occipital regions. Region of interest analysis showed a higher percentage signal change for facial than for vocal anger in the superior temporal sulcus. Study 2 showed that facial relative to vocal priming of anger had a greater influence on perceived emotion for bimodal targets, irrespective of the target valence. These findings suggest that facial expression is associated with enhanced emotion perception compared to equivalent vocal prosodies.

The real deal: Willingness-to-pay and satiety expectations are greater for real foods versus their images

Laboratory studies of human dietary choice have relied on computerized two-dimensional (2D) images as stimuli, whereas in everyday life, consumers make decisions in the context of real foods that have actual caloric content and afford grasping and consumption. Surprisingly, few studies have compared whether real foods are valued more than 2D images of foods, and in the studies that have, differences in the stimuli and testing conditions could have resulted in inflated bids for the real foods. Moreover, although the caloric content of food images has been shown to influence valuation, no studies to date have investigated whether 'real food exposure effects' on valuation reflect greater sensitivity to the caloric content of real foods versus images. Here, we compared willingness-to-pay (WTP) for, and expectations about satiety after consuming, everyday snack foods that were displayed as real foods versus 2D images. Critically, our 2D images were matched closely to the real foods for size, background, illumination, and apparent distance, and trial presentation and stimulus timing were identical across conditions. We used linear mixed effects modeling to determine whether effects of display format were modulated by food preference and the caloric content of the foods. Compared to food images, observers were willing to pay 6.62% more for (Experiment 1) and believed that they would feel more satiated after consuming (Experiment 2), foods displayed as real objects. Moreover, these effects appeared to be consistent across food preference, caloric content, as well as observers' estimates of the caloric content of the foods. Together, our results confirm that consumers' perception and valuation of everyday foods is influenced by the format in which they are displayed. Our findings raise important new insights into the factors that shape dietary choice in real-world contexts and highlight potential avenues for improving public health approaches to diet and obesity.

Women Overestimate Temporal Duration: Evidence from Chinese Emotional Words

Numerous studies have proven the effect of emotion on temporal perception, using various emotional stimuli. However, research investigating this issue from the lexico-semantic perspective and gender difference remains scarce. In this study, participants were presented with different types of emotional words designed in classic temporal bisection tasks. In Experiment 1 where the arousal level of emotional words was controlled, no pure effect of valence on temporal perception was found; however, we observed the overestimation of women relative to men. Furthermore, in Experiment 2, an orthogonal design of valence and arousal with neutral condition was employed to study the arousal-mechanism of temporal distortion effect and its difference between genders. The results showed that the gender difference observed in Experiment 1 was robust and was not influenced by valence and arousal. Taken together, our findings suggest a stable gender difference in the temporal perception of semantic stimuli, which might be related to some intrinsic properties of linguistic stimuli and sex differences in brain structure as well as physiological features. The automatic processing of time information was also discussed.

Modulation of the inter-hemispheric processing of semantic information during normal aging. A divided visual field experiment

We evaluated the effect of normal aging on the inter-hemispheric processing of semantic information by using the divided visual field (DVF) method, with words and pictures. Two main theoretical models have been considered, (a) the HAROLD model which posits that aging is associated with supplementary recruitment of the right hemisphere (RH) and decreased hemispheric specialization, and (b) the RH decline theory, which assumes that the RH becomes less efficient with aging, associated with increased LH specialization. Two groups of subjects were examined, a Young Group (YG) and an Old Group (OG), while participants performed a semantic categorization task (living vs. non-living) in words and pictures. The DVF was realized in two steps: (a) unilateral DVF presentation with stimuli presented separately in each visual field, left or right, allowing for their initial processing by only one hemisphere, right or left, respectively; (b) bilateral DVF presentation (BVF) with stimuli presented simultaneously in both visual fields, followed by their processing by both hemispheres. These two types of presentation permitted the evaluation of two main characteristics of the inter-hemispheric processing of information, the hemispheric specialization (HS) and the inter-hemispheric cooperation (IHC). Moreover, the BVF allowed determining the driver-hemisphere for processing information presented in BVF. Results obtained in OG indicated that: (a) semantic categorization was performed as accurately as YG, even if more slowly, (b) a non-semantic RH decline was observed, and (c) the LH controls the semantic processing during the BVF, suggesting an increased role of the LH in aging. However, despite the stronger involvement of the LH in OG, the RH is not completely devoid of semantic abilities. As discussed in the paper, neither the HAROLD nor the RH decline does fully explain this pattern of results. We rather suggest that the effect of aging on the hemispheric specialization and inter-hemispheric cooperation during semantic processing is explained not by only one model, but by an interaction between several complementary mechanisms and models.

The time course of emotional picture processing: an event-related potential study using a rapid serial visual presentation paradigm

The present study recorded event-related potentials using rapid serial visual presentation paradigm to explore the time course of emotionally charged pictures. Participants completed a dual-target task as quickly and accurately as possible, in which they were asked to judge the gender of the person depicted (task 1) and the valence (positive, neutral, or negative) of the given picture (task 2). The results showed that the amplitudes of the P2 component were larger for emotional pictures than they were for neutral pictures, and this finding represents brain processes that distinguish emotional stimuli from non-emotional stimuli. Furthermore, positive, neutral, and negative pictures elicited late positive potentials with different amplitudes, implying that the differences between emotions are recognized. Additionally, the time course for emotional picture processing was consistent with the latter two stages of a three-stage model derived from studies on emotional facial expression processing and emotional adjective processing. The results of the present study indicate that in the three-stage model of emotion processing, the middle and late stages are more universal and stable, and thus occur at similar time points when using different stimuli (faces, words, or scenes).

Emotional picture and word processing: an FMRI study on effects of stimulus complexity

Neuroscientific investigations regarding aspects of emotional experiences usually focus on one stimulus modality (e.g., pictorial or verbal). Similarities and differences in the processing between the different modalities have rarely been studied directly. The comparison of verbal and pictorial emotional stimuli often reveals a processing advantage of emotional pictures in terms of larger or more pronounced emotion effects evoked by pictorial stimuli. In this study, we examined whether this picture advantage refers to general processing differences or whether it might partly be attributed to differences in visual complexity between pictures and words. We first developed a new stimulus database comprising valence and arousal ratings for more than 200 concrete objects representable in different modalities including different levels of complexity: words, phrases, pictograms, and photographs. Using fMRI we then studied the neural correlates of the processing of these emotional stimuli in a valence judgment task, in which the stimulus material was controlled for differences in emotional arousal. No superiority for the pictorial stimuli was found in terms of emotional information processing with differences between modalities being revealed mainly in perceptual processing regions. While visual complexity might partly account for previously found differences in emotional stimulus processing, the main existing processing differences are probably due to enhanced processing in modality specific perceptual regions. We would suggest that both pictures and words elicit emotional responses with no general superiority for either stimulus modality, while emotional responses to pictures are modulated by perceptual stimulus features, such as picture complexity.

The worth of pictures: using high density event-related potentials to understand the memorial power of pictures and the dynamics of recognition memory

To understand the neural correlates of the memorial power of pictures, pictures and words were systematically varied at study and test within subjects, and high-density event-related potentials (ERPs) were recorded at retrieval. Using both conventional and novel methods, the results were presented as ERP waveforms, 50 ms scalp topographies, and video clips, and analyzed using t-statistic topographic maps and nonparametric p-value maps. The authors found that a parietally-based ERP component was enhanced when pictures were presented at study or test, compared to when words were presented. An early frontally-based component was enhanced when words were presented at study compared to pictures. From these data the authors speculate that the memorial power of pictures is related to the ability of pictures to enhance recollection. Familiarity, by contrast, was enhanced when words were presented at study compared to pictures. From these results and the dynamic view of memory afforded by viewing the data as video clips, the authors propose an ERP model of recognition memory.