The neural correlates of visual working memory encoding: a time-resolved fMRI study

Hypertension Impacts the Oscillatory Dynamics Serving the Encoding Phase of Verbal Working Memory

BACKGROUND

Chronic hypertension is known to be a major contributor to cognitive decline, with executive function and working memory being among the domains most commonly affected. Despite the growing literature on such dysfunction in patients with hypertension, the underlying neural processes are poorly understood.

METHODS

In this cross-sectional study, we examine these neural processes by having participants with controlled hypertension, uncontrolled hypertension, and healthy controls perform a verbal working memory task during magnetoencephalography. Neural oscillations associated with the encoding and maintenance components of the working memory task were imaged and statistically evaluated among the 3 groups.

RESULTS

Differences related to hypertension emerged during the encoding phase, where the hypertension groups exhibited weaker α-β oscillatory responses compared with controls in the left parietal cortices, whereas such oscillatory activity differed between the 2 hypertension groups in the right prefrontal regions. Importantly, these neural responses in the prefrontal and parietal cortices during encoding were also significantly associated with behavioral performance across all participants.

CONCLUSIONS

Overall, our data suggest that hypertension is associated with neurophysiological abnormalities during working memory encoding, whereas the neural processes serving maintenance seem to be preserved. The right hemispheric neural responses likely reflected compensatory processing, which patients with controlled hypertension may use to achieve verbal working memory function at the level of controls, as opposed to the uncontrolled hypertension group where diminished resources may have limited such additional recruitment.

Reward influences the allocation but not the availability of resources in visual working memory

Visual working memory possesses capacity constraints limiting the availability of resources for encoding and maintaining information. Studies have shown that prospective rewards improve performance on visual working memory tasks, but it remains unclear whether rewards increase total resource availability or simply influence the allocation of resources. Participants performed a continuous report visual working memory task with oriented grating stimuli. On each trial, participants were presented with a priority cue, which signaled the item most likely to be probed, and a reward cue, which signaled the magnitude of a performance-contingent reward. We showed that rewards decreased recall error for cued items and increased recall error for noncued items. This tradeoff was due to a change in the probability of successfully encoding a cued versus a noncued item rather than a change in recall precision or the probability of binding errors. Rewards did not modulate performance when priority cues were retroactively presented after the stimulus presentation period, indicating that rewards only affect resource allocation when participants are able to engage proactive control before encoding. Additionally, reward had no effect on visual working memory performance when priority cues were absent and thus unable to guide resource allocation. These findings indicate that rewards influence the flexible allocation of resources during selection and encoding in visual working memory, but do not augment total capacity. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

The role of right temporo-parietal junction in stimulus evaluation

A predominant model of the temporo-parietal junction (TPJ) claims that this region is critical for attentional orienting/reorienting toward an unexpected, but behaviorally significant stimulus. However, recent studies have suggested that the TPJ is also involved in the process of evaluating stimulus, especially matching between external sensory inputs and internal representations. While some studies provide evidence for the involvement of the TPJ in stimulus evaluation, the nature of the evaluative process mediated by the TPJ remains unclear. To address this issue, we tested whether the TPJ activation amplitude and its peak latency is proportional to the demand of the evaluative process. We found that when the amount of sensory evidence for the matching process was abundant, the TPJ was transiently activated. Importantly, the TPJ activation showed a greater and more sustained pattern while the sensory evidence was accumulating for a longer period of time. These findings suggest that the TPJ function is associated with the evaluative process of matching sensory inputs with internal representations, as well as attentional reorienting.

How do neural processes give rise to cognition? Simultaneously predicting brain and behavior with a dynamic model of visual working memory

There is consensus that activation within distributed functional brain networks underlies human thought. The impact of this consensus is limited, however, by a gap that exists between data-driven correlational analyses that specify where functional brain activity is localized using functional magnetic resonance imaging (fMRI), and neural process accounts that specify how neural activity unfolds through time to give rise to behavior. Here, we show how an integrative cognitive neuroscience approach may bridge this gap. In an exemplary study of visual working memory, we use multilevel Bayesian statistics to demonstrate that a neural dynamic model simultaneously explains behavioral data and predicts localized patterns of brain activity, outperforming standard analytic approaches to fMRI. The model explains performance on both correct trials and incorrect trials where errors in change detection emerge from neural fluctuations amplified by neural interaction. Critically, predictions of the model run counter to cognitive theories of the origin of errors in change detection. Results reveal neural patterns predicted by the model within regions of the dorsal attention network that have been the focus of much debate. The model-based analysis suggests that key areas in the dorsal attention network such as the intraparietal sulcus play a central role in change detection rather than working memory maintenance, counter to previous interpretations of fMRI studies. More generally, the integrative cognitive neuroscience approach used here establishes a framework for directly testing theories of cognitive and brain function using the combined power of behavioral and fMRI data. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

One bad apple spoils the whole bushel: The neural basis of outlier processing

How are outliers in an otherwise homogeneous object ensemble represented by our visual system? Are outliers ignored because they are the minority? Or do outliers alter our perception of an otherwise homogeneous ensemble? We have previously demonstrated ensemble representation in human anterior-medial ventral visual cortex (overlapping the scene-selective parahippocampal place area; PPA). In this study we investigated how outliers impact object-ensemble representation in this human brain region as well as visual representation throughout posterior brain regions. We presented a homogeneous ensemble followed by an ensemble containing either identical elements or a majority of identical elements with a few outliers. Human participants ignored the outliers and made a same/different judgment between the two ensembles. In PPA, fMRI adaptation was observed when the outliers in the second ensemble matched the items in the first, even though the majority of the elements in the second ensemble were distinct from those in the first; conversely, release from fMRI adaptation was observed when the outliers in the second ensemble were distinct from the items in the first, even though the majority of the elements in the second ensemble were identical to those in the first. A similarly robust outlier effect was also found in other brain regions, including a shape-processing region in lateral occipital cortex (LO) and task-processing fronto-parietal regions. These brain regions likely work in concert to flag the presence of outliers during visual perception and then weigh the outliers appropriately in subsequent behavioral decisions. To our knowledge, this is the first time the neural mechanisms involved in outlier processing have been systematically documented in the human brain. Such an outlier effect could well provide the neural basis mediating our perceptual experience in situations like "one bad apple spoils the whole bushel".

Neural activity during working memory encoding, maintenance, and retrieval: A network-based model and meta-analysis

It remains unclear whether and to what extent working memory (WM) temporal subprocesses (i.e., encoding, maintenance, and retrieval) involve shared or distinct intrinsic networks. To address this issue, I constructed a model of intrinsic network contributions to different WM phases and then evaluated the validity of the model by performing a quantitative meta-analysis of relevant functional neuroimaging data. The model suggests that the transition from the encoding to maintenance and to retrieval stages involves progressively decreasing involvement of the dorsal attention network (DAN), but progressively increasing involvement of the frontoparietal control network (FPCN). Separate meta-analysis of each phase effect and direct comparisons between them yielded results that were largely consistent with the model. This evidence included between-phase double dissociations that were consistent with the model, such as encoding > maintenance contrast showing some DAN, but no FPCN, regions, and maintenance > encoding contrast showing the reverse, that is, some FPCN, but no DAN, regions. Two closely juxtaposed regions that are members of the DAN and FPCN, such as inferior frontal junction versus caudal prefrontal cortex and superior versus inferior intraparietal sulcus, showed a high degree of functional differentiation. Although all regions identified in the present study were already identified in previous WM studies, this study uniquely enhances our understating of their roles by clarifying their network membership and specific associations with different WM phases.

Functional dissociation of the inferior frontal junction from the dorsal attention network in top-down attentional control

The posterior lateral prefrontal cortex-specifically, the inferior frontal junction (IFJ)-is thought to exert a key role in the control of attention. However, the precise nature of that role remains elusive. During the voluntary deployment and maintenance of visuospatial attention, the IFJ is typically coactivated with a core dorsal network consisting of the frontal eye field and superior parietal cortex. During stimulus-driven attention, IFJ instead couples with a ventrolateral network, suggesting that IFJ plays a role in attention distinct from the dorsal network. Because IFJ rapidly switches activation patterns to accommodate conditions of goal-directed and stimulus-driven attention (Asplund CL, Todd JJ, Snyder AP, Marois R. Nat Neurosci 13: 507-512, 2010), we hypothesized that IFJ's primary role is to dynamically reconfigure attention rather than to maintain attention under steady-state conditions. This hypothesis predicts that in a goal-directed visuospatial cuing paradigm IFJ would transiently deploy attention toward the cued location, whereas the dorsal attention network would maintain attentional weights during the delay between cue and target presentation. Here we tested this hypothesis with functional magnetic resonance imaging while subjects were engaged in a Posner cuing task with variable cue-target delays. Both IFJ and dorsal network regions were involved in transient processes, but sustained activity was far more evident in the dorsal network than in IFJ. These results support the account that IFJ primarily acts to shift attention whereas the dorsal network is the main locus for the maintenance of stable attentional states. NEW & NOTEWORTHY Goal-directed visuospatial attention is controlled by a dorsal fronto-parietal network and lateral prefrontal cortex. However, the relative roles of these regions in goal-directed attention are unknown. Here we present evidence for their dissociable roles in the transient reconfiguration and sustained maintenance of attentional settings: while maintenance of attentional settings is confined to the dorsal network, the configuration of these settings at the beginning of an attentional episode is a function of lateral prefrontal cortex.

Dissociable meta-analytic brain networks contribute to coordinated emotional processing

Meta-analytic techniques for mining the neuroimaging literature continue to exert an impact on our conceptualization of functional brain networks contributing to human emotion and cognition. Traditional theories regarding the neurobiological substrates contributing to affective processing are shifting from regional- towards more network-based heuristic frameworks. To elucidate differential brain network involvement linked to distinct aspects of emotion processing, we applied an emergent meta-analytic clustering approach to the extensive body of affective neuroimaging results archived in the BrainMap database. Specifically, we performed hierarchical clustering on the modeled activation maps from 1,747 experiments in the affective processing domain, resulting in five meta-analytic groupings of experiments demonstrating whole-brain recruitment. Behavioral inference analyses conducted for each of these groupings suggested dissociable networks supporting: (1) visual perception within primary and associative visual cortices, (2) auditory perception within primary auditory cortices, (3) attention to emotionally salient information within insular, anterior cingulate, and subcortical regions, (4) appraisal and prediction of emotional events within medial prefrontal and posterior cingulate cortices, and (5) induction of emotional responses within amygdala and fusiform gyri. These meta-analytic outcomes are consistent with a contemporary psychological model of affective processing in which emotionally salient information from perceived stimuli are integrated with previous experiences to engender a subjective affective response. This study highlights the utility of using emergent meta-analytic methods to inform and extend psychological theories and suggests that emotions are manifest as the eventual consequence of interactions between large-scale brain networks.

Sensory-Biased and Multiple-Demand Processing in Human Lateral Frontal Cortex

The functionality of much of human lateral frontal cortex (LFC) has been characterized as "multiple demand" (MD) as these regions appear to support a broad range of cognitive tasks. In contrast to this domain-general account, recent evidence indicates that portions of LFC are consistently selective for sensory modality. Michalka et al. (2015) reported two bilateral regions that are biased for visual attention, superior precentral sulcus (sPCS) and inferior precentral sulcus (iPCS), interleaved with two bilateral regions that are biased for auditory attention, transverse gyrus intersecting precentral sulcus (tgPCS) and caudal inferior frontal sulcus (cIFS). In the present study, we use fMRI to examine both the multiple-demand and sensory-bias hypotheses within caudal portions of human LFC (both men and women participated). Using visual and auditory 2-back tasks, we replicate the finding of two bilateral visual-biased and two bilateral auditory-biased LFC regions, corresponding to sPCS and iPCS and to tgPCS and cIFS, and demonstrate high within-subject reliability of these regions over time and across tasks. In addition, we assess MD responsiveness using BOLD signal recruitment and multi-task activation indices. In both, we find that the two visual-biased regions, sPCS and iPCS, exhibit stronger MD responsiveness than do the auditory-biased LFC regions, tgPCS and cIFS; however, neither reaches the degree of MD responsiveness exhibited by dorsal anterior cingulate/presupplemental motor area or by anterior insula. These results reconcile two competing views of LFC by demonstrating the coexistence of sensory specialization and MD functionality, especially in visual-biased LFC structures.SIGNIFICANCE STATEMENT Lateral frontal cortex (LFC) is known to play a number of critical roles in supporting human cognition; however, the functional organization of LFC remains controversial. The "multiple demand" (MD) hypothesis suggests that LFC regions provide domain-general support for cognition. Recent evidence challenges the MD view by demonstrating that a preference for sensory modality, vision or audition, defines four discrete LFC regions. Here, the sensory-biased LFC results are reproduced using a new task, and MD responsiveness of these regions is tested. The two visual-biased regions exhibit MD behavior, whereas the auditory-biased regions have no more than weak MD responses. These findings help to reconcile two competing views of LFC functional organization.

Superior Intraparietal Sulcus Controls the Variability of Visual Working Memory Precision

Limitations of working memory (WM) capacity depend strongly on the cognitive resources that are available for maintaining WM contents in an activated state. Increasing the number of items to be maintained in WM was shown to reduce the precision of WM and to increase the variability of WM precision over time. Although WM precision was recently associated with neural codes particularly in early sensory cortex, we have so far no understanding of the neural bases underlying the variability of WM precision, and how WM precision is preserved under high load. To fill this gap, we combined human fMRI with computational modeling of behavioral performance in a delayed color-estimation WM task. Behavioral results replicate a reduction of WM precision and an increase of precision variability under high loads (5 > 3 > 1 colors). Load-dependent BOLD signals in primary visual cortex (V1) and superior intraparietal sulcus (IPS), measured during the WM task at 2-4 s after sample onset, were modulated by individual differences in load-related changes in the variability of WM precision. Although stronger load-related BOLD increase in superior IPS was related to lower increases in precision variability, thus stabilizing WM performance, the reverse was observed for V1. Finally, the detrimental effect of load on behavioral precision and precision variability was accompanied by a load-related decline in the accuracy of decoding the memory stimuli (colors) from left superior IPS. We suggest that the superior IPS may contribute to stabilizing visual WM performance by reducing the variability of memory precision in the face of higher load.

SIGNIFICANCE STATEMENT

This study investigates the neural bases of capacity limitations in visual working memory by combining fMRI with cognitive modeling of behavioral performance, in human participants. It provides evidence that the superior intraparietal sulcus (IPS) is a critical brain region that influences the variability of visual working memory precision between and within individuals (Fougnie et al., 2012; van den Berg et al., 2012) under increased memory load, possibly in cooperation with perceptual systems of the occipital cortex. These findings substantially extend our understanding of the nature of capacity limitations in visual working memory and their neural bases. Our work underlines the importance of integrating cognitive modeling with univariate and multivariate methods in fMRI research, thus improving our knowledge of brain-behavior relationships.

The Contribution of Object Shape and Surface Properties to Object Ensemble Representation in Anterior-medial Ventral Visual Cortex

Our visual system can extract summary statistics from large collections of objects without forming detailed representations of the individual objects in the ensemble. In a region in ventral visual cortex encompassing the collateral sulcus and the parahippocampal gyrus and overlapping extensively with the scene-selective parahippocampal place area (PPA), we have previously reported fMRI adaptation to object ensembles when ensemble statistics repeated, even when local image features differed across images (e.g., two different images of the same strawberry pile). We additionally showed that this ensemble representation is similar to (but still distinct from) how visual texture patterns are processed in this region and is not explained by appealing to differences in the color of the elements that make up the ensemble. To further explore the nature of ensemble representation in this brain region, here we used PPA as our ROI and investigated in detail how the shape and surface properties (i.e., both texture and color) of the individual objects constituting an ensemble affect the ensemble representation in anterior-medial ventral visual cortex. We photographed object ensembles of stone beads that varied in shape and surface properties. A given ensemble always contained beads of the same shape and surface properties (e.g., an ensemble of star-shaped rose quartz beads). A change to the shape and/or surface properties of all the beads in an ensemble resulted in a significant release from adaptation in PPA compared with conditions in which no ensemble feature changed. In contrast, in the object-sensitive lateral occipital area (LO), we only observed a significant release from adaptation when the shape of the ensemble elements varied, and found no significant results in additional scene-sensitive regions, namely, the retrosplenial complex and occipital place area. Together, these results demonstrate that the shape and surface properties of the individual objects comprising an ensemble both contribute significantly to object ensemble representation in anterior-medial ventral visual cortex and further demonstrate a functional dissociation between object- (LO) and scene-selective (PPA) visual cortical regions and within the broader scene-processing network itself.

Visual working memory continues to develop through adolescence

The capacity of visual working memory (VWM) refers to the amount of visual information that can be maintained in mind at once, readily accessible for ongoing tasks. In healthy young adults, the capacity limit of VWM corresponds to about three simple objects. While some researchers argued that VWM capacity becomes adult-like in early years of life, others claimed that the capacity of VWM continues to develop beyond middle childhood. Here we assessed whether VWM capacity reaches adult levels in adolescence. Using an adaptation of the visual change detection task, we measured VWM capacity estimates in 13-year-olds, 16-year-olds, and young adults. We tested whether the capacity estimates observed in early or later years of adolescence were comparable to the estimates obtained from adults. Our results demonstrated that the capacity of VWM continues to develop throughout adolescence, not reaching adult levels even in 16-year-olds. These findings suggest that VWM capacity displays a prolonged development, similar to the protracted trajectories observed in various other aspects of cognition.

The role of the frontopolar cortex in manipulation of integrated information in working memory

Cognitive operations often require integration of information. Previous studies have shown that, integration of information in working memory recruits frontopolar cortex (FPC). In this fMRI study, we sought to reveal neural mechanisms of FPC underlying the integration of information during arithmetic tasks. We compared a condition requiring manipulation of two features of an item held in working memory with manipulation of one feature. The results showed that, FPC was equally recruited in both conditions, while dorsolateral prefrontal cortex (DLPFC) tended to be more activated when manipulating two features. We suggest that, FPC plays an integrative role and is recruited by the production of representations in accordance with task constraints, whereas DLPFC appears to be sensitive to processing demands induced by the manipulation of information.

You may look unhappy unless you smile: the distinctiveness of a smiling face against faces without an explicit smile

An expressionless face is often perceived as rude whereas a smiling face is considered as hospitable. Repetitive exposure to such perceptions may have developed stereotype of categorizing an expressionless face as expressing negative emotion. To test this idea, we displayed a search array where the target was an expressionless face and the distractors were either smiling or frowning faces. We manipulated set size. Search reaction times were delayed with frowning distractors. Delays became more evident as the set size increased. We also devised a short-term comparison task where participants compared two sequential sets of expressionless, smiling, and frowning faces. Detection of an expression change across the sets was highly inaccurate when the change was made between frowning and expressionless face. These results indicate that subjects were confused with expressed emotions on frowning and expressionless faces, suggesting that it is difficult to distinguish expressionless face from frowning faces.

Co-Activation-Based Parcellation of the Lateral Prefrontal Cortex Delineates the Inferior Frontal Junction Area

The inferior frontal junction (IFJ) area, a small region in the posterior lateral prefrontal cortex (LPFC), has received increasing interest in recent years due to its central involvement in the control of action, attention, and memory. Yet, both its function and anatomy remain controversial. Here, we employed a meta-analytic parcellation of the left LPFC to show that the IFJ can be isolated based on its specific functional connections. A seed region, oriented along the left inferior frontal sulcus (IFS), was subdivided via cluster analyses of voxel-wise whole-brain co-activation patterns. The ensuing clusters were characterized by their unique connections, the functional profiles of associated experiments, and an independent topic mapping approach. A cluster at the posterior end of the IFS matched previous descriptions of the IFJ in location and extent and could be distinguished from a more caudal cluster involved in motor control, a more ventral cluster involved in linguistic processing, and 3 more rostral clusters involved in other aspects of cognitive control. Overall, our findings highlight that the IFJ constitutes a core functional unit within the frontal lobe and delineate its borders. Implications for the IFJ's role in human cognition and the organizational principles of the frontal lobe are discussed.

Performance-based empathy mediates the influence of working memory on social competence in schizophrenia

Empathic deficits have been linked to poor functioning in schizophrenia, but this work is mostly limited to self-report data. This study examined whether performance-based empathy measures account for incremental variance in social competence and social attainment above and beyond self-reported empathy, neurocognition, and clinical symptoms. Given the importance of working memory in theoretical models of empathy and in the prediction of functioning in schizophrenia, we also examined whether empathy mediates the relationship between working memory and functioning. Sixty outpatients and 45 healthy controls were compared on performance-based measures of 3 key components of empathic responding, including facial affect perception, emotional empathy (affective responsiveness), and cognitive empathy (emotional perspective-taking). Participants also completed measures of self-reported empathy, neurocognition, clinical symptoms, and social competence and attainment. Patients demonstrated lower accuracy than controls across the 3 performance-based empathy measures. Among patients, these measures showed minimal relations to self-reported empathy but significantly correlated with working memory and other neurocognitive functions as well as symptom levels. Furthermore, cognitive empathy explained significant incremental variance in social competence (∆R (2) = .07, P < .05) and was found to mediate the relation between working memory and social competence. Performance-based measures of empathy were sensitive to functionally relevant disturbances in schizophrenia. Working memory deficits appear to have an important effect on these disruptions in empathy. Empathy is emerging as a promising new area for social cognitive research and for novel recovery-oriented treatment development.

The Impact of Density and Ratio on Object-Ensemble Representation in Human Anterior-Medial Ventral Visual Cortex

Behavioral research has demonstrated that observers can extract summary statistics from ensembles of multiple objects. We recently showed that a region of anterior-medial ventral visual cortex, overlapping largely with the scene-sensitive parahippocampal place area (PPA), participates in object-ensemble representation. Here we investigated the encoding of ensemble density in this brain region using fMRI-adaptation. In Experiment 1, we varied density by changing the spacing between objects and found no sensitivity in PPA to such density changes. Thus, density may not be encoded in PPA, possibly because object spacing is not perceived as an intrinsic ensemble property. In Experiment 2, we varied relative density by changing the ratio of 2 types of objects comprising an ensemble, and observed significant sensitivity in PPA to such ratio change. Although colorful ensembles were shown in Experiment 2, Experiment 3 demonstrated that sensitivity to object ratio change was not driven mainly by a change in the ratio of colors. Thus, while anterior-medial ventral visual cortex is insensitive to density (object spacing) changes, it does code relative density (object ratio) within an ensemble. Object-ensemble processing in this region may thus depend on high-level visual information, such as object ratio, rather than low-level information, such as spacing/spatial frequency.

Age-related changes to the neural correlates of working memory which emerge after midlife

Previous research has indicated that the neural processes which underlie working memory change with age. Both age-related increases and decreases to cortical activity have been reported. This study investigated which stages of working memory are most vulnerable to age-related changes after midlife. To do this we examined age-differences in the 13 Hz steady state visually evoked potential (SSVEP) associated with a spatial working memory delayed response task. Participants were 130 healthy adults separated into a midlife (40–60 years) and an older group (61–82 years). Relative to the midlife group, older adults demonstrated greater bilateral frontal activity during encoding and this pattern of activity was related to better working memory performance. In contrast, evidence of age-related under activation was identified over left frontal regions during retrieval. Findings from this study suggest that after midlife, under-activation of frontal regions during retrieval contributes to age-related decline in working memory performance.

The attentional blink reveals the probabilistic nature of discrete conscious perception

Attention and awareness are two tightly coupled processes that have been the subject of the same enduring debate: Are they allocated in a discrete or in a graded fashion? Using the attentional blink paradigm and mixture-modeling analysis, we show that awareness arises at central stages of information processing in an all-or-none manner. Manipulating the temporal delay between two targets affected subjects' likelihood of consciously perceiving the second target, but did not affect the precision of its representation. Furthermore, these results held across stimulus categories and paradigms, and they were dependent on attention having been allocated to the first target. The findings distinguish the fundamental contributions of attention and awareness at central stages of visual cognition: Conscious perception emerges in a quantal manner, with attention serving to modulate the probability that representations reach awareness.

Acute effects of different multivitamin mineral preparations with and without Guaraná on mood, cognitive performance and functional brain activation

Previous work has identified the positive effects of the acute administration of a multivitamin-guaraná preparation during an effortful executive/working memory task. Here, we aimed to differentiate the effects of multivitamins with and without guaraná and to examine the neural substrates of such effects using functional magnetic resonance imaging (fMRI). Following a double-blind, placebo-controlled, randomised, balanced crossover design, 20 participants (mean age 29 ± 5.54 years) consumed multivitamin preparations with or without guaraná (Berocca^® Performance and Boost, respectively) and a placebo. Thirty minutes post-treatment, they underwent neurocognitive assessment, consisting of a 10 min Cognitive Demand Battery, with mood ratings taken immediately before and after the battery. Five additional participants underwent post-treatment fMRI scanning during Rapid Visual Information Processing and Inspection Time activation tasks. The multivitamin with guaraná treatment was associated with significantly enhanced Serial Threes performance and self-rated contentment. fMRI revealed that both multivitamin treatments increased activation in areas associated with working memory and attentional processing, with the effect being greater in the multivitamin with guaraná condition. These data confirm the acute benefits of multivitamins with guaraná on mood and cognitive performance. Furthermore, they demonstrate for the first time increased brain activation from multivitamin preparations both with and without guaraná, as measured using fMRI.

Explorations of object and location memory using fMRI

Content-specific sub-systems of visual working memory (VWM) have been explored in many neuroimaging studies with inconsistent findings and procedures across experiments. The present study employed functional magnetic resonance imaging (fMRI) and a change detection task using a high number of trials and matched stimulus displays across object and location change (what vs. where) conditions. Furthermore, individual task periods were studied independently across conditions to identify differences corresponding to each task period. Importantly, this combination of task controls has not previously been described in the fMRI literature. Composite results revealed differential frontoparietal activation during each task period. A separation of object and location conditions yielded a distributed system of dorsal and ventral streams during the encoding of information corresponding to bilateral inferior parietal lobule (IPL) and lingual gyrus activation, respectively. Differential activity was also shown during the maintenance of information in middle frontal structures bilaterally for objects and the right IPL and left insula for locations. Together, these results reflect a domain-specific dissociation spanning several cortices and task periods. Furthermore, differential activations suggest a general caudal-rostral separation corresponding to object and location memory, respectively.

Top-down modulation from inferior frontal junction to FEFs and intraparietal sulcus during short-term memory for visual features

Visual STM of simple features is achieved through interactions between retinotopic visual cortex and a set of frontal and parietal regions. In the present fMRI study, we investigated effective connectivity between central nodes in this network during the different task epochs of a modified delayed orientation discrimination task. Our univariate analyses demonstrate that the inferior frontal junction (IFJ) is preferentially involved in memory encoding, whereas activity in the putative FEFs and anterior intraparietal sulcus (aIPS) remains elevated throughout periods of memory maintenance. We have earlier reported, using the same task, that areas in visual cortex sustain information about task-relevant stimulus properties during delay intervals [Sneve, M. H., Alnæs, D., Endestad, T., Greenlee, M. W., & Magnussen, S. Visual short-term memory: Activity supporting encoding and maintenance in retinotopic visual cortex. Neuroimage, 63, 166-178, 2012]. To elucidate the temporal dynamics of the IFJ-FEF-aIPS-visual cortex network during memory operations, we estimated Granger causality effects between these regions with fMRI data representing memory encoding/maintenance as well as during memory retrieval. We also investigated a set of control conditions involving active processing of stimuli not associated with a memory task and passive viewing. In line with the developing understanding of IFJ as a region critical for control processes with a possible initiating role in visual STM operations, we observed influence from IFJ to FEF and aIPS during memory encoding. Furthermore, FEF predicted activity in a set of higher-order visual areas during memory retrieval, a finding consistent with its suggested role in top-down biasing of sensory cortex.

School-age effects of the newborn individualized developmental care and assessment program for preterm infants with intrauterine growth restriction: preliminary findings

BACKGROUND

The experience in the newborn intensive care nursery results in premature infants' neurobehavioral and neurophysiological dysfunction and poorer brain structure. Preterms with severe intrauterine growth restriction are doubly jeopardized given their compromised brains. The Newborn Individualized Developmental Care and Assessment Program improved outcome at early school-age for preterms with appropriate intrauterine growth. It also showed effectiveness to nine months for preterms with intrauterine growth restriction. The current study tested effectiveness into school-age for preterms with intrauterine growth restriction regarding executive function (EF), electrophysiology (EEG) and neurostructure (MRI).

METHODS

Twenty-three 9-year-old former growth-restricted preterms, randomized at birth to standard care (14 controls) or to the Newborn Individualized Developmental Care and Assessment Program (9 experimentals) were assessed with standardized measures of cognition, achievement, executive function, electroencephalography, and magnetic resonance imaging. The participating children were comparable to those lost to follow-up, and the controls to the experimentals, in terms of newborn background health and demographics. All outcome measures were corrected for mother's intelligence. Analysis techniques included two-group analysis of variance and stepwise discriminate analysis for the outcome measures, Wilks' lambda and jackknifed classification to ascertain two-group classification success per and across domains; canonical correlation analysis to explore relationships among neuropsychological, electrophysiological and neurostructural domains at school-age, and from the newborn period to school-age.

RESULTS

Controls and experimentals were comparable in age at testing, anthropometric and health parameters, and in cognitive and achievement scores. Experimentals scored better in executive function, spectral coherence, and cerebellar volumes. Furthermore, executive function, spectral coherence and brain structural measures discriminated controls from experimentals. Executive function correlated with coherence and brain structure measures, and with newborn-period neurobehavioral assessment.

CONCLUSION

The intervention in the intensive care nursery improved executive function as well as spectral coherence between occipital and frontal as well as parietal regions. The experimentals' cerebella were significantly larger than the controls'. These results, while preliminary, point to the possibility of long-term brain improvement even of intrauterine growth compromised preterms if individualized intervention begins with admission to the NICU and extends throughout transition home. Larger sample replications are required in order to confirm these results.

CLINICAL TRIAL REGISTRATION

The study is registered as a clinical trial. The trial registration number is NCT00914108.

Dissociation between process-based and data-based limitations for conscious perception in the human brain

Successful performance of a cognitive task depends upon both the quality of the sensory information and the processing resources available to perform that task. Thus, task performance can either be data-limited or process-limited (D. A. Norman and D. G. Bobrow, 1975). Using fMRI, we show that these conceptual distinctions are neurally dissociable: A parieto-frontal network involved in conscious perception is modulated by target interference manipulations that strain attentional processing, but not by equally difficult manipulations that limit the quality of target information. These results suggest that limitations imposed by processing capacity have distinct neural effects from those arising from the quality of sensory input, and provide empirical support for an influential neurobiological theory of consciousness (S. Dehaene, J.-P. Changeux, L. Naccache, J. Sackur, and C. Sergent, 2006).

Object ensemble processing in human anterior-medial ventral visual cortex

Our visual system can extract summary statistics from large collections of similar objects without forming detailed representations of the individual objects in the ensemble. Such object ensemble representation is adaptive and allows us to overcome the capacity limitation associated with representing specific objects. Surprisingly, little is known about the neural mechanisms supporting such object ensemble representation. Here we showed human observers identical photographs of the same object ensemble, different photographs depicting the same ensemble, or different photographs depicting different ensembles. We observed fMRI adaptation in anterior-medial ventral visual cortex whenever object ensemble statistics repeated, even when local image features differed across photographs. Interestingly, such object ensemble processing is closely related to texture and scene processing in the brain. In contrast, the lateral occipital area, a region involved in object-shape processing, showed adaptation only when identical photographs were repeated. These results provide the first step toward understanding the neural underpinnings of real-world object ensemble representation.

Visual short-term memory: activity supporting encoding and maintenance in retinotopic visual cortex

Recent studies have demonstrated that retinotopic cortex maintains information about visual stimuli during retention intervals. However, the process by which transient stimulus-evoked sensory responses are transformed into enduring memory representations is unknown. Here, using fMRI and short-term visual memory tasks optimized for univariate and multivariate analysis approaches, we report differential involvement of human retinotopic areas during memory encoding of the low-level visual feature orientation. All visual areas show weaker responses when memory encoding processes are interrupted, possibly due to effects in orientation-sensitive primary visual cortex (V1) propagating across extrastriate areas. Furthermore, intermediate areas in both dorsal (V3a/b) and ventral (LO1/2) streams are significantly more active during memory encoding compared with non-memory (active and passive) processing of the same stimulus material. These effects in intermediate visual cortex are also observed during memory encoding of a different stimulus feature (spatial frequency), suggesting that these areas are involved in encoding processes on a higher level of representation. Using pattern-classification techniques to probe the representational content in visual cortex during delay periods, we further demonstrate that simply initiating memory encoding is not sufficient to produce long-lasting memory traces. Rather, active maintenance appears to underlie the observed memory-specific patterns of information in retinotopic cortex.

Lifespan age differences in working memory: a two-component framework

We suggest that working memory (WM) performance can be conceptualized as the interplay of low-level feature binding processes and top-down control, relating to posterior and frontal brain regions and their interaction in a distributed neural network. We propose that due to age-differential trajectories of posterior and frontal brain regions top-down control processes are not fully mature until young adulthood and show marked decline with advancing age, whereas binding processes are relatively mature in children, but show senescent decline in older adults. A review of the literature spanning from middle childhood to old age shows that binding and top-down control processes undergo profound changes across the lifespan. We illustrate commonalities and dissimilarities between children, younger adults, and older adults reflecting the change in the two components' relative contribution to visual WM performance across the lifespan using results from our own lab. We conclude that an integrated account of visual WM lifespan changes combining research from behavioral neuroscience and cognitive psychology of child development as well as aging research opens avenues to advance our understanding of cognition in general.

What limits working memory capacity? Evidence for modality-specific sources to the simultaneous storage of visual and auditory arrays

There is considerable debate on whether working memory (WM) storage is mediated by distinct subsystems for auditory and visual stimuli (Baddeley, 1986) or whether it is constrained by a single, central capacity-limited system (Cowan, 2006). Recent studies have addressed this issue by measuring the dual-task cost during the concurrent storage of auditory and visual arrays (e.g., Cocchini, Logie, Della Sala, MacPherson, & Baddeley, 2002; Fougnie & Marois, 2006; Saults & Cowan, 2007). However, studies have yielded widely different dual-task costs, which have been taken to support both modality-specific and central capacity-limit accounts of WM storage. Here, we demonstrate that the controversies regarding such costs mostly stem from how these costs are measured. Measures that compare combined dual-task capacity with the higher single-task capacity support a single, central WM store when there is a large disparity between the single-task capacities (Experiment 1) but not when the single-task capacities are well equated (Experiment 2). In contrast, measures of the dual-task cost that normalize for differences in single-task capacity reveal evidence for modality-specific stores, regardless of single-task performance. Moreover, these normalized measures indicate that dual-task cost is much smaller if the tasks do not involve maintaining bound feature representations in WM (Experiment 3). Taken together, these experiments not only resolve a discrepancy in the field and clarify how to assess the dual-task cost but also indicate that WM capacity can be constrained both by modality-specific and modality-independent sources of information processing.

A Unified attentional bottleneck in the human brain

Human information processing is characterized by bottlenecks that constrain throughput. These bottlenecks limit both what we can perceive and what we can act on in multitask settings. Although perceptual and response limitations are often attributed to independent information processing bottlenecks, it has recently been suggested that a common attentional limitation may be responsible for both. To date, however, evidence supporting the existence of such a "unified" bottleneck has been mixed. Here, we tested the unified bottleneck hypothesis using time-resolved fMRI. Experiment 1 isolated brain regions involved in the response selection bottleneck that limits speeded dual-task performance. These same brain regions were not only engaged by a perceptual encoding task in Experiment 2, their activity also tracked delays to a speeded decision-making task caused by concurrent perceptual encoding (Experiment 3). We conclude that a unified attentional bottleneck, including the inferior frontal junction, superior medial frontal cortex, and bilateral insula, temporally limits operations as diverse as perceptual encoding and decision-making.