The conjunction of non-consciously perceived object identity and spatial position can be retained during a visual short-term memory task

Nonconscious information can be identified as task-relevant but not prioritized in working memory

Two critical features of working memory are the identification and appropriate use of task-relevant information while avoiding distraction. Here, in 3 experiments, we explored if these features can be achieved also for nonconscious stimuli. Participants performed a delayed match-to-sample task in which task relevance of 2 competing stimuli was indicated by a cue, and continuous flash suppression was used to manipulate the conscious/nonconscious visual experience. Experiment 1 revealed better-than-chance performance with nonconscious stimuli, demonstrating goal-directed use of nonconscious task-relevant information. Experiment 2 demonstrated that the cue that defined task relevance must be conscious to allow such goal-directed use. In Experiment 3, multi-voxel pattern analyses of brain activity revealed that only the target was prioritized and maintained during conscious trials. Conversely, during nonconscious trials, both target and distractor were maintained. However, decoding of task relevance during the probe/test phase demonstrated identification of both target and distractor information. These results show that identification of task-relevant information can operate also on nonconscious material. However, they do not support the prioritization of nonconscious task-relevant information, thus suggesting a mismatch in the attentional mechanisms involved during conscious and nonconscious working memory.

Humans, fish, spiders and bees inherited working memory and attention from their last common ancestor

All brain processes that generate behaviour, apart from reflexes, operate with information that is in an "activated" state. This activated information, which is known as working memory (WM), is generated by the effect of attentional processes on incoming information or information previously stored in short-term or long-term memory (STM or LTM). Information in WM tends to remain the focus of attention; and WM, attention and STM together enable information to be available to mental processes and the behaviours that follow on from them. WM and attention underpin all flexible mental processes, such as solving problems, making choices, preparing for opportunities or threats that could be nearby, or simply finding the way home. Neither WM nor attention are necessarily conscious, and both may have evolved long before consciousness. WM and attention, with similar properties, are possessed by humans, archerfish, and other vertebrates; jumping spiders, honey bees, and other arthropods; and members of other clades, whose last common ancestor (LCA) is believed to have lived more than 600 million years ago. It has been reported that very similar genes control the development of vertebrate and arthropod brains, and were likely inherited from their LCA. Genes that control brain development are conserved because brains generate adaptive behaviour. However, the neural processes that generate behaviour operate with the activated information in WM, so WM and attention must have existed prior to the evolution of brains. It is proposed that WM and attention are widespread amongst animal species because they are phylogenetically conserved mechanisms that are essential to all mental processing, and were inherited from the LCA of vertebrates, arthropods, and some other animal clades.

Unconsciously registered items reduce working memory capacity

The assumption that the contents of consciousness correspond to those of working memory (WM) is challenged by evidence that stimuli masked from awareness can be retained for several seconds (Soto et al., 2011; Bergström & Eriksson, 2015). To assess whether conscious and unconscious items compete in a unitary WM store we conducted an experiment in which some of the memory items in an array were masked from conscious sight using continuous flash suppression (CFS) while others remained visible. After a retention interval, participants decided whether the probed item (either masked or visible) had changed its orientation. Behavioral results indicated that change detection for visible items was significantly impaired when masked items were present, suggesting that masked items either displaced or reduced the precision of visible items in WM. However, change detection for masked items was at chance levels, indicating that these items were not stored. The unsuccessful attempt to encode them may have drawn upon a common pool of attentional resources needed to retain or retrieve visible items. Contralateral Delay Activity, an EEG index of net WM load, failed to temporally localize this interference.

Visual working memory in aphantasia: Retained accuracy and capacity with a different strategy

Visual working memory paradigms involve retaining and manipulating visual information in mind over a period of seconds. Evidence suggests that visual imagery (sensory recruitment) is a strategy used by many to retain visual information during such tasks, leading some researchers to propose that visual imagery and visual working memory may be one and the same. If visual imagery is essential to visual working memory task performance there should be large ramifications for a special population of individuals who do not experience visual imagery, aphantasia. Here we assessed visual working memory task performance in this population using a number of different lab and clinical working memory tasks. We found no differences in capacity limits for visual, general number or spatial working memory for aphantasic individuals compared to controls. Further, aphantasic individuals showed no significant differences in performance on visual components of clinical working memory tests as compared to verbal components. However, there were significant differences in the reported strategies used by aphantasic individuals across all memory tasks. Additionally, aphantasic individual's visual memory accuracy did not demonstrate a significant oblique orientation effect, which is proposed to occur due to sensory recruitment, further supporting their non-visual imagery strategy reports. Taken together these data demonstrate that aphantasic individuals are not impaired on visual working memory tasks, suggesting visual imagery and working memory are not one and the same, with imagery (and sensory recruitment) being just one of the tools that can be used to solve visual working memory tasks.

The human visual system differentially represents subjectively and objectively invisible stimuli

The study of unconscious processing requires a measure of conscious awareness. Awareness measures can be either subjective (based on participant’s report) or objective (based on perceptual performance). The preferred awareness measure depends on the theoretical position about consciousness and may influence conclusions about the extent of unconscious processing and about the neural correlates of consciousness. We obtained functional magnetic resonance imaging (fMRI) measurements from 43 subjects while they viewed masked faces and houses that were either subjectively or objectively invisible. Even for objectively invisible (perceptually indiscriminable) stimuli, we found significant category information in both early, lower-level visual areas and in higher-level visual cortex, although representations in anterior, category-selective ventrotemporal areas were less robust. For subjectively invisible stimuli, similar to visible stimuli, there was a clear posterior-to-anterior gradient in visual cortex, with stronger category information in ventrotemporal cortex than in early visual cortex. For objectively invisible stimuli, however, category information remained virtually unchanged from early visual cortex to object- and category-selective visual areas. These results demonstrate that although both objectively and subjectively invisible stimuli are represented in visual cortex, the extent of unconscious information processing is influenced by the measurement approach. Furthermore, our data show that subjective and objective approaches are associated with different neural correlates of consciousness and thus have implications for neural theories of consciousness.

This study shows that the extent of unconscious information processing in human visual cortex is determined by the measurement approach; only subjectively, but not objectively, invisible stimuli are represented at a categorical level.

The attentional blink unveils the interplay between conscious perception, spatial attention and working memory encoding

Our ability to perceive two events in close temporal succession is severely limited, a phenomenon known as the attentional blink. While the blink has served as a popular tool to prevent conscious perception, there is less research on its causes, and in particular on the role of conscious perception of the first event in triggering it. In three experiments, we disentangled the roles of spatial attention, conscious perception and working memory (WM) in causing the blink. We show that while allocating spatial attention to T1 is neither necessary nor sufficient for eliciting a blink, consciously perceiving it is necessary but not sufficient. When T1 was task irrelevant, consciously perceiving it triggered a blink only when it matched the attentional set for T2. We conclude that consciously perceiving a task-relevant event causes the blink, possibly because it triggers encoding of this event into WM. We discuss the implications of these findings for the relationship between spatial attention, conscious perception and WM, as well as for the distinction between access and phenomenal consciousness.

The Common Basis of Memory and Consciousness: Understanding the Brain as a Write-Read Head Interacting With an Omnipresent Background Field

The main goal of this article consists in addressing two fundamental issues of consciousness research and cognitive science, namely, the question of why declarative memory functions are inextricably linked with phenomenal awareness and the question of the physical basis of memory traces. The presented approach proposes that high-level cognitive processes involving consciousness employ a universal mechanism by means of which they access and modulate an omnipresent background field that is identified with the zero-point field (ZPF) specified by stochastic electrodynamics (SED), a branch of physics that deals with the universal principles underlying quantum systems. In addition to its known physical properties and memory capacities, the ZPF is hypothesized to be an immanently sentient medium. It is propounded that linking up to a particular field mode of the ZPF activates a particular phenomenal nuance, implying that the phase-locked coupling of a set of field modes, i.e., the formation of a so-called ZPF information state, constitutes an appropriate mechanism for the amalgamation of elementary shades of consciousness into a complex state of consciousness. Since quantum systems rest exactly on this mechanism, conscious memory processes in the brain are expected to differ from unconscious processes by the presence of the typical features of many-body quantum systems, particularly long-range coherence and attractor formation, which is supported by a huge body of empirical evidence. On this basis, the conceptual framework set out in this article paves the way for a new understanding of the brain as a write-read head interacting with the ZPF, leading to self-consistent interpretations of the neural correlates of memory formation and memory retrieval and explaining why these memory processes are closely intertwined with phenomenal awareness. In particular, the neural correlates suggest that the brain produces consciously perceived memory traces by writing sequences of information states into the ZPF and retrieves consciously experienced memory traces by reading sequences of information states from the ZPF. Using these theoretical foundations, altered states of consciousness and memory disorders can be traced back to impairments of the ZPF write-read mechanism. The mechanism should reveal itself through characteristic photon emissions, resulting in testable predictions.

Probing the limits of activity-silent non-conscious working memory

Two types of working memory (WM) have recently been proposed: (i) active WM, relying on sustained neural firing, and (ii) activity-silent WM, for which firing returns to baseline, yet memories may be retained by short-term synaptic changes. Activity-silent WM in particular might also underlie the recently discovered phenomenon of non-conscious WM, which permits even subliminal stimuli to be stored for several seconds. However, whether both states support identical forms of information processing is unknown. Theory predicts that activity-silent states are confined to passive storage and cannot operate on stored information. To determine whether an explicit reactivation is required before the manipulation of information in WM, we evaluated whether participants could mentally rotate brief visual stimuli of variable subjective visibility. Behaviorally, even for unseen targets, subjects reported the rotated location above chance after several seconds. As predicted, however, at the time of mental rotation, such blindsight performance was accompanied by (i) neural signatures of consciousness in the form of a sustained desynchronization in alpha/beta frequency and (ii) a reactivation of the memorized information as indicated by decodable representations of participants' guess and response. Our findings challenge the concept of genuine non-conscious "working" memory, argue that activity-silent states merely support passive short-term memory, and provide a cautionary note for purely behavioral studies of non-conscious information processing.

Temporal-order information can be maintained in non-conscious working memory

Classical theories hold conscious perception and working memory to be tightly interwoven. Recent work has challenged this assumption, demonstrating that information may be stored for several seconds without any subjective awareness. Does such non-conscious working memory possess the same functional properties as conscious working memory? Here, we probe whether non-conscious working memory can maintain multiple items and their temporal order. In a visual masking task with a delayed response, 38 participants were asked to retain the location and order of presentation of two sequentially flashed spatial positions, and retrieve both after a 2.5 second delay. Even when subjective visibility was nil, subjects' objective forced-choice performance exceeded chance level and, crucially, distinct retrieval of the first and second location was observed on both conscious and non-conscious trials. Non-conscious working memory may therefore store two items in proper temporal order. These findings can be explained by recent models of activity-silent working memory.

Working Memory and Consciousness: The Current State of Play

Working memory (WM), an important posit in cognitive science, allows one to temporarily store and manipulate information in the service of ongoing tasks. WM has been traditionally classified as an explicit memory system-that is, as operating on and maintaining only consciously perceived information. Recently, however, several studies have questioned this assumption, purporting to provide evidence for unconscious WM. In this article, we focus on visual working memory (VWM) and critically examine these studies as well as studies of unconscious perception that seem to provide indirect evidence for unconscious WM. Our analysis indicates that current evidence does not support an unconscious WM store, though we offer independent reasons to think that WM may operate on unconsciously perceived information.

A theory of working memory without consciousness or sustained activity

Working memory and conscious perception are thought to share similar brain mechanisms, yet recent reports of non-conscious working memory challenge this view. Combining visual masking with magnetoencephalography, we investigate the reality of non-conscious working memory and dissect its neural mechanisms. In a spatial delayed-response task, participants reported the location of a subjectively unseen target above chance-level after several seconds. Conscious perception and conscious working memory were characterized by similar signatures: a sustained desynchronization in the alpha/beta band over frontal cortex, and a decodable representation of target location in posterior sensors. During non-conscious working memory, such activity vanished. Our findings contradict models that identify working memory with sustained neural firing, but are compatible with recent proposals of 'activity-silent' working memory. We present a theoretical framework and simulations showing how slowly decaying synaptic changes allow cell assemblies to go dormant during the delay, yet be retrieved above chance-level after several seconds.

Subliminal messages exert long-term effects on decision-making

Subliminal manipulation is often considered harmless because its effects typically decay within a second. So far, subliminal long-term effects on behavior were only observed in studies which repeatedly presented highly familiar information such as single words. These studies suggest that subliminal messages are only slowly stored and might not be stored at all if they provide novel, unfamiliar information. We speculated that subliminal messages might affect delayed decision-making especially if messages contain several pieces of novel information that must be relationally bound in long-term memory. Relational binding engages the hippocampal memory system, which can rapidly encode and durably store novel relations. Here, we hypothesized that subliminally presented stimulus pairs would be relationally processed influencing the direction of delayed conscious decisions. In experiment 1, subliminal face–occupation pairs affected conscious decisions about the income of these individuals almost half an hour later. In experiment 2, subliminal presentation of vocabulary of a foreign language enabled participants to later decide whether these foreign words are presented with correct or incorrect translations. Subliminal influence did not significantly decay if probed after 25 versus 15 min. This is unprecedented evidence of the longevity and impact of subliminal messages on conscious, rational decision-making.

Dissociating Perceptual Confidence from Discrimination Accuracy Reveals No Influence of Metacognitive Awareness on Working Memory

Visual awareness is hypothesized to be intimately related to visual working memory (WM), such that information present in WM is thought to have necessarily been represented consciously. Recent work has challenged this longstanding view by demonstrating that visual stimuli rated by observers as unseen can nevertheless be maintained over a delay period. These experiments have been criticized, however, on the basis that subjective awareness ratings may contain response bias (e.g., an observer may report no awareness when in fact they had partial awareness). We mitigated this issue by investigating WM for visual stimuli that were matched for perceptual discrimination capacity (d'), yet which varied in subjective confidence ratings (so-called relative blindsight). If the degree of initial subjective awareness of a stimulus facilitates later maintenance of that information, WM performance should improve for stimuli encoded with higher confidence. In contrast, we found that WM performance did not benefit from higher visual discrimination confidence. This relationship was observed regardless of WM load (1 or 3). Insofar as metacognitive ratings (e.g., confidence, visibility) reflect visual awareness, these results challenge a strong relationship between conscious perception and WM using a paradigm that controls for discrimination accuracy and is less subject to response bias (since confidence is manipulated within subjects). Methodologically, we replicate prior efforts to induce relative blindsight using similar stimulus displays, providing a general framework for isolating metacognitive awareness in order to examine the function of consciousness.

Can working memory be non-conscious?

Working memory (WM) is closely linked to conscious awareness: In most conceptions of WM, the inputs to WM need to be conscious. The findings of some recent studies, however, have been taken to suggest that WM can indeed operate on non-conscious inputs. Here, we argue that these findings can easily be accommodated by conventional conceptions of non-conscious perception and conscious WM. We conclude that these studies do not provide conclusive evidence for non-conscious WM. It is thus too early to dismiss the traditional view of a tight link between WM and conscious awareness.