Conscious perception of fear in faces: Insights from high-density EEG and perceptual awareness scale with threshold stimuli

Contrary to the extensive research on processing subliminal and/or unattended emotional facial expressions, only a minority of studies have investigated the neural correlates of consciousness (NCCs) of emotions conveyed by faces. In the present high-density electroencephalography (EEG) study, we first employed a staircase procedure to identify each participant's perceptual threshold of the emotion expressed by the face and then compared the EEG signals elicited in trials where the participants were aware with the activity elicited in trials where participants were unaware of the emotions expressed by these, otherwise identical, faces. Drawing on existing knowledge of the neural mechanisms of face processing and NCCs, we hypothesized that activity in frontal electrodes would be modulated in relation to participants' awareness of facial emotional content. More specifically, we hypothesized that the NCC of fear seen on someone else's face could be detected as a modulation of a later and more anterior (i.e., at frontal sites) event-related potential (ERP) than the face-sensitive N170. By adopting a data-driven approach and cluster-based statistics to the analysis of EEG signals, the results were clear-cut in showing that visual awareness of fear was associated with the modulation of a frontal ERP component in a 150-300 msec interval. These insights are dissected and contextualized in relation to prevailing theories of visual consciousness and their proposed NCC benchmarks.

When mind and body align: examining the role of cross-modal congruency in conscious representations of happy facial expressions

This study explored how congruency between facial mimicry and observed expressions affects the stability of conscious facial expression representations. Focusing on the congruency effect between proprioceptive/sensorimotor signals and visual stimuli for happy expressions, participants underwent a binocular rivalry task displaying neutral and happy faces. Mimicry was either facilitated with a chopstick or left unrestricted. Key metrics included Initial Percept (bias indicator), Onset Resolution Time (time from onset to Initial Percept), and Cumulative Time (content stabilization measure). Results indicated that mimicry manipulation significantly impacted Cumulative Time for happy faces, highlighting the importance of congruent mimicry in stabilizing conscious awareness of facial expressions. This supports embodied cognition models, showing the integration of proprioceptive information significantly biases conscious visual perception of facial expressions.

Feedforward connectivity patterns from visual areas to the front of the brain contain information about sensory stimuli regardless of awareness or report

Current theories of consciousness can be categorized to some extent by their predictions about the putative role of the prefrontal cortex (PFC) in conscious perception. One family of the theories proposes that the PFC is necessary for conscious perception. The other postulates that the PFC is not necessary and that other areas (e.g., posterior cortical areas) are more important for conscious perception. No-report paradigms could potentially arbitrate the debate as they disentangle task reporting from conscious perception. While previous no-report paradigms tend to point to a reduction in PFC activity, they have not examined the critical role of the PFC in "monitoring" or "reading out" the patterns of activity in the sensory cortex to generate conscious perception. To address this, we reanalysed electroencephalography (EEG) data from a no-report inattentional blindness paradigm (Shafto & Pitts, 2015). We examined the role of feedforward input patterns to the PFC from sensory cortices. We employed nonparametric spectral Granger causality and quantified the amount of information that reflected the contents of consciousness using multivariate classifiers. Unexpectedly, regardless of whether the stimulus was consciously seen or not, we found that information relating to the current sensory stimulus was present in the pattern of inputs from visual areas to the PFC. In light of these findings, we suggest various theories of consciousness need to be revised to accommodate the fact that the contents of consciousness are decodable from the input patterns from posterior sensory regions to the PFC, regardless of awareness (or report).

Unifying pairwise interactions in complex dynamics

Scientists have developed hundreds of techniques to measure the interactions between pairs of processes in complex systems, but these computational methods-from contemporaneous correlation coefficients to causal inference methods-define and formulate interactions differently, using distinct quantitative theories that remain largely disconnected. Here we introduce a large assembled library of 237 statistics of pairwise interactions, and assess their behavior on 1,053 multivariate time series from a wide range of real-world and model-generated systems. Our analysis highlights commonalities between disparate mathematical formulations of interactions, providing a unified picture of a rich interdisciplinary literature. Using three real-world case studies, we then show that simultaneously leveraging diverse methods can uncover those most suitable for addressing a given problem, facilitating interpretable understanding of the quantitative formulation of pairwise dependencies that drive successful performance. Our results and accompanying software enable comprehensive analysis of time-series interactions by drawing on decades of diverse methodological contributions.

When do parts form wholes? Integrated information as the restriction on mereological composition

Under what conditions are material objects, such as particles, parts of a whole object? This is the composition question and is a longstanding open question in philosophy. Existing attempts to specify a non-trivial restriction on composition tend to be vague and face serious counterexamples. Consequently, two extreme answers have become mainstream: composition (the forming of a whole by its parts) happens under no or all conditions. In this paper, we provide a self-contained introduction to the integrated information theory (IIT) of consciousness. We show that IIT specifies a non-trivial restriction on composition: composition happens when integrated information is maximized. We compare the IIT restriction to existing proposals and argue that the IIT restriction has significant advantages, especially in response to the problems of vagueness and counterexamples. An appendix provides an introduction to calculating parts and wholes with a simple system.

INs and OUTs of faces in consciousness: a study of the temporal evolution of consciousness of faces during binocular rivalry

Contents of consciousness change over time. However, the study of dynamics in consciousness has been largely neglected. Aru and Bachmann have recently brought to the attention of scientists dealing with consciousness the relevance of making inquiries about its temporal evolution. Importantly, they also pointed out several experimental questions as guidelines for researchers interested in studying the temporal evolution of consciousness, including the phases of formation and dissolution of content. They also suggested that these two phases could be characterized by asymmetric inertia. The main objective of the present investigation was to approximate the dynamics of these two phases in the context of conscious face perception. To this aim, we tested the time course of content transitions during a binocular rivalry task using face stimuli and asked participants to map their subjective experience of transitions from one content to the other through a joystick. We then computed metrics of joystick velocity linked to content transitions as proxies of the formation and dissolution phases. We found a general phase effect such that the formation phase was slower than the dissolution phase. Furthermore, we observed an effect specific to happy facial expressions, such that their contents were slower to form and dissolve than that of neutral expressions. We further propose to include a third phase of stabilization of conscious content between formation and dissolution.

Effect of Blonanserin on the Proliferation and Migration of Glioblastoma Cells

Glioblastoma is a highly malignant and invasive brain tumor, and there is an urgent need to establish a treatment option that prevents its growth and metastasis. Blonanserin is an antipsychotic drug widely used in the treatment of schizophrenia. It has recently been reported to inhibit the growth of breast cancer cells. In this study, we investigated the effect of blonanserin on the proliferation and migration of glioblastoma cells. The anti-proliferative activity of blonanserin was evaluated in terms of cell viability, competition, and cell death pathways in glioblastoma. Cell viability studies showed that blonanserin had growth inhibitory ability regardless of the malignancy of glioblastoma cells, but at concentrations close to its IC₅₀, it only had a slight cell death-inducing effect. Blonanserin showed growth inhibitory activity without D₂ antagonism following an independent competition analysis using blonanserin and D₂ antagonists. When the anti-migration activity of U251 cells was measured, blonanserin was found to attenuate cell migration. Furthermore, treatment with blonanserin at concentrations close to its IC₅₀ value inhibited extensive filament actin formation. In conclusion, blonanserin inhibited the proliferation and migration of glioblastoma cells independent of D₂ antagonism. The present study shows that blonanserin may serve as a seed compound for the discovery of new glioblastoma therapeutics to prevent the growth and metastasis of glioblastoma.

Are Color Experiences the Same across the Visual Field?

It seems obvious to laypeople that neurotypical humans experience color equivalently across their entire visual field. To some neuroscientists, psychologists, and philosophers, though, this claim has been met with skepticism, as neurophysiological evidence indicates the mechanisms that support color perception degrade with eccentricity. However, the argument that this entails altered color experience in peripheral vision is not universally accepted. Here, we address whether color experience is essentially equivalent between central and peripheral vision. To assess this, we will obtain similarity relationships between color experiences across the visual field using both online and laboratory-based far-field displays, while removing the confounds of saccades, memory, and expectation about color experiences. Our experiment was designed to provide clear evidence that would favor either unchanged or altered color experience relationships in the periphery. Our results are consistent with lay people's phenomenological reports: Color experiences, as probed by similarity relationships in central vision and the far field (60°), are equivalent when elicited by large stimuli. These findings challenge the widespread view in philosophy and cognitive science that peripheral color experiences are illusory, and are discussed in the context of their related neurophysiological, psychophysical, and philosophical literature.

An adjunction hypothesis between qualia and reports

What are the nature of the relationship among qualia, contents of consciousness, and behavioral reports? Traditionally, this type of question has been only addressed via a qualitative and philosophical approach. Some theorists emphasize an incomplete and inaccurate nature of reports of one's own qualia to discourage formal research programs on qualia. Other empirical researchers, however, have made substantial progress in understanding the structure of qualia from such limited reports. What is the precise relationship between the two? To answer this question, we introduce the concept of “adjoint” or “adjunction” from the category theory in mathematics. We claim that the adjunction captures some aspects of the nuanced relationships between qualia and reports. The concept of adjunction allows us to clarify the conceptual issues with a precise mathematical formulation. In particular, adjunction establishes coherence between two categories that cannot be considered equivalent, yet has an important relationship. This rises in empirical experimental situations between qualia and reports. More importantly, an idea of adjunction naturally leads to various proposals of new empirical experiments to test the predictions about the nature of their relationship as well as other issues in consciousness research.

Separating weak integrated information theory into inspired and aspirational approaches

Mediano et al. (The strength of weak integrated information theory. Trends Cogn Sci 2022;26: 646-55.) separate out strong and weak flavours of the integrated information theory (IIT) of consciousness. They describe 'strong IIT' as attempting to derive a universal formula for consciousness and 'weak IIT' as searching for empirically measurable correlates of aspects of consciousness. We put forward that their overall notion of 'weak IIT' may be too weak. Rather, it should be separated out to distinguish 'aspirational-IIT', which aims to empirically test IIT by making trade-offs to its proposed measures, and 'IIT-inspired' approaches, which adopt high-level ideas of IIT while dropping the mathematical framework it reaches through its introspective, first-principles approach to consciousness.

A Quantum Geometric Framework for Modeling Color Similarity Judgments

Since Tversky argued that similarity judgments violate the three metric axioms, asymmetrical similarity judgments have been particularly challenging for standard, geometric models of similarity, such as multidimensional scaling. According to Tversky, asymmetrical similarity judgments are driven by differences in salience or extent of knowledge. However, the notion of salience has been difficult to operationalize, especially for perceptual stimuli for which there are no apparent differences in extent of knowledge. To investigate similarity judgments between perceptual stimuli, across three experiments, we collected data where individuals would rate the similarity of a pair of temporally separated color patches. We identified several violations of symmetry in the empirical results, which the conventional multidimensional scaling model cannot readily capture. Pothos et al. proposed a quantum geometric model of similarity to account for Tversky's findings. In the present work, we extended this model to a more general framework that can be fit to similarity judgments. We fitted several variants of quantum and multidimensional scaling models to the behavioral data and concluded in favor of the quantum approach. Without further modifications of the model, the best-fit quantum model additionally predicted violations of the triangle inequality that we observed in the same data. Overall, by offering a different form of geometric representation, the quantum geometric framework of similarity provides a viable alternative to multidimensional scaling for modeling similarity judgments, while still allowing a convenient, spatial illustration of similarity.

What can we experience and report on a rapidly presented image? Intersubjective measures of specificity of freely reported contents of consciousness

Background: A majority of previous studies appear to support a view that human observers can only perceive coarse information from a natural scene image when it is presented rapidly (<100ms, masked). In these studies, participants were often forced to choose an answer from options that experimenters preselected. These options can underestimate what participants experience and can report on it. The current study aims to introduce a novel methodology to investigate how detailed information participants can report after briefly seeing a natural scene image.     Methods: We used a novel free-report paradigm to examine what people can freely report following a rapidly presented natural scene image (67/133/267ms, masked). N = 600 online participants typed up to five words to report what they saw in the image together with confidence of the respective responses. We developed a novel index, Intersubjective Agreement (IA). IA quantifies how specifically the response words were used to describe the target image, with a high value meaning the word is not often reported for other images. Importantly, IA eliminates the need for experimenters to preselect response options. Results: The words with high IA values are often something detailed (e.g., a small object) in a particular image. With IA, unlike commonly believed, we demonstrated that participants reported highly specific and detailed aspects of the briefly (even at 67ms, masked) shown image. Further, IA is positively correlated with confidence, indicating metacognitive conscious access to the reported aspects of the image. Conclusion: These new findings challenge the dominant view that the content of rapid scene experience is limited to global and coarse gist. Our novel paradigm opens a door to investigate various contents of consciousness with a free-report paradigm.

Beyond traditional sleep scoring: Massive feature extraction and data-driven clustering of sleep time series

The widely used guidelines for sleep staging were developed for the visual inspection of electrophysiological recordings by the human eye. As such, these rules reflect a limited range of features in these data and are therefore restricted in accurately capturing the physiological changes associated with sleep. Here we present a novel analysis framework that extensively characterizes sleep dynamics using over 7700 time-series features from the hctsa software. We used clustering to categorize sleep epochs based on the similarity of their time-series features, without relying on established scoring conventions. The resulting sleep structure overlapped substantially with that defined by visual scoring. However, we also observed discrepancies between our approach and traditional scoring. This divergence principally stemmed from the extensive characterization by hctsa features, which captured distinctive time-series properties within the traditionally defined sleep stages that are overlooked with visual scoring. Lastly, we report time-series features that are highly discriminative of stages. Our framework lays the groundwork for a data-driven exploration of sleep sub-stages and has significant potential to identify new signatures of sleep disorders and conscious sleep states.

Relationship between the housing coldness/warmth evaluation by CASBEE Housing Health Checklist and psychological distress based on TMM Community-Based Cohort Study: a cross-sectional analysis

OBJECTIVES

Previous studies have reported the relationship between housing environment and health, although due to cost and effort, it was difficult to conduct housing condition surveys on a large scale. The CASBEE Housing Health Checklist (the Checklist) made it possible to easily evaluate the housing condition from the resident's perspective. This study examined the relationship between housing coldness/warmth evaluation using the Checklist and psychological distress in a large-scale general Japanese population.

STUDY DESIGN

A cross-sectional study.

METHODS

We analysed data from 29,380 people aged ≥20 years who lived in Miyagi Prefecture, Japan. As an assessment of housing coldness/warmth, we used the Checklist. We classified participants' total scores on the Checklist related to coldness/warmth into quartiles. The Kessler 6 scale was used as an indicator of psychological distress. Multivariable logistic regression models were used to estimate the adjusted odds ratio (OR) and 95% confidence intervals (CIs). Adjusted OR and P-values for linear trends were calculated using the quartiles of the Checklists' score.

RESULTS

Among participants in Q1 (i.e., poorer subjective house condition), the percentage of people with psychological distress was high. Compared to the highest quartile, Q1 showed poorer evaluation of housing coldness/warmth, and higher OR for psychological distress. The OR (95% CI) of psychological distress for Q3, Q2, and Q1 compared with Q4 were 1.93 (1.74-2.14), 2.82 (2.55-3.12), and 5.78 (5.25-6.35), respectively.

CONCLUSIONS

Housing coldness/warmth evaluation was significantly related to psychological distress. This finding suggests that maintaining a comfortable thermal environment at home could be important for residents' mental health.

Surprising Threats Accelerate Conscious Perception

The folk psychological notion that "we see what we expect to see" is supported by evidence that we become consciously aware of visual stimuli that match our prior expectations more quickly than stimuli that violate our expectations. Similarly, "we see what we want to see," such that more biologically-relevant stimuli are also prioritised for conscious perception. How, then, is perception shaped by biologically-relevant stimuli that we did not expect? Here, we conducted two experiments using breaking continuous flash suppression (bCFS) to investigate how prior expectations modulated response times to neutral and fearful faces. In both experiments, we found that prior expectations for neutral faces hastened responses, whereas the opposite was true for fearful faces. This interaction between emotional expression and prior expectations was driven predominantly by participants with higher trait anxiety. Electroencephalography (EEG) data collected in Experiment 2 revealed an interaction evident in the earliest stages of sensory encoding, suggesting prediction errors expedite sensory encoding of fearful faces. These findings support a survival hypothesis, where biologically-relevant fearful stimuli are prioritised for conscious access even more so when unexpected, especially for people with high trait anxiety.

How much can we differentiate at a brief glance: revealing the truer limit in conscious contents through the massive report paradigm (MRP)

Upon a brief glance, how well can we differentiate what we see from what we do not? Previous studies answered this question as 'poorly'. This is in stark contrast with our everyday experience. Here, we consider the possibility that previous restriction in stimulus variability and response alternatives reduced what participants could express from what they consciously experienced. We introduce a novel massive report paradigm that probes the ability to differentiate what we see from what we do not. In each trial, participants viewed a natural scene image and judged whether a small image patch was a part of the original image. To examine the limit of discriminability, we also included subtler changes in the image as modification of objects. Neither the images nor patches were repeated per participant. Our results showed that participants were highly accurate (accuracy greater than 80%) in differentiating patches from the viewed images from patches that are not present. Additionally, the differentiation between original and modified objects was influenced by object sizes and/or the congruence between objects and the scene gists. Our massive report paradigm opens a door to quantitatively measure the limit of immense informativeness of a moment of consciousness.

Unconscious Visual Working Memory: A critical review and Bayesian meta-analysis

The relationship between consciousness and working memory (WM) has been recently debated both at the theoretical and methodological levels (Persuh et al., 2018; Velichkovsky, 2017). While there is behavioral and neural evidence that argues for the existence of unconscious WM, several methodological concerns have been raised, rendering this issue highly controversial. To address the robustness of the previous findings, here we adopt a meta-analytic approach to estimate the effect size and heterogeneity of the previously reported unconscious WM results, also including unpublished results. We used meta-regression to isolate relevant experimental variables, in particular, consciousness manipulation and the WM paradigm to identify the source of the heterogeneity in the reported effect size of the unconscious WM. Our meta-analysis supports the existence of the unconscious WM effect and critically reveals several experimental variables that contribute to relevant heterogeneity. Our analysis clarifies several theoretical and methodological issues. We recommend that future studies explicitly operationalize the definition of consciousness, standardize the methodology and systematically explore the role of critical variables for the unconscious WM effect.

Neural and computational processes of accelerated perceptual awareness and decisions: A 7T fMRI study

Rapidly detecting salient information in our environments is critical for survival. Visual processing in subcortical areas like the pulvinar and amygdala has been shown to facilitate unconscious processing of salient stimuli. It is unknown, however, if and how these areas might interact with cortical regions to facilitate faster conscious perception of salient stimuli. Here we investigated these neural processes using 7T functional magnetic resonance imaging (fMRI) in concert with computational modelling while participants (n = 33) engaged in a breaking continuous flash suppression paradigm (bCFS) in which fearful and neutral faces are initially suppressed from conscious perception but then eventually ‘breakthrough’ into awareness. Participants reported faster breakthrough times for fearful faces compared with neutral faces. Drift‐diffusion modelling suggested that perceptual evidence was accumulated at a faster rate for fearful faces compared with neutral faces. For both neutral and fearful faces, faster response times were associated with greater activity in the amygdala (specifically within its subregions, including superficial, basolateral and amygdalo‐striatal transition area) and the insula. Faster rates of evidence accumulation coincided with greater activity in frontoparietal regions and occipital lobe, as well as the amygdala. A lower decision‐boundary correlated with activity in the insula and the posterior cingulate cortex (PCC), but not with the amygdala. Overall, our findings suggest that hastened perceptual awareness of salient stimuli recruits the amygdala and, more specifically, is driven by accelerated evidence accumulation in fronto‐parietal and visual areas. In sum, we have mapped distinct neural computations that accelerate perceptual awareness of visually suppressed faces.

A relational approach to consciousness: categories of level and contents of consciousness

Characterizing consciousness in and of itself is notoriously difficult. Here, we propose an alternative approach to characterize, and eventually define, consciousness through exhaustive descriptions of consciousness' relationships to all other consciousness. This approach is founded in category theory. Indeed, category theory can prove that two objects A and B in a category can be equivalent if and only if all the relationships that A holds with others in the category are the same as those of B; this proof is called the Yoneda lemma. To introduce the Yoneda lemma, we gradually introduce key concepts of category theory to consciousness researchers. Along the way, we propose several possible definitions of categories of consciousness, both in terms of level and contents, through the usage of simple examples. We propose to use the categorical structure of consciousness as a gold standard to formalize empirical research (e.g. color qualia structure at fovea and periphery) and, especially, the empirical testing of theories of consciousness.

Predicting lapses of attention with sleep-like slow waves

Attentional lapses occur commonly and are associated with mind wandering, where focus is turned to thoughts unrelated to ongoing tasks and environmental demands, or mind blanking, where the stream of consciousness itself comes to a halt. To understand the neural mechanisms underlying attentional lapses, we studied the behaviour, subjective experience and neural activity of healthy participants performing a task. Random interruptions prompted participants to indicate their mental states as task-focused, mind-wandering or mind-blanking. Using high-density electroencephalography, we report here that spatially and temporally localized slow waves, a pattern of neural activity characteristic of the transition toward sleep, accompany behavioural markers of lapses and preceded reports of mind wandering and mind blanking. The location of slow waves could distinguish between sluggish and impulsive behaviours, and between mind wandering and mind blanking. Our results suggest attentional lapses share a common physiological origin: the emergence of local sleep-like activity within the awake brain.

Blocking facial mimicry during binocular rivalry modulates visual awareness of faces with a neutral expression

Several previous studies have interfered with the observer’s facial mimicry during a variety of facial expression recognition tasks providing evidence in favor of the role of facial mimicry and sensorimotor activity in emotion processing. In this theoretical context, a particularly intriguing facet has been neglected, namely whether blocking facial mimicry modulates conscious perception of facial expressions of emotions. To address this issue, we used a binocular rivalry paradigm, in which two dissimilar stimuli presented to the two eyes alternatingly dominate conscious perception. On each trial, female participants (N = 32) were exposed to a rivalrous pair of a neutral and a happy expression of the same individual through anaglyph glasses in two conditions: in one, they could freely use their facial mimicry, in the other they had to keep a chopstick between their lips, constraining the mobility of the zygomatic muscle and producing ‘noise’ for sensorimotor simulation. We found that blocking facial mimicry affected the perceptual dominance in terms of cumulative time favoring neutral faces, but it did not change the time before the first dominance was established. Taken together, our results open a door to future investigation of the intersection between sensorimotor simulation models and conscious perception of emotional facial expressions.

Steady state evoked potential (SSEP) responses in the primary and secondary somatosensory cortices of anesthetized cats: Nonlinearity characterized by harmonic and intermodulation frequencies

When presented with an oscillatory sensory input at a particular frequency, F [Hz], neural systems respond with the corresponding frequency, f [Hz], and its multiples. When the input includes two frequencies (F1 and F2) and they are nonlinearly integrated in the system, responses at intermodulation frequencies (i.e., n1*f1+n2*f2 [Hz], where n1 and n2 are non-zero integers) emerge. Utilizing these properties, the steady state evoked potential (SSEP) paradigm allows us to characterize linear and nonlinear neural computation performed in cortical neurocircuitry. Here, we analyzed the steady state evoked local field potentials (LFPs) recorded from the primary (S1) and secondary (S2) somatosensory cortex of anesthetized cats (maintained with alfaxalone) while we presented slow (F1 = 23Hz) and fast (F2 = 200Hz) somatosensory vibration to the contralateral paw pads and digits. Over 9 experimental sessions, we recorded LFPs from N = 1620 and N = 1008 bipolar-referenced sites in S1 and S2 using electrode arrays. Power spectral analyses revealed strong responses at 1) the fundamental (f1, f2), 2) its harmonic, 3) the intermodulation frequencies, and 4) broadband frequencies (50-150Hz). To compare the computational architecture in S1 and S2, we employed simple computational modeling. Our modeling results necessitate nonlinear computation to explain SSEP in S2 more than S1. Combined with our current analysis of LFPs, our paradigm offers a rare opportunity to constrain the computational architecture of hierarchical organization of S1 and S2 and to reveal how a large-scale SSEP can emerge from local neural population activities.

Integrated information structure collapses with anesthetic loss of conscious arousal in Drosophila melanogaster

The physical basis of consciousness remains one of the most elusive concepts in current science. One influential conjecture is that consciousness is to do with some form of causality, measurable through information. The integrated information theory of consciousness (IIT) proposes that conscious experience, filled with rich and specific content, corresponds directly to a hierarchically organised, irreducible pattern of causal interactions; i.e. an integrated informational structure among elements of a system. Here, we tested this conjecture in a simple biological system (fruit flies), estimating the information structure of the system during wakefulness and general anesthesia. Consistent with this conjecture, we found that integrated interactions among populations of neurons during wakefulness collapsed to isolated clusters of interactions during anesthesia. We used classification analysis to quantify the accuracy of discrimination between wakeful and anesthetised states, and found that informational structures inferred conscious states with greater accuracy than a scalar summary of the structure, a measure which is generally championed as the main measure of IIT. In stark contrast to a view which assumes feedforward architecture for insect brains, especially fly visual systems, we found rich information structures, which cannot arise from purely feedforward systems, occurred across the fly brain. Further, these information structures collapsed uniformly across the brain during anesthesia. Our results speak to the potential utility of the novel concept of an “informational structure” as a measure for level of consciousness, above and beyond simple scalar values.

The physical basis of consciousness remains elusive. Efforts to measure consciousness have generally been restricted to simple, scalar quantities which summarise the complexity of a system, inspired by integrated information theory, which links a multi-dimensional, informational structure to the contents of experience in a system. Due to the complexity of the definition of the structure, assessment of its utility as a measure of conscious arousal in a system has largely been ignored. In this manuscript we evaluate the utility of such an information structure in measuring the level of arousal in the fruit fly. Our results indicate that this structure can be more informative about the level of arousal in a system than even the single-value summary proposed by the theory itself. These results may push consciousness research towards the notion of multi-dimensional informational structures, instead of traditional scalar summaries.

Growing evidence for separate neural mechanisms for attention and consciousness

Our conscious experience of the world seems to go in lockstep with our attentional focus: We tend to see, hear, taste, and feel what we attend to, and vice versa. This tight coupling between attention and consciousness has given rise to the idea that these two phenomena are indivisible. In the late 1950s, the honoree of this special issue, Charles Eriksen, was among a small group of early pioneers that sought to investigate whether a transient increase in overall level of attention (alertness) in response to a noxious stimulus can be decoupled from conscious perception using experimental techniques. Recent years saw a similar debate regarding whether attention and consciousness are two dissociable processes. Initial evidence that attention and consciousness are two separate processes primarily rested on behavioral data. However, the past couple of years witnessed an explosion of studies aimed at testing this conjecture using neuroscientific techniques. Here we provide an overview of these and related empirical studies on the distinction between the neuronal correlates of attention and consciousness, and detail how advancements in theory and technology can bring about a more detailed understanding of the two. We argue that the most promising approach will combine ever-evolving neurophysiological and interventionist tools with quantitative, empirically testable theories of consciousness that are grounded in a mathematically formalized understanding of phenomenology.

Reasonable criteria for functionalists; scarce criteria from phenomenological perspective

In their article, Doerig et al suggest a set of criteria for evaluating theories of consciousness. Naturally, their criteria are situated in their own particular perspective on consciousness science, which we have critiqued in the past. Their first criterion is likely to be the one that is most productive and least contentious: if the field can agree to a family of paradigm cases for consciousness, this would be an important endeavor for the field.

Detecting (Un)seen Change: The Neural Underpinnings of (Un)conscious Prediction Errors

Detecting changes in the environment is fundamental for our survival. According to predictive coding theory, detecting these irregularities relies both on incoming sensory information and our top-down prior expectations (or internal generative models) about the world. Prediction errors (PEs), detectable in event-related potentials (ERPs), occur when there is a mismatch between the sensory input and our internal model (i.e., a surprise event). Many changes occurring in our environment are irrelevant for survival and may remain unseen. Such changes, even if subtle, can nevertheless be detected by the brain without emerging into consciousness. What remains unclear is how these changes are processed in the brain at the network level. Here, we used a visual oddball paradigm in which participants engaged in a central letter task during electroencephalographic (EEG) recordings while presented with task-irrelevant high- or low-coherence background, random-dot motion. Critically, once in a while, the direction of the dots changed. After the EEG session, we confirmed that changes in motion direction at high- and low-coherence were visible and invisible, respectively, using psychophysical measurements. ERP analyses revealed that changes in motion direction elicited PE regardless of the visibility, but with distinct spatiotemporal patterns. To understand these responses, we applied dynamic causal modeling (DCM) to the EEG data. Bayesian Model Averaging showed visible PE relied on a release from adaptation (repetition suppression) within bilateral MT+, whereas invisible PE relied on adaptation at bilateral V1 (and left MT+). Furthermore, while feedforward upregulation was present for invisible PE, the visible change PE also included downregulation of feedback between right MT+ to V1. Our findings reveal a complex interplay of modulation in the generative network models underlying visible and invisible motion changes.

The SSVEP tracks attention, not consciousness, during perceptual filling-in

Research on the neural basis of conscious perception has almost exclusively shown that becoming aware of a stimulus leads to increased neural responses. By designing a novel form of perceptual filling-in (PFI) overlaid with a dynamic texture display, we frequency-tagged multiple disappearing targets as well as their surroundings. We show that in a PFI paradigm, the disappearance of a stimulus and subjective invisibility is associated with increases in neural activity, as measured with steady-state visually evoked potentials (SSVEPs), in electroencephalography (EEG). We also find that this increase correlates with alpha-band activity, a well-established neural measure of attention. These findings cast doubt on the direct relationship previously reported between the strength of neural activity and conscious perception, at least when measured with current tools, such as the SSVEP. Instead, we conclude that SSVEP strength more closely measures changes in attention.

The Dream Catcher experiment: blinded analyses failed to detect markers of dreaming consciousness in EEG spectral power

The Dream Catcher test defines the criteria for a genuine discovery of the neural constituents of phenomenal consciousness. Passing the test implies that some patterns of purely brain-based data directly correspond to the subjective features of phenomenal experience, which would help to bridge the explanatory gap between consciousness and brain. Here, we conducted the Dream Catcher test for the first time in a step-wise and simplified form, capturing its core idea. The Dream Catcher experiment involved a Data Team, which measured participants' brain activity during sleep and collected dream reports, and a blinded Analysis Team, which was challenged to predict, based solely on brain measurements, whether or not a participant had a dream experience. Using a serial-awakening paradigm, the Data Team prepared 54 1-min polysomnograms of non-rapid eye movement sleep-27 of dreamful sleep and 27 of dreamless sleep (three of each condition from each of the nine participants)-redacting from them all associated participant and dream information. The Analysis Team attempted to classify each recording as either dreamless or dreamful using an unsupervised machine learning classifier, based on hypothesis-driven, extracted features of electroencephalography (EEG) spectral power and electrode location. The procedure was repeated over five iterations with a gradual removal of blindness. At no level of blindness did the Analysis Team perform significantly better than chance, suggesting that EEG spectral power could not be utilized to detect signatures specific to phenomenal consciousness in these data. This study marks the first step towards realizing the Dream Catcher test in practice.

Evidence accumulation clustering using combinations of features

Evidence accumulation clustering (EAC) is an ensemble clustering algorithm that can cluster data for arbitrary shapes and numbers of clusters. Here, we present a variant of EAC in which we aimed to better cluster data with a large number of features, many of which may be uninformative. Our new method builds on the existing EAC algorithm by populating the clustering ensemble with clusterings based on combinations of fewer features than the original dataset at a time. Our method also calls for prewhitening the recombined data and weighting the influence of each individual clustering by an estimate of its informativeness. We provide code of an example implementation of the algorithm in Matlab and demonstrate its effectiveness compared to ordinary evidence accumulation clustering with synthetic data.•The clustering ensemble is made by clustering on subset combinations of features from the data•The recombined data may be prewhitened•Evidence accumulation can be improved by weighting the evidence with a goodness-of-clustering measure.

A multiple-response frequency-tagging paradigm measures graded changes in consciousness during perceptual filling-in

Perceptual filling-in (PFI) occurs when a physically present visual target disappears from conscious perception, with its location filled-in by the surrounding visual background. These perceptual changes are complete, near instantaneous, and can occur for multiple separate locations simultaneously. Here, we show that contrasting neural activity during the presence or absence of multi-target PFI can complement other findings from multistable phenomena to reveal the neural correlates of consciousness (NCC). We presented four peripheral targets over a background dynamically updating at 20 Hz. While participants reported on target disappearances/reappearances via button press/release, we tracked neural activity entrained by the background during PFI using steady-state visually evoked potentials (SSVEPs) recorded in the electroencephalogram. We found background SSVEPs closely correlated with subjective report, and increased with an increasing amount of PFI. Unexpectedly, we found that as the number of filled-in targets increased, the duration of target disappearances also increased, suggesting that facilitatory interactions exist between targets in separate visual quadrants. We also found distinct spatiotemporal correlates for the background SSVEP harmonics. Prior to genuine PFI, the response at the second harmonic (40 Hz) increased before the first (20 Hz), which we tentatively link to an attentional effect, while no such difference between harmonics was observed for physically removed stimuli. These results demonstrate that PFI can be used to study multi-object perceptual suppression when frequency-tagging the background of a visual display, and because there are distinct neural correlates for endogenously and exogenously induced changes in consciousness, that it is ideally suited to study the NCC.

Motion-induced blindness as a tool to measure attentional biases and the link to attention-deficit/hyperactivity traits

Typically, individuals have an attentional bias toward the left visual field. This is often absent in individuals with attention-deficit/hyperactivity (ADH) disorder (ADHD). We used a motion-induced blindness task with targets in 4 quadrants to assess left/right as well as upper/lower spatial biases in perceptual disappearances and also measured changes in the disappearances with time-on-task. Fifty-eight university students (41 female) completed the Conners Adult ADHD self-report short-form to assess the number of ADH traits, and 48 trials of a 1-min motion-induced blindness (MIB) task. Through a hybrid hypothesis-driven and data-driven analysis approach, we found that the MIB illusion increased with more ADH traits, decreased with time-on-task, and was stronger for left and lower quadrants. The time-on-task likely contributed to the strength of the illusion through changes in arousal, as pupil size decreased with time-on-trial in a subset of participants (n = 11) for whom we measure eye movements. In addition, although participants were biased toward the lower left visual field, this was, unexpectedly, most prominent with those with higher ADH traits. This novel result suggests an additive effect of left/right and upper/lower spatial biases. Taken together, this study supports an association between spatial attention, arousal and ADH traits in MIB. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Modulation of methotrexate-induced intestinal mucosal injury by dietary factors

Methotrexate (MTX)-induced intestinal mucosal injury in animals has been studied to understand how MTX can cause gastrointestinal disorders, but the pathogenesis of gastrointestinal disorders is still uncertain. We have attempted to reveal how dietary factors influence intestinal toxicity due to MTX. Mice were fed normal chow (NC) or a high-fat high-sucrose diet (HFHSD) before oral administration of MTX. While MTX significantly decreased the survival rates of mice fed HFHSD, the intestinal epithelial injury was detected. MTX excretion in the feces of mice fed HFHSD was reduced. Change of diets between NC and HFHSD influences the survival. The survival rates of the mice fed a high-sucrose diet or control diet were higher than those fed HFHSD. Higher survival rates were observed in mice fed a high-fat high-sucrose diet modified (HFHSD-M) in which casein was replaced by soybean-derived proteins. The survival rates of mice treated with vancomycin were lower than those administered neomycin. Microbiome and metabolome analyses on feces suggest a similarity of the intestinal environments of mice fed NC and HFHSD-M. HFHSD may modify MTX-induced toxicity in intestinal epithelia on account of an altered MTX distribution as a result of change in the intestinal environment.

A general spectral decomposition of causal influences applied to integrated information

BACKGROUND

Quantifying interactions among many neurons is fundamental to understanding system-level phenomena such as attention, learning and even conscious experience. Causal influences in the brain, quantified as integrated information, are thought to support subjective conscious experience. Recent empirical work has shown that the spectral decomposition of causal influences, for example using Granger causality, can reveal frequency-specific influences that are not observed in the time domain. However, a spectral decomposition of integrated information has not been put forward, limiting its adoption for analyzing neural data.

NEW METHOD

We present a general and flexible framework for deriving the spectral decomposition of causal influences in autoregressive processes.

RESULTS

We use the framework to derive a spectral decomposition of integrated information. We show that other well-known measures, including Granger causality, can be derived using the same framework. Using simulations, we demonstrate a complex interplay between the spectral decomposition of integrated information and other measures that is not observed in the time domain.

COMPARISON WITH EXISTING METHODS

This paper provides a spectral decomposition of integrated information for the first time. Although a spectral decomposition of Granger causality has been derived, that approach is only applicable to uni-directional causal influences, not multi-directional causal influences as required for integrated information.

CONCLUSIONS

Our novel framework can be used to derive the spectral decomposition of uni- and multi-directional measures of causal influences. We use this framework to derive a spectral decomposition of integrated information, paving the way for better understanding how frequency-specific causal influences in the brain relate to cognition.

Does the Mind Wander When the Brain Takes a Break? Local Sleep in Wakefulness, Attentional Lapses and Mind-Wandering

Sleep has been classically described as an all-or-nothing global phenomenon. However, recent research strongly suggests that this view requires tempering. Invasive and non-invasive recordings in animals and humans show that neural activity typically associated with sleep can locally occur during wakefulness. Although local sleep is defined neuronally, it has been associated with impaired performance during cognitive tasks. Comparatively, the phenomenology of local sleep (i.e., what it feels like when your brain is partially asleep) has been less explored. Taking into account the literature on the neuronal and behavioral profile of local sleep intrusions in wakefulness, we propose that occurrences of local sleep could represent the neural mechanism underlying many attentional lapses. In particular, we argue that a unique physiological event such as local sleep could account for a diversity of behavioral outcomes from sluggish to impulsive responses. We further propose that local sleep intrusions could impact individuals' subjective experience. Specifically, we propose that the timing and anatomical sources of local sleep intrusions could be responsible for both the behavioral consequences and subjective content of attentional lapses and may underlie the difference between subjective experiences such as mind wandering and mind blanking. Our framework aims to build a parallel between spontaneous experiences in sleep and wakefulness by integrating evidence across neuronal, behavioral and experiential levels. We use the example of attention deficit hyperactivity disorder (ADHD) to illustrate how local sleep could explain complex cognitive profiles which include inattention, impulsivity, mind-wandering and mind-blanking.

Metacognitive Accuracy Improves With the Perceptual Learning of a Low- but Not High-Level Face Property

Experience with visual stimuli can improve their perceptual performance, a phenomenon termed visual perceptual learning (VPL). VPL has been found to improve metacognitive measures, suggesting increased conscious accessibility to the knowledge supporting perceptual decision-making. However, such studies have largely failed to control objective task accuracy, which typically correlates with metacognition. Here, using a staircase method to control this confound, we investigated whether VPL improves the metacognitive accuracy of perceptual decision-making. Across 3 days, subjects were trained to discriminate faces based on their high-level identity or low-level contrast. Holding objective accuracy constant across training days, perceptual thresholds decreased in both tasks, demonstrating VPL in our protocol. However, whilemetacognitive accuracy was not affected by face contrast VPL, it was decreased by face identity VPL. Our findings couldbe parsimoniously explained by a dual-stage signal detection theory-based model involving an initial perceptual decision-making stage and a second confidence judgment stage. Within this model, internal noise reductions for both stages accounts for our face contrast VPL result, while only first stage noise reductions accounts for our face identity VPL result. In summary, we found evidence suggesting that conscious knowledge accessibility was improved by the VPL of face contrast but not face identity.

From intermodulation components to visual perception and cognition-a review

Perception results from complex interactions among sensory and cognitive processes across hierarchical levels in the brain. Intermodulation (IM) components, used in frequency tagging neuroimaging designs, have emerged as a promising direct measure of such neural interactions. IMs have initially been used in electroencephalography (EEG) to investigate low-level visual processing. In a more recent trend, IMs in EEG and other neuroimaging methods are being used to shed light on mechanisms of mid- and high-level perceptual processes, including the involvement of cognitive functions such as attention and expectation. Here, we provide an account of various mechanisms that may give rise to IMs in neuroimaging data, and what these IMs may look like. We discuss methodologies that can be implemented for different uses of IMs and we demonstrate how IMs can provide insights into the existence, the degree and the type of neural integration mechanisms at hand. We then review a range of recent studies exploiting IMs in visual perception research, placing an emphasis on high-level vision and the influence of awareness and cognition on visual processing. We conclude by suggesting future directions that can enhance the benefits of IM-methodology in perception research.

Expectation and attention increase the integration of top-down and bottom-up signals in perception through different pathways

Perception likely results from the interplay between sensory information and top-down signals. In this electroencephalography (EEG) study, we utilised the hierarchical frequency tagging (HFT) method to examine how such integration is modulated by expectation and attention. Using intermodulation (IM) components as a measure of nonlinear signal integration, we show in three different experiments that both expectation and attention enhance integration between top-down and bottom-up signals. Based on a multispectral phase coherence (MSPC) measure, we present two direct physiological measures to demonstrate the distinct yet related mechanisms of expectation and attention, which would not have been possible using other amplitude-based measures. Our results link expectation to the modulation of descending signals and to the integration of top-down and bottom-up information at lower levels of the visual hierarchy. Meanwhile, the results link attention to the modulation of ascending signals and to the integration of information at higher levels of the visual hierarchy. These results are consistent with the predictive coding account of perception.

Attention periodically samples competing stimuli during binocular rivalry

The attentional sampling hypothesis suggests that attention rhythmically enhances sensory processing when attending to a single (~8 Hz), or multiple (~4 Hz) objects. Here, we investigated whether attention samples sensory representations that are not part of the conscious percept during binocular rivalry. When crossmodally cued toward a conscious image, subsequent changes in consciousness occurred at ~8 Hz, consistent with the rates of undivided attentional sampling. However, when attention was cued toward the suppressed image, changes in consciousness slowed to ~3.5 Hz, indicating the division of attention away from the conscious visual image. In the electroencephalogram, we found that at attentional sampling frequencies, the strength of inter-trial phase-coherence over fronto-temporal and parieto-occipital regions correlated with changes in perception. When cues were not task-relevant, these effects disappeared, confirming that perceptual changes were dependent upon the allocation of attention, and that attention can flexibly sample away from a conscious image in a task-dependent manner.

Conscious access in the near absence of attention: critical extensions on the dual-task paradigm

Whether conscious perception requires attention remains a topic of intense debate. While certain complex stimuli such as faces and animals can be discriminated outside the focus of spatial attention, many simpler stimuli cannot. Because such evidence was obtained in dual-task paradigms involving no measure of subjective insight, it remains unclear whether accurate discrimination of unattended complex stimuli is the product of automatic, unconscious processing, as in blindsight, or is accessible to consciousness. Furthermore, these paradigms typically require extensive training over many hours, bringing into question whether this phenomenon can be achieved in naive subjects. We developed a novel dual-task paradigm incorporating confidence ratings to calculate metacognition and adaptive staircase procedures to reduce training. With minimal training, subjects were able to discriminate face-gender in the near absence of top-down attentional amplification, while also displaying above-chance metacognitive accuracy. By contrast, the discrimination of simple coloured discs was significantly impaired and metacognitive accuracy dropped to chance-level, even in a partial-report condition. In a final experiment, we used blended face/disc stimuli and confirmed that face-gender but not colour orientation can be discriminated in the dual task. Our results show direct evidence for metacognitive conscious access in the near absence of attention for complex, but not simple, stimuli.This article is part of the theme issue 'Perceptual consciousness and cognitive access'.

The Effect of Common Signals on Power, Coherence and Granger Causality: Theoretical Review, Simulations, and Empirical Analysis of Fruit Fly LFPs Data

When analyzing neural data it is important to consider the limitations of the particular experimental setup. An enduring issue in the context of electrophysiology is the presence of common signals. For example a non-silent reference electrode adds a common signal across all recorded data and this adversely affects functional and effective connectivity analysis. To address the common signals problem, a number of methods have been proposed, but relatively few detailed investigations have been carried out. As a result, our understanding of how common signals affect neural connectivity estimation is incomplete. For example, little is known about recording preparations involving high spatial-resolution electrodes, used in linear array recordings. We address this gap through a combination of theoretical review, simulations, and empirical analysis of local field potentials recorded from the brains of fruit flies. We demonstrate how a framework that jointly analyzes power, coherence, and quantities based on Granger causality reveals the presence of common signals. We further show that subtracting spatially adjacent signals (bipolar derivations) largely removes the effects of the common signals. However, in some special cases this operation itself introduces a common signal. We also show that Granger causality is adversely affected by common signals and that a quantity referred to as “instantaneous interaction” is increased in the presence of common signals. The theoretical review, simulation, and empirical analysis we present can readily be adapted by others to investigate the nature of the common signals in their data. Our contributions improve our understanding of how common signals affect power, coherence, and Granger causality and will help reduce the misinterpretation of functional and effective connectivity analysis.