Modality-specific and modality-general electrophysiological correlates of visual and auditory awareness: Evidence from a bimodal ERP experiment

To date, most studies on the event-related potential (ERP) correlates of conscious perception have examined a single perceptual modality. We compared electrophysiological correlates of visual and auditory awareness in the same experiment to test whether there are modality-specific and modality-general correlates of conscious perception. We used near threshold stimulation and analyzed event-related potentials in response to aware and unaware trials in visual, auditory and bimodal conditions. The results showed modality-specific negative amplitude correlates of conscious perception between 200 and 300 ms after stimulus onset. A combination of these auditory and visual awareness negativities was observed in the bimodal condition. A later positive amplitude difference, whose early part was modality-specific, possibly reflecting access to global workspace, and later part shared modality-general features, possibly indicating higher level cognitive processing involving the decision making, was also observed.

ERP signatures of auditory awareness in cross-modal distractor-induced deafness

Previous research showed that dual-task processes such as the attentional blink are not always transferable from unimodal to cross-modal settings. This study investigated whether such a transfer can be stated for a distractor-induced impairment of target detection established in vision (distractor-induced blindness, DIB) and recently observed in the auditory modality (distractor-induced deafness, DID). A cross-modal DID effect was confirmed: The detection of an auditory target indicated by a visual cue was impaired if multiple auditory distractors preceded the target. Event-related potentials (ERPs) were used to identify psychophysiological correlates of target detection. A frontal negativity about 200 ms succeeded by a sustained, widespread negativity was associated with auditory target awareness. In contrast to unimodal findings, P3 amplitude was not enhanced for hits. The results support the notion that early frontal attentional processes are linked to auditory awareness, whereas the P3 does not seem to be a reliable indicator of target access.

The early but not the late neural correlate of auditory awareness reflects lateralized experiences

Theories disagree as to whether it is the early or the late neural correlate of awareness that plays a critical role in phenomenal awareness. According to recurrent processing theory, early activity in primary sensory areas corresponds closely to phenomenal awareness. In support, research with electroencephalography found that in the visual and somatosensory modality, an early neural correlate of awareness is contralateral to the perceived side of stimulation. Thus, early activity is sensitive to the perceived side of visual and somatosensory stimulation. Critically, it is unresolved whether this is true also for hearing. In the present study (N = 26 students), Bayesian analyses showed that the early neural correlate of awareness (auditory awareness negativity, AAN) was stronger for contralateral than ipsilateral electrodes whereas the late correlate of auditory awareness (late positivity, LP) was not lateralized. These findings demonstrate that the early but not the late neural correlate of auditory awareness reflects lateralized experiences. Thus, these findings imply that AAN is a more suitable NCC than LP because it correlates more closely with lateralized experiences.

Dissociating neural correlates of consciousness and task relevance during auditory processing

In recent years, several ERP components have been identified as potential neural correlates of consciousness (NCC), including early negativities and late positivities. Based on experiments in the visual modality, it has recently been shown that awareness is often confounded with reporting it, possibly overestimating the NCC. It is unknown whether similar constraints also exist in the auditory modality. In order to address this gap, we presented spoken words in a sustained inattentional deafness paradigm. Electrophysiological responses were obtained in three physically identical experimental conditions that differed only with respect to the participants' instructions. Participants were either left uninformed or informed about the presence of spoken words while confronted with an auditory distractor task (U/I condition), informed about the words while exposed to the same task as before (I condition), or requested to respond to the now task-relevant speech stimuli (TR condition). After completion of the U/I condition, only informed participants reported awareness of the words. In ERPs, awareness of words in the U/I and I condition was accompanied by an anterior auditory awareness negativity (AAN). Only when stimuli were task-relevant, i.e., during the TR condition, late positivities emerged. Taken together, these results indicate that early negativities but not late positivities index awareness across sensory modalities. Thus, they provide evidence for a recurrent processing framework, which highlights the importance of early sensory processing in conscious perception.