Differential Visual Processing of Animal Images, with and without Conscious Awareness

The temporal dynamics of conscious and unconscious audio-visual semantic integration

We compared the time course of cross-modal semantic effects induced by both naturalistic sounds and spoken words on the processing of visual stimuli, whether visible or suppressed form awareness through continuous flash suppression. We found that, under visible conditions, spoken words elicited audio-visual semantic effects over longer time (-1000, -500, -250 ms SOAs) than naturalistic sounds (-500, -250 ms SOAs). Performance was generally better with auditory primes, but more so with congruent stimuli. Spoken words presented in advance (-1000, -500 ms) outperformed naturalistic sounds; the opposite was true for (near-)simultaneous presentations. Congruent spoken words demonstrated superior categorization performance compared to congruent naturalistic sounds. The audio-visual semantic congruency effect still occurred with suppressed visual stimuli, although without significant variations in the temporal patterns between auditory types. These findings indicate that: 1. Semantically congruent auditory input can enhance visual processing performance, even when the visual stimulus is imperceptible to conscious awareness. 2. The temporal dynamics is contingent on the auditory types only when the visual stimulus is visible. 3. Audiovisual semantic integration requires sufficient time for processing auditory information.

Priming of natural scene categorization during continuous flash suppression

Continuous Flash Suppression (CFS) reduces conscious awareness of stimuli. Whether stimuli suppressed by CFS are processed at categorical or semantic levels is still debated. Here, we approached this question using a large set of indoor and outdoor scene photographs in a priming paradigm. Perceptually suppressed primes were followed by visible targets. Participants rapidly reported whether the targets showed an indoor or an outdoor scene. Responses were faster (and fast responses more accurate) when primes and targets came from a congruent superordinate category (e.g., both were outdoor scenes). During CFS, priming effects were relatively small (up to 10 ms) and modulated by prime visibility and stimulus onset asynchrony (SOA) of prime and target. Without CFS, the stimuli elicited consistent and more robust priming effects (about 24 ms). Our results imply that scene category is processed during CFS, although some residual prime visibility is likely necessary for significant priming effects to occur.

Object Categorization Capability of Psychological Potential Field in Perceptual Assessment Using Line-Drawing Images

Affective/cognitive engineering investigations typically require the quantitative assessment of object perception. Recent research has suggested that certain perceptions of object categorization can be derived from human eye fixation and that color images and line drawings induce similar neural activities. Line drawings contain less information than color images; therefore, line drawings are expected to simplify the investigations of object perception. The psychological potential field (PPF), which is a psychological feature, is an image feature of line drawings. On the basis of the PPF, the possibility that the general human perception of object categorization can be assessed from the similarity to fixation maps (FMs) generated from human eye fixations has been reported. However, this may be due to chance because image features other than the PPF have not been compared with FMs. This study examines the potential and effectiveness of the PPF by comparing its performance with that of other image features in terms of the similarity to FMs. The results show that the PPF shows the ideal performance for assessing the perception of object categorization. In particular, the PPF effectively distinguishes between animal and nonanimal targets; however, real-time assessment is difficult.

General and own-species attentional face biases

Humans demonstrate enhanced processing of human faces compared with animal faces, known as own-species bias. This bias is important for identifying people who may cause harm, as well as for recognizing friends and kin. However, growing evidence also indicates a more general face bias. Faces have high evolutionary importance beyond conspecific interactions, as they aid in detecting predators and prey. Few studies have explored the interaction of these biases together. In three experiments, we explored processing of human and animal faces, compared with each other and to nonface objects, which allowed us to examine both own-species and broader face biases. We used a dot-probe paradigm to examine human adults' covert attentional biases for task-irrelevant human faces, animal faces, and objects. We replicated the own-species attentional bias for human faces relative to animal faces. We also found an attentional bias for animal faces relative to objects, consistent with the proposal that faces broadly receive privileged processing. Our findings suggest that humans may be attracted to a broad class of faces. Further, we found that while participants rapidly attended to human faces across all cue display durations, they attended to animal faces only when they had sufficient time to process them. Our findings reveal that the dot-probe paradigm is sensitive for capturing both own-species and more general face biases, and that each has a different attentional signature, possibly reflecting their unique but overlapping evolutionary importance.

Faces under continuous flash suppression capture attention faster than objects, but without a face-evoked steady-state visual potential: Is curvilinearity responsible for the behavioral effect?

Face perception is a vital part of human social interactions. The social value of faces makes their efficient detection evolutionarily advantageous. It has been suggested that this might occur nonconsciously, but experimental results are equivocal thus far. Here, we probe nonconscious face perception using a novel combination of binocular rivalry with continuous flash suppression and steady-state visually evoked potentials. In the first two experiments, participants viewed either non-face objects, neutral faces (Study 1), or fearful faces (Study 2). Consistent with the hypothesis that faces are processed nonconsciously, we found that faces broke through suppression faster than objects. We did not, however, observe a concomitant face-selective steady-state visually evoked potential. Study 3 was run to reconcile this paradox. We hypothesized that the faster breakthrough time was due to a mid-level visual feature, curvilinearity, rather than high-level category membership, which would explain the behavioral difference without neural evidence of face-selective processing. We tested this hypothesis by presenting participants with four different groups of stimuli outside of conscious awareness: rectilinear objects (e.g., chessboard), curvilinear objects (e.g., dartboard), faces, and objects that were not dominantly curvilinear or rectilinear. We found that faces and curvilinear objects broke through suppression faster than objects and rectilinear objects. Moreover, there was no difference between faces and curvilinear objects. These results support our hypothesis that the observed behavioral advantage for faces is due to their curvilinearity, rather than category membership.

Gamma oscillations in the superior colliculus and pulvinar in response to faces support discrimination performance in monkeys

The subcortical visual pathway including the superior colliculus (SC), pulvinar, and amygdala has been implicated in unconscious visual processing of faces, eyes, and gaze direction in blindsight. Our previous studies reported that monkey SC and pulvinar neurons responded preferentially to images of faces while performing a delayed non-matching to sample (DNMS) task to discriminate different visual stimuli (Nguyen et al., 2013, 2014). However, the contribution of SC and pulvinar neurons to the discrimination of the facial images and subsequent behavioral performance remains unknown. Since gamma oscillations have been implicated in sensory and cognitive processes as well as behavioral execution, we hypothesized that gamma oscillations during neuronal responses might contribute to achieving the appropriate behavioral performance (i.e., a correct response). In the present study, we re-analyzed those neuronal responses in the monkey SC and pulvinar to investigate possible relationships between gamma oscillations in these neurons and behavioral performance (correct response ratios) during the DNMS task. Gamma oscillations of SC and pulvinar neuronal activity were analyzed in three phases around the stimulus onset [inter-trial interval (ITI): 1000ms before trial onset; Early: 0-200ms after stimulus onset; and Late: 300-500ms after stimulus onset]. We found that human facial images elicited stronger gamma oscillations in the early phase than the ITI and late phase in both the SC and pulvinar neurons. Furthermore, there was a significant correlation between strengths of gamma oscillations in the early phase and behavioral performance in both the SC and pulvinar. The results suggest that gamma oscillatory activity in the SC and pulvinar contributes to successful behavioral performance during unconscious perceptual and behavioral processes.