Intergration and interruption in the masking of form by form

Masked blindsight in normal observers: Measuring subjective and objective responses to two features of each stimulus

Recent visual masking studies that have measured visual awareness with graded subjective scales have often failed the show any evidence for unconscious visual processing in normal observers in a paradigm similar to that used in studies on blindsight patients. Without any reported awareness of the target, normal observers typically cannot discriminate target's features better than chance. The present study examined processing of color and orientation by measuring graded awareness and forced-choice discriminations for both features in each trial. When no awareness for either feature was reported, discrimination of each feature succeed better than expected by chance, even when the other feature was incorrectly discriminated in the same trial. However, the characteristics of the mask determined whether or not masked blindsight was observed. We conclude that when the processing channels are free from intra-channel interference, unbound or weakly bound features can guide behaviour without any reported awareness in normal observers.

Masking the Integration of Complementary Shape Cues

Retinal and cortical mechanisms provide for persistence of visual information across intervals of many hundreds of milliseconds, which supports the integration of partial shape cues. The present experiments displayed unknown shapes in a match recognition task, wherein a target shape was quickly followed by a comparison shape; the task was to specify whether the comparison shape was the same or different from the target. The target and comparison shapes were displayed as sparse dots that marked boundary locations. The first experiment successively displayed the target shape as two complementary subsets and found that the probability of correct match remained above chance with up to 500 ms of subset separation. The second experiment demonstrated masking of the target by a random pattern of dots when the target and mask were displayed simultaneously, but with much less or no masking when the two were separated by 100 ms. The third experiment displayed the target subsets with 200 ms of separation and found that match recognition was disrupted when the random-dot mask was displayed midway between the two subsets. Much less masking of an intact target was produced with that amount of temporal separation, which suggests that mechanisms for integration of shape cues have a special vulnerability to masking. The third experiment also found very little impairment of match recognition when the mask was displayed simultaneous with one of the subsets. We hypothesize that there is embedding of the subset pattern within the mask pattern, but additional display of the other subset effectively disembeds the buried partial shape cues.

A face versus non-face context influences amygdala responses to masked fearful eye whites

The structure of the mask stimulus is crucial in backward masking studies and we recently demonstrated such an effect when masking faces. Specifically, we showed that activity of the amygdala is increased to fearful facial expressions masked with neutral faces and decreased to fearful expressions masked with a pattern mask-but critically both masked conditions discriminated fearful expressions from happy expressions. Given this finding, we sought to test whether masked fearful eye whites would produce a similar profile of amygdala response in a face vs non-face context. During functional magnetic resonance imaging scanning sessions, 30 participants viewed fearful or happy eye whites masked with either neutral faces or pattern images. Results indicated amygdala activity was increased to fearful vs happy eye whites in the face mask condition, but decreased to fearful vs happy eye whites in the pattern mask condition-effectively replicating and expanding our previous report. Our data support the idea that the amygdala is responsive to fearful eye whites, but that the nature of this activity observed in a backward masking design depends on the mask stimulus.

Variations in Backward Masking with Different Masking Stimuli: I. Local Interaction versus Attentional Switch

The types of stimuli used as targets and masks considerably change the masking functions in a way that requires us to abandon any single mechanism of masking as the sole explanation of backward masking. In the first of two reports in which the problem of the mask-dependence of masking is addressed, we explore the role of the relative spatial positioning of targets and masks in order to differentiate between local interaction and attentional models. If single letters were masked by double-letter masks then the relative spatial arrangement of the letters, which was changed in order to vary the involvement of metacontrast-like processes, had an effect at shorter SOAs, but not at longer SOAs where strong masking still persisted. This poses difficulties for proposing local contour interaction as the main mechanism of masking. Similarly, crowding effects alone cannot explain the results. Backward masking also involves attention being directed to working-memory processing of the succeeding object while abandoning the preceding object.

It is time to combine the two main traditions in the research on the neural correlates of consciousness: C = L × D

Research on neural correlates of consciousness has been conducted and carried out mostly from within two relatively autonomous paradigmatic traditions – studying the specific contents of conscious experience and their brain-process correlates and studying the level of consciousness. In the present paper we offer a theoretical integration suggesting that an emphasis has to be put on understanding the mechanisms of consciousness (and not a mere correlates) and in doing this, the two paradigmatic traditions must be combined. We argue that consciousness emerges as a result of interaction of brain mechanisms specialized for representing the specific contents of perception/cognition – the data – and mechanisms specialized for regulating the level of activity of whatever data the content-carrying specific mechanisms happen to represent. Each of these mechanisms are necessary because without the contents there is no conscious experience and without the required level of activity the processed contents remain unconscious. Together the two mechanisms, when activated up to a necessary degree each, provide conditions sufficient for conscious experience to emerge. This proposal is related to pertinent experimental evidence.

The mental wormhole: internal attention shifts without regard for distance

Attention operates perceptually on items in the environment, and internally on objects in visuospatial working memory. In the present study, we investigated whether spatial and temporal constraints affecting endogenous perceptual attention extend to internal attention. A retro-cue paradigm in which a cue is presented beyond the range of iconic memory and after stimulus encoding was used to manipulate shifts of internal attention. Participants' memories were tested for colored circles (Experiments 1, 2, 3a, 4) or for novel shapes (Experiment 3b) and their locations within an array. In these experiments, the time to shift internal attention (Experiments 1 and 3) and the eccentricity of encoded objects (Experiments 2-4) were manipulated. Our data showed that, unlike endogenous perceptual attention, internal shifts of attention are not modulated by stimulus eccentricity. Across several timing parameters and stimuli, we found that shifts of internal attention require a minimum quantal amount of time regardless of the object eccentricity at encoding. Our findings are consistent with the view that internal attention operates on objects whose spatial information is represented in relative terms. Although endogenous perceptual attention abides by the laws of space and time, internal attention can shift across spatial representations without regard for physical distance.

Target-mask shape congruence impacts the type of metacontrast masking

Visual metacontrast masking may depend on the time intervals between target and mask in two qualitatively different ways: in type-A masking the smaller the mask delay from target the stronger the masking while in type-B masking maximal masking effect is obtained with a larger temporal delay of the mask. Variability in the qualitative apperance of masking functions has been explained by variability in stimuli parameters and tasks. Recent research on metacontrast masking has surprisingly shown that both of these types of functions can be found with an identical range of stimulation parameters depending on individual differences between observers. Here we show that obtaining clear-cut type-A masking depends on whether target and mask shapes are congruent or incongruent and whether observers use the cues available due to the congruence factor. Conspicuously expressed type-A masking is selectively associated with incongruent target-mask pairings. In the latter conditions target identification level significantly drops with the shortest target-to-mask delays.

Behind the mask: the influence of mask-type on amygdala response to fearful faces

In this study, we compared the effects of using neutral face masks vs non-face pattern masks on amygdala activity to masked fearful faces. Twenty-seven subjects viewed 18 s blocks of either fearful or happy faces masked with either neutral faces or patterns, while their brain activity was measured using functional magnetic resonance imaging. Results replicated increased amygdala activation to face-masked fearful vs happy faces. In the pattern mask condition, the amygdala discriminated between masked fearful and happy faces, but this effect manifested as a decrease in activation to fearful faces compared to happy faces. This interactive effect between facial expression and mask stimulus shows that amygdala responses to masked fearful faces are influenced by the fearful stimuli per se as well as their interaction with the mask stimulus.

Pitting temporal against spatial integration in schizophrenic patients

Schizophrenic patients show strong impairments in visual backward masking possibly caused by deficits on the early stages of visual processing. The underlying aberrant mechanisms are not clearly understood. Spatial as well as temporal processing deficits have been proposed. Here, by combining a spatial with a temporal integration paradigm, we show further evidence that temporal but not spatial processing is impaired in schizophrenic patients. Eleven schizophrenic patients and ten healthy controls were presented with sequences composed of Vernier stimuli. Patients needed significantly longer presentation times for sequentially presented Vernier stimuli to reach a performance level comparable to that of healthy controls (temporal integration deficit). When we added spatial contextual elements to some of the Vernier stimuli, performance changed in a complex but comparable manner in patients and controls (intact spatial integration). Hence, temporal but not spatial processing seems to be deficient in schizophrenia.

Binding binding: Departure points for a different version of the perceptual retouch theory

In the perceptual retouch theory, masking and related microgenetic phenomena were explained as a result of interaction between specific cortical representational systems and the non-specific sub-cortical modulation system. Masking appears as deprivation of sufficient modulation of the consciousness mechanism suffered by the target-specific signals because of the temporal delay of non-specific modulation (necessary for conscious representation), which explicates the later-coming mask information instead of the already decayed target information. The core of the model envisaged relative magnitudes of EPSPs of single cortical cells driven by target and mask signals at the moment when the nonspecific, presynaptic, excitatory input arrives from the thalamus. In the light of the current evidence about the importance of synchronised activity of specific and non-specific systems in generating consciousness, the retouch theory requires perhaps a different view. This article presents some premises for modification of the retouch theory, where instead of the cumulative presynaptic spike activities and EPSPs of single cells, the oscillatory activity in the gamma range of the participating systems is considered and shown to be consistent with the basic ideas of the retouch theory. In this conceptualisation, O-binding refers to specific encoding which is based on gamma-band synchronised oscillations in the activity of specific cortical sensory modules that represent features and objects; C-binding refers to the gamma-band oscillations in the activity of the non-specific thalamic systems, which is necessary for the O-binding based data to become consciously experienced.

Visual similarity in masking and priming: The critical role of task relevance

Cognitive scientists use rapid image sequences to study both the emergence of conscious perception (visual masking) and the unconscious processes involved in response preparation (masked priming). The present study asked two questions: (1) Does image similarity influence masking and priming in the same way? (2) Are similarity effects in both tasks governed by the extent of feature overlap in the images or only by task-relevant features? Participants in Experiment 1 classified human faces using a single dimension even though the faces varied in three dimensions (emotion, race, sex). Abstract geometric shapes and colors were tested in the same way in Experiment 2. Results showed that similarity reduced the visibility of the target in the masking task and increased response speed in the priming task, pointing to a double-dissociation between the two tasks. Results also showed that only task-relevant (not objective) similarity influenced masking and priming, implying that both tasks are influenced from the beginning by intentions of the participant. These findings are interpreted within the framework of a reentrant theory of visual perception. They imply that intentions can influence object formation prior to the separation of vision for perception and vision for action.

Luminance processing in object substitution masking

We probed how processing of luminance increments and decrements interacts with attention dependent substitution masking. Results showed that a target was identified better when surrounded by an opposite polarity mask as compared to the same polarity mask. Opposite polarity mask decreased an effect of distracters, indicating influence on the time of directing attention to a target. The opposite polarity mask decreased masking when delayed for longer than 100 ms. Stimuli with the same polarity but different contrast showed increased masking with high contrast mask. Luminance processing, particularly polarity processing, probably enables faster formation of distinct object representation, interacting with attentional selection processes in object substitution masking.

Bloch’s law and the dynamics of feature fusion

How the visual brain integrates temporally dispersed information is an open question. Often, it is assumed that the visual system simply sums light over a certain period of time (e.g. Bloch's law). However, in feature fusion, information presented later dominates, suggesting complex temporal dynamics that cannot be described by simple energy summation. For example, if two verniers are presented in rapid succession at the same location, they are not perceived individually but they fuse to one single vernier. The perceived offset of the fused vernier is a combination of the offsets of the two presented verniers, with the later one dominating. Here, we show that indeed, Bloch's law does not hold across verniers in a sequence. However, changes in the luminance of a single vernier can be compensated for by changes in its duration in accordance with Bloch's law. We present a simple model to demonstrate that these findings can be explained by decaying neural activation.

Temporal uncertainty degrades perceptual processing

When participants are required to react to a stimulus, reaction times (RTs) are usually reduced when temporal uncertainty about stimulus occurrence is minimized. Contrary to the common assumption attributing this RT benefit solely to the speeding of motor processes, recent evidence suggests that temporal uncertainty might rather influence premotoric processing levels. We employed a backward-masking procedure to further confine the locus of the temporal uncertainty effect. Participants performed a discrimination task and indicated whether a spatial gap within a square was on the right or the left side. In addition to the shorter RTs, visual discrimination accuracy was improved when temporal uncertainty was low. This result demonstrates that temporal uncertainty influences stimulus processing at a perceptual level.

The attentional blink is governed by a temporary loss of control

Identification of the second of two brief targets is impaired at intertarget lags of less than about 500 msec. We compared two accounts of this attentional blink (AB) by manipulating the number of digit distractors--and hence the lag--inserted among three letter targets in a rapid serial visual presentation stream of digit distractors. On the resource-depletion hypothesis, longer lags provide more time for processing the leading target, thus releasing resources for the trailing target. On the temporary-loss-of-control (TLC) hypothesis, intervening distractors disrupt the current attentional set, producing a trailing-target deficit. Identification accuracy for trailing targets was unimpaired not only at lag 1 (conventional lag 1 sparing) but also at later lags, if preceded by another target. The results supported the TLC hypothesis but not the resource-depletion hypothesis. We conclude that the AB is caused by a disruption in attentional set when a distractor is presented while the central executive is busy processing a leading target.

The interdependence of spatial attention and lexical access as revealed by early asymmetries in occipito-parietal ERP activity

A test of the possible functional interaction between mechanisms subserving spatial attention and lexical access was devised by displaying one green and one red string of letters, one to the left and one to the right of fixation, and having participants attend to a target string defined by color while ignoring the other distractor string. The target string for a delayed lexical decision task could be a word or a nonword. The distractor was always a word. When the target was a word, target and distractor were associatively related on half of the trials and not related in the other trials. The event-related potential time-locked to the onset of the letter strings produced an N2pc (a greater negativity at scalp sites contralateral to the target relative to the ipsilateral sites arising at about 170 ms poststimulus). N2pc amplitude was reduced when the words were related relative to when they were not related. The results provide direct, online evidence that the rapid activation of meaning by visual words can influence the efficiency of the deployment of spatial attention.

Visual attention and the mechanism of metacontrast

The U-shaped metacontrast function may result from the superimposition of two monotonic components which reflect the effects of mechanisms similar to the peripheral and central processes suggested for backward pattern masking by Turvey (Psychol Rev 80:1-52, 1973). In an experiment using the disc-ring paradigm, it was demonstrated that the decreasing and increasing branches of the metacontrast function are differently affected by the exposure duration of the mask and a task-irrelevant stimulus (distractor) appearing in the contralateral visual hemifield. The phenomenal representation of masking is different for the two parts of the curve. It is suggested that masking in the second part of the masking function, but not in the first, is related to the control of visual attention.

Perception of successive targets presented in invariant-item streams

When two successive, spatially overlapping, targets (S1 and S2) are presented on a blank background, S2 typically dominates in explicit perception. We tested whether S2 dominance is also found for the conditions of presenting S1 and S2 in a stream of irrelevant objects. Successive target letters were presented within a stream of invariant stimulus items (capital Is). The stream items were presented either as a perceptually continuous object where both type and token appeared invariant (60-Hz stream) or as a flickering stream of successive replicas of the invariant stationary object where the type appeared invariant but the token appearance seemed intermittent (20-Hz condition). Compared to the control condition where targets were presented on a blank background we found that (1) recognition rate was lower for targets embedded in a perceptually continuous type-and-token object (60 Hz), but was unchanged for targets in a perceptually flickering sequence of the invariant-object tokens (20 Hz); (2) S1 recognition rate was higher compared to S2 recognition rate within the first epoch of stream (0-150 ms) while within the later stream-epochs S2 dominated over S1 as usual; (3) the overall difference in recognition rates between S1 and S2 was decreased. The results are discussed in the theoretical context of visual masking and attentional blink.

Variations in backward masking with different masking stimuli: II. The effects of spatially quantised masks in the light of local contour interaction, interchannel inhibition, perceptual retouch, and substitution theories

In part I we showed that with spatially non-overlapping targets and masks both local metacontrast-like interactions and attentional processes are involved in backward masking. In this second part we extend the strategy of varying the contents of masks to pattern masking where targets and masks overlap in space, in order to compare different masking theories. Images of human faces were backward-masked by three types of spatially quantised masks (the same faces as targets, faces different from targets, and Gaussian noise with power spectra typical for faces). Configural characteristics, rather than the spectral content of the mask, predicted the extent of masking at relatively long stimulus onset asynchronies (SOAs). This poses difficulties for the theory of transient-on-sustained inhibition as the principal mechanism of masking and also for local contour interaction being a decisive factor in pattern masking. The scale of quantisation had no effect on the masking capacity of noise masks and a strong effect on the capacity of different-face masks. Also, the decrease of configural masking with an increase in the coarseness of the quantisation of the mask highlights ambiguities inherent in the re-entrance-based substitution theory of masking. Different masking theories cannot solve the problems of masking separately. They should be combined in order to create a complex, yet comprehensible mode of interaction for the different mechanisms involved in visual backward masking.

A comparison of masking by visual and transcranial magnetic stimulation: implications for the study of conscious and unconscious visual processing

Visual stimuli as well as transcranial magnetic stimulation (TMS) can be used: (1) to suppress the visibility of a target and (2) to recover the visibility of a target that has been suppressed by another mask. Both types of stimulation thus provide useful methods for studying the microgenesis of object perception. We first review evidence of similarities between the processes by which a TMS mask and a visual mask can either suppress the visibility of targets or recover such suppressed visibility. However, we then also point out a significant difference that has important implications for the study of the time course of unconscious and conscious visual information processing and for theoretical accounts of the processes involved. We present evidence and arguments showing: (a) that visual masking techniques, by revealing more detailed aspects of target masking and target recovery, support a theoretical approach to visual masking and visual perception that must take into account activities in two separate neural channels or processing streams and, as a corollary, (b) that at the current stage of methodological sophistication visual masks, by acting in more highly specifiable ways on these pathways, provide information about the microgenesis of form perception not available with TMS masks.

Rapid serial visual distraction: Task-irrelevant items can produce an attentional blink

When two sequential targets (T1 and T2) are presented within about 600 msec, perception of the second target is impaired. This attentional blink (AB) has been studied by means of two paradigms: rapid serial visual presentation (RSVP), in which targets are embedded in a stream of central distractors, and the two-target paradigm, in which targets are presented eccentrically without distractors. We examined the role of distractors in the AB, using a modified two-target paradigm with a central stream of task-irrelevant distractors. In six experiments, the RSVP stream of distractors substantially impaired identification of both T1 and T2, but only when the distractors shared common characteristics with the targets. Without such commonalities, the distractors had no effect on performance. This points to the subjects' attentional control setting as an important factor in the AB deficit and suggests a conceptual link between the AB and a form of nonspatial contingent capture attributable to distractor processing.

Miracles of perception

This paper draws a bird's eye view of various counter-intuitive characteristics of perception. Peculiar is that perception is a both tool and topic of its study. As a consequence, its output is easily mistaken for its input. Furthermore, its output is characterized by remarkable Gestalt features, such as mutual dependence of stimulus elements and detour solutions. Detour solutions require a complex perception process of testing countless optional pattern interpretations against a criterion. Likelihood is a plausible criterion for reasoning. For perception, however, the simplicity criterion is more appropriate. The consideration is that reasoning aims at establishing properties of distal objects whereas perception aims at establishing objects from proximal properties. The role of knowledge in perception seems plausible but often leads to conflicts. For instance, the assumption that knowledge about handedness is present in pattern representations conflicts with image mirror-image discrimination data. Moreover, knowledge does not provide an anchor for subjective time direction, but a Gestalt quality does.

Four-dot masking produces the attentional blink

When two target stimuli (T1 and T2) are presented sequentially within half a second of each other, identification accuracy is often poor for T2. This phenomenon, known as attentional blink (AB), can be observed generally only if the stimulus terminating the presentation of T2 acts as an interruption mask. Recent evidence suggests that even four small dots surrounding a target item can exert masking effects, provided the target onset occurs at an unattended spatial location. In order to test whether an AB could be observed under conditions of four-dot masking of T2, five rapid serial visual presentation streams of letters were synchronously displayed on each trial of the present experiment. T1 and T2 were digits presented at unpredictable locations and unpredictable temporal intervals. T2 was followed by either a blank field, a letter, or four-dots. No AB was observed when T2 was not masked, but robust and equally sized ABs were observed when T2 was followed by both the letter mask and the four-dots.

The role of attention in temporal integration

When two visual patterns are presented in rapid succession, their contours may be combined into a single unified percept. This temporal integration is known to be influenced by such low-level visual factors as stimulus intensity, contour proximity, and stimulus duration. In this study we asked whether temporal integration is modulated by an attentional-blink procedure. The results from a localisation task in experiment 1 and a detection task in experiment 2 pointed to two separate effects. First, greater attentional availability increased the accuracy of spatial localisation. Second, it increased the duration over which successive stimuli could be integrated. These results imply that theories of visible persistence and visual masking must account for attentional influences in addition to lower-level effects. They also have practical implications for use of the temporal-integration task in the assessment of group and individual differences.

What's new in visual masking?

A brief display that is clearly visible when shown alone can be rendered invisible by the subsequent presentation of a second visual stimulus. Several recently described backward masking effects are not predicted by current theories of visual masking, including masking by four small dots that surround (but do not touch) a target object and masking by a surrounding object that remains on display after the target object has been turned off. A crucial factor in both of these effects is attention: almost no masking occurs if attention can be rapidly focused on the target, whereas powerful masking ensues if attention directed at the target is delayed. A new theory of visual masking, inspired by developments in neuroscience, can account for these effects, as well as more traditional masking effects. In addition, the new theory sheds light on related research, such as the attentional blink, inattentional blindness and change blindness.

Visual masking plays two roles in the attentional blink

When two targets are displayed in rapid visual sequence and masked by trailing patterns, identification accuracy is nearly perfect for the first target but follows a U-shaped pattern over temporal lag for the second target. Three experiments examined the role of visual masking in this attentional blink. Experiment 1 compared integration and interruption masks for both targets. Although either mask was effective in producing the blink when applied to the first target, only the interruption mask was effective when applied to the second target. Experiment 2 showed that integration masking of the second target was ineffective over a wide range of accuracy levels. Combining the two forms of masking in Experiment 3 confirmed the dissociation: A combined mask and only a main effect on accuracy for the first target, whereas it produced a qualitatively different pattern over temporal lag for the second target. These results suggest that representations of the target are substituted in consciousness by that of the interruption mask when visual attention is preoccupied.

Visibility of brief images: the dual-process approach

If successive, brief visual images are exposed for recognition or for psychophysical ratings, various effects and phenomena of fast dynamics of conscious perception such as mutual masking, metacontrast, proactive enhancement of contrast, proactive speed-up of the latency of subjective visual experience, the Fröhlich Effect, the Tandem Effect, attentional facilitation by visuospatial precuing, and some others have been found. The theory proposed to deal with these phenomena proceeds from the assumption that two types of brain processes are necessary in order to consciously recognize visual stimuli: (1) fast, specific processes of encoding that allocate and reactivate the stimulus representation which is based on the activity of selected cortical neurons and (2) relatively slower processes of facilitation of the activity of this specific representation that are mediated by the excitatory modulation of the EPSPs of those selected cortical neurons by the ascending input from nonspecific thalamus. The perceptual retouch construct is proposed in order to characterize and analyze the interaction of (1) and (2). The neurophysiological characteristics of this bifunctional system of afference help to put forward several predictions that are found to be consistent with the empirical regularities of the above-described perceptual-attentional phenomena. These data form a body of converging evidence that is consistent with the predictions of the perceptual retouch approach.

Microgenesis as traced by the transient paired-forms paradigm

Two successive, spatially overlapping human faces were exposed for recognition with SOAs ranging from 20 to 160 msec. The subjects effectively perceived one face, which at short SOAs mostly resembled the first stimulus and with increasing SOAs gradually shifted towards the appearance of the second, dimmer stimulus. These results replicated those from the study by Calis, et al, and extended them to the experimental conditions of controlled simultaneity of each of the two temporally separate, extremely brief stimuli and to the conditions of personally unfamiliar stimulus-subjects. In the second experiment we employed a direct measurement of the microgenetic focus in real time by using a procedure by which the subjects' judgments about the relative temporal order of the critical visual stimulus and an auditory click were recorded. Via this procedure it was shown that one of the effects of the first visual stimulus is to speed up the microgenetic process for the second stimulus which then appears subjectively earlier as compared to the single-stimulus control.

Parafoveal identification asymmetry in a lateral masking effect

The degree to which the identification of a parafoveally presented letter target was impaired by being flanked by a foveal or peripheral nontarget at a target-mask interval of zero, 75, or 150 msec, was examined. Peripheral placement of the nontarget was more disruptive than foveal placement, and this asymmetry was significantly more pronounced at a 75-msec interval than at either of the other two. This finding is consonant with explanations of the asymmetry based on target visibility rather than on criterion or response factors.