Pupillary responses and attentional allocation problems on the backward masking task in schizophrenia

Pupil response patterns distinguish true from false memories

Memory is reconstructive and error-prone, which make memory illusions very common in everyday life. However, studying memory illusions can provide valuable insights into how memory works. Pupil response has emerged, in recent years, as an indicator of memory encoding and retrieval, however its validity as a measure of memory success is debated. In this study, we explored whether pupil response patterns can differentiate true from false memories and whether variations in the temporal dynamics of pupil response can elucidate the mechanisms underlying false memory creation. The Deese-Roediger-McDermott (DRM) paradigm was employed to generate false memories in two separate experiments involving visual and auditory stimuli. Pupil responses effectively differentiated true from false memories based on variations in pupil amplitude at different temporal components. This discrimination remained consistent across both experiments, with slightly stronger effects in the auditory condition, aligning with the more pronounced false memory effects in this condition. Notably, differential pupil responses between true and false memories varied based on the type of memory involved at recognition. These findings provide valuable insights into the cognitive processes underlying memory distortions, with implications for theoretical frameworks and real-world contexts.

Blunted pupil light reflex is associated with negative symptoms and working memory in individuals with schizophrenia

Two largely separate lines of research have documented altered pupillary dynamics in individuals diagnosed with schizophrenia. An older set of studies has demonstrated reductions in the pupillary light reflex (PLR) in individuals with schizophrenia; however, clinical and cognitive correlates of this blunted PLR have been relatively unexplored. More recently, a large body of work has demonstrated reductions in pupillary dilation in response to cognitive demands in individuals with schizophrenia, and the degree of this blunted pupil dilation has been related to more severe cognitive deficits and motivational negative symptoms. These clinically relevant alterations in the cognitive modulation of pupil size have been interpreted as reflecting insufficient information processing resources or inappropriate effort allocation. To begin to bridge these two lines of work, we investigated the PLR in 34 individuals with schizophrenia and 30 healthy controls and related the amplitude of the PLR to motivational negative symptoms and cognitive performance. Consistent with prior work, we found that the PLR was reduced in individuals with schizophrenia, and furthermore, that these measurements were highly reliable across individuals. Blunted constriction was associated with more severe motivational negative symptoms and poorer working memory among individuals with schizophrenia. These observed correlates provide a bridge between older literature documenting an altered PLR and more recent work reporting associations between negative symptoms, cognition, and blunted pupillary dilation in response to cognitive demands in individuals with schizophrenia. We provide possible mechanistic interpretations of our data and consider a parsimonious explanation for reduced cognitive- and light-related modulation of pupil size.

Schizophrenia in Translation: Why the Eye?

Schizophrenia is increasingly recognized as a systemic disease, characterized by dysregulation in multiple physiological systems (eg, neural, cardiovascular, endocrine). Many of these changes are observed as early as the first psychotic episode, and in people at high risk for the disorder. Expanding the search for biomarkers of schizophrenia beyond genes, blood, and brain may allow for inexpensive, noninvasive, and objective markers of diagnosis, phenotype, treatment response, and prognosis. Several anatomic and physiologic aspects of the eye have shown promise as biomarkers of brain health in a range of neurological disorders, and of heart, kidney, endocrine, and other impairments in other medical conditions. In schizophrenia, thinning and volume loss in retinal neural layers have been observed, and are associated with illness progression, brain volume loss, and cognitive impairment. Retinal microvascular changes have also been observed. Abnormal pupil responses and corneal nerve disintegration are related to aspects of brain function and structure in schizophrenia. In addition, studying the eye can inform about emerging cardiovascular, neuroinflammatory, and metabolic diseases in people with early psychosis, and about the causes of several of the visual changes observed in the disorder. Application of the methods of oculomics, or eye-based biomarkers of non-ophthalmological pathology, to the treatment and study of schizophrenia has the potential to provide tools for patient monitoring and data-driven prediction, as well as for clarifying pathophysiology and course of illness. Given their demonstrated utility in neuropsychiatry, we recommend greater adoption of these tools for schizophrenia research and patient care.

Emotion schema effects on associative memory differ across emotion categories at the behavioural, physiological and neural level: Emotion schema effects on associative memory differs for disgust and fear

Previous behavioural and neuroimaging studies have consistently reported that memory is enhanced for associations congruent or incongruent with the structure of prior knowledge, termed as schemas. However, it remains unclear if similar effects arise with emotion-related associations, and whether they depend on the type of emotions. Here, we addressed this question using a novel face-word pair association paradigm combined with fMRI and eye-tracking techniques. In two independent studies, we demonstrated and replicated that both congruency with emotion schemas and emotion category interact to affect associative memory. Overall, memory retrieval was higher for faces from pairs congruent vs. incongruent with emotion schemas, paralleled by a greater recruitment of left inferior frontal gyrus (IFG) during successful encoding. However, emotion schema effects differed across two negative emotion categories. Disgust was remembered better than fear, and only disgust activated left IFG stronger during encoding of congruent vs. incongruent pairs, suggestive of deeper semantic processing for the associations. On the contrary, encoding of congruent fear vs. disgust-related pairs was accompanied with greater activity in right fusiform gyrus (FG), suggesting a stronger sensory processing of faces. In addition, successful memory formation for congruent disgust pairs was associated with a higher pupil dilation index related to sympathetic activation, longer gaze time on words compared to faces, and more gaze switches between paired words and faces. This was reversed for fear-related congruent pairs where the faces attracted longer gaze time (compared to words). Overall, our results provide converging evidence from behavioural, physiological, and neural measures to suggest that congruency with available emotion schemas influence memory associations in a similar manner to semantic schemas. However, these effects vary across distinct emotion categories, pointing to a differential role of semantic processing and visual attention processes in the modulation of memory by disgust and fear, respectively.

Publication guidelines and recommendations for pupillary measurement in psychophysiological studies

A variety of psychological and physical phenomena elicit variations in the diameter of pupil of the eye. Changes in pupil size are mediated by the relative activation of the sphincter pupillae muscle (decrease pupil diameter) and the dilator pupillae muscle (increase pupil diameter), innervated by the parasympathetic and sympathetic branches, respectively, of the autonomic nervous system. The current guidelines are intended to inform and guide psychophysiological research involving pupil measurement by (1) summarizing important aspects concerning the physiology of the pupil, (2) providing methodological and data-analytic guidelines and recommendations, and (3) briefly reviewing psychological phenomena that modulate pupillary reactivity. Because of the increased ease and tractability of pupil measurement, the goal of these guidelines is to promote accurate recording, analysis, and reporting of pupillary data in psychophysiological research.

The role of norepinephrine in the pathophysiology of schizophrenia

Several lines of evidence have suggested for decades a role for norepinephrine (NE) in the pathophysiology and treatment of schizophrenia. Recent experimental findings reveal anatomical and physiological properties of the locus coeruleus-norepinephrine (LC-NE) system and its involvement in brain function and cognition. Here, we integrate these two lines of evidence. First, we review the functional and structural properties of the LC-NE system and its impact on functional brain networks, cognition, and stress, with special emphasis on recent experimental and theoretical advances. Subsequently, we present an update about the role of LC-associated functions for the pathophysiology of schizophrenia, focusing on the cognitive and motivational deficits. We propose that schizophrenia phenomenology, in particular cognitive symptoms, may be explained by an abnormal interaction between genetic susceptibility and stress-initiated LC-NE dysfunction. This in turn, leads to imbalance between LC activity modes, dysfunctional regulation of brain network integration and neural gain, and deficits in cognitive functions. Finally, we suggest how recent development of experimental approaches can be used to characterize LC function in schizophrenia.

Schizophrenia and the retina: Towards a 2020 perspective

BACKGROUND

Differences between people with schizophrenia and psychiatrically healthy controls have been consistently demonstrated on measures of retinal function such as electroretinography (ERG), and measures of retinal structure such as optical coherence tomography (OCT). Since our 2015 review of this literature, multiple new studies have been published using these techniques. At the same time, the accumulation of data has highlighted the "fault lines" in these fields, suggesting methodological considerations that need greater attention in future studies.

METHODS

We reviewed studies of ERG and OCT in schizophrenia, as well as data from studies whose findings are relevant to interpreting these papers, such as those on effects of the following on ERG and OCT data: comorbid medical conditions that are over-represented in schizophrenia, smoking, antipsychotic medication, substance abuse, sex and gender, obesity, attention, motivation, and influences of brain activity on retinal function.

RESULTS

Recent ERG and OCT studies continue to support the hypothesis of retinal structural and functional abnormalities in schizophrenia, and suggest that these are relevant to understanding broader aspects of pathophysiology, neurodevelopment, and neurodegeneration in this disorder. However, there are differences in findings which suggest that the effects of multiple variables on ERG and OCT data need further clarification.

CONCLUSIONS

The retina, as the only component of the CNS that can be imaged directly in live humans, has potential to clarify important aspects of schizophrenia. With greater attention to specific methodological issues, the true potential of ERG and OCT as biomarkers for important clinical phenomena in schizophrenia should become apparent.

Using task effort and pupil size to track covert shifts of visual attention independently of a pupillary light reflex

We tested the link between pupil size and the task effort involved in covert shifts of visual attention. The goal of this study was to establish pupil size as a marker of attentional shifting in the absence of luminance manipulations. In three experiments, participants evaluated two stimuli that were presented peripherally, appearing equidistant from and on opposite sides of eye fixation. The angle between eye fixation and the peripherally presented target stimuli varied from 12.5° to 42.5°. The evaluation of more distant stimuli led to poorer performance than did the evaluation of more proximal stimuli throughout our study, confirming that the former required more effort than the latter. In addition, in Experiment 1 we found that pupil size increased with increasing angle and that this effect could not be reduced to the operation of low-level visual processes in the task. In Experiment 2 the pupil dilated more strongly overall when participants evaluated the target stimuli, which required shifts of attention, than when they merely reported on the target's presence versus absence. Both conditions yielded larger pupils for more distant than for more proximal stimuli, however. In Experiment 3, we manipulated task difficulty more directly, by changing the contrast at which the target stimuli were presented. We replicated the results from Experiment 1 only with the high-contrast stimuli. With stimuli of low contrast, ceiling effects in pupil size were observed. Our data show that the link between task effort and pupil size can be used to track the degree to which an observer covertly shifts attention to or detects stimuli in peripheral vision.

Standards in Pupillography

The number of research groups studying the pupil is increasing, as is the number of publications. Consequently, new standards in pupillography are needed to formalize the methodology including recording conditions, stimulus characteristics, as well as suitable parameters of evaluation. Since the description of intrinsically photosensitive retinal ganglion cells (ipRGCs) there has been an increased interest and broader application of pupillography in ophthalmology as well as other fields including psychology and chronobiology. Color pupillography plays an important role not only in research but also in clinical observational and therapy studies like gene therapy of hereditary retinal degenerations and psychopathology. Stimuli can vary in size, brightness, duration, and wavelength. Stimulus paradigms determine whether rhodopsin-driven rod responses, opsin-driven cone responses, or melanopsin-driven ipRGC responses are primarily elicited. Background illumination, adaptation state, and instruction for the participants will furthermore influence the results. This standard recommends a minimum set of variables to be used for pupillography and specified in the publication methodologies. Initiated at the 32nd International Pupil Colloquium 2017 in Morges, Switzerland, the aim of this manuscript is to outline standards in pupillography based on current knowledge and experience of pupil experts in order to achieve greater comparability of pupillographic studies. Such standards will particularly facilitate the proper application of pupillography by researchers new to the field. First we describe general standards, followed by specific suggestions concerning the demands of different targets of pupil research: the afferent and efferent reflex arc, pharmacology, psychology, sleepiness-related research and animal studies.

Reduced pupil dilation during action preparation in schizophrenia

Impairments in cognitive control-the ability to exert control over thoughts and actions and respond flexibly to the environment-are well-documented in schizophrenia. However, the degree to which experimental task performance reflects true cognitive control impairments or more general alterations in effort, arousal and/or task preparedness is unclear. Pupillary responses can provide insight into these latter factors, as the pupil dilates with degree of cognitive effort and response preparation. In the current study, 16 medicated outpatients with schizophrenia (SZP) and 18 healthy controls performed a task that measures the ability to reactively inhibit and modify a planned action-the double-step task. In this task, participants were required to make a saccade to a visual target. Infrequently, the target jumped to a new location and participants were instructed to rapidly inhibit and change their eye movement plan. Applying a race model of performance, we have previously shown that SZP require more time to inhibit a planned action. In the current analysis, we measured pupil dilation associated with task preparation and found that SZP had a shallower increase in pupil size prior to the onset of the trial. Additionally, reduced magnitude of the pupil response was associated with negative symptom severity in patients. Based on primate neurophysiology and cognitive neuroscience work, we suggest that this blunted pupillary response may reflect abnormalities in a general orienting response or reduced motivational significance of a cue signifying the onset of a preparatory period and that these abnormalities might share an autonomic basis with negative symptoms.

Neuromodulatory Systems and Their Interactions: A Review of Models, Theories, and Experiments

Neuromodulatory systems, including the noradrenergic, serotonergic, dopaminergic, and cholinergic systems, track environmental signals, such as risks, rewards, novelty, effort, and social cooperation. These systems provide a foundation for cognitive function in higher organisms; attention, emotion, goal-directed behavior, and decision-making derive from the interaction between the neuromodulatory systems and brain areas, such as the amygdala, frontal cortex, hippocampus, and sensory cortices. Given their strong influence on behavior and cognition, these systems also play a key role in disease states and are the primary target of many current treatment strategies. The fact that these systems interact with each other either directly or indirectly, however, makes it difficult to understand how a failure in one or more systems can lead to a particular symptom or pathology. In this review, we explore experimental evidence, as well as focus on computational and theoretical models of neuromodulation. Better understanding of neuromodulatory systems may lead to the development of novel treatment strategies for a number of brain disorders.

Visual masking & schizophrenia

Visual masking is a frequently used tool in schizophrenia research. Visual masking has a very high sensitivity and specificity and masking paradigms have been proven to be endophenotypes. Whereas masking is a powerful technique to study schizophrenia, the underlying mechanisms are discussed controversially. For example, for more than 25 years, masking deficits of schizophrenia patients were mainly attributed to a deficient magno-cellular system (M-system). Here, we show that there is very little evidence that masking deficits are magno-cellular deficits. We will discuss the magno-cellular and other approaches in detail and highlight their pros and cons.

The pupil response reveals increased listening effort when it is difficult to focus attention

Recent studies have shown that prior knowledge about where, when, and who is going to talk improves speech intelligibility. How related attentional processes affect cognitive processing load has not been investigated yet. In the current study, three experiments investigated how the pupil dilation response is affected by prior knowledge of target speech location, target speech onset, and who is going to talk. A total of 56 young adults with normal hearing participated. They had to reproduce a target sentence presented to one ear while ignoring a distracting sentence simultaneously presented to the other ear. The two sentences were independently masked by fluctuating noise. Target location (left or right ear), speech onset, and talker variability were manipulated in separate experiments by keeping these features either fixed during an entire block or randomized over trials. Pupil responses were recorded during listening and performance was scored after recall. The results showed an improvement in performance when the location of the target speech was fixed instead of randomized. Additionally, location uncertainty increased the pupil dilation response, which suggests that prior knowledge of location reduces cognitive load. Interestingly, the observed pupil responses for each condition were consistent with subjective reports of listening effort. We conclude that communicating in a dynamic environment like a cocktail party (where participants in competing conversations move unpredictably) requires substantial listening effort because of the demands placed on attentional processes.

Pupillary motility: bringing neuroscience to the psychiatry clinic of the future

Modern pupillometry has expanded the study and utility of pupil responses in many new domains, including psychiatry, particularly for understanding aspects of cognitive and emotional information processing. Here, we review the applications of pupillometry in psychiatry for understanding patients' information processing styles, predicting treatment, and augmenting function. In the past year pupillometry has been shown to be useful in specifying cognitive/affective occurrences during experimental tasks and informing clinical diagnoses. Such studies demonstrate the potential of pupillary motility to be used in clinical psychiatry much as it has been in neurology for the past century.

Pupillometry in Chinese female patients with depression: a pilot study

The pupillary responses to light in patients with depression and normal controls were evaluated among Chinese females. Four parameters related to the pupil were assessed using a video-based pupillometer. The results showed that there were significant differences in the pupil area in the darkness and the pupil area at the peak of constriction between depressed patients and normal controls.

Impact of chronotype and time perspective on the processing of scripts

Little is known about the impact of temporal orientation (chronotype; time perspective) on cognitive performance. This study adopted a psychophysiological approach to explore how chronotype (morningness-eveningness) and time perspective (present; future) influence time succession as another aspect of psychological time that is entailed within script knowledge. In a temporal judgment task, participants decided which of the two presented sub-events (e.g., get new batteries-set right time on alarm clock) comes earlier (or later) within a given script (e.g., changing batteries in an alarm clock). Behavioral and pupillary data suggest a differential impact of chronotype and time perspective on script knowledge and cognitive performance. The impact of time perspective on the processing of temporal information entailed in script knowledge appears linked to match or mismatch conditions between a strong focus on future outcomes associated with future time perspective and the task of identifying either the later (future-oriented) or the earlier (past-oriented) sub-event. Concerning the chronotype, evening types process items in which chronological time succession is violated (i.e., reversely presented items) more accurately than morning types. Indexed by pupillary data, the impact of chronotype may relate to more general cognitive abilities. The psychophysiological data derived in this study suggests that evening types typically outperform morning types in various measures such working memory capacity and verbal intelligence simply because they invest more cognitive resources than morning types.

An open-source, FireWire camera-based, Labview-controlled image acquisition system for automated, dynamic pupillometry and blink detection

The dynamic, accurate measurement of pupil size is extremely valuable for studying a large number of neuronal functions and dysfunctions. Despite tremendous and well-documented progress in image processing techniques for estimating pupil parameters, comparatively little work has been reported on practical hardware issues involved in designing image acquisition systems for pupil analysis. Here, we describe and validate the basic features of such a system which is based on a relatively compact, off-the-shelf, low-cost FireWire digital camera. We successfully implemented two configurable modes of video record: a continuous mode and an event-triggered mode. The interoperability of the whole system is guaranteed by a set of modular software components hosted on a personal computer and written in Labview. An offline analysis suite of image processing algorithms for automatically estimating pupillary and eyelid parameters were assessed using data obtained in human subjects. Our benchmark results show that such measurements can be done in a temporally precise way at a sampling frequency of up to 120 Hz and with an estimated maximum spatial resolution of 0.03 mm. Our software is made available free of charge to the scientific community, allowing end users to either use the software as is or modify it to suit their own needs.

"To see or not to see: that is the question." The "Protection-Against-Schizophrenia" (PaSZ) model: evidence from congenital blindness and visuo-cognitive aberrations

The causes of schizophrenia are still unknown. For the last 100 years, though, both “absent” and “perfect” vision have been associated with a lower risk for schizophrenia. Hence, vision itself and aberrations in visual functioning may be fundamental to the development and etiological explanations of the disorder. In this paper, we present the “Protection-Against-Schizophrenia” (PaSZ) model, which grades the risk for developing schizophrenia as a function of an individual's visual capacity. We review two vision perspectives: (1) “Absent” vision or how congenital blindness contributes to PaSZ and (2) “perfect” vision or how aberrations in visual functioning are associated with psychosis. First, we illustrate that, although congenitally blind and sighted individuals acquire similar world representations, blind individuals compensate for behavioral shortcomings through neurofunctional and multisensory reorganization. These reorganizations may indicate etiological explanations for their PaSZ. Second, we demonstrate that visuo-cognitive impairments are fundamental for the development of schizophrenia. Deteriorated visual information acquisition and processing contribute to higher-order cognitive dysfunctions and subsequently to schizophrenic symptoms. Finally, we provide different specific therapeutic recommendations for individuals who suffer from visual impairments (who never developed “normal” vision) and individuals who suffer from visual deterioration (who previously had “normal” visual skills). Rather than categorizing individuals as “normal” and “mentally disordered,” the PaSZ model uses a continuous scale to represent psychiatrically relevant human behavior. This not only provides a scientific basis for more fine-grained diagnostic assessments, earlier detection, and more appropriate therapeutic assignments, but it also outlines a trajectory for unraveling the causes of abnormal psychotic human self- and world-perception.

Fragile early visual percepts mark genetic liability specific to schizophrenia

Disruption of visual percepts by a subsequent stimulus (ie, backward masking) has been consistently noted in schizophrenia, with some evidence that this fragility in early perception is present in people with genetic liability for the disorder. Given the potential of backward masking paradigms to mark neural processes that confer risk for schizophrenia, it is important to test the diagnostic specificity of abnormalities in visual perception. To more fully assess whether masking visual stimuli reveals a marker of genetic liability (ie, endophenotype) specific to schizophrenia, we tested 44 people with the disorder, 29 people with bipolar disorder, 56 first-degree biological relatives of people with schizophrenia, 26 first-degree biological relatives of people with bipolar disorder, and 43 nonpsychiatric control participants using a magnocellular-biased visual backward masking procedure that included target-to-mask onset asynchronies ranging from 0 to 80 ms. Relatives of people with schizophrenia who were without schizophrenia spectrum disorders exhibited impaired performance compared with nonpsychiatric control participants and relatives of people with bipolar disorder when a visual mask interrupted early perception (eg, 27 ms). A similar vulnerability of early processes was noted in people with schizophrenia, yet they also had impaired performance when masks occurred at later time points (ie, 80 ms). Performance deficits were not attributable to intellectual function, measures of attention and memory, symptomatology, or medication dosage. Bipolar patients and their relatives failed to exhibit deficits on the backward masking task. Fragility of early visual percepts appears to mark genetic liability specific to schizophrenia and may serve as an endophenotype for the disorder.

Emotional context processing in severe mental illness: scale development and preliminary construct validity

There is growing recognition that emotional context may play an important role in emotion perception and severe mental illness (SMI). Limited instruments directly assess and adequately account for emotional context processing. To measure this construct in schizophrenia research, this study aimed to develop and validate the Emotional Context Processing Scale (ECOS) using cartoon portrayals originally developed by Masuda et al. (2008). In Study 1, we piloted the measure with 99 college students and selected 20 cartoon portrayals (4 simple emotions only+16 simple emotions with contextual emotions). In Study 2, we confirmed the emotion-specificity and factor structure of the measure by administering it to 73 individuals with SMI. Item response theory (IRT) modeling confirmed a 4-factor structure of the ECOS, providing evidence that emotional context processing is specific to particular emotions. Internal consistency of the ECOS subscales ranged from 0.61 to 0.83. In Study 3, we examined the convergent and divergent validity of the ECOS in a separate sample of 36 individuals with SMI. Even after controlling for facial affect perception, the ECOS is uniquely related to multi-modal emotion perception and executive functioning measures.

Pupil-BLAH-metry: cognitive effort in speech planning reflected by pupil dilation

In reading research, a longstanding question is whether any stages of lexical processing require central attention, and whether such potential demands are frequency-sensitive. In the present study, we examined the allocation of cognitive effort in lexical processing by examining pupil dilations and naming latencies in a modified delayed naming procedure. In this dual-task/change procedure, participants read words and waited for various delays before being signaled to issue a response. On most trials (80%), participants issued a standard naming response. On the remaining trials, they were cued to abandon the original speech plan, saying "blah" instead, thereby equating production across different words. Using feature-matched low- and high-frequency words, we observed the differences in pupil dilations as a function of word frequency. Indeed, frequency-sensitive cognitive demands were seen in word processing, even after naming responses were issued. The results suggest that word perception and/or speech planning requires the frequency-sensitive allocation of cognitive resources.

Temporal information processing in short- and long-term memory of patients with schizophrenia

Cognitive deficits of patients with schizophrenia have been largely recognized as core symptoms of the disorder. One neglected factor that contributes to these deficits is the comprehension of time. In the present study, we assessed temporal information processing and manipulation from short- and long-term memory in 34 patients with chronic schizophrenia and 34 matched healthy controls. On the short-term memory temporal-order reconstruction task, an incidental or intentional learning strategy was deployed. Patients showed worse overall performance than healthy controls. The intentional learning strategy led to dissociable performance improvement in both groups. Whereas healthy controls improved on a performance measure (serial organization), patients improved on an error measure (inappropriate semantic clustering) when using the intentional instead of the incidental learning strategy. On the long-term memory script-generation task, routine and non-routine events of everyday activities (e.g., buying groceries) had to be generated in either chronological or inverted temporal order. Patients were slower than controls at generating events in the chronological routine condition only. They also committed more sequencing and boundary errors in the inverted conditions. The number of irrelevant events was higher in patients in the chronological, non-routine condition. These results suggest that patients with schizophrenia imprecisely access temporal information from short- and long-term memory. In short-term memory, processing of temporal information led to a reduction in errors rather than, as was the case in healthy controls, to an improvement in temporal-order recall. When accessing temporal information from long-term memory, patients were slower and committed more sequencing, boundary, and intrusion errors. Together, these results suggest that time information can be accessed and processed only imprecisely by patients who provide evidence for impaired time comprehension. This could contribute to symptomatic cognitive deficits and strategic inefficiency in schizophrenia.

Memory strength and specificity revealed by pupillometry

Voice-specificity effects in recognition memory were investigated using both behavioral data and pupillometry. Volunteers initially heard spoken words and nonwords in two voices; they later provided confidence-based old/new classifications to items presented in their original voices, changed (but familiar) voices, or entirely new voices. Recognition was more accurate for old-voice items, replicating prior research. Pupillometry was used to gauge cognitive demand during both encoding and testing: enlarged pupils revealed that participants devoted greater effort to encoding items that were subsequently recognized. Further, pupil responses were sensitive to the cue match between encoding and retrieval voices, as well as memory strength. Strong memories, and those with the closest encoding-retrieval voice matches, resulted in the highest peak pupil diameters. The results are discussed with respect to episodic memory models and Whittlesea's (1997) SCAPE framework for recognition memory.

Recognition Memory Strength is Predicted by Pupillary Responses at Encoding While Fixation Patterns Distinguish Recollection from Familiarity

Thirty-five healthy participants incidentally encoded a set of man-made and natural object pictures, while their pupil response and eye movements were recorded. At retrieval, studied and new stimuli were rated as novel, familiar (strong, moderate, or weak), or recollected. We found that both pupil response and fixation patterns at encoding predict later recognition memory strength. The extent of pupillary response accompanying incidental encoding was found to be predictive of subsequent memory. In addition, the number of fixations was also predictive of later recognition memory strength, suggesting that the accumulation of greater visual detail, even for single objects, is critical for the creation of a strong memory. Moreover, fixation patterns at encoding distinguished between recollection and familiarity at retrieval, with more dispersed fixations predicting familiarity and more clustered fixations predicting recollection. These data reveal close links between the autonomic control of pupil responses and eye movement patterns on the one hand and memory encoding on the other. Moreover, the data illustrate quantitative as well as qualitative differences in the incidental visual processing of stimuli, which are differentially predictive of the strength and the kind of memory experienced at recognition.

In the eye of the listener: pupil dilation elucidates discourse processing

The current study investigated cognitive resource allocation in discourse processing by means of pupil dilation and behavioral measures. Short question-answer dialogs were presented to listeners. Either the context question queried a new information focus in the successive answer, or else the context query was corrected in the answer sentence (correction information). The information foci contained in the answer sentences were either adequately highlighted by prosodic means or not. Participants had to judge the adequacy of the focus prosody with respect to the preceding context question. Prosodic judgment accuracy was higher in the conditions bearing adequate focus prosody than in the conditions with inadequate focus prosody. Latency to peak pupil dilation was longer when new information foci were perceived compared to correction foci. Moreover, for the peak dilation, an interaction of focus type and prosody was found. Post hoc statistical tests revealed that prosodically adequate correction focus positions were processed with smaller peak dilation in comparison to all other dialog conditions. Thus, pupil dilation and results of a principal component analysis suggest an interaction of focus type and focus prosody in discourse processing.

Oculomotor and pupillometric indices of pro- and antisaccade performance in youth-onset psychosis and attention deficit/hyperactivity disorder

The goals of the study were to examine inhibitory deficits on the antisaccade task in 8- to 20-year olds with youth-onset psychosis or attention deficit/hyperactivity disorder (ADHD) and healthy controls and to examine if age-related changes in performance differed across groups. In addition to the conventional measures of performance, pupillary dilations were used to obtain estimates of phasic and tonic level of arousal. Results showed that the psychosis, but not the ADHD, group had elevated antisaccade error rates; however, variability of error rates was high in all groups. These inhibitory failures were accompanied by a lower level of momentary cognitive effort (as indexed by pupillary dilations). The largest differences between the control and clinical groups were found not in the expected indices of inhibition but in the probability of correcting inhibitory errors and in variability of antisaccade response times, which were correlated with each other. These findings did not appear to be attributable to a deficit in maintaining task instructions in mind in either disorder or lack of motivation in ADHD. Instead, results point to impairments in both clinical groups in sustaining attention on a trial-by-trial basis, resulting in deficits in self-monitoring. Thus, results show inhibitory deficits in the context of more general attentional impairments in both disorders.

Are masking abnormalities in schizophrenia specific to type-B masking?

The abnormal visual masking in those with schizophrenia, it has been proposed, arises from a deficiency in their magnocellular system. Two kinds of masking exist: Type-A and Type-B. Type-A masking is characterized by the masking being strongest when target and mask are presented simultaneously. Type-B masking is characterized by a non-monotonic masking curve, i.e. the masking is largest when the mask is presented at some time after the target. The proposed link between masking and magnocellular activity applies mainly to Type-B masking. Thus, a magnocellular deficiency, if it exists, should effect Type-B masking more prominently than Type-A masking. Here we review the relevant literature. The majority of studies of masking in those with schizophrenia, it is found, have examined only Type-A masking. These find substantial evidence for abnormal masking. Where Type-B masking has been obtained, evidence also exists for abnormalities. However, the abnormal masking in these cases is largely unrelated to the defining characteristic of Type-B masking (i.e. to the non-monotonic masking function). It is concluded that the evidence for linking masking abnormalities in schizophrenia specifically to Type-B masking is weak. This undermines the proposal that masking abnormalities in schizophrenia have a magnocellular origin.

The head-centered meridian effect: Auditory attention orienting in conditions of impaired visuo-spatial information

This paper examines the characteristics of spatial attention orienting in situations of visual impairment. Two groups of subjects, respectively schizophrenic and blind, with different degrees of visual spatial information impairment, were tested. In Experiment 1, the schizophrenic subjects were instructed to detect an auditory target, which was preceded by a visual cue. The cue could appear in the same location as the target, separated from it respectively by the vertical visual meridian (VM), the vertical head-centered meridian (HCM) or another meridian. Similarly to normal subjects tested with the same paradigm (Ferlazzo, Couyoumdjian, Padovani, and Olivetti Belardinelli, 2002), schizophrenic subjects showed slower reactions times (RTs) when cued, and when the target locations were on the opposite sides of the HCM. This HCM effect strengthens the assumption that different auditory and visual spatial maps underlie the representation of attention orienting mechanisms. In Experiment 2, blind subjects were asked to detect an auditory target, which had been preceded by an auditory cue, while staring at an imaginary point. The point was located either to the left or to the right, in order to control for ocular movements and maintain the dissociation between the HCM and the VM. Differences between crossing and no-crossing conditions of HCM were not found. Therefore it is possible to consider the HCM effect as a consequence of the interaction between visual and auditory modalities. Related theoretical issues are also discussed.

Pupillometric measures of attentional allocation to target and mask processing on the backward masking task in schizophrenia

Allocation of attentional resources during early visual processing was investigated in schizophrenia. Pupillary responses were recorded during a backward masking task as an index of resource allocation in schizophrenia patients (n=51) and nonpsychiatric controls (n=51). Two time-linked components of pupillary response waveforms appeared to differentially index resource allocation to targets versus masks. Two patient subgroups were identified: One with normal overall pupillary responses (resource allocation), but greater allocation on mask relative to target components, and another with abnormally small overall pupillary responses and similar allocation between target and mask components. Thus, misallocation of resources to masks contributed to masking deficits in one subgroup, whereas reduced resource allocation contributed to deficits in the other. The nature of resource-related deficits can vary across schizophrenia subgroups.

Are masking abnormalities in schizophrenia limited to backward masking?

Schizophrenia, it has been proposed, is associated with deficits in the magnocellular part of the visual system. In support of this suggestion, it has been claimed that schizophrenic subjects have abnormal backward masking. However, if this abnormality is to be linked specifically to magnocellular defects, then it must be specific to backward masking, and not, also effect, for example, forward masking. We examined this issue by reviewing the studies of masking in schizophrenic subjects. We find: (i) Most studies (56 out of 67) of backward masking have researched only backward masking. This makes it impossible to determine if the abnormalities found in these studies are exclusively confined to backward masking. (ii) Of those studies (11) that have included both forward and backward masking conditions, the majority found some degree of abnormality under both forward and backward masking conditions. It is concluded that the evidence for linking the abnormalities found in those with schizophrenia specifically to backward masking, rather than masking in general, or more general visual impairments, is at present relatively weak. Given the rationale for using backward masking as a test of magnocellular sensitivity, research in this area does not point to a deficit specific to the magnocellular system.

Investigating dimensional organization in scripts using the pupillary response

Scripts are mental representations of activities in memory and are thought to be organized dimensionally in a temporal dimension. We investigated the cognitive strategies during the processing of temporal order of an event sequence to gain insight into the organization of scripts. Subjects were presented with triplets of script events (A - B - C). Fifty percent of the items included sequence violations at different positions within the triplet (late: A - C - B, or early: C - A - B). Reaction times indicate that subjects use an economical strategy by comparing the relative temporal positions of event pairs (e.g., A vs. B and if necessary B vs. C) and only attend to information that is necessary. Pupil data and error rates indicate that the temporal information of the complete sequence affects the decision process even if the first event pair indicates that temporal order has been violated. Results are seen as evidence of a dimensional structure of scripts.

Effortful cognitive resource allocation and negative symptom severity in chronic schizophrenia

BACKGROUND

The relationship between negative symptoms, early visual information-processing deficits, and effortful processing resource allocation was investigated.

METHODS

Older patients with chronic schizophrenia (n = 58) and healthy controls (n = 71) participated. Pupillary responses were recorded during performance of the span of apprehension task (blocks of 3- and 10-letter arrays) as an index of resource allocation or mental effort during the task.

RESULTS

Patients and controls showed larger pupillary responses in higher relative to lower processing loads both during array processing and just prior to array onset (preparation). Both groups, therefore, invested more cognitive effort preparing for and then processing larger arrays. A subgroup of patients with abnormally small pupillary responses and impaired performance showed greater negative symptom severity relative to a subgroup of patients with normal pupillary responses. Smaller pupillary responses in the patients were also significantly correlated with greater negative symptom severity, independent of positive symptom severity. Patients with reduced effortful resource allocation, therefore, exhibited greater negative symptomatology. A subgroup of patients with normal pupillary responses still showed impaired detection accuracy relative to controls, suggesting that reduced cognitive effort or resource allocation problems cannot account for impairments in early visual information processing in this subgroup.

CONCLUSIONS

The study illustrates important relationships between cognitive effort and performance that can impact conclusions about the nature of cognitive impairments and associations between negative symptoms and neurocognition in schizophrenia.

Optimal segmentation of pupillometric images for estimating pupil shape parameters

The problem of determining the pupil morphological parameters from pupillometric data is considered. These characteristics are of great interest for non-invasive early diagnosis of the central nervous system response to environmental stimuli of different nature, in subjects suffering some typical diseases such as diabetes, Alzheimer disease, schizophrenia, drug and alcohol addiction. Pupil geometrical features such as diameter, area, centroid coordinates, are estimated by a procedure based on an image segmentation algorithm. It exploits the level set formulation of the variational problem related to the segmentation. A discrete set up of this problem that admits a unique optimal solution is proposed: an arbitrary initial curve is evolved towards the optimal segmentation boundary by a difference equation; therefore no numerical approximation schemes are needed, as required in the equivalent continuum formulation usually adopted in the relevant literature.

Tracking stimulus processing in Pavlovian pupillary conditioning

The aim of the present study was to evaluate whether the anticipatory pupillary dilation response is a useful indicator for the examination of complex differential conditioning problems like patterning. A human fear conditioning procedure with six groups (n=20 each) was used to examine conditioned stimulus (CS) processing when a compound stimulus was reinforced, but not its elements (positive patterning) or when the elements were reinforced, but not the compound (negative patterning), as well as modifications in which the compound was replaced by either a new compound or by a new element. We found evidence for conditioning within 2 s after CS onset. Group differences in differential conditioning indicated systematic differences in CS processing due to different discrimination task difficulties. This study showed that the pupil response is a suitable indicator for human Pavlovian conditioning with high time resolution within and between trials.

Psychophysical assessment of magno- and parvocellular function in schizophrenia

Recently developed psychophysical techniques permit the biasing of the processing of the stimulus by early visual channels so that responses reflect characteristics of either magno- or parvocellular pathways (Pokorny & Smith, 1997). We used such techniques to test psychophysically whether the global magnocellular dysfunction reported in schizophrenia also affects early processes. Seven schizophrenic patients and 19 normal controls participated. The task was a four-alternative forced-choice luminance discrimination, using a 2 × 2 configuration of four 1-deg squares. Target luminance threshold was determined in three conditions: the stimulus, including the target, was pulsed for 17 ms (pulse paradigm); the target was presented on a steady background of four squares (steady paradigm), or the target was presented alone (no background paradigm). We replicated previous results demonstrating magnocellular and parvocellular signatures in control participants. No evidence for an early magnocellular deficit could be detected as the thresholds of all schizophrenic observers were higher both in the steady paradigm (presumed magnocellular mediation) and in the pulse paradigm (presumed parvocellular mediation). Magnocellular dysfunction, if present in schizophrenia, must concern more integrated processes, possibly at levels at which parvocellular and magnocellular paths interact.

Executive “Brake Failure” following Deactivation of Human Frontal Lobe

In the course of daily living, humans frequently encounter situations in which a motor activity, once initiated, becomes unnecessary or inappropriate. Under such circumstances, the ability to inhibit motor responses can be of vital importance. Although the nature of response inhibition has been studied in psychology for several decades, its neural basis remains unclear. Using transcranial magnetic stimulation, we found that temporary deactivation of the pars opercularis in the right inferior frontal gyrus selectively impairs the ability to stop an initiated action. Critically, deactivation of the same region did not affect the ability to execute responses, nor did it influence physiological arousal. These findings confirm and extend recent reports that the inferior frontal gyrus is vital for mediating response inhibition.

Time's arrow and pupillary response

The psychological arrow of time refers to our experience of the forward temporal progression of all natural processes. To investigate whether and how time's arrow is mentally coded in individual everyday events, a relatedness judgment task was used. The items each consisted of a verb (probe) and an adjective or participle (target). The temporal orientation between probe and target was varied either corresponding to the chronological orientation (e.g., shrinking-small) or corresponding to the reverse orientation (e.g., shrinking-large). Reaction times, error rates, and pupillary responses were recorded. Chronological items were processed faster than reverse items. These findings suggest that time's arrow is mentally coded in single everyday events. Pupil dilation and results of principal component analyses suggest top-down influences in the processing of temporally related items.

Pupillary responses on the visual backward masking task reflect general cognitive ability

Cognitive processing efficiency requires both an ability to attend to task-relevant stimuli with quickness and accuracy, also while filtering distracting or task-irrelevant stimuli. This study investigated cognitive processing efficiency by using pupillary responses as an index of attentional allocation to relevant target and irrelevant masks on a visual backward masking task. The relationship between attentional allocation on this task and general cognitive ability on the scholastic aptitude test (SAT) was examined in college students (n=67). A principle components analysis of the pupillary response waveform isolated a late component that appeared to index the attentional demands associated with processing masks on the backward masking task. This pupillary response index of wasteful resource allocation to the mask accounted for significant variance in SAT scores over and above that accounted for by socio-economic status and target detection accuracy scores. Consistent with the neural efficiency hypothesis, individuals who allocated more resources to processing irrelevant information performed more poorly on cognitive ability tests.