The role of meaning in contextual cueing: evidence from chess expertise

Contextual cueing during lethal force training: How target design and repetition can alter threat assessments

Lethal force training requires individuals to make threat assessments, which involves holistic scenario processing to identify potential threats. Photorealistic targets can make threat/non-threat judgments substantially more genuine and challenging compared to simple cardboard or silhouette targets. Unfortunately, repeated target use also brings unintended consequences that could invalidate threat assessment processes conducted during training. Contextually rich or unique targets could be implicitly memorable in a way that allows observers to recall weapon locations rather than forcing observers to conduct a naturalistic assessment. Experiment 1 demonstrated robust contextual cueing effects in a well-established shoot/don't-shoot stimulus set, and Experiment 2 extended this finding from complex scene stimuli to simple actor-only stimuli. Experiment 3 demonstrated that these effects also occurred among trained professionals using rifles rather than computer-based tasks. Taken together, these findings demonstrate the potential for uncontrolled target repetition to alter the fundamental processes of threat assessment during lethal force training.

Evaluating Operator Training Performance Using Recurrence Quantification Analysis of Autocorrelation Transformed Eye Gaze Data

OBJECTIVE

This research aimed to investigate the relationship between gaze behaviour dynamics and operator performance.

BACKGROUND

Individuals differ in their approach when learning a new task often resulting in performance disparity. During training some individuals learn the structure and dynamics of the task and develop a systematic approach, whereas others may achieve the same result albeit with increased perceived workload, or indeed some may fail to achieve superior performance levels. Previous research has shown that comparing gaze of experts with novices can provide unique insights into cognitive functioning of superior performers.

METHODS

Twenty-five individuals participated in a computer-based simulation task. The concept of coefficient of variation (CoV) of task scores was used to compute the participants' consistency of performance. Based on CoV, the cohort was split into two performance categories. The temporal patterns in participants gaze data were transformed using autocorrelation, and recurrence quantification analysis (RQA) was employed to analyse and quantify the patterns.

RESULTS

A Mann-Whitney U analysis demonstrated significantly (p < .01) higher determinism, entropy and laminarity in the superior group compared to the moderate group. Pearson's correlation revealed a significant (p < .01) negative correlation between the consistency of task performance (CoV) and the RQA measures.

CONCLUSION

The results demonstrated that eye gaze dynamics can be used as an objective measure of performance. Participants classified as superior performers consistently demonstrated a systematic gaze activity which were in line with the task structure.

APPLICATION

The methods presented here are applicable to observe and evaluate operators' strategic distribution of gaze. Specifically, for tactical monitoring and decision making in task environments where spatial locations of elements-of-interest vary continuously.

Eye movements reflect expertise development in hybrid search

Domain-specific expertise changes the way people perceive, process, and remember information from that domain. This is often observed in visual domains involving skilled searches, such as athletics referees, or professional visual searchers (e.g., security and medical screeners). Although existing research has compared expert to novice performance in visual search, little work has directly documented how accumulating experiences change behavior. A longitudinal approach to studying visual search performance may permit a finer-grained understanding of experience-dependent changes in visual scanning, and the extent to which various cognitive processes are affected by experience. In this study, participants acquired experience by taking part in many experimental sessions over the course of an academic semester. Searchers looked for 20 categories of targets simultaneously (which appeared with unequal frequency), in displays with 0-3 targets present, while having their eye movements recorded. With experience, accuracy increased and response times decreased. Fixation probabilities and durations decreased with increasing experience, but saccade amplitudes and visual span increased. These findings suggest that the behavioral benefits endowed by expertise emerge from oculomotor behaviors that reflect enhanced reliance on memory to guide attention and the ability to process more of the visual field within individual fixations.

Bayesian priors in estimates of object location in virtual reality

We investigated the category bias in spatial memory, which reveals the influence of a region (i.e., a spatial category) on memory for specific locations within the region's bounds. The standard approach to investigating the category bias employs a static dot-in-circle task, in which observers indicate the location of a single dot from memory after a brief interval. The agreement in the literature is that these location estimates result from Bayesian principles; however, the priors in the dot-in-circle task are geometric prototypes (the central angular value of each quadrant and two-thirds of the radius from the center of the circle to its circumference). These geometric prototypes are not "true" priors in that they are not pre-existing statistical likelihoods of a target's location before other evidence is considered. In this paper, we tested the category bias with items for which informative priors exist (e.g., a vase, which is expected to be in the center of a table) and found that people favor them over geometric prototypes for estimating angular but not radial target positions. Our work contributes to the literature by showing that localizing common everyday objects in a circular space is not restricted to the use of cues intrinsic to the space. This is important because the majority of the empirical data on the category bias derives from locating targets that have little to no semantic information.

Dual-target hazard perception: Could identifying one hazard hinder a driver's capacity to find a second?

Low-level cognitive processes like visual search are crucial for hazard detection. In dual-target searches, subsequent search misses (SSMs) are known to occur when the identification of one target impedes detection of another that is concurrently presented. Despite the high likelihood of concurrent hazards in busy driving environments, SSMs have not been empirically investigated in driving. In three studies, participants were asked to identify safety-related target(s) in simulated traffic scenes that contained zero, one, or two target(s) of low or high perceptual saliency. These targets were defined as objects or events that would have prevented safe travel in the direction indicated by an arrow preceding the traffic scene. Findings from the pilot study (n = 20) and Experiment 1 (n = 29) demonstrated that detecting one target hindered drivers' abilities to find a second from the same scene. In Experiment 2 (n = 30), explicit instructions regarding the level of risk were manipulated. It was found that search times were affected by the instructions, though SSMs persisted. Implications of SSMs in understanding the causes of some crashes are discussed, as well as future directions to improve ecological and criterion validity and to explore the roles of expertise and cognitive capabilities in multi-hazard detection.

How the Brain's Navigation System Shapes Our Visual Experience

We explore the environment not only by navigating, but also by viewing our surroundings with our eyes. Here we review growing evidence that the mammalian hippocampal formation, extensively studied in the context of navigation and memory, mediates a representation of visual space that is stably anchored to the external world. This visual representation puts the hippocampal formation in a central position to guide viewing behavior and to modulate visual processing beyond the medial temporal lobe (MTL). We suggest that vision and navigation share several key computational challenges that are solved by overlapping and potentially common neural systems, making vision an optimal domain to explore whether and how the MTL supports cognitive operations beyond navigation.

Bridging views in cinema: a review of the art and science of view integration

Recently, there has been a surge of interest in the relationship between film and cognitive science. This is reflected in a new science of cinema that can help us both to understand this art form, and to produce new insights about cognition and perception. In this review, we begin by describing how the initial development of cinema involved close observation of audience response. This allowed filmmakers to develop an informal theory of visual cognition that helped them to isolate and creatively recombine fundamental elements of visual experience. We review research exploring naturalistic forms of visual perception and cognition that have opened the door to a productive convergence between the dynamic visual art of cinema and science of visual cognition that can enrich both. In particular, we discuss how parallel understandings of view integration in cinema and in cognitive science have been converging to support a new understanding of meaningful visual experience. WIREs Cogn Sci 2017, 8:e1436. doi: 10.1002/wcs.1436 For further resources related to this article, please visit the WIREs website.

The role of memory for visual search in scenes

Many daily activities involve looking for something. The ease with which these searches are performed often allows one to forget that searching represents complex interactions between visual attention and memory. Although a clear understanding exists of how search efficiency will be influenced by visual features of targets and their surrounding distractors or by the number of items in the display, the role of memory in search is less well understood. Contextual cueing studies have shown that implicit memory for repeated item configurations can facilitate search in artificial displays. When searching more naturalistic environments, other forms of memory come into play. For instance, semantic memory provides useful information about which objects are typically found where within a scene, and episodic scene memory provides information about where a particular object was seen the last time a particular scene was viewed. In this paper, we will review work on these topics, with special emphasis on the role of memory in guiding search in organized, real-world scenes.

Perceptual load corresponds with factors known to influence visual search

One account of the early versus late selection debate in attention proposes that perceptual load determines the locus of selection. Attention selects stimuli at a late processing level under low-load conditions but selects stimuli at an early level under high-load conditions. Despite the successes of perceptual load theory, a noncircular definition of perceptual load remains elusive. We investigated the factors that influence perceptual load by using manipulations that have been studied extensively in visual search, namely target-distractor similarity and distractor-distractor similarity. Consistent with previous work, search was most efficient when targets and distractors were dissimilar and the displays contained homogeneous distractors; search became less efficient when target-distractor similarity increased irrespective of display heterogeneity. Importantly, we used these same stimuli in a typical perceptual load task that measured attentional spillover to a task-irrelevant flanker. We found a strong correspondence between search efficiency and perceptual load; stimuli that generated efficient searches produced flanker interference effects, suggesting that such displays involved low perceptual load. Flanker interference effects were reduced in displays that produced less efficient searches. Furthermore, our results demonstrate that search difficulty, as measured by search intercept, has little bearing on perceptual load. We conclude that rather than be arbitrarily defined, perceptual load might be defined by well-characterized, continuous factors that influence visual search.

Large-scale brain networks in board game experts: insights from a domain-related task and task-free resting state

Cognitive performance relies on the coordination of large-scale networks of brain regions that are not only temporally correlated during different tasks, but also networks that show highly correlated spontaneous activity during a task-free state. Both task-related and task-free network activity has been associated with individual differences in cognitive performance. Therefore, we aimed to examine the influence of cognitive expertise on four networks associated with cognitive task performance: the default mode network (DMN) and three other cognitive networks (central-executive network, dorsal attention network, and salience network). During fMRI scanning, fifteen grandmaster and master level Chinese chess players (GM/M) and fifteen novice players carried out a Chinese chess task and a task-free resting state. Modulations of network activity during task were assessed, as well as resting-state functional connectivity of those networks. Relative to novices, GM/Ms showed a broader task-induced deactivation of DMN in the chess problem-solving task, and intrinsic functional connectivity of DMN was increased with a connectivity pattern associated with the caudate nucleus in GM/Ms. The three other cognitive networks did not exhibit any difference in task-evoked activation or intrinsic functional connectivity between the two groups. These findings demonstrate the effect of long-term learning and practice in cognitive expertise on large-scale brain networks, suggesting the important role of DMN deactivation in expert performance and enhanced functional integration of spontaneous activity within widely distributed DMN-caudate circuitry, which might better support high-level cognitive control of behavior.

Biasing perception by spatial long-term memory

Human perception is highly flexible and adaptive. Selective processing is tuned dynamically according to current task goals and expectations to optimize behavior. Arguably, the major source of our expectations about events yet to unfold is our past experience; however, the ability of long-term memories to bias early perceptual analysis has remained untested. We used a noninvasive method with high temporal resolution to record neural activity while human participants detected visual targets that appeared at remembered versus novel locations within naturalistic visual scenes. Upon viewing a familiar scene, spatial memories changed oscillatory brain activity in anticipation of the target location. Memory also enhanced neural activity during early stages of visual analysis of the target and improved behavioral performance. Both measures correlated with subsequent target-detection performance. We therefore demonstrated that memory can directly enhance perceptual functions in the human brain.

Visual prediction and perceptual expertise

Making accurate predictions about what may happen in the environment requires analogies between perceptual input and associations in memory. These elements of predictions are based on cortical representations, but little is known about how these processes can be enhanced by experience and training. On the other hand, studies on perceptual expertise have revealed that the acquisition of expertise leads to strengthened associative processing among features or objects, suggesting that predictions and expertise may be tightly connected. Here we review the behavioral and neural findings regarding the mechanisms involving prediction and expert processing, and highlight important possible overlaps between them. Future investigation should examine the relations among perception, memory and prediction skills as a function of expertise. The knowledge gained by this line of research will have implications for visual cognition research, and will advance our understanding of how the human brain can improve its ability to predict by learning from experience.

Expertise modulates the neural basis of context dependent recognition of objects and their relations

Recognition of objects and their relations is necessary for orienting in real life. We examined cognitive processes related to recognition of objects, their relations, and the patterns they form by using the game of chess. Chess enables us to compare experts with novices and thus gain insight in the nature of development of recognition skills. Eye movement recordings showed that experts were generally faster than novices on a task that required enumeration of relations between chess objects because their extensive knowledge enabled them to immediately focus on the objects of interest. The advantage was less pronounced on random positions where the location of chess objects, and thus typical relations between them, was randomized. Neuroimaging data related experts' superior performance to the areas along the dorsal stream-bilateral posterior temporal areas and left inferior parietal lobe were related to recognition of object and their functions. The bilateral collateral sulci, together with bilateral retrosplenial cortex, were also more sensitive to normal than random positions among experts indicating their involvement in pattern recognition. The pattern of activations suggests experts engage the same regions as novices, but also that they employ novel additional regions. Expert processing, as the final stage of development, is qualitatively different than novice processing, which can be viewed as the starting stage. Since we are all experts in real life and dealing with meaningful stimuli in typical contexts, our results underline the importance of expert-like cognitive processing on generalization of laboratory results to everyday life.

Many faces of expertise: fusiform face area in chess experts and novices

The fusiform face area (FFA) is involved in face perception to such an extent that some claim it is a brain module for faces exclusively. The other possibility is that FFA is modulated by experience in individuation in any visual domain, not only faces. Here we test this latter FFA expertise hypothesis using the game of chess as a domain of investigation. We exploited the characteristic of chess, which features multiple objects forming meaningful spatial relations. In three experiments, we show that FFA activity is related to stimulus properties and not to chess skill directly. In all chess and non-chess tasks, experts' FFA was more activated than that of novices' only when they dealt with naturalistic full-board chess positions. When common spatial relationships formed by chess objects in chess positions were randomly disturbed, FFA was again differentially active only in experts, regardless of the actual task. Our experiments show that FFA contributes to the holistic processing of domain-specific multipart stimuli in chess experts. This suggests that FFA may not only mediate human expertise in face recognition but, supporting the expertise hypothesis, may mediate the automatic holistic processing of any highly familiar multipart visual input.

Get the story straight: contextual repetition promotes word learning from storybooks

Although shared storybook reading is a common activity believed to improve the language skills of preschool children, how children learn new vocabulary from such experiences has been largely neglected in the literature. The current study systematically explores the effects of repeatedly reading the same storybooks on both young children's fast and slow mapping abilities. Specially created storybooks were read to 3-year-old children three times during the course of 1 week. Each of the nine storybooks contained two novel name-object pairs. At each session, children either heard three different stories with the same two novel name-object pairs or the same story three times. Importantly, all children heard each novel name the same number of times. Both immediate recall and retention were tested with a four-alternative forced-choice task with pictures of the novel objects. Children who heard the same stories repeatedly were very accurate on both the immediate recall and retention tasks. In contrast, children who heard different stories were only accurate on immediate recall during the last two sessions and failed to learn any of the new words. Overall, then, we found a dramatic increase in children's ability to both recall and retain novel name-object associations encountered during shared storybook reading when they heard the same stories multiple times in succession. Results are discussed in terms of contextual cueing effects observed in other cognitive domains.