Visual search for category sets: tradeoffs between exploration and memory

Effect of Periodic Voluntary Interventions on Trapezius Activation and Fatigue During Light Upper Limb Activity

OBJECTIVE

The effects of diverse periodic interventions on trapezius muscle fatigue and activity during a full day of computer work were investigated.

BACKGROUND

Musculoskeletal disorders, including trapezius myalgia, may be associated with repeated exposure to prolonged low-level activity, even during light upper-extremity tasks including computer work.

METHODS

Thirty healthy adults participated in a study that simulated two 6-hour workdays of computer work. One workday involved imposed periodic passive and active interventions aimed at disrupting trapezius contraction monotony (Intervention day), whereas the other workday did not (Control day). Trapezius muscle activity was quantified by the 3-dimensional acceleration of the jolt movement of the acromion produced by electrically induced muscle twitches. The spatio-temporal distribution of trapezius activity was measured through high-density surface electromyography (HD-EMG).

RESULTS

The twitch acceleration magnitude in one direction was significantly different across measurement periods (p = 0.0156) on Control day, whereas no significant differences in any direction were observed (p > 0.05) on Intervention day. The HD-EMG from Intervention day showed that only significant voluntary muscle contractions (swing arms, Jacobson maneuver) induced a decrease in the muscle activation time and an increase in the spatial muscle activation areas (p < 0.01).

CONCLUSION

Disruption of trapezius monotonous activity via brief voluntary contractions effectively modified the ensuing contraction pattern (twitch acceleration along one axis, active epochs reduction, and larger spatial distribution). The observed changes support an associated reduction of muscle fatigue.

APPLICATION

This study suggests that disruptive intervention activity is efficient in reducing the impact of trapezius muscle fatigue.

Explore versus store: Children strategically trade off reliance on exploration versus working memory during a complex task

During complex tasks, we use working memory to actively maintain goal sets and direct attention toward goal-relevant information in the environment. However, working memory is severely limited, and storing information in working memory is cognitively effortful. Previous work by Kibbe and Kowler [2011, Journal of Vision, 11(3), Article 14] showed that adults strategically modulate reliance on working memory during complex, goal-oriented tasks, varying the amount of information they store in working memory depending both on the cognitive demands of the task and on the ease with which task-relevant information can be accessed from the environment. We asked whether children, whose working memory and executive functions are undergoing significant developmental change, also use working memory strategically during complex tasks. Forty-six 8-10-year-old children searched through arrays of hidden objects to find three that belonged to a given category defined over the objects' features. We manipulated the cognitive demands of the task by increasing the complexity of the category. We manipulated the exploration costs of the task by varying the rate at which task-relevant information could be accessed. We measured children's search patterns to gain insights into how the children used working memory during the task. We found that as the cognitive demands of the task increased, children stored less information in working memory, relying more on exploration. When exploration was costlier, children explored less, storing more in working memory. These results suggest that developing children, like adults, make strategic decisions about when to explore versus when to store during a complex, goal-oriented task.

Benefits and pitfalls of data compression in visual working memory

Data compression in memory is a cognitive process allowing participants to cope with complexity to reduce information load. However, previous studies have not yet considered the hypothesis that this process could also lead to over-simplifying information due to haphazard amplification of the compression process itself. For instance, we could expect that the over-regularized features of a visual scene could produce false recognition of patterns, not because of storage capacity limits but because of an errant compression process. To prompt memory compression in our participants, we used multielement visual displays for which the underlying information varied in compressibility. The compressibility of our material could vary depending on the number of common features between the multi-dimensional objects in the displays. We measured both accuracy and response times by probing memory representations with probes that we hypothesized could modify the participants' representations. We confirm that more compressible information facilitates performance, but a more novel finding is that compression can produce both typical memory errors and lengthened response times. Our findings provide clearer evidence of the forms of compression that participants carry out.

Why are the batteries in the microwave?: Use of semantic information under uncertainty in a search task

A major problem in human cognition is to understand how newly acquired information and long-standing beliefs about the environment combine to make decisions and plan behaviors. Over-dependence on long-standing beliefs may be a significant source of suboptimal decision-making in unusual circumstances. While the contribution of long-standing beliefs about the environment to search in real-world scenes is well-studied, less is known about how new evidence informs search decisions, and it is unclear whether the two sources of information are used together optimally to guide search. The present study expanded on the literature on semantic guidance in visual search by modeling a Bayesian ideal observer's use of long-standing semantic beliefs and recent experience in an active search task. The ability to adjust expectations to the task environment was simulated using the Bayesian ideal observer, and subjects' performance was compared to ideal observers that depended on prior knowledge and recent experience to varying degrees. Target locations were either congruent with scene semantics, incongruent with what would be expected from scene semantics, or random. Half of the subjects were able to learn to search for the target in incongruent locations over repeated experimental sessions when it was optimal to do so. These results suggest that searchers can learn to prioritize recent experience over knowledge of scenes in a near-optimal fashion when it is beneficial to do so, as long as the evidence from recent experience was learnable.

Individual difference in serial dependence results from opposite influences of perceptual choices and motor responses

Natural image statistics exhibit temporal regularities of slow changes and short-term correlations and visual perception, too, is biased toward recently seen stimuli, i.e., a positive serial dependence. Some studies report strong individual differences in serial dependence in perceptual decision-making: some observers show positive serial effects, others repulsive effects, and some show no bias. To understand these contrasting results, this study separates the influences of physical stimuli per se, perceptual choices, and motor responses on serial dependence in perceptual decision making. In two experiments, human observers reported which orientation (45° or −45°, at threshold contrast) they perceived. Experiment 1, used a consistent mapping between stimulus and response buttons whereas in Experiment 2, observers did two tasks: one with a consistent stimulus-response mapping, the other with a random stimulus-response mapping (perceptual choice and motor response unrelated). Results show that the stimulus percept (not the physical stimulus per se) affected subsequent perceptual choices in an attractive way and that motor responses produced a repulsive serial effect. When the choice-response mapping was consistent (inseparable choice and response, typical of most experiments), individual differences in the overall serial effect was observed: some were positive, some repulsive, and some were bias-free. The multiple regression analysis revealed that observers’ overall serial effects in the consistent choice-response mapping task could be predicted by their serial effects for choices and motor responses in the random mapping task. These individual differences likely reflect relative weightings of a positive choice bias and a repulsive motor bias.

The role of implicit perceptual-motor costs in the integration of information across graph and text

Strategies used to gather visual information are typically viewed as depending solely on the value of information gained from each action. A different approach may be required when actions entail cognitive effort or deliberate control. Integration of information across a graph and text is a resource-intensive task in which decisions to switch between graph and text may take into account the resources required to plan or execute the switches. Participants viewed a graph and text depicting attributes of two fictitious products and were asked to select the preferred product. Graph and text were presented: (1) simultaneously, side by side; (2) sequentially, where the appearance of graph or text was triggered by a button press, or (3) sequentially, where the appearance of graph or text was triggered by a saccade, thus requiring cognitive effort, memory, or controlled processing to access regions out of immediate view. Switches between graph and text were rare during initial readings, consistent with prior observations of perceptual "switch costs." Switches became more frequent during re-inspections (80% of time). Switches were twice as frequent in the simultaneous condition than in either sequential condition (button press or saccade-contingent), showing the importance of perceptual availability. These results show that strategies used to gather information while reading a graph and text are not based solely on information value, but also on implicit costs of switching, such as effort level, working memory load, or demand on controlled processing. Taking implicit costs into account is important for a complete understanding of strategies used to gather visual information.

Failure of Intuition When Choosing Whether to Invest in a Single Goal or Split Resources Between Two Goals

In a series of related experiments, we asked people to choose whether to split their attention between two equally likely potential tasks or to prioritize one task at the expense of the other. In such a choice, when the tasks are easy, the best strategy is to prepare for both of them. As difficulty increases beyond the point at which people can perform both tasks accurately, they should switch strategy and focus on one task at the expense of the other. Across three very different tasks (target detection, throwing, and memory), none of the participants switched their strategy at the correct point. Moreover, the majority consistently failed to modify their strategy in response to changes in task difficulty. This failure may have been related to uncertainty about their own ability, because in a version of the experiment in which there was no uncertainty, participants uniformly switched at an optimal point.

Allocation of cognitive resources in comparative visual search--individual and task dependent effects

Behaviors recruit multiple, mutually substitutable types of cognitive resources (e.g., data acquisition and memorization in comparative visual search), and the allocation of resources is performed in a cost-optimizing way. If costs associated with each type of resource are manipulated, e.g., by varying the complexity of the items studied or the visual separation of the arrays to be compared, according adjustments of resource allocation ("trade-offs") have been demonstrated. Using between-subject designs, previous studies showed overall trade-off behavior but neglected inter-individual variability of trade-off behavior. Here, we present a simplified paradigm for comparative visual search in which gaze-measurements are replaced by switching of a visual mask covering one stimulus array at a time. This paradigm allows for a full within-subject design. While overall trade-off curves could be reproduced, we found that each subject used a specific trade-off strategy which differ substantially between subjects. Still, task-dependent adjustment of resource allocation can be demonstrated but accounts only for a minor part of the overall trade-off range. In addition, we show that the individual trade-offs were adjusted in an unconscious and rather intuitive way, enabling a robust manifestation of the selected strategy space.

Timing of saccadic eye movements during visual search for multiple targets

Visual search requires sequences of saccades. Many studies have focused on spatial aspects of saccadic decisions, while relatively few (e.g., Hooge & Erkelens, 1999) consider timing. We studied saccadic timing during search for targets (thin circles containing tilted lines) located among nontargets (thicker circles). Tasks required either (a) estimating the mean tilt of the lines, or (b) looking at targets without a concurrent psychophysical task. The visual similarity of targets and nontargets affected both the probability of hitting a target and the saccade rate in both tasks. Saccadic timing also depended on immediate conditions, specifically, (a) the type of currently fixated location (dwell time was longer on targets than nontargets), (b) the type of goal (dwell time was shorter prior to saccades that hit targets), and (c) the ordinal position of the saccade in the sequence. The results show that timing decisions take into account the difficulty of finding targets, as well as the cost of delays. Timing strategies may be a compromise between the attempt to find and locate targets, or other suitable landing locations, using eccentric vision (at the cost of increased dwell times) versus a strategy of exploring less selectively at a rapid rate.

Eye movements while viewing narrated, captioned, and silent videos

Videos are often accompanied by narration delivered either by an audio stream or by captions, yet little is known about saccadic patterns while viewing narrated video displays. Eye movements were recorded while viewing video clips with (a) audio narration, (b) captions, (c) no narration, or (d) concurrent captions and audio. A surprisingly large proportion of time (>40%) was spent reading captions even in the presence of a redundant audio stream. Redundant audio did not affect the saccadic reading patterns but did lead to skipping of some portions of the captions and to delays of saccades made into the caption region. In the absence of captions, fixations were drawn to regions with a high density of information, such as the central region of the display, and to regions with high levels of temporal change (actions and events), regardless of the presence of narration. The strong attraction to captions, with or without redundant audio, raises the question of what determines how time is apportioned between captions and video regions so as to minimize information loss. The strategies of apportioning time may be based on several factors, including the inherent attraction of the line of sight to any available text, the moment by moment impressions of the relative importance of the information in the caption and the video, and the drive to integrate visual text accompanied by audio into a single narrative stream.

Waiting and weighting: Information sampling is a balance between efficiency and error-reduction

The current study investigates the relative extent to which information utility and planning efficiency guide information-sampling strategies in a classification task. Prior research has pointed to the importance of probability gain, the degree to which sampling a feature reduces the chance of error, in contexts where participants are restricted to one sample. We monitored participants as they sampled information in an unrestricted context and recorded whether they began their search with a high gain feature or an efficient feature that ultimately allowed for fewer samples per trial. Participants preferred to sample the more efficient feature first, especially when feature information had a higher access cost (Experiment 1). When access costs were all but eliminated using eye-tracking (Experiment 2), participants' fixations still emphasized efficiency over high probability gain, though probability gain was shown to influence access patterns.

Motor control is decision-making

Motor behavior may be viewed as a problem of maximizing the utility of movement outcome in the face of sensory, motor and task uncertainty. Viewed in this way, and allowing for the availability of prior knowledge in the form of a probability distribution over possible states of the world, the choice of a movement plan and strategy for motor control becomes an application of statistical decision theory. This point of view has proven successful in recent years in accounting for movement under risk, inferring the loss function used in motor tasks, and explaining motor behavior in a wide variety of circumstances.