Sensory memory of illusory depth in structure-from-motion

Reconstructing a disambiguation sequence that forms perceptual memory of multistable displays via reverse correlation method: Bias onset perception but gently

When multistable displays are presented intermittently with long blank intervals, their onset perception is determined by perceptual memory of multistable displays. We investigated when and how it is formed using a reverse correlation method and bistable kinetic depth effect displays. Each experimental block consisted of interleaved fully ambiguous probe and exogenously disambiguated prime displays. The purpose of the former was to "read out" the perceptual memory, whereas the latter contained purely random disambiguation sequences that were presented at the beginning of the prime display, throughout the entire presentation, or at the beginning and the end of the presentation. For each experiment and condition, we selected a subset of trials with disambiguation sequences that led to a change in perception of either the prime itself (sequences that modified perception) or the following fully ambiguous probe (sequences that modified perceptual memory). We estimated average disambiguation sequences for each participant using additive linear models. We found that an optimal sequence started at the onset with a moderate disambiguation against the previously dominant state (dominant perception for the previous probe) that gradually reduced until the display is fully ambiguous. We also show that the same sequence leads to an altered perception of the prime, indicating that perception and perceptual memory form at the same time. We suggest that perceptual memory is a consequence of an earlier evidence accumulation process and is informative about how the visual system treated ambiguity in the past rather than how it anticipates an uncertain future.

Pattern recognition of tumor dormancy and relapse beyond cell-intrinsic and cell-extrinsic pathways

In this thematic issue, several mechanisms of tumor dormancy and relapse are discussed. The reviews suggest mutual interactions and communications between malignant cells and other cells in their niche during tumor dormancy. Nevertheless, a complete understanding of tumor dormancy remains elusive. This is because we are getting lost in details of cell-intrinsic and cell-extrinsic molecular pathways without being able to discover the pattern of tumor dormancy. Here, we discuss some conceptual frameworks and methodological approaches that facilitate pattern recognition of tumor dormancy, and propose that settling on certain biological scale such as mitochondria would be the key to discover the pattern of tumor dormancy and relapse.

Binocular rivalry reveals an out-of-equilibrium neural dynamics suited for decision-making

In ambiguous or conflicting sensory situations, perception is often ‘multistable’ in that it perpetually changes at irregular intervals, shifting abruptly between distinct alternatives. The interval statistics of these alternations exhibits quasi-universal characteristics, suggesting a general mechanism. Using binocular rivalry, we show that many aspects of this perceptual dynamics are reproduced by a hierarchical model operating out of equilibrium. The constitutive elements of this model idealize the metastability of cortical networks. Independent elements accumulate visual evidence at one level, while groups of coupled elements compete for dominance at another level. As soon as one group dominates perception, feedback inhibition suppresses supporting evidence. Previously unreported features in the serial dependencies of perceptual alternations compellingly corroborate this mechanism. Moreover, the proposed out-of-equilibrium dynamics satisfies normative constraints of continuous decision-making. Thus, multistable perception may reflect decision-making in a volatile world: integrating evidence over space and time, choosing categorically between hypotheses, while concurrently evaluating alternatives.

Age-dependency in binocular rivalry is reflected by exclusive percepts, not mixed percepts

Some aspects of decision-making are known to decline with normal aging. One of the known perceptual decision-making processes which is vastly studied is binocular rivalry. It is well-established that the older the person, the slower the perceptual dynamics. However, the underlying neurobiological cause is unknown. So, to understand how age affects visual decision-making, we investigated age-related changes in perception during binocular rivalry. In binocular rivalry, the image presented to one eye competes for perceptual dominance with the image presented to the other eye. Perception during binocular rivalry consists of alternations between exclusive percepts. However, frequently, mixed percepts with combinations of the two monocular images occur. The mixed percepts reflect a transition from the percept of one eye to the other but frequently the transitions do not complete the full cycle and the previous exclusive percept becomes dominant again. The transitional idiosyncrasy of mixed percepts has not been studied systematically in different age groups. Previously, we have found evidence for adaptation and noise, and not inhibition, as underlying neural factors that are related to age-dependent perceptual decisions. Based on those conclusions, we predict that mixed percepts/inhibitory interactions should not change with aging. Therefore, in an old and a young age group, we studied binocular rivalry dynamics considering both exclusive and mixed percepts by using two paradigms: percept-choice and percept-switch. We found a decrease in perceptual alternation Probability for older adults, although the rate of mixed percepts did not differ significantly compared to younger adults. Interestingly, the mixed percepts play a very similar transitional idiosyncrasy in our different age groups. Further analyses suggest that differences in synaptic depression, gain modulation at the input level, and/or slower execution of motor commands are not the determining factors to explain these findings. We then argue that changes in perceptual decisions at an older age are the result of changes in neural adaptation and noise.

Changes in low-level neural properties underlie age-dependent visual decision making

Aging typically slows down cognitive processes, specifically those related to perceptual decisions. However, the neurobiological mechanisms underlying these age-associated changes are still elusive. To address this, we studied the effect of aging on both perceptual and binocular rivalry in various presentation conditions. Two age groups of participants reported their spontaneous percept switches during continuous presentation and percept choices during intermittent presentation. We find no significant age effect on the mean and cumulative frequencies of percept switch durations under continuous presentation. However, the data show a significant age effect on coefficient of variation, ratio of standard deviation to mean of percept durations. Our results also reveal that the alternation rate for percept choices significantly declines at an older age under intermittent presentation. The latter effect is even more pronounced at shorter inter-stimulus durations. These results together with the predictions of existing neural models for bistable perception imply that age-dependency of visual perceptual decisions is caused by shifts in neural adaptation and noise, not by a change in inhibition strength. Thus, variation in the low-level neural properties, adaptation and noise, cause age-dependent properties in visual perceptual decisions.

Perception and the strongest sensory memory trace of multi-stable displays both form shortly after the stimulus onset

We investigated the relation between perception and sensory memory of multi-stable structure-from-motion displays. The latter is an implicit visual memory that reflects a recent history of perceptual dominance and influences only the initial perception of multi-stable displays. First, we established the earliest time point when the direction of an illusory rotation can be reversed after the display onset (29-114 ms). Because our display manipulation did not bias perception towards a specific direction of illusory rotation but only signaled the change in motion, this means that the perceptual dominance was established no later than 29-114 ms after the stimulus onset. Second, we used orientation-selectivity of sensory memory to establish which display orientation produced the strongest memory trace and when this orientation was presented during the preceding prime interval (80-140 ms). Surprisingly, both estimates point towards the time interval immediately after the display onset, indicating that both perception and sensory memory form at approximately the same time. This suggests a tighter integration between perception and sensory memory than previously thought, warrants a reconsideration of its role in visual perception, and indicates that sensory memory could be a unique behavioral correlate of the earlier perceptual inference that can be studied post hoc.

Transformation priming helps to disambiguate sudden changes of sensory inputs

Retinal input is riddled with abrupt transients due to self-motion, changes in illumination, object-motion, etc. Our visual system must correctly interpret each of these changes to keep visual perception consistent and sensitive. This poses an enormous challenge, as many transients are highly ambiguous in that they are consistent with many alternative physical transformations. Here we investigated inter-trial effects in three situations with sudden and ambiguous transients, each presenting two alternative appearances (rotation-reversing structure-from-motion, polarity-reversing shape-from-shading, and streaming-bouncing object collisions). In every situation, we observed priming of transformations as the outcome perceived in earlier trials tended to repeat in subsequent trials and this repetition was contingent on perceptual experience. The observed priming was specific to transformations and did not originate in priming of perceptual states preceding a transient. Moreover, transformation priming was independent of attention and specific to low level stimulus attributes. In summary, we show how "transformation priors" and experience-driven updating of such priors helps to disambiguate sudden changes of sensory inputs. We discuss how dynamic transformation priors can be instantiated as "transition energies" in an "energy landscape" model of the visual perception.

A bio-inspired memory model embedded with a causality reasoning function for structural fault location

Structural health monitoring (SHM) is challenged by massive data storage pressure and structural fault location. In response to these issues, a bio-inspired memory model that is embedded with a causality reasoning function is proposed for fault location. First, the SHM data for processing are divided into three temporal memory areas to control data volume reasonably. Second, the inherent potential of the causal relationships in structural state monitoring is mined. Causality and dependence indices are also proposed to establish the mechanism of quantitative description of the reason and result events. Third, a mechanism of causality reasoning is developed for the reason and result events to locate faults in a SHM system. Finally, a deformation experiment conducted on a steel spring plate demonstrates that the proposed model can be applied to real-time acquisition, compact data storage, and system fault location in a SHM system. Moreover, the model is compared with some typical methods based on an experimental benchmark dataset.

Top-down influences on ambiguous perception: the role of stable and transient states of the observer

The world as it appears to the viewer is the result of a complex process of inference performed by the brain. The validity of this apparently counter-intuitive assertion becomes evident whenever we face noisy, feeble or ambiguous visual stimulation: in these conditions, the state of the observer may play a decisive role in determining what is currently perceived. On this background, ambiguous perception and its amenability to top-down influences can be employed as an empirical paradigm to explore the principles of perception. Here we offer an overview of both classical and recent contributions on how stable and transient states of the observer can impact ambiguous perception. As to the influence of the stable states of the observer, we show that what is currently perceived can be influenced (1) by cognitive and affective aspects, such as meaning, prior knowledge, motivation, and emotional content and (2) by individual differences, such as gender, handedness, genetic inheritance, clinical conditions, and personality traits and by (3) learning and conditioning. As to the impact of transient states of the observer, we outline the effects of (4) attention and (5) voluntary control, which have attracted much empirical work along the history of ambiguous perception. In the huge literature on the topic we trace a difference between the observer's ability to control dominance (i.e., the maintenance of a specific percept in visual awareness) and reversal rate (i.e., the switching between two alternative percepts). Other transient states of the observer that have more recently drawn researchers' attention regard (6) the effects of imagery and visual working memory. (7) Furthermore, we describe the transient effects of prior history of perceptual dominance. (8) Finally, we address the currently available computational models of ambiguous perception and how they can take into account the crucial share played by the state of the observer in perceiving ambiguous displays.