Implied motion perception from a still image in infancy

Direction-selective adaptation from implied motion in infancy

We investigated whether adaptation from implied motion (IM) is transferred to real motion using optokinetic nystagmus (OKN) in infants. Specifically, we examined whether viewing a series of images depicting motion shifted infants' OKN responses to the opposite direction of random dot kinematograms (RDKs). Each RDK was presented 10 times in a pre-test, followed by 10 trials of IM adaptation and test. During the pre-test, the signal dots of the RDK moved left or right. During IM adaptation, 10 randomly selected images depicting leftward (or rightward) IM were presented. In the test, the RDK was presented immediately after the last IM image. An observer, blinded to the motion direction, assessed the OKN direction. The number of matches in OKN responses for each RDK direction was calculated as the match ratio of OKN. We conducted a two-way mixed analysis of variance, with age group (5-6 months and 7-8 months) as the between-participant factor and adaptation (pre-test and test) as the within-participant factor. Only in 7-8 months the OKN responses were shifted in the opposite direction of RDK by viewing a series of images depicting motion, and these infants could detect both IM and RDK motion directions in the pre-test. Our results indicate that detecting the IM and RDK directions might induce direction-selective adaptation in 7-8 months.

Modeling short visual events through the BOLD moments video fMRI dataset and metadata

Studying the neural basis of human dynamic visual perception requires extensive experimental data to evaluate the large swathes of functionally diverse brain neural networks driven by perceiving visual events. Here, we introduce the BOLD Moments Dataset (BMD), a repository of whole-brain fMRI responses to over 1000 short (3 s) naturalistic video clips of visual events across ten human subjects. We use the videos' extensive metadata to show how the brain represents word- and sentence-level descriptions of visual events and identify correlates of video memorability scores extending into the parietal cortex. Furthermore, we reveal a match in hierarchical processing between cortical regions of interest and video-computable deep neural networks, and we showcase that BMD successfully captures temporal dynamics of visual events at second resolution. With its rich metadata, BMD offers new perspectives and accelerates research on the human brain basis of visual event perception.

Free viewing biases for complex scenes in preschoolers and adults

Adult gaze behaviour towards naturalistic scenes is highly biased towards semantic object classes. Little is known about the ontological development of these biases, nor about group-level differences in gaze behaviour between adults and preschoolers. Here, we let preschoolers (n = 34, age 5 years) and adults (n = 42, age 18-59 years) freely view 40 complex scenes containing objects with different semantic attributes to compare their fixation behaviour. Results show that preschool children allocate a significantly smaller proportion of dwell time and first fixations on Text and instead fixate Faces, Touched objects, Hands and Bodies more. A predictive model of object fixations controlling for a range of potential confounds suggests that most of these differences can be explained by drastically reduced text salience in pre-schoolers and that this effect is independent of low-level salience. These findings are in line with a developmental attentional antagonism between text and body parts (touched objects and hands in particular), which resonates with recent findings regarding 'cortical recycling'. We discuss this and other potential mechanisms driving salience differences between children and adults.

Pupillary response to real, illusory, and implied motion

The perception of moving objects (real motion) is a critical function for interacting with a dynamic environment. Motion perception can be also induced by particular structural features of static images (illusory motion) or by photographic images of subjects in motion (implied motion, IM). Many cortical areas are involved in motion processing, particularly the medial temporal cortical area (MT), dedicated to the processing of real, illusory, and implied motion. Recently, there has been a growing interest in the influence of high-level visual processes on pupillary responses. However, just a few studies have measured the effect of motion processing on the pupil, and not always with consistent results. Here we systematically investigate the effects of real, illusory, and implied motion on the pupil diameter for the first time, by showing different types of stimuli (movies, illusions, and photos) with the same average luminance to the same observers. We find different pupillary responses depending on the nature of motion. Real motion elicits a larger pupillary dilation than IM, which in turn induces more dilation than control photos representing static subjects (No-IM). The pupil response is sensitive even to the strength of IM, as photos with enhanced IM (blur, motion streaks, speed lines) induce larger dilation than simple freezed IM (subjects captured in the instant they are moving). Also, the subject represented in the stimulus matters: human figures are interpreted as more dynamic and induce larger dilation than objects/animals. Interestingly, illusory motion induces much less dilation than all the other motion categories, despite being seen as moving. Overall, pupil responses depend on the individual perception of dynamicity, confirming that the pupil is modulated by the subjective interpretation of complex stimuli. We argue that the different pupillary responses to real, illusory, and implied motion reflect the top-down modulations of different cortical areas involved in their processing.

The Disentangled Sub-Processes Involved in Implied Motion Contributing to Food Freshness: The Neural Evidence from ERPs

Implied motion can enhance the consumer’s judgment of food freshness. However, this enhancing effect has only been investigated for a few products. Furthermore, researchers have not conclusively determined whether the effects of the low-level visual sensory processing and high-level conceptual processing on food evaluation differ. In Experiment 1, using different fruits in static water (fruit_IS), fruit with implied moving water (fruit_IM), or only fruits as stimuli, we initially generalized the effect of implied motion on the broader category of fruit, and implied motion improved the perceived freshness of the fruit. In Experiment 2, we recorded event-related potentials (ERPs) and measured the temporal processes involved in the mechanism by which implied motion improved perceived fruit freshness. The behavioral results further supported the findings from Experiment 1. The ERP data revealed a pronounced positive difference between fruit_IM and fruit-only conditions recorded from posterior electrodes at approximately 200-300 ms (P2). This difference reflected the low-level visual implied motion sensory processing involved in the effect of implied motion on improving food freshness. Additionally, an early frontocentral negativity difference of approximately 300-500 ms between fruit_IM and fruit-only conditions was recorded, which reflected the high-level visual conceptual processing involved in the effect of implied motion on improving food freshness. These results strengthen and extend previous behavioral findings indicating that implied motion enhances the consumer’s judgment of food freshness across various food categories, and improves our understanding of the cognitive processes involved in the mechanism by which implied motion influences food judgments.

Move Still: The Effects of Implied and Real Motion on the Duration Estimates of Dance Steps

It has been argued that movement can be implied by static cues of images depicting an instance of a dynamic event. Instances of implied motion have been investigated as a special type of stimulus with common processing mechanisms to those of real motion. Timing studies have reported a lengthening of the perceived time for moving as opposed to static stimuli and for stimuli of higher as compared to lower amounts of implied motion. However, the actual comparison of real versus implied motion on timing has never been investigated. In the present study, we compared directly the effect of two hypothetically analogous ballet steps with different amounts of movement and static instances of the dynamic peak of these events in a reproduction task. The analysis revealed an overestimation and lower response variability for real as compared to implied motion stimuli. These findings replicate and extend the apparent duration lengthening for moving as compared to static stimulation, even for static images containing implied motion, questioning whether or not the previously reported correspondence between real and implied motion transfers in the timing domain. This lack of correspondence was further supported by the finding that the amount of movement presented affected only displays of real motion.

Differences in the Magnitude of Representational Momentum Between School-Aged Children and Adults as a Function of Experimental Task

Representational momentum (RM) is the phenomenon that occurs when an object moves and then disappears, and the recalled final position of the object shifts in the direction of its motion. Some previous findings indicate that the magnitude of RM in early childhood is comparable to that in adulthood, whereas other findings suggest that the magnitude of RM is significantly greater in childhood than in adulthood. We examined whether the inconsistencies between previous studies could be explained by differences in the experimental tasks used in these studies. Futterweit and Beilin used a same-different judgment between the position where a moving stimulus disappeared and where a comparison stimulus reappeared (judging task), whereas Hubbard et al. used a task wherein a computer mouse cursor pointed to the position where the moving stimulus disappeared (pointing task). Three age groups (M = 7.4, 10.7, and 22.1 years, respectively) participated in both the judging and pointing tasks in the current study. A multivariate analysis of variance with the magnitudes of RM in each task as dependent variables revealed a significant main effect for age. A one-way analysis of variance performed for each of the judging and pointing tasks also indicated a significant main effect of age. However, post hoc multiple comparisons detected a significant age effect only for the pointing task. The inconsistency between the judging and pointing tasks was discussed related to the distinct effect size of the age difference in the magnitude of RM between the two tasks.

Emergence of the ability to perceive dynamic events from still pictures in human infants

The ability to understand a visual scene depicted in a still image is among the abilities shared by all human beings. The aim of the present study was to examine when human infants acquire the ability to perceive the dynamic events depicted in still images (implied motion perception). To this end, we tested whether 4- and 5-month-old infants shifted their gaze toward the direction cued by a dynamic running action depicted in a still figure of a person. Results indicated that the 5- but not the 4-month-olds showed a significant gaze shift toward the direction implied by the posture of the runner (Experiments 1, 2, and 3b). Moreover, the older infants showed no significant gaze shift toward the direction cued by control stimuli, which depicted a figure in a non-dynamic standing posture (Experiment 1), an inverted running figure (Experiment 2), and some of the body parts of a running figure (Experiment 3a). These results suggest that only the older infants responded in the direction of the implied running action of the still figure; thus, implied motion perception emerges around 5 months of age in human infants.

Neural activity associated with attention orienting triggered by implied action cues

Spatial attention can be directed by the actions of others. We used ERPs method to investigate the neural underpins associated with attention orienting which is induced by implied body action. Participants performed a standard non-predictive cuing task, in which a directional implied action (throwing and running) or non-action (standing) cue was randomly presented and then followed by a target to the left or right of the central cue, despite cue direction. The cue-triggered ERPs results demonstrated that implied action cues, rather than the non-action cue, could shift the observers' spatial attention as demonstrated by the robust anterior directing attention negativity (ADAN) effects in throwing and running cues. Further, earlier N1 (100-170ms) and P2 (170-260ms) waveform differences occurred between implied action and non-action cues over posterior electrodes. The P2 component might reflect implied motion signal perception of implied action cues, and this implied motion perception might play an important role in facilitating the attentional shifts induced by implied action cues. Target-triggered ERPs data (mainly P3a component) indicated that implied action cues (throwing and running) speeded and enhanced the responses to valid targets compared to invalid targets. Furthermore, P3a might imply that implied action orienting may share similar mechanisms of action with voluntary attention, especially at the novel stimuli processing decision-level. These results further support previous behavioral findings that implied body actions direct spatial attention and extend our understanding about the nature of the attentional shifts that are elicited by implied action cues.