Benefits of Motion in Animated Storybooks for Children's Visual Attention and Story Comprehension. An Eye-Tracking Study

Self-regulation and comprehension in shared reading: The moderating effects of verbal interactions and E-book discussion prompts

The study examined how children's self-regulation skills measured by the strengths and weaknesses of ADHD symptoms and normal behavior rating are associated with story comprehension and how verbal engagement and e-book discussion prompts moderate this relation. Children aged 3-7 (N = 111, 50% female, Chinese as first language) read an interactive Chinese-English bilingual story e-book with or without discussion prompts twice with their parents (2020-2021). Results demonstrated that the lower children's self-regulation skills, the more they struggled with story comprehension. Critically, our data suggest that embedding e-book discussion prompts and more verbalization in English can mitigate this negative association for children with inattention/hyperactivity. These findings have critical implications for future e-book design, interventions, and home reading practice for children with inattention/hyperactivity and those at risk for attention deficit/hyperactivity disorder.

Evidence of Language Development Using Brief Animated Stimuli: A Systematic Review

There is limited evidence regarding the effect of animation compared to static pictures on children's language development. The aim was to systematically review the available literature for evidence concerning the effect of brief animation on spoken language responses (receptive-listening or expressive-speaking) in typically developing (TD) children aged 3 to 9 years. Five databases were searched, resulting in seven included studies. The characteristics of animated stimuli, the manner of presentation, and the language-related tasks were recorded, and questions were posed about the effect of brief animation on children's receptive and expressive language abilities. The evidence suggests that animation may have a positive effect on expressive language abilities of children compared to static pictures. As far as the effect of animation on receptive language performance is concerned, the evidence is less concrete. Future directions regarding the potential of animation on language development are discussed.

Executive attention modulates the facilitating effect of electronic storybooks on information encoding in preschoolers

Interactive features and multimedia elements in electronic storybooks might enhance knowledge acquisition in children due to the playful learning experience they provide. However, to date, there is no systematic research on the long-term efficacy of storybooks, and the individual cognitive factors that influence information processing when using these apps. Therefore, in Experiment 1, we focused on long-term improvements. Children (M = 5.55 years, SD = 0.51, N = 33) were divided into an Interactive App group (N = 16) and a Print Book group (N = 17), then they were exposed to a story. Their recall performance was measured immediately after the exposure and three weeks later. In Experiment 2, we focused on individual differences in cognitive factors (working memory and sustained attention). Children (M = 5.56 years, SD = 0.62, N = 32) were exposed to three stories with interactive, multimedia-only elements and an audio-only condition. Caregivers were asked to fill out the ADHD Rating Scale-IV regarding each child. According to our results, in Experiment 1, children in the Interactive App group performed better compared to the Print Book group and this improvement persisted over time. In Experiment 2, we replicated the results of Experiment 1, however, children with poorer sustained attentional abilities performed worse in multimedia and interactive conditions compared to the audio-only condition. Our results indicate that electronic storybooks can facilitate learning because they enhance encoding efficacy. However, the benefit is only evident in children with good attentional control abilities. Our results guide parents and educators on how to choose and design age-appropriate applications for learning.

To explore the impact of augmented reality digital picture books in environmental education courses on environmental attitudes and environmental behaviors of children from different cultures

Introduction

Environmental education has long been closely related to sustainable development. In this study, in response to the United Nations Sustainable Development Goals (SDGs), an augmented reality (AR) digital picture book was created using the unique natural ecosystem of Taiwan's Orchid Island as a source of self-efficacy for science learning.

Methods

Interactive environmental education learning through AR drawing was used to determine whether students' science learning self-efficacy and environmental attitudes significantly influenced the environmental behavioral skills of culturally diverse children. In this study, 26 elementary sixth-grade Taiwanese students and 26 elementary sixth-grade Japanese students were invited to participate in an extended reality drawing activity as an environmental education curriculum.

Results

Based on the sample size of 52, the survey results were accurate with a sampling error of 3.8% with a confidence level of 95%. A questionnaire survey was administered to the 52 students after the event. After the valid questionnaire samples were collected, a partial least squares structural equation modeling (PLS-SEM) analysis was conducted with Smart PLS 3.0 on the small sample. The results of the study showed that students who had a better self-efficacy in science learning were more likely to engage in conservation actions related to the natural environment in their daily lives.

Discussion

In this study, the constructs of environmental behavior were further discussed and the hypothesis model was validated using the quantitative empirical method. The results of the study revealed good reliability, convergent validity, and discriminant validity of the constructs in the hypothesis model, and the hypothesis model itself was validated. In the validated model, students' science learning self-efficacy affects the sustainability of their environmental behaviors, but only through the role of environmental attitudes. However, the environmental attitudes construct plays a fully mediating role in the model.

Psychological Impact and Influence of Animation on Viewer’s Visual Attention and Cognition: A Systematic Literature Review, Open Challenges, and Future Research Directions

Animation is an excellent method to associate with the audience in a fun and innovative manner. In recent span, animation has been employed in various fields to enhance knowledge, marketing, advertisement, and age groups from infants to adults. The present communication expounds the systematic review on the impact created by animation on the viewer’s visual attention. For this review, a database such as Google Scholar, ScienceDirect, Taylor & Francis, and IEEE Xplore were pursued for publications on the impact of animation on viewer’s visual attention from January 2015 to December 2021. The search results showcased 175 titles with 114 full articles, out of which 35 were related to viewers’ visual attention towards animation. These reviewed studies comprised of physical outcome ( $n=9$ ), psychological outcome ( $n=15$ ), and cognitive outcome ( $n=11$ ) from which the attention-related factors, physical effects, and cognitive effects of animation were assessed. The animation has influenced the viewer’s visual attention through the integration of the different stimuli and the highly organized presentation. Furthermore, the animation has also aided the viewer in attaining greater conceptual understanding, thereby facilitating their cognitive response. As a result, the animation was found to be helpful in enhancing learning skills, food marketing, and teaching strategy. Furthermore, the drawbacks and future recommendations of the studies were elaborated. In addition, challenges and open issues faced during the studies were discussed. Finally, the priority areas in animation identified for promising future directions to visualize large pool data, provide smart communication, and design 3D modeling structures were highlighted.

Decoding Pixel-Level Image Features from Two-Photon Calcium Signals of Macaque Visual Cortex

Images of visual scenes comprise essential features important for visual cognition of the brain. The complexity of visual features lies at different levels, from simple artificial patterns to natural images with different scenes. It has been a focus of using stimulus images to predict neural responses. However, it remains unclear how to extract features from neuronal responses. Here we address this question by leveraging two-photon calcium neural data recorded from the visual cortex of awake macaque monkeys. With stimuli including various categories of artificial patterns and diverse scenes of natural images, we employed a deep neural network decoder inspired by image segmentation technique. Consistent with the notation of sparse coding for natural images, a few neurons with stronger responses dominated the decoding performance, whereas decoding of ar tificial patterns needs a large number of neurons. When natural images using the model pretrained on artificial patterns are decoded, salient features of natural scenes can be extracted, as well as the conventional category information. Altogether, our results give a new perspective on studying neural encoding principles using reverse-engineering decoding strategies.

Bilingual children's visual attention while reading digital picture books and story retelling

This study examined Mandarin-English bilingual children's visual attention over repetitive readings of Mandarin enhanced digital books and static books as well as the effects visual attention has on story retelling. We assigned 89 4- and 5-year-old preschoolers in Singapore to one of three reading conditions: (a) digital books with visual and auditory enhancements, (b) digital books with only auditory enhancements, and (c) static digital books with neither visual nor auditory enhancements. We presented three stories to the children in four sessions over 2 weeks, traced their visual attention with an eye tracker, and examined their story retelling after the first and fourth readings. The results demonstrated that the digital books with visual and auditory enhancements maintained greater visual attention from children compared with that from children in the other two conditions across the four repetitive readings. Moreover, children's bilingual language proficiency significantly modulates the conditional effects of attention. Children with higher bilingual proficiency in the visual and auditory enhancements condition outperformed their peers in the other two conditions in terms of visual attention across most readings. However, for the children with lower bilingual proficiency, the digital books with auditory and visual enhancements only outperformed the static condition but not the auditory enhanced condition. Children with lower language proficiency maintained their attention at a relatively high level across the repetitive readings in the enhanced digital book conditions but demonstrated significantly decreased visual attention in the static digital book condition. Because children with better visual attention and higher bilingual proficiency retold the stories significantly better, the results indicate that influencing visual attention helps to improve story comprehension.

The Effects of Emotional Design on Multimedia Learning and Appreciation of Chinese Poetry

Painting, music, literature, and other art forms embody the essence of human wisdom and induce esthetic experience, among which poetry is inherently creative, because it contains a wealth of symbols, imageries, insights, and so forth. The appreciation and learning of Chinese poetry is an important part of the curriculum in secondary schools. However, studies have mainly focused on textual characters of poetry, with little literature focusing on esthetic appreciation and in-depth learning of poetry. In this vein, we ask whether emotional designs will promote the appreciation and learning of Chinese poetry. To answer this question, we explored the influence of the combination of external emotion induction (positive and neutral movie clips) and internal colorful design (chromatic and achromatic) on esthetic preference and learning of poetry. One hundred and sixty-six participants (14–15 years old) were randomly assigned to one of four conditions created by two factors (external emotion induction and internal colorful design). The results showed that the combination of external emotion induction and internal colorful design promoted positive emotions, retention, and transfer performances of learners. Furthermore, perceived difficulty of learners decreased significantly when external emotional induction and internal colorful design were both positive. Consequently, these findings indicated that emotional designs in multimedia facilitated the learning performance of middle school students in Chinese poetry, and supported the cognitive-affective theory of learning with media. This research was a preliminary exploration of emotional design in humanities.

Competing Perceptual Salience in a Visual Word Recognition Task Differentially Affects Children With and Without Autism Spectrum Disorder

Differences in visual attention have long been recognized as a central characteristic of autism spectrum disorder (ASD). Regardless of social content, children with ASD show a strong preference for perceptual salience-how interesting (i.e., striking) certain stimuli are, based on their visual properties (e.g., color, geometric patterning). However, we do not know the extent to which attentional allocation preferences for perceptual salience persist when they compete with top-down, linguistic information. This study examined the impact of competing perceptual salience on visual word recognition in 17 children with ASD (mean age 31 months) and 17 children with typical development (mean age 20 months) matched on receptive language skills. A word recognition task presented two images on a screen, one of which was named (e.g., Find the bowl!). On Neutral trials, both images had high salience (i.e., were colorful and had geometric patterning). On Competing trials, the distracter image had high salience but the target image had low salience, creating competition between bottom-up (i.e., salience-driven) and top-down (i.e., language-driven) processes. Though both groups of children showed word recognition in an absolute sense, competing perceptual salience significantly decreased attention to the target only in the children with ASD. These findings indicate that perceptual properties of objects can disrupt attention to relevant information in children with ASD, which has implications for supporting their language development. Findings also demonstrate that perceptual salience affects attentional allocation preferences in children with ASD, even in the absence of social stimuli. LAY SUMMARY: This study found that visually striking objects distract young children with autism spectrum disorder (ASD) from looking at relevant (but less striking) objects named by an adult. Language-matched, younger children with typical development were not significantly affected by this visual distraction. Though visual distraction could have cascading negative effects on language development in children with ASD, learning opportunities that build on children's focus of attention are likely to support positive outcomes.

Narrative Potential of Picture-Book Apps: A Media- and Interaction-Oriented Study

Digital literature is playing an increasingly important role in children's everyday lives and opening up new paths for family literacy and early childhood education. However, despite positive effects of electronic books and picture-book apps on vocabulary learning, early writing, or phonological awareness, research findings on early narrative skills are ambiguous. Particularly, there still is a research gap regarding how app materiality affects children's story understanding. Thus, based on the ViSAR model for picture-book app analysis and data stemming from 12 digital reading dyads containing German monolingual 2- to 3-year-olds and their caregivers this study assessed the narrative potential of a commercial picture-book app and how this is used in interaction. Results of the media analysis showed that the app provides a high number of narrative animations. These animations could be used interactively to engage the child in the story. However, results of the interaction analysis showed that adult readers do not exploit this potential due to their strong concentration on operative prompts and instructions. Furthermore, an explorative analysis of the relation between adults' utterances and children's story comprehension provided preliminary indicators regarding how the length of reading duration and the number of utterances might relate to children's understanding of the story. Findings and methodological limitations of the study are discussed and combined didactically with practical recommendations on how to use narrative animations in interaction effectively.

A randomized controlled trial to test efficacy of digital enhancements of storybooks in support of narrative comprehension and word learning

Experiments with film-like story presentations have been found to be beneficial in supporting children's story comprehension and word learning. The main goal of the current study was to disentangle the effects of visual and auditory enhancements in digital books. Participants were 99 typically developing children (41 boys and 58 girls) aged 4-6 years from two public kindergartens in Bursa, Turkey. A randomized controlled trial was conducted with a control group and four experimental conditions that included all possible combinations: static illustrations with and without music/sounds and animated illustrations with and without music/sounds. In each experimental condition, children read two different storybooks twice, each time in small group sessions of 2 or 3 children. The posttest included, apart from story comprehension, expressive and receptive vocabulary tests of book-based words. Story comprehension, not word learning, benefited from visual enhancements in digital books. Music and background sounds did not stimulate story comprehension and even had a negative effect on receptive vocabulary. To explain the findings, we refer to multimedia learning principles such as temporal contiguity. Consequences for a digital storybook format are discussed.

How pictures in picture storybooks support young children's story comprehension: An eye-tracking experiment

In a within-participant design, 41 children (mean age = 64 months, range = 50-81) listened to brief stories in four conditions. Written text was present on the screen in all conditions (similar to the typical storybook experience) but combined with other sources of information: (a) only oral narration, (b) oral narration and a picture that was congruent with the narration, (c) oral narration and an incongruent picture, and (d) only a picture but no oral narration. Children's eye movements while looking at the screen were recorded with an eye-tracker. An important finding was that a congruent picture contributed substantially to children's story retellings, more so than a picture that was incongruent with the narration. The eye-tracking data showed that children explored pictures in a way that they could maximally integrate the narration and the picture. Consequences for interactive reading and picture storybook format are discussed.