Contingent computer interactions for young children's object retrieval success

Effects of screen exposure on young children's cognitive development: A review

The past decade has witnessed a rapid increase in the use of screen media in families, and infants are exposed to screens at younger ages than ever before. The objective of this review is twofold: (1) to understand the correlates and demographic factors determining exposure to screens, including interactive screens, when available, and (2) to study the effects of watching screens and using touchscreens on cognitive development, during the first 3 years of life. We argue that the effects of screen viewing depend mostly on contextual aspects of the viewing rather than on the quantity of viewing. That context includes the behavior of adult caregivers during viewing, the watched content in relation to the child's age, the interactivity of the screen and whether the screen is in the background or not. Depending on the context, screen viewing can have positive, neutral or negative effects on infants' cognition.

Infant media use: A harm reduction approach

There are a myriad of potentially harmful developmental outcomes associated with infant digital media use. Studies revealing risk associated with early media use have informed the current American Academy of Pediatrics (AAP) recommendations that discourage most digital media use among children under 18 months of age. Recent research advances, however, suggest potential benefits of technology engagement in this age group. Additionally, surveys of parents reveal that most infants engage with digital media for at least 30 min a day, exceeding the AAP recommendations. In response to these discoveries and cultural trends, some scholars have made compelling cases to adapt the AAP guidelines for infants. A helpful model for developing infant digital media use guidelines for families may be the harm reduction approach. The intent of this review is to suggest adaptations to the AAP guidelines for infant media engagement using a harm reduction framework. This review describes the challenge of restrictive guidelines, briefly summarizes the harm reduction approach, provides a review of risks and benefits associated with infant media use in each developmental domain (physical, cognitive, and socioemotional), summarizes correlates of infant screen media use, and examines intervention strategies for reducing screen time. The paper concludes with examples of possible adaptations to current AAP infant media use recommendations using harm reduction and bioecological frameworks.

The origins of touchscreen competence: Examining infants' exploration of touchscreens

Infants' exposure to images presented on screens is increasing with the accelerating use of technology in society and at home. Touchscreen technology provides numerous interactive screen opportunities geared toward infants and toddlers. Touchscreens are unique in that they possess the 2D qualities of a picture, but a set of manipulation possibilities similar to, but distinct from, a 3D object. Research comparing infants' manual exploration of photographs, objects, and screen images has demonstrated that although 7-10-month-old infants direct different actions towards 3D objects, their exploration of screen images does not differ significantly from their exploration of 2D photographs (Ziemer & Snyder, 2016). The current investigation compares the ways in which 7-10-month-old infants and 15-18-month-old infants manually explore screen images, photographs, and objects. Infants in the older age group were shown examples of objects, photographs, and screen images presented within a well in a table with a Plexiglas® cover to create identical tactile feedback. Coders noted the presence or absence of appropriate actions displayed toward the various surfaces. Results were compared to data collected earlier (Ziemer & Snyder, 2016) to demonstrate the evolution of touchscreen competence across the first years of infant development. By 15-18 months, infants demonstrate an emerging repertoire of touchscreen-appropriate behaviors directed towards touchscreens that is not demonstrated by 7-10-month-old infants. Differences in haptic exploration suggest the beginnings of a touchscreen competence that enables infants to understand and interact with touchscreens in a new way.

Examining joint parent-child interactions involving infants and toddlers when introducing mobile technology

Research suggests that parents play a critical role in introducing technology to their young children and that parent-child joint engagement with technology can improve learning and social outcomes. The present mixed-methods study extends the current literature by directly observing the interactions of 30 parents with their infant or toddler child (ages 12-24 months) while introducing and engaging with familiar and novel mobile technologies. Qualitative analysis of observations yielded five overarching themes that described key content of parent-child interactions. Subthemes further clarified the types of verbal interactions of the child and of the parent, as well as issues of control over the device, activities and selection choices, skill needs/supports, and interest in the interactions. Developmental milestones and parental surveys contributed to the understanding of developmental change and family media use. Familiarity with the device influenced frequencies of identified themes with greater likelihood for fewer interactions, scaffolds and more passive screen activities with familiar technology. More varied verbal scaffolding was related to higher developmental scores. Physical scaffolding was provided infrequently, despite limited skill in the children. Counter to parental expectations, initiating and sustaining interest even for a short period of time was challenging in some cases. Outcomes suggest that parents engage in a wide array of relevant scaffolds with variability across individuals and child age. Overall, the study provides a rich and complex description of interactions and behaviors when parents introduce mobile devices to their infants and toddlers.

Touchscreens for Whom? Working Memory and Age Moderate the Impact of Contingency on Toddlers' Transfer From Video

Toddlers exhibit poor transfer between video and real-world contexts. Contingently responsive video such as that found in touchscreen apps appears to assist transfer for some toddlers but not others. This study investigated the extent to which toddlers' working memory moderates the impact of contingency on toddler's transfer of learning from video. Toddlers (24–36 months; N = 134) watched a hiding event on either (a) contingent video that advanced only after touch input or (b) non-contingent video that proceeded automatically. Toddlers then searched for a corresponding object on a felt board. Additionally, toddlers' working memory (WM) was assessed. Findings indicate WM and age moderated the impact of contingency on transfer: Contingency decreased transfer in younger children while increasing transfer among older children. However, this was only true for children with relatively low WM. Contingency had little impact on transfer among children with relatively high WM, regardless of age. Results from this study suggest that WM is one specific moderator that predicts whether toddlers are likely to learn from contingent vs. non-contingent video, yet WM does not operate in isolation. Together, these findings underscore the importance of considering multiple child characteristics when identifying the optimal conditions for toddlers' learning from symbolic media.

Word learning from a tablet app: Toddlers perform better in a passive context

In recent years, the popularity of tablets has skyrocketed and there has been an explosive growth in apps designed for children. Howhever, many of these apps are released without tests for their effectiveness. This is worrying given that the factors influencing children's learning from touchscreen devices need to be examined in detail. In particular, it has been suggested that children learn less from passive video viewing relative to equivalent live interaction, which would have implications for learning from such digital tools. However, this so-called video deficit may be reduced by allowing children greater influence over their learning environment. Across two touchscreen-based experiments, we examined whether 2- to 4-year-olds benefit from actively choosing what to learn more about in a digital word learning task. We designed a tablet study in which "active" participants were allowed to choose which objects they were taught the label of, while yoked "passive" participants were presented with the objects chosen by their active peers. We then examined recognition of the learned associations across different tasks. In Experiment 1, children in the passive condition outperformed those in the active condition (n = 130). While Experiment 2 replicated these findings in a new group of Malay-speaking children (n = 32), there were no differences in children's learning or recognition of the novel word-object associations using a more implicit looking time measure. These results suggest that there may be performance costs associated with active tasks designed as in the current study, and at the very least, there may not always be systematic benefits associated with active learning in touchscreen-based word learning tasks. The current studies add to the evidence that educational apps need to be evaluated before release: While children might benefit from interactive apps under certain conditions, task design and requirements need to consider factors that may detract from successful performance.

Preschoolers Benefit Equally From Video Chat, Pseudo-Contingent Video, and Live Book Reading: Implications for Storytime During the Coronavirus Pandemic and Beyond

During the unprecedented coronavirus disease (COVID-19) crisis, virtual education activities have become more prevalent than ever. One activity that many families have incorporated into their routines while at home is virtual storytime, with teachers, grandparents, and other remote adults reading books to children over video chat. The current study asks how dialogic reading over video chat compares to more traditional forms of book reading in promoting story comprehension and vocabulary learning. Fifty-eight 4-year-olds (M age = 52.7, SD = 4.04, 31 girls) were randomly assigned to one of three conditions (Video chat, Live, and Prerecorded). Across conditions, children were read the same narrative storybook by a female experimenter who used the same 10 scripted dialogic reading prompts during book reading. In the Video chat (n = 21) and Live conditions (n = 18), the experimenter gave the scripted prompts and interacted naturally and contingently, responding in a timely, relevant manner to children's behaviors. In the Prerecorded condition (n = 19), children viewed a video of an experimenter reading the book. The Prerecorded condition was pseudo-contingent; the reader posed questions and paused for a set period of time as if to wait for a child's response. After reading, children completed measures of vocabulary and comprehension. Results revealed no differences between conditions across six different outcome measures, suggesting that children comprehended and learned from the story similarly across book formats. Further, children in the three experimental conditions scored significantly higher on measures than children in a fourth condition (control) who had never read the book, confirming that children learned from the three different book formats. However, children were more responsive to the prompts in the Live and Video chat conditions than the Prerecorded condition, suggesting that children recognized that these interactions were contingent with their responses, a feature that was lacking in the Prerecorded condition. Results indicate that children can comprehend books over video chat, suggesting that this technology is a viable option for reading to children, especially during the current pandemic.

Mirror, Peephole and Video - The Role of Contiguity in Children's Perception of Reference in Iconic Signs

The present study looked at the extent to which 2-year-old children benefited from information conveyed by viewing a hiding event through an opening in a cardboard screen, seeing it as live video, as pre-recorded video, or by way of a mirror. Being encouraged to find the hidden object by selecting one out of two cups, the children successfully picked the baited cup significantly more often when they had viewed the hiding through the opening, or in live video, than when they viewed it in pre-recorded video, or by way of a mirror. All conditions rely on the perception of similarity. The study suggests, however, that contiguity – i.e., the perception of temporal and physical closeness between events – rather than similarity is the principal factor accounting for the results.

Young Children's Mathematical Learning From Intelligent Characters

Children’s math learning (N = 217; M_age = 4.87 years; 63% European American, 96% college‐educated families) from an intelligent character game was examined via social meaningfulness (parasocial relationships [PSRs]) and social contingency (parasocial interactions, e.g., math talk). In three studies (data collected in the DC area: 12/2015–10/2017), children’s parasocial relationships and math talk with the intelligent character predicted quicker, more accurate math responses during virtual game play. Children performed better on a math transfer task with physical objects when exposed to an embodied character (Study 2), and when the character used socially contingent replies, which was mediated by math talk (Study 3). Results suggest that children’s parasocial relationships and parasocial interactions with intelligent characters provide new frontiers for 21st century learning.

When Representation Becomes Reality: Interactive Digital Media and Symbolic Development

One challenge of using an interesting object such as a scale model as a symbol for something else is children's deep interest in the object itself. Attending to the model (the symbol) as a toy, children do not use information about where in the model a tiny dog is hiding to mentally represent where a larger dog is hiding in the full-sized room (the referent). Young children use pictures in this way because they are relatively uninteresting as objects. Today, interactive images on touchscreens function as virtual objects on which to act and which respond to the user's actions. In this chapter, we examine how interactive symbolic media (e.g., touchscreens, video chat, augmented reality) might affect children's symbolic development and the way that psychologists think about representational objects. Young children's learning about and from interactive media may depend upon adults scaffolding children's use of these new cultural tools.

Two are better than one: Infant language learning from video improves in the presence of peers

Studies show that young children learn new phonemes and words from humans significantly better than from machines. However, it is not clear why learning from video is ineffective or what might be done to improve learning from a screen. The present study, conducted with 9-month-old infants, utilized a manipulation-touch screen video-which allowed infants to control presentations of foreign-language video clips. We tested the hypothesis that infant learning from a screen would be enhanced in the presence of a peer, as opposed to learning alone. Brain measures of phonetic learning and detailed analyses of interaction during learning confirm the hypothesis that social partners enhance learning, even from screens.

Co-viewing supports toddlers' word learning from contingent and noncontingent video

Social cues are one way young children determine that a situation is pedagogical in nature-containing information to be learned and generalized. However, some social cues (e.g., contingent gaze and responsiveness) are missing from prerecorded video, a potential reason why toddlers' language learning from video can be inefficient compared with their learning directly from a person. This study explored two methods for supporting children's word learning from video by adding social-communicative cues. A sample of 88 30-month-olds began their participation with a video training phase. In one manipulation, an on-screen actress responded contingently to children through a live video feed (similar to Skype or FaceTime "video chat") or appeared in a prerecorded demonstration. In the other manipulation, parents either modeled responsiveness to the actress's on-screen bids for participation or sat out of their children's view. Children then viewed a labeling demonstration on video, and their knowledge of the label was tested with three-dimensional objects. Results indicated that both on-screen contingency and parent modeling increased children's engagement with the actress during training. However, only parent modeling increased children's subsequent word learning, perhaps by revealing the symbolic (representational) intentions underlying this video. This study highlights the importance of adult co-viewing in helping toddlers to interpret communicative cues from video.

All Tapped Out: Touchscreen Interactivity and Young Children's Word Learning

Touchscreen devices differ from passive screen media in promoting physical interaction with events on the screen. Two studies examined how young children's screen-directed actions related to self-regulation (Study 1) and word learning (Study 2). In Study 1, 30 2-year-old children's tapping behaviors during game play were related to their self-regulation, measured using Carlson's snack task: girls and children with high self-regulation tapped significantly less during instruction portions of an app (including object labeling events) than did boys and children with low self-regulation. Older preschoolers (N = 47, aged 4-6 years) tapped significantly less during instruction than 2-year-olds did. Study 2 explored whether the particular way in which 170 children (2-4 years of age) interacted with a touchscreen app affected their learning of novel object labels. Conditions in which children tapped or dragged a named object to move it across the screen required different amounts of effort and focus, compared to a non-interactive (watching) condition. Age by sex interactions revealed a particular benefit of dragging (a motorically challenging behavior) for preschool girls' learning compared to that of boys, especially for girls older than age 2. Boys benefited more from watching than dragging. Children from low socioeconomic status families learned more object names when dragging objects versus tapping them, possibly because tapping is a prepotent response that does not require thoughtful attention. Parents and industry experts should consider age, sex, self-regulation, and the physical requirements of children's engagement with touchscreens when designing and using educational content.

Children's Learning from Touch Screens: A Dual Representation Perspective

Parents and educators often expect that children will learn from touch screen devices, such as during joint e-book reading. Therefore an essential question is whether young children understand that the touch screen can be a symbolic medium – that entities represented on the touch screen can refer to entities in the real world. Research on symbolic development suggests that symbolic understanding requires that children develop dual representational abilities, meaning children need to appreciate that a symbol is an object in itself (i.e., picture of a dog) while also being a representation of something else (i.e., the real dog). Drawing on classic research on symbols and new research on children’s learning from touch screens, we offer the perspective that children’s ability to learn from the touch screen as a symbolic medium depends on the effect of interactivity on children’s developing dual representational abilities. Although previous research on dual representation suggests the interactive nature of the touch screen might make it difficult for young children to use as a symbolic medium, the unique interactive affordances may help alleviate this difficulty. More research needs to investigate how the interactivity of the touch screen affects children’s ability to connect the symbols on the screen to the real world. Given the interactive nature of the touch screen, researchers and educators should consider both the affordances of the touch screen as well as young children’s cognitive abilities when assessing whether young children can learn from it as a symbolic medium.

Young Children Learning from Touch Screens: Taking a Wider View

Touch screen devices such as smartphones and tablets are now ubiquitous in the lives of American children. These devices permit very young children to engage interactively in an intuitive fashion with actions as simple as touching, swiping and pinching. Yet, we know little about the role these devices play in very young children’s lives or their impact on early learning and development. Here we focus on two areas in which existing research sheds some light on these issues with children under 3 years of age. The first measures transfer of learning, or how well children use information learned from screens to reason about events off-screen, using object retrieval and word learning tasks. The second measures the impact of interactive screens on parent-child interactions and story comprehension during reading time. More research is required to clarify the pedagogical potential and pitfalls of touch screens for infants and very young children, especially research focused on capabilities unique to touch screens and on the social and cultural contexts in which young children use them.

Baby FaceTime: can toddlers learn from online video chat?

There is abundant evidence for the 'video deficit': children under 2 years old learn better in person than from video. We evaluated whether these findings applied to video chat by testing whether children aged 12-25 months could form relationships with and learn from on-screen partners. We manipulated social contingency: children experienced either real-time FaceTime conversations or pre-recorded Videos as the partner taught novel words, actions and patterns. Children were attentive and responsive in both conditions, but only children in the FaceTime group responded to the partner in a temporally synced manner. After one week, children in the FaceTime condition (but not the Video condition) preferred and recognized their Partner, learned more novel patterns, and the oldest children learned more novel words. Results extend previous studies to demonstrate that children under 2 years show social and cognitive learning from video chat because it retains social contingency. A video abstract of this article can be viewed at: https://youtu.be/rTXaAYd5adA.

Touch or Watch to Learn? Toddlers’ Object Retrieval Using Contingent and Noncontingent Video

The experiment reported here was designed to examine the effect of contingent interaction with touch-screen devices on toddlers’ use of symbolic media (video) during an object-retrieval task. Toddlers (24–36 months old; N = 75) were randomly assigned to watch an animated character hiding on screen either in a no-contingency video (requiring no action), a general-contingency video (accepting touch input anywhere on screen), or a specific-contingency video (requiring touch input on a particular area of interest). After the hiding event, toddlers searched for the character on a corresponding felt board. Across all trials, younger toddlers were more likely to search correctly after a specific-contingency video than after a no-contingency video, which suggests that contingent interaction designed to emphasize specific information on screen may promote learning. However, this effect was reversed for older toddlers. We interpret our findings with respect to the selective encoding of target features during hiding events and the relative strength of memory traces during search.

Putting Education in “Educational” Apps

Children are in the midst of a vast, unplanned experiment, surrounded by digital technologies that were not available but 5 years ago. At the apex of this boom is the introduction of applications (“apps”) for tablets and smartphones. However, there is simply not the time, money, or resources available to evaluate each app as it enters the market. Thus, “educational” apps—the number of which, as of January 2015, stood at 80,000 in Apple’s App Store (Apple, 2015)—are largely unregulated and untested. This article offers a way to define the potential educational impact of current and future apps. We build upon decades of work on the Science of Learning, which has examined how children learn best. From this work, we abstract a set of principles for two ultimate goals. First, we aim to guide researchers, educators, and designers in evidence-based app development. Second, by creating an evidence-based guide, we hope to set a new standard for evaluating and selecting the most effective existing children’s apps. In short, we will show how the design and use of educational apps aligns with known processes of children’s learning and development and offer a framework that can be used by parents and designers alike. Apps designed to promote active, engaged, meaningful, and socially interactive learning—four “pillars” of learning—within the context of a supported learning goal are considered educational.

An Attentional Goldilocks Effect: An Optimal Amount of Social Interactivity Promotes Word Learning from Video

Television can be a powerful education tool; however, content-makers must understand the factors that engage attention and promote learning from screen media. Prior research suggests that social engagement is critical for learning and that interactivity may enhance the educational quality of children's media. The present study examined the effects of increasing the social interactivity of television on children's visual attention and word learning. Three- to 5-year-old (M_Age = 4;5 years, SD = 9 months) children completed a task in which they viewed videos of an actress teaching them the Swahili label for an on-screen image. Each child viewed these video clips in four conditions that parametrically manipulated social engagement and interactivity. We then tested whether each child had successfully learned the Swahili labels. Though 5-year-old children were able to learn words in all conditions, we found that there was an optimal level of social engagement that best supported learning for all participants, defined by engaging the child but not distracting from word labeling. Our eye-tracking data indicated that children in this condition spent more time looking at the target image and less time looking at the actress's face as compared to the most interactive condition. These findings suggest that social interactivity is critical to engaging attention and promoting learning from screen media up until a certain point, after which social stimuli may draw attention away from target images and impair children's word learning.

Skype me! Socially contingent interactions help toddlers learn language

Language learning takes place in the context of social interactions, yet the mechanisms that render social interactions useful for learning language remain unclear. This study focuses on whether social contingency might support word learning. Toddlers aged 24-30 months (N = 36) were exposed to novel verbs in one of three conditions: live interaction training, socially contingent video training over video chat, and noncontingent video training (yoked video). Results suggest that children only learned novel verbs in socially contingent interactions (live interactions and video chat). This study highlights the importance of social contingency in interactions for language learning and informs the literature on learning through screen media as the first study to examine word learning through video chat technology.