Editors’ Introduction and Review: Visual Narrative Research: An Emerging Field in Cognitive Science

A tutorial: self-created film as a semiotic resource in AAC

Sharing personal stories with others is essential to human interaction and language development. To communicate, individuals use a variety of semiotic resources, including images, symbols, and written and spoken language. These modes are deployed in the co-construction of a daily face-to-face conversation. A self-created film can serve as a valuable resource to facilitate a deeper understanding of a personal experience, especially where spoken or written language may present a challenge, for example, for people who rely on augmentative and alternative communication (AAC). Although the AAC literature indicates that using videos delivers benefits for aided communicators, guidelines on how to self-create, use, and transcribe them are rare. The present paper, a tutorial, describes how people who use AAC can develop a personal-video-scene (PVS) via the Film as Observable Communication (FaOC) method to utilize self-created films in sharing their stories. The first part of this paper, the theoretical framework, describes theories, methods, and practices from the fields of AAC, social semiotics, and visual anthropology, on which the FaOC method is based. The second part provides a step-by-step tutorial delivering practical guidance on how to create, use, and transcribe the PVS as a resource in conversations.

Guidelines to support the design, and selection and appraisal of multimedia teaching aids for microbiology education

Microbiology education has a serious handicap - the lack of visibility of the players of the subject and their interactions - which engenders a disproportionate reliance upon multimedia teaching aids (MTAs). The International Microbiology Literacy Initiative (IMiLI) is creating educational resources in societally-relevant microbiology complemented by appropriate MTAs. However, proper guidance supporting microbiology educators in locating and selecting, or commissioning the creation of, adequate MTAs for different target audiences and learning objectives is lacking. The aims of this study were to (i) identify important considerations regarding educational/didactical standards and the design of educational multimedia and (ii) create an evidence-based guideline for selecting and appraising existing, and informing the creation of new, microbiology MTAs. This investigation is based on an exploratory, mixed-methods approach. The results of two literature reviews (covering educational and good practice multimedia design) informed the collation of a preliminary appraisal guideline for videos, animations, comics, and video games. A web-scraping approach was utilised to locate and retrieve existing exemplars of the four multimedia types and create four pertinent multimedia databases (including metadata). The preliminary guideline was piloted (and revised accordingly) by appraising quasi-random (or purposive) samples of each multimedia type. Educational multimedia experts were interviewed to discuss the findings. Finally, the guideline was updated to reflect the expert comments together with the results of the pilot appraisals. The final guideline has four components: (i) central considerations for selecting and appraising multimedia for specific audiences and educational purposes, (ii) multimedia selection tool, (iii) multimedia appraisal tools, and (iv) extensive background information as appendices linking all sections for further comprehension. Broad utilisation of the guideline has significant potential for simplifying and systematising multimedia selection/creation, leading to superior multimedia-based learning outcomes, establishing a rapid selection database (pre-appraised multimedia), reducing disparities in microbiology education and incentivising educational content creators.

Anaphoric distance dependencies in visual narrative structure and processing

Linguistic syntax has often been claimed as uniquely complex due to features like anaphoric relations and distance dependencies. However, visual narratives of sequential images, like those in comics, have been argued to use sequencing mechanisms analogous to those in language. These narrative structures include "refiner" panels that "zoom in" on the contents of another panel. Similar to anaphora in language, refiners indexically connect inexplicit referential information in one unit (refiner, pronoun) to a more informative "antecedent" elsewhere in the discourse. Also like in language, refiners can follow their antecedents (anaphoric) or precede them (cataphoric), along with having either proximal or distant connections. We here explore the constraints on visual narrative refiners created by modulating these features of order and distance. Experiment 1 examined participants' preferences for where refiners are placed in a sequence using a force-choice test, which revealed that refiners are preferred to follow their antecedents and have proximal distances from them. Experiment 2 then showed that distance dependencies lead to slower self-paced viewing times. Finally, measurements of event-related brain potentials (ERPs) in Experiment 3 revealed that these patterns evoke similar brain responses as referential dependencies in language (i.e., N400, LAN, Nref). Across all three studies, the constraints and (neuro)cognitive responses to refiners parallel those shown to anaphora in language, suggesting domain-general constraints on the sequencing of referential dependencies.

Experiences of mental health support workers in mental healthcare practice: Three visual arts narratives

WHAT IS KNOWN ON THE SUBJECT?: Mental health support workers (MHSWs) are frequently employed in mental health services in order to augment and diversify the workforce and to promote recovery centred care Research shows that while MHSWs positively support service user mental health recovery, these roles are often unclear or not well understood by MHSWs and other mental health practitioners WHAT THE PAPER ADDS TO EXISTING KNOWLEDGE?: Through arts-based research methods, three MHSWs communicated their personal vulnerabilities and anxieties in supporting others with mental health issues; these insights are rarely presented in mental health research. MHSW experiences of not having recovery-oriented expertise recognized or valued by healthcare team were powerfully conveyed through arts narrative. These findings promote recognition of the strengths and contributions of MHSWs to mental health practice. Arts-based inquiry is a means of providing additional depth to what is already known and contributes novel insights regarding the occupational experiences and perceptions of MHSWs. WHAT ARE THE IMPLICATIONS FOR PRACTICE?: Mental health nurses and healthcare teams need to engage fully with recovery-oriented principles acknowledging the vulnerabilities of all practitioners and establishing adequate supervision and support. There needs to be greater clarity concerning roles/scope of practice for MHSWs to enable productive working partnerships in mental health teams. This can be achieved through open communication, education and planning among the wider mental healthcare team. ABSTRACT: Introduction Mental health support workers (MHSWs) make positive contributions to mental health recovery practice yet their roles and support needs are often unclear. This research explored the occupational lived experiences of three MHSWs working in Irish mental healthcare services. Aim The study examined the experiences and perceptions of MHSWs regarding their mental health recovery work. Method A narrative design was used incorporating participatory art-based inquiry as a collaborative means of engaging participants. This innovative methodology enabled exploration and evocative expression of participants' occupational experiences and stories. Results Participants revealed feelings of vulnerability and anxiety regarding personal mental health and supporting the mental health of others; a finding not commonly explored in previous research. MHSW skills and knowledge were evident; however, this expertise and recovery focus was not valued in mental health services. Discussion The strengths and challenges of MHSW engagement in service provision are discussed. Interdisciplinary team integration is explored in terms of contrasting recovery philosophies, practitioner vulnerability and professional demands and imperatives. Implications for practice Mental health teams need to engage with recovery principles, acknowledging strengths and vulnerabilities of all practitioners and establishing adequate supervision and support. Greater clarity and education is required concerning roles/scope of practice for MHSWs to enable productive interdisciplinary partnerships.

Educational Psychology Is Evolving to Accommodate Technology, Multiple Disciplines, and Twenty-First-Century Skills

This article covers recent research activities in educational psychology that have an interdisciplinary emphasis and that accommodate twenty-first-century skills in addition to the traditional foundations of literacy, numeracy, science, reasoning (problem-solving), and academic subject matter. We emphasize digital technologies because they are capable of tracking learning data in rich detail and reliably delivering interventions that are tailored to individual learners in particular sociocultural contexts. This is a departure from inflexible pedagogical approaches that previously have been routinely adopted in most classrooms and other contexts of instruction with no precise record of learning and instructional activities. A good design of educational technology embraces the principles of learning science, identifies the basic types of learning that are needed, implements relevant technological affordances, and accommodates feedback from different stakeholders. This article covers research in literacy, collaborative problem-solving, motivation, emotion, and science, technology, engineering, and mathematics (STEM) areas. Expected final online publication date for the Annual Review of Psychology, Volume 73 is January 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Coherence formation during narrative text processing: a comparison between auditory and audiovisual text presentation in 9- to 12-year-old children

In an experiment with 114 children aged 9-12 years, we compared the ability to establish local and global coherence of narrative texts between auditory and audiovisual (auditory text and pictures) presentation. The participants listened to a series of short narrative texts, in each of which a protagonist pursued a goal. Following each text, we collected the response time to a query word that was either associated with a near or a distant causal antecedent of the final sentence. Analysis of these response times indicated that audiovisual presentation has advantages over auditory presentation for accessing information relevant for establishing both local and global coherence, but there are indications that this effect may be slightly more pronounced for global coherence.

Narrative Skills in Primary School Children with Autism in Relation to Language and Nonverbal Temporal Sequencing

Recent research has suggested that temporal sequencing of narrative events might be a domain-general ability that underlies oral narrative capacities. The current study investigated this issue in a group of children with known pragmatic and narrative difficulties, namely Autism Spectrum Disorder (ASD). We hypothesized (1) that children with ASD (n = 45) would retell narratives of poorer quality than both chronological age-matched (CAM) children and younger children matched on sentence-level language skills (LM), and (2) that nonverbal temporal sequencing skills would uniquely predict individual differences in oral narrative performance in children with ASD. The results show that children with ASD performed poorer on all measures of oral narrative quality compared with the CAM group, and on eight of ten measures compared with the LM group. Thus, our first hypothesis was confirmed, suggesting that narrative difficulties in ASD cannot be fully explained by impaired language. The second hypothesis was only partly confirmed: nonverbal temporal sequencing explained significant or marginally significant variance in some, but not all, aspects of oral narrative performance of children with ASD. These results are discussed from theoretical and clinical/educational perspectives, in relation to the heterogeneity of language skills in ASD and to domain-general features of narrative processing.

Editors’ Introduction and Review: Visual Narrative Research: An Emerging Field in Cognitive Science

Drawn sequences of images are among our oldest records of human intelligence, appearing on cave paintings, wall carvings, and ancient pottery, and they pervade across cultures from instruction manuals to comics. They also appear prevalently as stimuli across Cognitive Science, for studies of temporal cognition, event structure, social cognition, discourse, and basic intelligence. Yet, despite this fundamental place in human expression and research on cognition, the study of visual narratives themselves has only recently gained traction in Cognitive Science. This work has suggested that visual narrative comprehension requires cultural exposure across a developmental trajectory and engages with domain‐general processing mechanisms shared by visual perception, attention, event cognition, and language, among others. Here, we review the relevance of such research for the broader Cognitive Science community, and make the case for why researchers should join the scholarship of this ubiquitous but understudied aspect of human expression.

Drawn sequences of images, like those in comics and picture stories, are a pervasive and fundamental way that humans have communicated for millennia. Yet, the study of visual narratives has only recently gained traction in Cognitive Science. Here we explore what has held back the study of the cognition of visual narratives, and why researchers should join in scholarship of this ubiquitous aspect of expression.