Uncovering cognitive processes: Different techniques that can contribute to cognitive load research and instruction

Teaching through their eyes: effects on optometry teachers' adaptivity and students' learning when teachers see students' gaze

Adaptive teacher support fosters effective learning in one-to-one teaching sessions, which are a common way of learning complex visual tasks in the health sciences. Adaptive support is tailored to student needs, and this is difficult in complex visual tasks as visual problem-solving processes are covert and thus cannot be directly observed by the teacher. Eye-tracking apparatus can measure covert processes and make them visible in gaze displays: visualizations of where a student looks while executing a task. We investigate whether live dynamic gaze displays help teachers in being more adaptive to students' needs when teaching optical coherence tomography interpretation in one-to-one teaching sessions and whether this fosters learning. Forty-nine students and 10 teachers participated in a one-to-one teaching session in clinical optometry. In the control condition, teachers saw the learning task of the student and could discuss it with them, whereas in the gaze-display condition, teachers could additionally see where the student looked. After the 15-minute teaching session, a test was administered to examine achievement. Furthermore, students filled in the 'questionnaire on teacher support adaptivity', and teachers rated how adaptive their support was. Bayesian analyses provide some initial evidence that students did not experience support to be more adaptive in the gaze-display condition versus the control condition, nor were their post-test scores higher. Teachers rated their provided support as being more adaptive in the gaze-display versus the control condition. Further research could investigate if live dynamic gaze displays impact adaptive teaching when used over longer periods or with more teacher training.

Effect of Object on Kinesthetic Motor Imagery in Autism Spectrum Disorder: A Pilot Study Based on Eye-Tracking Methodology

Introduction

Social disturbance is a significant autism spectrum disorder (ASD) symptom. Action representation, which is a fundamental component of social interaction, can be investigated through kinesthetic motor imagery (KMI). KMI has been commonly studied with the well-developed laterality judgment paradigm, wherein participants are required to discriminate the laterality of a hand rotated by different angles along one or more axes. Here, we investigated the KMI processing in individuals with ASD by hand laterality judgment paradigm with eye-tracking methodology.

Methods

The current study included 22 participants with ASD and 22 typical developing (TD) peers matched for age, gender, and intelligence. Participants were asked to judge the laterality of hand-with-tooth brush images.

Results

Compared to the TD controls, individuals with ASD performed KMI with lower accuracy and longer response time in both correct and incorrect action conditions. The incorrect action representation had greater effect on KMI for individuals with ASD. Differences in eye-movement patterns were also observed, characterized by individuals with ASD were more focused on the object area while TD peers were more focused on the hand area.

Conclusion

Results suggest that while altered KMI performance was observed, the incorrect action representation elicited more engagement of KMI in both groups. The object-centered eye-movement pattern may contribute to the refine of motor simulation intervention for individuals with ASD.

How problem difficulty and order influence programming education outcomes in online judge systems

With the widespread application of computer technology in engineering education, Online Judge (OJ) systems have become an important platform for programming teaching. OJ systems provide a platform for learners to practice programming skills, submit solutions, and receive feedback. They offer a conducive environment for learners to engage in hands-on coding exercises and enhance their programming abilities. This article explores the use of OJ systems as a software tool for enhancing programming education in engineering. It investigates how the difficulty and order of programming problems affect the users' behavior, performance, and cognitive load in OJ environments. The research data were sourced from Project_CodeNet. Using statistical methods, such as Spearman correlation analysis and differential analysis, the study reveals the factors that influence the users' submission situations, answer order, and learning outcomes. The findings provide useful implications for OJ system developers, teachers, and learners in designing, implementing, and using OJ systems for programming education in engineering. The study suggests that problem difficulty and order should be considered and adjusted according to the users' abilities and progress, to provide appropriate challenges and support, balance the cognitive load, and improve the programming skills of the users.

Using pointing gestures to convey tactical information: investigating the roles of expertise and complexity

Coach's speech and pointing gestures are closely related. However, the question of whether the coach's pointing gestures influence the learning of complex game systems is still unclear. The present study examined the moderating roles of content complexity and expertise level on recall performance, visual attention, and mental effort through the coach's pointing gestures. One hundred and ninety-two novice and expert basketball players were randomly assigned to one of the four experimental conditions (simple content + no-gesture, simple content + with-gesture, more complex content + no-gesture, or more complex content + with-gesture). The results showed that regardless of the complexity of the content, novices showed significantly better recall performance, better visual search on the static diagrams and lower mental effort in the with-gesture condition than in the no-gesture condition. However, the results showed that experts benefited equally from both conditions (with-gesture and no-gestures) when the content was simple, whereas they benefited more from the condition with-gesture when the content was more complex. The findings and their implications for the design of learning materials are discussed in terms of cognitive load theory.

Did You Get That? Predicting Learners' Comprehension of a Video Lecture from Visualizations of Their Gaze Data

In online lectures, unlike in face-to-face lectures, teachers lack access to (nonverbal) cues to check if their students are still "with them" and comprehend the lecture. The increasing availability of low-cost eye-trackers provides a promising solution. These devices measure unobtrusively where students look and can visualize these data to teachers. These visualizations might inform teachers about students' level of "with-me-ness" (i.e., do students look at the information that the teacher is currently talking about) and comprehension of the lecture, provided that (1) gaze measures of "with-me-ness" are related to comprehension, (2) people not trained in eye-tracking can predict students' comprehension from gaze visualizations, (3) we understand how different visualization techniques impact this prediction. We addressed these issues in two studies. In Study 1, 36 students watched a video lecture while being eye-tracked. The extent to which students looked at relevant information and the extent to which they looked at the same location as the teacher both correlated with students' comprehension (score on an open question) of the lecture. In Study 2, 50 participants watched visualizations of students' gaze (from Study 1), using six visualization techniques (dynamic and static versions of scanpaths, heatmaps, and focus maps) and were asked to predict students' posttest performance and to rate their ease of prediction. We found that people can use gaze visualizations to predict learners' comprehension above chance level, with minor differences between visualization techniques. Further research should investigate if teachers can act on the information provided by gaze visualizations and thereby improve students' learning.

Feigned ADHD Associated Cognitive Impairment: Utility of Integrating an Eye-tracker and the MOXO-dCPT

OBJECTIVE

The current study assessed the utility of eye-movements measures, gathered while participants performed a commercially available Continuous Performance Test (CPT), to detect feigned ADHD-associated cognitive impairment.

METHOD

Healthy simulators (n = 37), ADHD patients (n = 33), and healthy controls (n = 36) performed an eye-tracker integrated MOXO-dCPT and a stand-alone validity indicator.

RESULTS

Simulators gazed significantly longer at regions that were irrelevant for successful MOXO-dCPT performance compared to ADHD patients and healthy controls. This eye-movement measure, however, had lower sensitivity than traditional MOXO-dCPT indices.

DISCUSSION

Gaze direction measures, gathered while performing a CPT, show initial promise as validity indicators. Traditional CPT measures, however, are more sensitive and therefore offer a more promising path for the establishment of CPT-based validity indicators. The current study is an initial exploration of the issue and further evaluation of both theoretical and practical aspects is mandated.

Thinking aloud on the road: Thematic differences in the experiences of drivers, cyclists, and motorcyclists

This study takes a qualitative approach to exploring the experiences (and differences therein) of individuals using either their car, bicycle, or motorcycle to navigate a ∼10.5 km urban route in a provincial UK city, with the aim of contributing to our understanding of the needs and requirements of different road users. Forty-six individuals provided concurrent verbal reports, using the 'think aloud' method, whilst using their vehicle to navigate the test route, the transcripts of which were subjected to a theory-agnostic, inductive, thematic analysis. A number of group differences were observed, revealing (among other factors) the importance of road surface quality to cyclists, the focus on vigilant observation in motorcyclists, and the heightened emotionality experienced by both two-wheeled groups, particularly those on bicycles. This affective component has, as yet, been under-explored in the academic domain and under-utilised in road transport policy and strategy; this is discussed, with attention drawn to the cyclists' greater tendency to make negatively valenced value judgements. Results are also discussed in terms of the potential to improve road users' experiences, foster inter-group empathy and understanding, and encourage a shift in mobility towards more sustainable modes.

Investigating professed and enacted epistemic beliefs about the uncertainty of scientific knowledge when students evaluate scientific controversies

Prior research on epistemic beliefs, that is, individuals’ views about knowledge and knowing, has mainly focused either on individuals’ professed beliefs (as reported in questionnaires) or on their enacted beliefs (as indicated during task processing). However, little is known about the relation between professed and enacted epistemic beliefs. The present study focused on beliefs about the uncertainty of scientific knowledge and investigated both professed and enacted beliefs in the context of evaluations of scientific controversies. Participants were N = 79 university students who first completed a questionnaire that targeted their professed uncertainty beliefs about scientific knowledge. Then, approximately 1 week later, they completed a standardized test in which they evaluated five scientific controversies. Cued retrospective verbal reports were used to measure their enacted uncertainty beliefs while taking the test. Results revealed that professed and enacted uncertainty beliefs were interrelated and that both variables predicted individuals’ performance with regard to the evaluation of scientific controversies. Furthermore, the effect of professed uncertainty beliefs on controversy-evaluation performance was partly mediated by enacted uncertainty beliefs. The findings of the present study point toward novel theoretical insights and educational implications regarding the relations between professed and enacted beliefs about the uncertainty of scientific knowledge and their role in individuals’ evaluation of scientific controversies.

Effects of map design characteristics on users’ search performance and cognitive load

Purpose

This paper aims to investigate the influence of map design characteristics on users’ cognitive load and search performance. Two design conditions (symbolic vs non-symbolic) were used to evaluate users’ ability to locate a place of interest.

Design/methodology/approach

A total of 19 students (10 male and 9 female, 20-23 years old) participated in this study. The time required for subjects to find a place in the two conditions was used to estimate their searching performance. An electroencephalogram (EEG) device was used to examine students’ cognitive load using event-related desynchronization percentages of alpha, beta and theta brain wave rhythms.

Findings

The results showed that subjects needed more time to find a place in the non-symbolic condition than the symbolic condition. The EEG data, however, revealed that users experienced higher cognitive load when searching for a place in the symbolic condition. The authors found that the design characteristics of the map significantly influenced users’ brain activity, thus impacting their search performance.

Originality/value

Outcomes from this study can be used by cartographic designers and scholars to understand how certain design characteristics can trigger cognitive activity to improve users' searching experience and efficiency.

Navigation in Indoor Environments: Does the Type of Visual Learning Stimulus Matter?

This work addresses the impact of a geovisualization’s level of realism on a user’s experience in indoor navigation. The key part of the work is a user study in which participants navigated along a designated evacuation route previously learnt in a virtual tour or traditional 2D floor plan. The efficiency and effectiveness of completing the task was measured by the number of incorrect turns during navigation and completion time. The complexity of mental spatial representations that participants developed before and after navigating the route was also evaluated. The data was obtained using several qualitative and quantitative research methods (mobile eye tracking, structured interviews, sketching of cognitive maps, creation of navigation instructions, and additional questions to evaluate spatial orientation abilities). A total of 36 subjects (17 in the “floor plan” group and 19 in the “virtual tour” group) participated in the study. The results showed that the participants from both groups were able to finish the designated navigation route, but more detailed mental spatial representations were developed by the “virtual tour” group than the “floor plan” group. The participants in the virtual tour group created richer navigation instructions both before and after evacuation, mentioned more landmarks and could recall their characteristics. Visual landmark characteristics available in the virtual tour also seemed to support the correct decision-making.

Eye tracking as a mean to detect feigned cognitive impairment in the word memory test

Eye movements showed initial promise for the detection of deception and may be harder to consciously manipulate than conventional accuracy measures. Therefore, we integrated an eye-tracker with the Word Memory Test (WMT) and tested its usefulness for the detection of feigned cognitive impairment. As part of the study, simulators (n = 44) and honest controls (n = 41) performed WMT's immediate-recognition (IR) subtest while their eye movements were recorded. In comparison to the control group, simulators spent less time gazing at relevant stimuli, spent more time gazing at irrelevant stimuli, and had a lower saccade rate. Group classification using a scale that combined the eye movement measures and the WMT's accuracy measure showed tentative promise (i.e., it enhanced classification compared to the use of the accuracy measure as the sole predictor of group membership). Overall, integration of an eye-tracker with the WMT was found to be feasible and the eye movement measures showed initial promise for the detection of feigned cognitive impairment. Moreover, eye movement measures proved useful in enhancing our understanding of strategies utilized by the simulators and the cognitive processes that affect their behavior. While the findings are clearly preliminary, we hope that they will encourage further research of these promising psychophysiological measures.

Detection-Response Task-Uses and Limitations

The Detection-Response Task is a method for assessing the attentional effects of cognitive load in a driving environment. Drivers are presented with a sensory stimulus every 3–5 s, and are asked to respond to it by pressing a button attached to their finger. Response times and hit rates are interpreted as indicators of the attentional effect of cognitive load. The stimuli can be visual, tactile and auditory, and are chosen based on the type of in-vehicle system or device that is being evaluated. Its biggest disadvantage is that the method itself also affects the driver’s performance and secondary task completion times. Nevertheless, this is an easy to use and implement method, which allows relevant assessment and evaluation of in-vehicle systems. By following the recommendations and taking into account its limitations, researchers can obtain reliable and valuable results on the attentional effects of cognitive load on drivers.

The challenges of studying visual expertise in medical image diagnosis

CONTEXT

Visual expertise is the superior visual skill shown when executing domain-specific visual tasks. Understanding visual expertise is important in order to understand how the interpretation of medical images may be best learned and taught. In the context of this article, we focus on the visual skill of medical image diagnosis and, more specifically, on the methodological set-ups routinely used in visual expertise research.

METHODS

We offer a critique of commonly used methods and propose three challenges for future research to open up new avenues for studying characteristics of visual expertise in medical image diagnosis. The first challenge addresses theory development. Novel prospects in modelling visual expertise can emerge when we reflect on cognitive and socio-cultural epistemologies in visual expertise research, when we engage in statistical validations of existing theoretical assumptions and when we include social and socio-cultural processes in expertise development. The second challenge addresses the recording and analysis of longitudinal data. If we assume that the development of expertise is a long-term phenomenon, then it follows that future research can engage in advanced statistical modelling of longitudinal expertise data that extends the routine use of cross-sectional material through, for example, animations and dynamic visualisations of developmental data. The third challenge addresses the combination of methods. Alternatives to current practices can integrate qualitative and quantitative approaches in mixed-method designs, embrace relevant yet underused data sources and understand the need for multidisciplinary research teams.

CONCLUSION

Embracing alternative epistemological and methodological approaches for studying visual expertise can lead to a more balanced and robust future for understanding superior visual skills in medical image diagnosis as well as other medical fields.

What does germane load mean? An empirical contribution to the cognitive load theory

While over the last decades, much attention has been paid to the mental workload in the field of human computer interactions, there is still a lack of consensus concerning the factors that generate it as well as the measurement methods that could reflect workload variations. Based on the multifactorial Cognitive Load Theory (CLT), our study aims to provide some food for thought about the subjective and objective measurement that can be used to disentangle the intrinsic, extraneous, and germane load. The purpose is to provide insight into the way cognitive load can explain how users' cognitive resources are allocated in the use of hypermedia, such as an online newspaper. A two-phase experiment has been conducted on the information retention from online news stories. Phase 1 (92 participants) examined the influence of multimedia content on performance as well as the relationships between cognitive loads and cognitive absorption. In Phase 2 (36 participants), eye-tracking data were collected in order to provide reliable and objective measures. Results confirmed that performance in information retention was impacted by the presence of multimedia content such as animations and pictures. The higher number of fixations on these animations suggests that users' attention could have been attracted by them. Results showed the expected opposite relationships between germane and extraneous load, a positive association between germane load and cognitive absorption and a non-linear association between intrinsic and germane load. The trends based on eye-tracking data analysis provide some interesting findings about the relationship between longer fixations, shorter saccades and cognitive load. Some issues are raised about the respective contribution of mean pupil diameter and Index of Cognitive Activity.

Believing is seeing: fixation duration predicts implicit negative attitudes

A prototypical finding of social cognition is that social experiences influence later performance even though those experiences are not introspectively available. Building on social cognition research on implicit attitudes, we evaluate whether ethnic category/attribute pairs influence eye movements during the Implicit Association Test (IAT, Greenwald, McGhee, & Schwartz 1998). Results show that fixation duration predicted implicit attitudes such that when the category/attribute pairs disconfirmed one's implicit negative attitude fixation duration toward that pair increased. The present research provides evidence that eye movements and implicit processes inherent in the IAT are more broadly connected than previously thought.

Prior knowledge in learning from a non-linear electronic document: Disorientation and coherence of the reading sequences

A study was carried out to investigate the effects of prior knowledge on learning with a non-linear electronic document including an interactive conceptual map. Cognitive Load Theory was used as theoretical framework to investigate effects on cognitive load and disorientation in learning from non-linear documents. Forty-four future high school biology teachers were required to learn the multiplication cycle of a virus from either a hierarchical structure (organisational links) or a network structure (relational links). For the low prior knowledge learners, the results showed that the hierarchical structure supported better free recall performance and reduced feelings of disorientation. In contrast, the high prior knowledge learners performed better and followed more coherent reading sequences in the network structure. However, no interaction effect between prior knowledge and the type of structure was observed on mental effort and disorientation ratings. The results and the construct of disorientation are discussed in light of the processing demands in non-linear documents.