An Effective Entropy-assisted Mind-wandering Detection System using EEG Signals of MM-SART Database

Exploring the Timing of Disengagement From Nondriving Related Tasks in Scheduled Takeovers With Pre-Alerts: An Analysis of Takeover-Related Measures

OBJECTIVES

This study aimed to investigate drivers' disengagement from nondriving related tasks (NDRT) during scheduled takeovers and to evaluate its impact on takeover performance.

BACKGROUND

During scheduled takeovers, drivers typically have sufficient time to prepare. However, inadequate disengagement from NDRTs can introduce safety risks.

METHOD

Participants experienced scheduled takeovers using a driving simulator, undergoing two conditions, with and without an NDRT. We assessed their takeover performance and monitored their NDRT disengagement from visual, cognitive, and physical perspectives.

RESULTS

The study examined three NDRT disengagement timings (DTs): DT1 (disengaged before the takeover request), DT2 (disengaged after the request but before taking over), and DT3 (not disengaged). The impact of NDRT on takeover performance varied depending on DTs. Specifically, DT1 demonstrated no adverse effects; DT2 impaired takeover time, while DT3 impaired both takeover time and quality. Additionally, participants who displayed DT1 exhibited longer eye-off-NDRT duration and a higher eye-off-NDRT count during the prewarning stage compared to those with DT2 and DT3.

CONCLUSION

Drivers can benefit from earlier disengagement from NDRTs, demonstrating resilience to the adverse effects of NDRTs on takeover performance. The disengagement of cognition is often delayed compared to that of eyes and hands, potentially leading to DT3. Moreover, visual disengagement from NDRTs during the prewarning stage could distinguish DT1 from the other two.

APPLICATION

Our study emphasizes considering NDRT disengagement in designing systems for scheduled takeovers. Measures should be taken to promote early disengagement, facilitate cognitive disengagement, and employ visual disengagement during the prewarning period as predictive indicators of DTs.

Electrophysiological functional connectivity and complexity reflecting cognitive processing speed heterogeneity in young children with ADHD

Early intervention is imperative for young children with attention-deficit/hyperactivity disorder (ADHD) who manifest heterogeneous neurocognitive deficits. The study investigated the functional connectivity and complexity of brain activity among young children with ADHD exhibiting a fast cognitive processing speed (ADHD-F, n = 26), with ADHD exhibiting a slow cognitive processing speed (ADHD-S, n = 17), and typically developing children (n = 35) using wireless electroencephalography (EEG) during rest and task conditions. During rest, compared with the typically developing group, the ADHD-F group displayed lower long-range intra-hemispheric connectivity, while the ADHD-S group had lower frontal beta inter-hemispheric connectivity. During task performance, the ADHD-S group displayed lower frontal beta inter-hemispheric connectivity than the typically developing group. The ADHD-S group had lower frontal inter-hemispheric connectivity in broader frequency bands than the ADHD-F group, indicating ADHD heterogeneity in mental processing speed. Regarding complexity, the ADHD-S group tended to show lower frontal entropy estimators than the typically developing group during the task condition. These findings suggest that the EEG profile of brain connectivity and complexity can aid the early clinical diagnosis of ADHD, support subgrouping young children with ADHD based on cognitive processing speed heterogeneity, and may contain specific novel neural biomarkers for early intervention planning.

Gaze-Based Detection of Thoughts across Naturalistic Tasks Using a PSO-Optimized Random Forest Algorithm

One key aspect of the human experience is our ongoing stream of thoughts. These thoughts can be broadly categorized into various dimensions, which are associated with different impacts on mood, well-being, and productivity. While the past literature has often identified eye movements associated with a specific thought dimension (task-relatedness) during experimental tasks, few studies have determined if these various thought dimensions can be classified by oculomotor activity during naturalistic tasks. Employing thought sampling, eye tracking, and machine learning, we assessed the classification of nine thought dimensions (task-relatedness, freely moving, stickiness, goal-directedness, internal-external orientation, self-orientation, others orientation, visual modality, and auditory modality) across seven multi-day recordings of seven participants during self-selected computer tasks. Our analyses were based on a total of 1715 thought probes across 63 h of recordings. Automated binary-class classification of the thought dimensions was based on statistical features extracted from eye movement measures, including fixation and saccades. These features all served as input into a random forest (RF) classifier, which was then improved with particle swarm optimization (PSO)-based selection of the best subset of features for classifier performance. The mean Matthews correlation coefficient (MCC) values from the PSO-based RF classifier across the thought dimensions ranged from 0.25 to 0.54, indicating above-chance level performance in all nine thought dimensions across participants and improved performance compared to the RF classifier without feature selection. Our findings highlight the potential of machine learning approaches combined with eye movement measures for the real-time prediction of naturalistic ongoing thoughts, particularly in ecologically valid contexts.

EEG complexity measures for detecting mind wandering during video-based learning

This study explores the efficacy of various EEG complexity measures in detecting mind wandering during video-based learning. Employing a modified probe-caught method, we recorded EEG data from participants engaged in viewing educational videos and subsequently focused on the discrimination between mind wandering (MW) and non-MW states. We systematically investigated various EEG complexity metrics, including metrics that reflect a system's regularity like multiscale permutation entropy (MPE), and metrics that reflect a system's dimensionality like detrended fluctuation analysis (DFA). We also compare these features to traditional band power (BP) features. Data augmentation methods and feature selection were applied to optimize detection accuracy. Results show BP features excelled (mean area under the receiver operating characteristic curve (AUC) 0.646) in datasets without eye-movement artifacts, while MPE showed similar performance (mean AUC 0.639) without requiring removal of eye-movement artifacts. Combining all kinds of features improved decoding performance to 0.66 mean AUC. Our findings demonstrate the potential of these complexity metrics in EEG analysis for mind wandering detection, highlighting their practical implications in educational contexts.

Mind wandering state detection during video-based learning via EEG

The aim of this study is to explore the potential of technology for detecting mind wandering, particularly during video-based distance learning, with the ultimate benefit of improving learning outcomes. To overcome the challenges of previous mind wandering research in ecological validity, sample balance, and dataset size, this study utilized practical electroencephalography (EEG) recording hardware and designed a paradigm consisting of viewing short-duration video lectures under a focused learning condition and a future planning condition. Participants estimated statistics of their attentional state at the end of each video, and we combined this rating scale feedback with self-caught key press responses during video watching to obtain binary labels for classifier training. EEG was recorded using an 8-channel system, and spatial covariance features processed by Riemannian geometry were employed. The results demonstrate that a radial basis function kernel support vector machine classifier, using Riemannian-processed covariance features from delta, theta, alpha, and beta bands, can detect mind wandering with a mean area under the receiver operating characteristic curve (AUC) of 0.876 for within-participant classification and AUC of 0.703 for cross-lecture classification. Furthermore, our results suggest that a short duration of training data is sufficient to train a classifier for online decoding, as cross-lecture classification remained at an average AUC of 0.689 when using 70% of the training set (about 9 min). The findings highlight the potential for practical EEG hardware in detecting mind wandering with high accuracy, which has potential application to improving learning outcomes during video-based distance learning.

Pavlovian-based neurofeedback enhances meta-awareness of mind-wandering

Absorption in mind-wandering (MW) may worsen our mood and can cause psychological disorders. Researchers indicate the possibility that meta-awareness of MW prevents these mal-effects and enhances favorable consequences of MW, such as boosting creativity; thus, meta-awareness has attracted psychological and clinical attention. However, few studies have investigated the nature of meta-awareness of MW, because there has been no method to isolate and operate this ability. Therefore, we propose a new approach to manipulate the ability of meta-awareness. We used Pavlovian conditioning, tying to it an occurrence of MW and a neutral tone sound inducing the meta-awareness of MW. To perform paired presentations of the unconditioned stimulus (neutral tone) and the conditioned stimulus (perception accompanying MW), we detected participants' natural occurrence of MW via electroencephalogram and a machine-learning estimation method. The double-blinded randomized controlled trial with 37 participants found that a single 20-min conditioning session significantly increased the meta-awareness of MW as assessed by behavioral and neuroscientific measures. The core protocol of the proposed method is real-time feedback on participants' neural information, and in that sense, we can refer to it as neurofeedback. However, there are some differences from typical neurofeedback protocols, and we discuss them in this paper. Our novel classical conditioning is expected to contribute to future research on the modulation effect of meta-awareness on MW.