Effects and prediction of cognitive load on encoding model of brain response to auditory and linguistic stimuli in educational multimedia

Multimedia is extensively used for educational purposes. However, certain types of multimedia lack proper design, which could impose a cognitive load on the user. Therefore, it is essential to predict cognitive load and understand how it impairs brain functioning. Participants watched a version of educational multimedia that applied Mayer's principles, followed by a version that did not. Meanwhile, their electroencephalography (EEG) was recorded. Subsequently, they participated in a post-test and completed a self-reported cognitive load questionnaire. The audio envelope and word frequency were extracted from the multimedia, and the temporal response functions (TRFs) were obtained using a linear encoding model. We observed that the behavioral data are different between the two groups and the TRFs of the two multimedia versions were different. We saw changes in the amplitude and latencies of both early and late components. In addition, correlations were found between behavioral data and the amplitude and latencies of TRF components. Cognitive load decreased participants' attention to the multimedia, and semantic processing of words also occurred with a delay and smaller amplitude. Hence, encoding models provide insights into the temporal and spatial mapping of the cognitive load activity, which could help us detect and reduce cognitive load in potential environments such as educational multimedia or simulators for different purposes.

RALF: an adaptive reinforcement learning framework for teaching dyslexic students

Dyslexia is a learning disorder in which individuals have significant reading difficulties. Previous studies found that using machine learning techniques in content supplements is vital in adapting the course concepts to the learners' educational level. However, to the best of our knowledge, no research objectively applied machine learning methods to adaptive content generation. This study introduces an adaptive reinforcement learning framework known as RALF through Cellular Learning Automata (CLA) to generate content automatically for students with dyslexia. At first, RALF generates online alphabet models as a simplified font. CLA structure learns each rule of character generation through the reinforcement learning cycle asynchronously. Second, Persian words are generated algorithmically. This process also considers each character's state to decide the alphabet cursiveness and the cells' response to the environment. Finally, RALF can generate long texts and sentences using the embedded word-formation algorithm. The spaces between words are proceeds through the CLA neighboring states. Besides, RALF provides word pronunciation and several exams and games to improve the learning performance of people with dyslexia. The proposed reinforcement learning tool enhances students' learning rate with dyslexia by almost 27% compared to the face-to-face approach. The findings of this research show the applicability of this approach in dyslexia treatment during Lockdown of COVID-19.