1
|
Zhang X, Lian J, Yu Z, Tang H, Liang D, Liu J, Liu JK. Revealing the mechanisms of semantic satiation with deep learning models. Commun Biol 2024; 7:487. [PMID: 38649503 PMCID: PMC11035687 DOI: 10.1038/s42003-024-06162-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2023] [Accepted: 04/08/2024] [Indexed: 04/25/2024] Open
Abstract
The phenomenon of semantic satiation, which refers to the loss of meaning of a word or phrase after being repeated many times, is a well-known psychological phenomenon. However, the microscopic neural computational principles responsible for these mechanisms remain unknown. In this study, we use a deep learning model of continuous coupled neural networks to investigate the mechanism underlying semantic satiation and precisely describe this process with neuronal components. Our results suggest that, from a mesoscopic perspective, semantic satiation may be a bottom-up process. Unlike existing macroscopic psychological studies that suggest that semantic satiation is a top-down process, our simulations use a similar experimental paradigm as classical psychology experiments and observe similar results. Satiation of semantic objectives, similar to the learning process of our network model used for object recognition, relies on continuous learning and switching between objects. The underlying neural coupling strengthens or weakens satiation. Taken together, both neural and network mechanisms play a role in controlling semantic satiation.
Collapse
Affiliation(s)
- Xinyu Zhang
- School of Information Science and Engineering, Lanzhou University, Lanzhou, 730000, Gansu, China
| | - Jing Lian
- School of Electronics and Information Engineering, Lanzhou Jiaotong University, Lanzhou, 730070, Gansu, China
| | - Zhaofei Yu
- School of Computer Science, Peking University, Beijing, 100871, Beijing, China
- Institute for Artificial Intelligence, Peking University, Beijing, 100871, Beijing, China
| | - Huajin Tang
- The State Key Lab of Brain-Machine Intelligence, Zhejiang University, Hangzhou, 310027, Zhejiang, China
- The MOE Frontier Science Center for Brain Science and Brain-Machine Integration, Zhejiang University, Hangzhou, 310027, Zhejiang, China
| | - Dong Liang
- Department of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, 211106, Jiangsu, China
| | - Jizhao Liu
- School of Information Science and Engineering, Lanzhou University, Lanzhou, 730000, Gansu, China.
| | - Jian K Liu
- School of Computer Science, Centre for Human Brain Health, University of Birmingham, Birmingham, B15 2TT, UK.
| |
Collapse
|
2
|
Hernández-Mustieles MA, Lima-Carmona YE, Pacheco-Ramírez MA, Mendoza-Armenta AA, Romero-Gómez JE, Cruz-Gómez CF, Rodríguez-Alvarado DC, Arceo A, Cruz-Garza JG, Ramírez-Moreno MA, Lozoya-Santos JDJ. Wearable Biosensor Technology in Education: A Systematic Review. SENSORS (BASEL, SWITZERLAND) 2024; 24:2437. [PMID: 38676053 PMCID: PMC11054421 DOI: 10.3390/s24082437] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/07/2024] [Revised: 03/31/2024] [Accepted: 04/02/2024] [Indexed: 04/28/2024]
Abstract
Wearable Biosensor Technology (WBT) has emerged as a transformative tool in the educational system over the past decade. This systematic review encompasses a comprehensive analysis of WBT utilization in educational settings over a 10-year span (2012-2022), highlighting the evolution of this field to address challenges in education by integrating technology to solve specific educational challenges, such as enhancing student engagement, monitoring stress and cognitive load, improving learning experiences, and providing real-time feedback for both students and educators. By exploring these aspects, this review sheds light on the potential implications of WBT on the future of learning. A rigorous and systematic search of major academic databases, including Google Scholar and Scopus, was conducted in accordance with the PRISMA guidelines. Relevant studies were selected based on predefined inclusion and exclusion criteria. The articles selected were assessed for methodological quality and bias using established tools. The process of data extraction and synthesis followed a structured framework. Key findings include the shift from theoretical exploration to practical implementation, with EEG being the predominant measurement, aiming to explore mental states, physiological constructs, and teaching effectiveness. Wearable biosensors are significantly impacting the educational field, serving as an important resource for educators and a tool for students. Their application has the potential to transform and optimize academic practices through sensors that capture biometric data, enabling the implementation of metrics and models to understand the development and performance of students and professors in an academic environment, as well as to gain insights into the learning process.
Collapse
Affiliation(s)
- María A. Hernández-Mustieles
- Mechatronics Department, School of Engineering and Sciences, Monterrey Campus, Tecnologico de Monterrey, Monterrey 64700, Mexico; (M.A.H.-M.); (Y.E.L.-C.); (M.A.P.-R.); (A.A.M.-A.); (C.F.C.-G.); (D.C.R.-A.); (A.A.); (M.A.R.-M.)
| | - Yoshua E. Lima-Carmona
- Mechatronics Department, School of Engineering and Sciences, Monterrey Campus, Tecnologico de Monterrey, Monterrey 64700, Mexico; (M.A.H.-M.); (Y.E.L.-C.); (M.A.P.-R.); (A.A.M.-A.); (C.F.C.-G.); (D.C.R.-A.); (A.A.); (M.A.R.-M.)
| | - Maxine A. Pacheco-Ramírez
- Mechatronics Department, School of Engineering and Sciences, Monterrey Campus, Tecnologico de Monterrey, Monterrey 64700, Mexico; (M.A.H.-M.); (Y.E.L.-C.); (M.A.P.-R.); (A.A.M.-A.); (C.F.C.-G.); (D.C.R.-A.); (A.A.); (M.A.R.-M.)
| | - Axel A. Mendoza-Armenta
- Mechatronics Department, School of Engineering and Sciences, Monterrey Campus, Tecnologico de Monterrey, Monterrey 64700, Mexico; (M.A.H.-M.); (Y.E.L.-C.); (M.A.P.-R.); (A.A.M.-A.); (C.F.C.-G.); (D.C.R.-A.); (A.A.); (M.A.R.-M.)
| | - José Esteban Romero-Gómez
- Mechatronics Department, School of Engineering and Sciences, Guadalajara Campus, Tecnologico de Monterrey, Guadalajara 45201, Mexico;
| | - César F. Cruz-Gómez
- Mechatronics Department, School of Engineering and Sciences, Monterrey Campus, Tecnologico de Monterrey, Monterrey 64700, Mexico; (M.A.H.-M.); (Y.E.L.-C.); (M.A.P.-R.); (A.A.M.-A.); (C.F.C.-G.); (D.C.R.-A.); (A.A.); (M.A.R.-M.)
| | - Diana C. Rodríguez-Alvarado
- Mechatronics Department, School of Engineering and Sciences, Monterrey Campus, Tecnologico de Monterrey, Monterrey 64700, Mexico; (M.A.H.-M.); (Y.E.L.-C.); (M.A.P.-R.); (A.A.M.-A.); (C.F.C.-G.); (D.C.R.-A.); (A.A.); (M.A.R.-M.)
| | - Alejandro Arceo
- Mechatronics Department, School of Engineering and Sciences, Monterrey Campus, Tecnologico de Monterrey, Monterrey 64700, Mexico; (M.A.H.-M.); (Y.E.L.-C.); (M.A.P.-R.); (A.A.M.-A.); (C.F.C.-G.); (D.C.R.-A.); (A.A.); (M.A.R.-M.)
| | - Jesús G. Cruz-Garza
- Department of Neurosurgery, Houston Methodist Research Institute, Houston, TX 77030, USA;
| | - Mauricio A. Ramírez-Moreno
- Mechatronics Department, School of Engineering and Sciences, Monterrey Campus, Tecnologico de Monterrey, Monterrey 64700, Mexico; (M.A.H.-M.); (Y.E.L.-C.); (M.A.P.-R.); (A.A.M.-A.); (C.F.C.-G.); (D.C.R.-A.); (A.A.); (M.A.R.-M.)
| | - Jorge de J. Lozoya-Santos
- Mechatronics Department, School of Engineering and Sciences, Monterrey Campus, Tecnologico de Monterrey, Monterrey 64700, Mexico; (M.A.H.-M.); (Y.E.L.-C.); (M.A.P.-R.); (A.A.M.-A.); (C.F.C.-G.); (D.C.R.-A.); (A.A.); (M.A.R.-M.)
| |
Collapse
|
3
|
Fuentes-Martinez VJ, Romero S, Lopez-Gordo MA, Minguillon J, Rodríguez-Álvarez M. Low-Cost EEG Multi-Subject Recording Platform for the Assessment of Students' Attention and the Estimation of Academic Performance in Secondary School. SENSORS (BASEL, SWITZERLAND) 2023; 23:9361. [PMID: 38067731 PMCID: PMC10708847 DOI: 10.3390/s23239361] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/19/2023] [Revised: 11/15/2023] [Accepted: 11/20/2023] [Indexed: 12/18/2023]
Abstract
The level of student attention in class greatly affects their academic performance. Teachers typically rely on visual inspection to react to students' attention in time, but this subjective method leads to inconsistencies across classes. Online education exacerbates the issue as students can turn off cameras and microphones to keep their own privacy. To address this, we present a novel, low-cost EEG-based platform for assessing students' attention and estimating their academic performance. In a study involving 34 secondary school students (aged 14 to 16), participants watched an academic video and answered evaluation questions while their EEG activity was recorded using a commercial headset. The results demonstrate a significant correlation (0.53, p-value = 0.003) between the power spectral density (PSD) of the EEG beta band (12-30 Hz) and students' academic performance. Additionally, there was a notable difference in PSD-beta between high and low academic performers. These findings encourage the use of PSD-beta for the immediate and objective assessment of both the student attention and the subsequent academic performance. The platform offers valuable and objective feedback to teachers, enhancing the effectiveness of both face-to-face and online teaching and learning environments.
Collapse
Affiliation(s)
- Victor Juan Fuentes-Martinez
- Department of Computer Engineering, Automation and Robotics, Research Centre for Information and Communication Technologies (CITIC-UGR), University of Granada, 18014 Granada, Spain;
- Department of Signal Theory, Telematics and Communications, Research Centre for Information and Communication Technologies (CITIC-UGR), University of Granada, 18014 Granada, Spain; (M.A.L.-G.); (J.M.)
- Neuroengineering and Computation Lab, Research Centre for Information and Communication Technologies (CITIC-UGR), University of Granada, 18014 Granada, Spain
| | - Samuel Romero
- Department of Computer Engineering, Automation and Robotics, Research Centre for Information and Communication Technologies (CITIC-UGR), University of Granada, 18014 Granada, Spain;
- Neuroengineering and Computation Lab, Research Centre for Information and Communication Technologies (CITIC-UGR), University of Granada, 18014 Granada, Spain
| | - Miguel Angel Lopez-Gordo
- Department of Signal Theory, Telematics and Communications, Research Centre for Information and Communication Technologies (CITIC-UGR), University of Granada, 18014 Granada, Spain; (M.A.L.-G.); (J.M.)
- Neuroengineering and Computation Lab, Research Centre for Information and Communication Technologies (CITIC-UGR), University of Granada, 18014 Granada, Spain
| | - Jesus Minguillon
- Department of Signal Theory, Telematics and Communications, Research Centre for Information and Communication Technologies (CITIC-UGR), University of Granada, 18014 Granada, Spain; (M.A.L.-G.); (J.M.)
- Neuroengineering and Computation Lab, Research Centre for Information and Communication Technologies (CITIC-UGR), University of Granada, 18014 Granada, Spain
| | - Manuel Rodríguez-Álvarez
- Department of Computer Engineering, Automation and Robotics, Research Centre for Information and Communication Technologies (CITIC-UGR), University of Granada, 18014 Granada, Spain;
| |
Collapse
|
4
|
Gerostathi M, Doukakis S. Proposal for Monitoring Students' Self-Efficacy Using Neurophysiological Measures and Self-Report Scales. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2023; 1425:635-643. [PMID: 37581837 DOI: 10.1007/978-3-031-31986-0_62] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/16/2023]
Abstract
The role of STEM-science, technology, engineering, mathematics-education is internationally recognized as critical to both the personal development of students and their future contribution to a country's economy as through this education they are equipped with the necessary twenty-first-century skills. As a result, there is a need to study the way in which such education affects students. In particular, the study of the self-efficacy factor is a contribution in this direction. Self-efficacy is a fundamental concept in the learning process as it contributes to shaping learning outcomes. Self-report scales are commonly used to measure self-efficacy; however, concerns in research circles have been raised regarding their limitations. On the other hand, there is a growing research interest in neurophysiological measures in the field of education, which seem to offer promising possibilities for understanding learning. Therefore, to better determine the impact of STEM education on students, a combination of self-report scales and neurophysiological measures is proposed to measure self-efficacy.
Collapse
|
5
|
Marceddu AC, Pugliese L, Sini J, Espinosa GR, Amel Solouki M, Chiavassa P, Giusto E, Montrucchio B, Violante M, De Pace F. A Novel Redundant Validation IoT System for Affective Learning Based on Facial Expressions and Biological Signals. SENSORS (BASEL, SWITZERLAND) 2022; 22:2773. [PMID: 35408387 PMCID: PMC9003217 DOI: 10.3390/s22072773] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Revised: 03/29/2022] [Accepted: 03/31/2022] [Indexed: 11/16/2022]
Abstract
Teaching is an activity that requires understanding the class's reaction to evaluate the teaching methodology effectiveness. This operation can be easy to achieve in small classrooms, while it may be challenging to do in classes of 50 or more students. This paper proposes a novel Internet of Things (IoT) system to aid teachers in their work based on the redundant use of non-invasive techniques such as facial expression recognition and physiological data analysis. Facial expression recognition is performed using a Convolutional Neural Network (CNN), while physiological data are obtained via Photoplethysmography (PPG). By recurring to Russel's model, we grouped the most important Ekman's facial expressions recognized by CNN into active and passive. Then, operations such as thresholding and windowing were performed to make it possible to compare and analyze the results from both sources. Using a window size of 100 samples, both sources have detected a level of attention of about 55.5% for the in-presence lectures tests. By comparing results coming from in-presence and pre-recorded remote lectures, it is possible to note that, thanks to validation with physiological data, facial expressions alone seem useful in determining students' level of attention for in-presence lectures.
Collapse
Affiliation(s)
- Antonio Costantino Marceddu
- Department of Control and Computer Engineering, Politecnico di Torino, 10129 Turin, Italy; (A.C.M.); (L.P.); (G.R.E.); (M.A.S.); (P.C.); (E.G.); (B.M.); (M.V.)
| | - Luigi Pugliese
- Department of Control and Computer Engineering, Politecnico di Torino, 10129 Turin, Italy; (A.C.M.); (L.P.); (G.R.E.); (M.A.S.); (P.C.); (E.G.); (B.M.); (M.V.)
| | - Jacopo Sini
- Department of Control and Computer Engineering, Politecnico di Torino, 10129 Turin, Italy; (A.C.M.); (L.P.); (G.R.E.); (M.A.S.); (P.C.); (E.G.); (B.M.); (M.V.)
| | - Gustavo Ramirez Espinosa
- Department of Control and Computer Engineering, Politecnico di Torino, 10129 Turin, Italy; (A.C.M.); (L.P.); (G.R.E.); (M.A.S.); (P.C.); (E.G.); (B.M.); (M.V.)
- Electronics Department, Engineering School, Pontificia Universidad Javeriana, Bogota 1301, Colombia
| | - Mohammadreza Amel Solouki
- Department of Control and Computer Engineering, Politecnico di Torino, 10129 Turin, Italy; (A.C.M.); (L.P.); (G.R.E.); (M.A.S.); (P.C.); (E.G.); (B.M.); (M.V.)
| | - Pietro Chiavassa
- Department of Control and Computer Engineering, Politecnico di Torino, 10129 Turin, Italy; (A.C.M.); (L.P.); (G.R.E.); (M.A.S.); (P.C.); (E.G.); (B.M.); (M.V.)
| | - Edoardo Giusto
- Department of Control and Computer Engineering, Politecnico di Torino, 10129 Turin, Italy; (A.C.M.); (L.P.); (G.R.E.); (M.A.S.); (P.C.); (E.G.); (B.M.); (M.V.)
| | - Bartolomeo Montrucchio
- Department of Control and Computer Engineering, Politecnico di Torino, 10129 Turin, Italy; (A.C.M.); (L.P.); (G.R.E.); (M.A.S.); (P.C.); (E.G.); (B.M.); (M.V.)
| | - Massimo Violante
- Department of Control and Computer Engineering, Politecnico di Torino, 10129 Turin, Italy; (A.C.M.); (L.P.); (G.R.E.); (M.A.S.); (P.C.); (E.G.); (B.M.); (M.V.)
| | - Francesco De Pace
- Institute of Visual Computing and Human-Centered Technology, Vienna University of Technology (TU Wien), 1040 Vienna, Austria;
| |
Collapse
|