1
|
Lee SH, Kang DK. Deep Learning Technology and Image Sensing. SENSORS (BASEL, SWITZERLAND) 2024; 24:5130. [PMID: 39204827 PMCID: PMC11358889 DOI: 10.3390/s24165130] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/28/2024] [Accepted: 07/31/2024] [Indexed: 09/04/2024]
Abstract
The scientific landscape is constantly evolving, marked by groundbreaking advancements in imaging, sensing, and machine learning that expand the realms of possibility across various disciplines [...].
Collapse
Affiliation(s)
- Suk-Ho Lee
- Department Computer Engineering, Dongseo University, Busan 47011, Republic of Korea;
| | | |
Collapse
|
2
|
Mizrahi D, Laufer I, Zuckerman I. Predicting Tacit Coordination Success Using Electroencephalogram Trajectories: The Impact of Task Difficulty. SENSORS (BASEL, SWITZERLAND) 2023; 23:9493. [PMID: 38067866 PMCID: PMC10708720 DOI: 10.3390/s23239493] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/08/2023] [Revised: 11/23/2023] [Accepted: 11/27/2023] [Indexed: 12/18/2023]
Abstract
In this study, we aim to develop a machine learning model to predict the level of coordination between two players in tacit coordination games by analyzing the similarity of their spatial EEG features. We present an analysis, demonstrating the model's sensitivity, which was assessed through three conventional measures (precision, recall, and f1 score) based on the EEG patterns. These measures are evaluated in relation to the coordination task difficulty, as determined by the coordination index (CI). Tacit coordination games are games in which two individuals are requested to select the same option out of a closed set without the ability to communicate. This study aims to examine the effect of the difficulty of a semantic coordination task on the ability to predict a successful coordination between two players based on the compatibility between their EEG signals. The difficulty of each of the coordination tasks was estimated based on the degree of dispersion of the different answers given by the players reflected by the CI. The classification of the spatial distance between each pair of individual brain patterns, analyzed using the random walk algorithm, was used to predict whether successful coordination occurred or not. The classification performance was obtained for each game individually, i.e., for each different complexity level, via recall and precision indices. The results showed that the classifier performance depended on the CI, that is, on the level of coordination difficulty. These results, along with possibilities for future research, are discussed.
Collapse
Affiliation(s)
- Dor Mizrahi
- Department of Industrial Engineering and Management, Ariel University, Ariel 4070000, Israel; (I.L.); (I.Z.)
| | | | | |
Collapse
|
3
|
Gerlo J, Kooijman DG, Wieling IW, Heirmans R, Vanlanduit S. Seaweed Growth Monitoring with a Low-Cost Vision-Based System. SENSORS (BASEL, SWITZERLAND) 2023; 23:9197. [PMID: 38005584 PMCID: PMC10674634 DOI: 10.3390/s23229197] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/29/2023] [Revised: 11/08/2023] [Accepted: 11/14/2023] [Indexed: 11/26/2023]
Abstract
In this paper, we introduce a method for automated seaweed growth monitoring by combining a low-cost RGB and stereo vision camera. While current vision-based seaweed growth monitoring techniques focus on laboratory measurements or above-ground seaweed, we investigate the feasibility of the underwater imaging of a vertical seaweed farm. We use deep learning-based image segmentation (DeeplabV3+) to determine the size of the seaweed in pixels from recorded RGB images. We convert this pixel size to meters squared by using the distance information from the stereo camera. We demonstrate the performance of our monitoring system using measurements in a seaweed farm in the River Scheldt estuary (in The Netherlands). Notwithstanding the poor visibility of the seaweed in the images, we are able to segment the seaweed with an intersection of the union (IoU) of 0.9, and we reach a repeatability of 6% and a precision of the seaweed size of 18%.
Collapse
Affiliation(s)
- Jeroen Gerlo
- InViLab Research Group, University of Antwerp, Groenenborgerlaan 171, 2020 Antwerp, Belgium; (J.G.); (R.H.)
| | - Dennis G. Kooijman
- Intelligent Autonomous Mobility Center, 5612 DX Eindhoven, The Netherlands;
| | | | - Ritchie Heirmans
- InViLab Research Group, University of Antwerp, Groenenborgerlaan 171, 2020 Antwerp, Belgium; (J.G.); (R.H.)
| | - Steve Vanlanduit
- InViLab Research Group, University of Antwerp, Groenenborgerlaan 171, 2020 Antwerp, Belgium; (J.G.); (R.H.)
| |
Collapse
|
4
|
Zhang L, Li C, Zhang R, Sun Q. Online semi-supervised learning for motor imagery EEG classification. Comput Biol Med 2023; 165:107405. [PMID: 37678137 DOI: 10.1016/j.compbiomed.2023.107405] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2023] [Revised: 07/29/2023] [Accepted: 08/26/2023] [Indexed: 09/09/2023]
Abstract
OBJECTIVE Time-consuming data labeling in brain-computer interfaces (BCIs) raises many problems such as mental fatigue and is one key factor that hinders the real-world adoption of motor imagery (MI)-based BCIs. An alternative approach is to integrate readily available, as well as informative, unlabeled data online, whereas this approach is less investigated. APPROACH We proposed an online semi-supervised learning scheme to improve the classification performance of MI-based BCI. This scheme uses regularized weighted online sequential extreme learning machine (RWOS-ELM) as the base classifier and updates its model parameters with incoming balanced data chunk-by-chunk. In the initial stage, we designed a technique that combines the synthetic minority oversampling with the edited nearest neighbor rule for data augmentation to construct more discriminative initial classifiers. When used online, the incoming chunk of data is first pseudo-labeled by RWOS-ELM as well as an auxiliary classifier, and then balanced again by the above-mentioned technique. Initial classifiers are further updated based on these class-balanced data. MAIN RESULTS Offline experimental results on two publicly available MI datasets demonstrate the superiority of the proposed scheme over its counterparts. Further online experiments on six subjects show that their BCI performance gradually improved by learning from incoming unlabeled data. SIGNIFICANCE Our proposed online semi-supervised learning scheme has higher computation and memory usage efficiency, which is promising for online MI-based BCIs, especially in the case of insufficient labeled training data.
Collapse
Affiliation(s)
- Li Zhang
- State Key Laboratory of Power Transmission Equipment & System Security and New Technology, School of Electrical Engineering, Chongqing University, Chongqing, 400044, People's Republic of China.
| | - Changsheng Li
- State Key Laboratory of Power Transmission Equipment & System Security and New Technology, School of Electrical Engineering, Chongqing University, Chongqing, 400044, People's Republic of China
| | - Run Zhang
- Marketing Service Center, State Grid Chongqing Electric Power Company, Yuzhong District, Chongqing, 400014, People's Republic of China
| | - Qiang Sun
- State Key Laboratory of Power Transmission Equipment & System Security and New Technology, School of Electrical Engineering, Chongqing University, Chongqing, 400044, People's Republic of China
| |
Collapse
|
5
|
Atila O, Deniz E, Ari A, Sengur A, Chakraborty S, Barua PD, Acharya UR. LSGP-USFNet: Automated Attention Deficit Hyperactivity Disorder Detection Using Locations of Sophie Germain's Primes on Ulam's Spiral-Based Features with Electroencephalogram Signals. SENSORS (BASEL, SWITZERLAND) 2023; 23:7032. [PMID: 37631569 PMCID: PMC10459515 DOI: 10.3390/s23167032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/20/2023] [Revised: 07/27/2023] [Accepted: 08/05/2023] [Indexed: 08/27/2023]
Abstract
Anxiety, learning disabilities, and depression are the symptoms of attention deficit hyperactivity disorder (ADHD), an isogenous pattern of hyperactivity, impulsivity, and inattention. For the early diagnosis of ADHD, electroencephalogram (EEG) signals are widely used. However, the direct analysis of an EEG is highly challenging as it is time-consuming, nonlinear, and nonstationary in nature. Thus, in this paper, a novel approach (LSGP-USFNet) is developed based on the patterns obtained from Ulam's spiral and Sophia Germain's prime numbers. The EEG signals are initially filtered to remove the noise and segmented with a non-overlapping sliding window of a length of 512 samples. Then, a time-frequency analysis approach, namely continuous wavelet transform, is applied to each channel of the segmented EEG signal to interpret it in the time and frequency domain. The obtained time-frequency representation is saved as a time-frequency image, and a non-overlapping n × n sliding window is applied to this image for patch extraction. An n × n Ulam's spiral is localized on each patch, and the gray levels are acquired from this patch as features where Sophie Germain's primes are located in Ulam's spiral. All gray tones from all patches are concatenated to construct the features for ADHD and normal classes. A gray tone selection algorithm, namely ReliefF, is employed on the representative features to acquire the final most important gray tones. The support vector machine classifier is used with a 10-fold cross-validation criteria. Our proposed approach, LSGP-USFNet, was developed using a publicly available dataset and obtained an accuracy of 97.46% in detecting ADHD automatically. Our generated model is ready to be validated using a bigger database and it can also be used to detect other children's neurological disorders.
Collapse
Affiliation(s)
- Orhan Atila
- Electrical-Electronics Engineering Department, Technology Faculty, Firat University, 23119 Elazig, Turkey; (O.A.); (E.D.); (A.S.)
| | - Erkan Deniz
- Electrical-Electronics Engineering Department, Technology Faculty, Firat University, 23119 Elazig, Turkey; (O.A.); (E.D.); (A.S.)
| | - Ali Ari
- Computer Engineering Department, Engineering Faculty, Inonu University, 44280 Malatya, Turkey;
| | - Abdulkadir Sengur
- Electrical-Electronics Engineering Department, Technology Faculty, Firat University, 23119 Elazig, Turkey; (O.A.); (E.D.); (A.S.)
| | - Subrata Chakraborty
- Faculty of Science, Agriculture, Business and Law, University of New England, Armidale, NSW 2351, Australia
- Faculty of Engineering and Information Technology, University of Technology Sydney, Ultimo, NSW 2007, Australia
| | - Prabal Datta Barua
- Faculty of Science, Agriculture, Business and Law, University of New England, Armidale, NSW 2351, Australia
- Faculty of Engineering and Information Technology, University of Technology Sydney, Ultimo, NSW 2007, Australia
- School of Information Systems, University of Southern Queensland, Springfield, QLD 4300, Australia
| | - U. Rajendra Acharya
- School of Mathematics, Physics and Computing, University of Southern Queensland, Springfield, QLD 4300, Australia;
| |
Collapse
|
6
|
Chaddad A, Wu Y, Kateb R, Bouridane A. Electroencephalography Signal Processing: A Comprehensive Review and Analysis of Methods and Techniques. SENSORS (BASEL, SWITZERLAND) 2023; 23:6434. [PMID: 37514728 PMCID: PMC10385593 DOI: 10.3390/s23146434] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/21/2023] [Revised: 06/16/2023] [Accepted: 07/13/2023] [Indexed: 07/30/2023]
Abstract
The electroencephalography (EEG) signal is a noninvasive and complex signal that has numerous applications in biomedical fields, including sleep and the brain-computer interface. Given its complexity, researchers have proposed several advanced preprocessing and feature extraction methods to analyze EEG signals. In this study, we analyze a comprehensive review of numerous articles related to EEG signal processing. We searched the major scientific and engineering databases and summarized the results of our findings. Our survey encompassed the entire process of EEG signal processing, from acquisition and pretreatment (denoising) to feature extraction, classification, and application. We present a detailed discussion and comparison of various methods and techniques used for EEG signal processing. Additionally, we identify the current limitations of these techniques and analyze their future development trends. We conclude by offering some suggestions for future research in the field of EEG signal processing.
Collapse
Affiliation(s)
- Ahmad Chaddad
- School of Artificial Intelligence, Guilin University of Electronic Technology, Guilin 541004, China
- The Laboratory for Imagery, Vision and Artificial Intelligence, Ecole de Technologie Supérieure, Montreal, QC H3C 1K3, Canada
| | - Yihang Wu
- School of Artificial Intelligence, Guilin University of Electronic Technology, Guilin 541004, China
| | - Reem Kateb
- College of Computer Science and Engineering, Taibah University, Madinah 41477, Saudi Arabia
| | - Ahmed Bouridane
- Centre for Data Analytics and Cybersecurity, University of Sharjah, Sharjah 27272, United Arab Emirates
| |
Collapse
|
7
|
Chen X, Gupta RS, Gupta L. Multidomain Convolution Neural Network Models for Improved Event-Related Potential Classification. SENSORS (BASEL, SWITZERLAND) 2023; 23:4656. [PMID: 37430568 PMCID: PMC10222268 DOI: 10.3390/s23104656] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/05/2023] [Revised: 05/08/2023] [Accepted: 05/08/2023] [Indexed: 07/12/2023]
Abstract
Two convolution neural network (CNN) models are introduced to accurately classify event-related potentials (ERPs) by fusing frequency, time, and spatial domain information acquired from the continuous wavelet transform (CWT) of the ERPs recorded from multiple spatially distributed channels. The multidomain models fuse the multichannel Z-scalograms and the V-scalograms, which are generated from the standard CWT scalogram by zeroing-out and by discarding the inaccurate artifact coefficients that are outside the cone of influence (COI), respectively. In the first multidomain model, the input to the CNN is generated by fusing the Z-scalograms of the multichannel ERPs into a frequency-time-spatial cuboid. The input to the CNN in the second multidomain model is formed by fusing the frequency-time vectors of the V-scalograms of the multichannel ERPs into a frequency-time-spatial matrix. Experiments are designed to demonstrate (a) customized classification of ERPs, where the multidomain models are trained and tested with the ERPs of individual subjects for brain-computer interface (BCI)-type applications, and (b) group-based ERP classification, where the models are trained on the ERPs from a group of subjects and tested on single subjects not included in the training set for applications such as brain disorder classification. Results show that both multidomain models yield high classification accuracies for single trials and small-average ERPs with a small subset of top-ranked channels, and the multidomain fusion models consistently outperform the best unichannel classifiers.
Collapse
Affiliation(s)
- Xiaoqian Chen
- School of Electrical, Computer, and Biomedical Engineering, Southern Illinois University, Carbondale, IL 62901, USA;
| | - Resh S. Gupta
- Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System, San Diego, CA 92161, USA;
| | - Lalit Gupta
- School of Electrical, Computer, and Biomedical Engineering, Southern Illinois University, Carbondale, IL 62901, USA;
| |
Collapse
|
8
|
Heo SP, Choi H. Development of a robust eye exam diagnosis platform with a deep learning model. Technol Health Care 2023; 31:423-428. [PMID: 37066941 DOI: 10.3233/thc-236036] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/18/2023]
Abstract
BACKGROUND Eye exam diagnosis is one of the early detection methods. However, such a method is dependent on expensive and unpredictable optical equipment. OBJECTIVE The eye exam can be re-emerged through an optometric lens attached to a smartphone and come to read the diseases automatically. Therefore, this study aims to provide a stable and predictable model with a given dataset representing the target group domain and develop a new method to identify eye disease with accurate and stable performance. METHODS The ResNet-18 models pre-trained on ImageNet data composed of 1,000 everyday objects were employed to learn the dataset's features and validate the test dataset separated from the training dataset. RESULTS A proposed model showed high training and validation accuracy values of 99.1% and 96.9%, respectively. CONCLUSION The designed model could produce a robust and stable eye disease discrimination performance.
Collapse
Affiliation(s)
- Sung-Phil Heo
- Department of Information and Telecommunication Engineering, Gangeung-Wonju National University, Wonju, Korea
| | - Hojong Choi
- Department of Electronic Engineering, Gachon University, Seongnam, Korea
| |
Collapse
|
9
|
Ranieri A, Pichiorri F, Colamarino E, de Seta V, Mattia D, Toppi J. Parallel Factorization to Implement Group Analysis in Brain Networks Estimation. SENSORS (BASEL, SWITZERLAND) 2023; 23:1693. [PMID: 36772731 PMCID: PMC9920099 DOI: 10.3390/s23031693] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Revised: 01/20/2023] [Accepted: 02/01/2023] [Indexed: 06/18/2023]
Abstract
When dealing with complex functional brain networks, group analysis still represents an open issue. In this paper, we investigated the potential of an innovative approach based on PARAllel FActorization (PARAFAC) for the extraction of the grand average connectivity matrices from both simulated and real datasets. The PARAFAC approach was solved using three different numbers of rank-one tensors (PAR-FACT). Synthetic data were parametrized according to different levels of three parameters: network dimension (NODES), number of observations (SAMPLE-SIZE), and noise (SWAP-CON) in order to investigate the way they affect the grand average estimation. PARAFAC was then tested on a real connectivity dataset, derived from EEG data of 17 healthy subjects performing wrist extension with left and right hand separately. Findings on both synthetic and real data revealed the potential of the PARAFAC algorithm as a useful tool for grand average extraction. As expected, the best performances in terms of FPR, FNR, and AUC were achieved for great values of sample size and low noise level. A crucial role has been revealed for the PAR-FACT parameter, revealing that an increase in the number of rank-one tensors solving the PARAFAC problem leads to an increase in FPR values and, thus, to a worse grand average estimation.
Collapse
Affiliation(s)
- Andrea Ranieri
- Department of Computer, Control and Management Engineering, Sapienza University of Rome, Via Ariosto, 25, 00185 Rome, Italy
- Neuroelectrical Imaging and Brain Computer Interface Lab, IRCCS Fondazione Santa Lucia, 00179 Rome, Italy
| | - Floriana Pichiorri
- Neuroelectrical Imaging and Brain Computer Interface Lab, IRCCS Fondazione Santa Lucia, 00179 Rome, Italy
| | - Emma Colamarino
- Department of Computer, Control and Management Engineering, Sapienza University of Rome, Via Ariosto, 25, 00185 Rome, Italy
- Neuroelectrical Imaging and Brain Computer Interface Lab, IRCCS Fondazione Santa Lucia, 00179 Rome, Italy
| | - Valeria de Seta
- Department of Computer, Control and Management Engineering, Sapienza University of Rome, Via Ariosto, 25, 00185 Rome, Italy
- Neuroelectrical Imaging and Brain Computer Interface Lab, IRCCS Fondazione Santa Lucia, 00179 Rome, Italy
| | - Donatella Mattia
- Neuroelectrical Imaging and Brain Computer Interface Lab, IRCCS Fondazione Santa Lucia, 00179 Rome, Italy
| | - Jlenia Toppi
- Department of Computer, Control and Management Engineering, Sapienza University of Rome, Via Ariosto, 25, 00185 Rome, Italy
- Neuroelectrical Imaging and Brain Computer Interface Lab, IRCCS Fondazione Santa Lucia, 00179 Rome, Italy
| |
Collapse
|