Detection of shockable ventricular cardiac arrhythmias from ECG signals using FFREWT filter-bank and deep convolutional neural network

Arrhythmia detection by the graph convolution network and a proposed structure for communication between cardiac leads

One of the most common causes of death worldwide is heart disease, including arrhythmia. Today, sciences such as artificial intelligence and medical statistics are looking for methods and models for correct and automatic diagnosis of cardiac arrhythmia. In pursuit of increasing the accuracy of automated methods, many studies have been conducted. However, in none of the previous articles, the relationship and structure between the heart leads have not been included in the model. It seems that the structure of ECG data can help develop the accuracy of arrhythmia detection. Therefore, in this study, a new structure of Electrocardiogram (ECG) data was introduced, and the Graph Convolution Network (GCN), which has the possibility of learning the structure, was used to develop the accuracy of cardiac arrhythmia diagnosis. Considering the relationship between the heart leads and clusters based on different ECG poles, a new structure was introduced. In this structure, the Mutual Information(MI) index was used to evaluate the relationship between the leads, and weight was given based on the poles of the leads. Weighted Mutual Information (WMI) matrices (new structure) were formed by R software. Finally, the 15-layer GCN network was adjusted by this structure and the arrhythmia of people was detected and classified by it. To evaluate the performance of the proposed new network, sensitivity, precision, specificity, accuracy, and confusion matrix indices were used. Also, the accuracy of GCN networks was compared by three different structures, including WMI, MI, and Identity. Chapman's 12-lead ECG Dataset was used in this study. The results showed that the values of sensitivity, precision, specificity, and accuracy of the GCN-WMI network with 15 intermediate layers were equal to 98.74%, 99.08%, 99.97% & 99.82%, respectively. This new proposed network was more accurate than the Graph Convolution Network-Mutual Information (GCN-MI) with an accuracy equal to 99.71% and GCN-Id with an accuracy equal to 92.68%. Therefore, utilizing this network, the types of arrhythmia were recognized and classified. Also, the new network proposed by the Graph Convolution Network-Weighted Mutual Information (GCN-WMI) was more accurate than those conducted in other studies on the same data set (Chapman). Based on the obtained results, the structure proposed in this study increased the accuracy of cardiac arrhythmia diagnosis and classification on the Chapman data set. Achieving such accuracy for arrhythmia diagnosis is a great achievement in clinical sciences.

Pre-Processing techniques and artificial intelligence algorithms for electrocardiogram (ECG) signals analysis: A comprehensive review

Electrocardiogram (ECG) are the physiological signals and a standard test to measure the heart's electrical activity that depicts the movement of cardiac muscles. A review study has been conducted on ECG signals analysis with the help of artificial intelligence (AI) methods over the last ten years i.e., 2012-22. Primarily, the method of ECG analysis by software systems was divided into classical signal processing (e.g. spectrograms or filters), machine learning (ML) and deep learning (DL), including recursive models, transformers and hybrid. Secondly, the data sources and benchmark datasets were depicted. Authors grouped resources by ECG acquisition methods into hospital-based portable machines and wearable devices. Authors also included new trends like advanced pre-processing, data augmentation, simulations and agent-based modeling. The study found improvement in ECG examination perfection made each year through ML, DL, hybrid models, and transformers. Convolutional neural networks and hybrid models were more targeted and proved efficient. The transformer model extended the accuracy from 90% to 98%. The Physio-Net library helps acquire ECG signals, including the popular benchmark databases such as MIT-BIH, PTB, and challenging datasets. Similarly, wearable devices have been established as a appropriate option for monitoring patient health without the time and place limitations and are also helpful for AI model calibration with so far accuracy of 82%-83% on Samsung smartwatch. In the pre-processing signals, spectrogram generation through Fourier and wavelet transformations are erected leading approaches promoting on average accuracy of 90%-95%. Likewise, data enhancement using geometrical techniques is well-considered; however, extraction and concatenation-based methods need attention. As the what-if analysis in healthcare or cardiac issues can be performed using a complex simulation, the study reviews agent-based modeling and simulation approaches for cardiovascular risk event assessment.

Automated Arrhythmia Classification Using Farmland Fertility Algorithm with Hybrid Deep Learning Model on Internet of Things Environment

In recent years, the rapid progress of Internet of Things (IoT) solutions has offered an immense opportunity for the collection and dissemination of health records in a central data platform. Electrocardiogram (ECG), a fast, easy, and non-invasive method, is generally employed in the evaluation of heart conditions that lead to heart ailments and the identification of heart diseases. The deployment of IoT devices for arrhythmia classification offers many benefits such as remote patient care, continuous monitoring, and early recognition of abnormal heart rhythms. However, it is challenging to diagnose and manually classify arrhythmia as the manual diagnosis of ECG signals is a time-consuming process. Therefore, the current article presents the automated arrhythmia classification using the Farmland Fertility Algorithm with Hybrid Deep Learning (AAC-FFAHDL) approach in the IoT platform. The proposed AAC-FFAHDL system exploits the hyperparameter-tuned DL model for ECG signal analysis, thereby diagnosing arrhythmia. In order to accomplish this, the AAC-FFAHDL technique initially performs data pre-processing to scale the input signals into a uniform format. Further, the AAC-FFAHDL technique uses the HDL approach for detection and classification of arrhythmia. In order to improve the classification and detection performance of the HDL approach, the AAC-FFAHDL technique involves an FFA-based hyperparameter tuning process. The proposed AAC-FFAHDL approach was validated through simulation using the benchmark ECG database. The comparative experimental analysis outcomes confirmed that the AAC-FFAHDL system achieves promising performance compared with other models under different evaluation measures.

Multi-classification method of arrhythmia based on multi-scale residual neural network and multi-channel data fusion

Since ECG contains key characteristic information of arrhythmias, extracting this information is crucial for identifying arrhythmias. Based on this, in order to effectively extract ECG data features and realize automatic detection of arrhythmia, a multi-classification method of arrhythmia based on multi-scale residual neural network and multi-channel data fusion is proposed. First, the features of single-lead ECG signals are extracted and converted into two-dimensional images, and the feature data sets are labeled and divided according to different types of arrhythmias. The improved residual neural network is trained on the training set to obtain the classification model of the neural network. Finally, the classification model is applied to the automatic detection of arrhythmias during exercise. The accuracy of the classification model of this method is as high as 99.60%, and it has high accuracy and generalization ability. The automatic identification of arrhythmia also contributes to the research and development of future wearable devices.

Diagnosis of sudden cardiac arrest using principal component analysis in automated external defibrillators

Sudden cardiac arrest (SCA) consisting of ventricular fibrillation and ventricular tachycardia considered as shockable rhythms is a life-threatening heart disease, which is treated efficiently by the automated external defibrillator (AED). This work proposes a novel design of the SAA, which includes a k-nearest neighbors model and a subset of 8 features extracted from the ECG segments, for the SCA diagnosis on the electrocardiogram (ECG) signal. These features are addressed as the most productive subset among 31 input features based on the evaluation of the feature correlation. The recursive feature elimination algorithm combined with the Boosting model and wise-patient fivefold cross-validation method is adopted for the calculation of the average feature importance, which shows the degree of feature correlation, to construct various input feature subsets. Moreover, component feature combinations known as the representatives of the input feature subsets with an enormous level of correlation and independence are transformed from the input subsets by the principal component analysis method. The wise-patient fivefold cross-validation procedure is used for the evaluation of these component feature combinations on the validation set. The proposed SAA is certainly efficient for SCA detection with a small number of the extracted feature and relatively high diagnosis performance such as accuracy of 99.52%, sensitivity of 97.69%, and specificity of 99.91%.

Real-time amplitude spectrum area estimation during chest compression from the ECG waveform using a 1D convolutional neural network

Introduction: Amplitude spectrum area (AMSA) is a well-established measure than can predict defibrillation outcome and guiding individualized resuscitation of ventricular fibrillation (VF) patients. However, accurate AMSA can only be calculated during cardiopulmonary resuscitation (CPR) pause due to artifacts produced by chest compression (CC). In this study, we developed a real-time AMSA estimation algorithm using a convolutional neural network (CNN). Methods: Data were collected from 698 patients, and the AMSA calculated from the uncorrupted signals served as the true value for both uncorrupted and the adjacent corrupted signals. An architecture consisting of a 6-layer 1D CNN and 3 fully connected layers was developed for AMSA estimation. A 5-fold cross-validation procedure was used to train, validate and optimize the algorithm. An independent testing set comprised of simulated data, real-life CC corrupted data, and preshock data was used to evaluate the performance. Results: The mean absolute error, root mean square error, percentage root mean square difference and correlation coefficient were 2.182/1.951 mVHz, 2.957/2.574 mVHz, 22.887/28.649% and 0.804/0.888 for simulated and real-life testing data, respectively. The area under the receiver operating characteristic curve regarding predicting defibrillation success was 0.835, which was comparable to that of 0.849 using the true value of the AMSA. Conclusions: AMSA can be accurately estimated during uninterrupted CPR using the proposed method.

Efficient Lightweight Multimodel Deep Fusion Based on ECG for Arrhythmia Classification

An arrhythmia happens when the electrical signals that organize the heartbeat do not work accurately. Most cases of arrhythmias may increase the risk of stroke or cardiac arrest. As a result, early detection of arrhythmia reduces fatality rates. This research aims to provide a lightweight multimodel based on convolutional neural networks (CNNs) that can transfer knowledge from many lightweight deep learning models and decant it into one model to aid in the diagnosis of arrhythmia by using electrocardiogram (ECG) signals. Thus, we gained a multimodel able to classify arrhythmia from ECG signals. Our system's effectiveness is examined by using a publicly accessible database and a comparison to the current methodologies for arrhythmia classification. The results we achieved by using our multimodel are better than those obtained by using a single model and better than most of the previous detection methods. It is worth mentioning that this model produced accurate classification results on small collection of data. Experts in this field can use this model as a guide to help them make decisions and save time.

Developing Graph Convolutional Networks and Mutual Information for Arrhythmic Diagnosis Based on Multichannel ECG Signals

Cardiovascular diseases, like arrhythmia, as the leading causes of death in the world, can be automatically diagnosed using an electrocardiogram (ECG). The ECG-based diagnostic has notably resulted in reducing human errors. The main aim of this study is to increase the accuracy of arrhythmia diagnosis and classify various types of arrhythmias in individuals (suffering from cardiovascular diseases) using a novel graph convolutional network (GCN) benefitting from mutual information (MI) indices extracted from the ECG leads. In this research, for the first time, the relationships of 12 ECG leads measured using MI as an adjacency matrix were illustrated by the developed GCN and included in the ECG-based diagnostic method. Cross-validation methods were applied to select both training and testing groups. The proposed methodology was validated in practice by applying it to the large ECG database, recently published by Chapman University. The GCN-MI structure with 15 layers was selected as the best model for the selected database, which illustrates a very high accuracy in classifying different types of rhythms. The classification indicators of sensitivity, precision, specificity, and accuracy for classifying heart rhythm type, using GCN-MI, were computed as 98.45%, 97.89%, 99.85%, and 99.71%, respectively. The results of the present study and its comparison with other studies showed that considering the MI index to measure the relationship between cardiac leads has led to the improvement of GCN performance for detecting and classifying the type of arrhythmias, in comparison to the existing methods. For example, the above classification indicators for the GCN with the identity adjacency matrix (or GCN-Id) were reported to be 68.24%, 72.83%, 95.24%, and 92.68%, respectively.

ECG Classification for Detecting ECG Arrhythmia Empowered with Deep Learning Approaches

According to the World Health Organization (WHO) report, heart disease is spreading throughout the world very rapidly and the situation is becoming alarming in people aged 40 or above (Xu, 2020). Different methods and procedures are adopted to detect and diagnose heart abnormalities. Data scientists are working on finding the different methods with the required accuracy (Strodthoff et al., 2021). Electrocardiogram (ECG) is the procedure to find the heart condition in the waveform. For ages, the machine learning techniques, which are feature based, played a vital role in the medical sciences and centralized the data in cloud computing and having access throughout the world. Furthermore, deep learning or transfer learning widens the vision and introduces different transfer learning methods to ensure accuracy and time management to detect the ECG in a better way in comparison to the previous and machine learning methods. Hence, it is said that transfer learning has turned world research into more appropriate and innovative research. Here, the proposed comparison and accuracy analysis of different transfer learning methods by using ECG classification for detecting ECG Arrhythmia (CAA-TL). The CAA-TL model has the multiclassification of the ECG dataset, which has been taken from Kaggle. Some of the healthy and unhealthy datasets have been taken in real-time, augmented, and fused with the Kaggle dataset, i.e., Massachusetts Institute of Technology-Beth Israel Hospital (MIT-BIH dataset). The CAA-TL worked on the accuracy of heart problem detection by using different methods like ResNet50, AlexNet, and SqueezeNet. All three deep learning methods showed remarkable accuracy, which is improved from the previous research. The comparison of different deep learning approaches with respect to layers widens the research and gives the more clarity and accuracy and at the same time finds it time-consuming while working with multiclassification with massive dataset of ECG. The implementation of the proposed method showed an accuracy of 98.8%, 90.08%, and 91% for AlexNet, SqueezeNet, and ResNet50, respectively.

Similarity Maps for Ventricular Arrhythmia Classification

Ventricular arrhythmias are the primary arrhythmias that cause sudden cardiac death. In current clinical and preclinical research, the discovery of new therapies and their translation is hampered by the lack of consistency in diagnostic criteria for distinguishing between ventricular tachycardia (VT) and ventricular fibrillation (VF). This study develops a new set of features, similarity maps, for discrimination between VT and VF using deep neural network architectures. The similarity maps are designed to capture the similarity and the regularity within an ECG trace. Our experiments show that the similarity maps lead to a substantial improvement in distinguishing VT and VF.

A review of progress and an advanced method for shock advice algorithms in automated external defibrillators

Shock advice algorithm plays a vital role in the detection of sudden cardiac arrests on electrocardiogram signals and hence, brings about survival improvement by delivering prompt defibrillation. The last decade has witnessed a surge of research efforts in racing for efficient shock advice algorithms, in this context. On one hand, it has been reported that the classification performance of traditional threshold-based methods has not complied with the American Heart Association recommendations. On the other hand, the rise of machine learning and deep learning-based counterparts is paving the new ways for the development of intelligent shock advice algorithms. In this paper, we firstly provide a comprehensive survey on the development of shock advice algorithms for rhythm analysis in automated external defibrillators. Shock advice algorithms are categorized into three groups based on the classification methods in which the detection performance is significantly improved by the use of machine learning and/or deep learning techniques instead of threshold-based approaches. Indeed, in threshold-based shock advice algorithms, a parameter is calculated as a threshold to distinguish shockable rhythms from non-shockable ones. In contrast, machine learning-based methods combine multiple parameters of conventional threshold-based approaches as a set of features to recognize sudden cardiac arrest. Noticeably, those features are possibly extracted from stand-alone ECGs, alternative signals using various decomposition techniques, or fully augmented ECG segments. Moreover, these signals can be also used directly as the input channels of deep learning-based shock advice algorithm designs. Then, we propose an advanced shock advice algorithm using a support vector machine classifier and a feature set extracted from a fully augmented ECG segment with its shockable and non-shockable signals. The relatively high detection performance of the proposed shock advice algorithm implies a potential application for the automated external defibrillator in the practical clinic environment. Finally, we outline several interesting yet challenging research problems for further investigation.

Machine learning techniques for arrhythmic risk stratification: a review of the literature

Ventricular arrhythmias (VAs) and sudden cardiac death (SCD) are significant adverse events that affect the morbidity and mortality of both the general population and patients with predisposing cardiovascular risk factors. Currently, conventional disease-specific scores are used for risk stratification purposes. However, these risk scores have several limitations, including variations among validation cohorts, the inclusion of a limited number of predictors while omitting important variables, as well as hidden relationships between predictors. Machine learning (ML) techniques are based on algorithms that describe intervariable relationships. Recent studies have implemented ML techniques to construct models for the prediction of fatal VAs. However, the application of ML study findings is limited by the absence of established frameworks for its implementation, in addition to clinicians’ unfamiliarity with ML techniques. This review, therefore, aims to provide an accessible and easy-to-understand summary of the existing evidence about the use of ML techniques in the prediction of VAs. Our findings suggest that ML algorithms improve arrhythmic prediction performance in different clinical settings. However, it should be emphasized that prospective studies comparing ML algorithms to conventional risk models are needed while a regulatory framework is required prior to their implementation in clinical practice.

Detection of COVID19 from X-ray images using multiscale Deep Convolutional Neural Network

The Coronavirus disease 2019 (COVID19) pandemic has led to a dramatic loss of human life worldwide and caused a tremendous challenge to public health. Immediate detection and diagnosis of COVID19 have lifesaving importance for both patients and doctors. The availability of COVID19 tests increased significantly in many countries, thereby provisioning a limited availability of laboratory test kits Additionally, the Reverse Transcription-Polymerase Chain Reaction (RT-PCR) test for the diagnosis of COVID 19 is costly and time-consuming. X-ray imaging is widely used for the diagnosis of COVID19. The detection of COVID19 based on the manual investigation of X-ray images is a tedious process. Therefore, computer-aided diagnosis (CAD) systems are needed for the automated detection of COVID19 disease. This paper proposes a novel approach for the automated detection of COVID19 using chest X-ray images. The Fixed Boundary-based Two-Dimensional Empirical Wavelet Transform (FB2DEWT) is used to extract modes from the X-ray images. In our study, a single X-ray image is decomposed into seven modes. The evaluated modes are used as input to the multiscale deep Convolutional Neural Network (CNN) to classify X-ray images into no-finding, pneumonia, and COVID19 classes. The proposed deep learning model is evaluated using the X-ray images from two different publicly available databases, where database A consists of 1225 images and database B consists of 9000 images. The results show that the proposed approach has obtained a maximum accuracy of 96% and 100% for the multiclass and binary classification schemes using X-ray images from dataset A with 5-fold cross-validation (CV) strategy. For dataset B, the accuracy values of 97.17% and 96.06% are achieved using multiscale deep CNN for multiclass and binary classification schemes with 5-fold CV. The proposed multiscale deep learning model has demonstrated a higher classification performance than the existing approaches for detecting COVID19 using X-ray images.

LDIAED: A lightweight deep learning algorithm implementable on automated external defibrillators

Differentiating between shockable and non-shockable Electrocardiogram (ECG) signals would increase the success of resuscitation by the Automated External Defibrillators (AED). In this study, a Deep Neural Network (DNN) algorithm is used to distinguish 1.4-second segment shockable signals from non-shockable signals promptly. The proposed technique is frequency-independent and is trained with signals from diverse patients extracted from MIT-BIH, MIT-BIH Malignant Ventricular Ectopy Database (VFDB), and a database for ventricular tachyarrhythmia signals from Creighton University (CUDB) resulting, in an accuracy of 99.1%. Finally, the raspberry pi minicomputer is used to load the optimized version of the model on it. Testing the implemented model on the processor by unseen ECG signals resulted in an average latency of 0.845 seconds meeting the IEC 60601-2-4 requirements. According to the evaluated results, the proposed technique could be used by AED’s.

Signal Folding for Efficient Classification of Near-Cyclostationary Biological Signals

The classification of biological signals is important in detecting abnormal conditions in observed biological subjects. The classifiers are trained on feature vectors, which often constitute the parameters of the observed time series data models. Since the feature extraction is usually the most time-consuming step in training a classifier, in this paper, signal folding and the associated folding operator are introduced to reduce the variability in near-cyclostationary biological signals so that these signals can be represented by models that have a lower order. This leads to a substantial reduction in computational complexity, so the classifier can be learned an order of magnitude faster and still maintain its decision accuracy. The performance of different classifiers involving signal folding as a pre-processing step is studied for sleep apnea detection in one-lead ECG signals assuming ARIMA modeling of the time series data. It is shown that the R-peak-based folding of ECG segments has superior performance to other more general, similarity based signal folding methods. The folding order can be optimized for the best classification accuracy. However, signal folding requires precise scaling and alignment of the created signal fragments.

Early Diagnosis of Multiple Sclerosis Using Swept-Source Optical Coherence Tomography and Convolutional Neural Networks Trained with Data Augmentation

BACKGROUND

The aim of this paper is to implement a system to facilitate the diagnosis of multiple sclerosis (MS) in its initial stages. It does so using a convolutional neural network (CNN) to classify images captured with swept-source optical coherence tomography (SS-OCT).

METHODS

SS-OCT images from 48 control subjects and 48 recently diagnosed MS patients have been used. These images show the thicknesses (45 × 60 points) of the following structures: complete retina, retinal nerve fiber layer, two ganglion cell layers (GCL+, GCL++) and choroid. The Cohen distance is used to identify the structures and the regions within them with greatest discriminant capacity. The original database of OCT images is augmented by a deep convolutional generative adversarial network to expand the CNN's training set.

RESULTS

The retinal structures with greatest discriminant capacity are the GCL++ (44.99% of image points), complete retina (26.71%) and GCL+ (22.93%). Thresholding these images and using them as inputs to a CNN comprising two convolution modules and one classification module obtains sensitivity = specificity = 1.0.

CONCLUSIONS

Feature pre-selection and the use of a convolutional neural network may be a promising, nonharmful, low-cost, easy-to-perform and effective means of assisting the early diagnosis of MS based on SS-OCT thickness data.

AFCNNet: Automated detection of AF using chirplet transform and deep convolutional bidirectional long short term memory network with ECG signals

Atrial fibrillation (AF) is the most common type of cardiac arrhythmia and is characterized by the heart's beating in an uncoordinated manner. In clinical studies, patients often do not have visible symptoms during AF, and hence it is harder to detect this cardiac ailment. Therefore, automated detection of AF using the electrocardiogram (ECG) signals can reduce the risk of stroke, coronary artery disease, and other cardiovascular complications. In this paper, a novel time-frequency domain deep learning-based approach is proposed to detect AF and classify terminating and non-terminating AF episodes using ECG signals. This approach involves evaluating the time-frequency representation (TFR) of ECG signals using the chirplet transform. The two-dimensional (2D) deep convolutional bidirectional long short-term memory (BLSTM) neural network model is used to detect and classify AF episodes using the time-frequency images of ECG signals. The proposed TFR based 2D deep learning approach is evaluated using the ECG signals from three public databases. Our developed approach has obtained an accuracy, sensitivity, and specificity of 99.18% (Confidence interval (CI) as [98.86, 99.49]), 99.17% (CI as [98.85 99.49]), and 99.18% (CI as [98.86 99.49]), respectively, with 10-fold cross-validation (CV) technique to detect AF automatically. The proposed approach also classified terminating and non-terminating AF episodes with an average accuracy of 75.86%. The average accuracy value obtained using the proposed approach is higher than the short-time Fourier transform (STFT), discrete-time continuous wavelet transform (DT-CWT), and Stockwell transform (ST) based time-frequency analysis methods with deep convolutional BLSTM models to detect AF. The proposed approach has better AF detection performance than the existing deep learning-based techniques using ECG signals from the MIT-BIH database.

The feasibility of predicting impending malignant ventricular arrhythmias by using nonlinear features of short heartbeat intervals

BACKGROUND AND OBJECTIVE

Malignant ventricular arrhythmias (MAs) occur unpredictably and lead to emergencies. A new approach that uses a timely tracking device e.g., photoplethysmogram (PPG) solely to predict MAs would be irreplaceably valuable and it is natural to expect the approach can predict the occurrence as early as possible.

METHOD

We assumed that with an appropriate metric based on signal complexity, the heartbeat interval time series (HbIs) can be used to manifest the intrinsic characteristics of the period immediately precedes the MAs (preMAs). The approach first characterizes the patterns of preMAs by a new complexity metric (the refined composite multi-scale entropy). The MAs detector is then constructed by checking the discriminability of the MAs against the sinus rhythm and other prevalent arrhythmias (atrial fibrillation and premature ventricular contraction) of three machine-learning models (SVM, Random Forest, and XGboost).

RESULTS

Two specifications are of interest: the length of the HbIs needed to delineate the preMAs patterns sufficiently (l_spec) and how long before the occurrence of MAs will the HbIs manifest specific patterns that are distinct enough to predict the impending MAs (t_spec). Our experimental results confirmed the best performance came from a Random-Forest model with an average precision of 99.99% and recall of 88.98% using a HbIs of 800 heartbeats (the l_spec), 108 seconds (the t_spec) before the occurrence of MAs.

CONCLUSION

By experimental validation of the unique pattern of the preMAs in HbIs and using it in the machine learning model, we showed the high possibility of MAs prediction in a broader circumstance, which may cover daily healthcare using the alternative sensor in HbIs monitoring. Therefore, this research is theoretically and practically significant in cardiac arrest prevention.

Automated accurate emotion recognition system using rhythm-specific deep convolutional neural network technique with multi-channel EEG signals

Emotion is interpreted as a psycho-physiological process, and it is associated with personality, behavior, motivation, and character of a person. The objective of affective computing is to recognize different types of emotions for human-computer interaction (HCI) applications. The spatiotemporal brain electrical activity is measured using multi-channel electroencephalogram (EEG) signals. Automated emotion recognition using multi-channel EEG signals is an exciting research topic in cognitive neuroscience and affective computing. This paper proposes the rhythm-specific multi-channel convolutional neural network (CNN) based approach for automated emotion recognition using multi-channel EEG signals. The delta (δ), theta (θ), alpha (α), beta (β), and gamma (γ) rhythms of EEG signal for each channel are evaluated using band-pass filters. The EEG rhythms from the selected channels coupled with deep CNN are used for emotion classification tasks such as low-valence (LV) vs. high valence (HV), low-arousal (LA) vs. high-arousal (HA), and low-dominance (LD) vs. high dominance (HD) respectively. The deep CNN architecture considered in the proposed work has eight convolutions, three average pooling, four batch-normalization, three spatial drop-outs, two drop-outs, one global average pooling and, three dense layers. We have validated our developed model using three publicly available databases: DEAP, DREAMER, and DASPS. The results reveal that the proposed multivariate deep CNN approach coupled with β-rhythm has obtained the accuracy values of 98.91%, 98.45%, and 98.69% for LV vs. HV, LA vs. HA, and LD vs. HD emotion classification strategies, respectively using DEAP database with 10-fold cross-validation (CV) scheme. Similarly, the accuracy values of 98.56%, 98.82%, and 98.99% are obtained for LV vs. HV, LA vs. HA, and LD vs. HD classification schemes, respectively, using deep CNN and θ-rhythm. The proposed multi-channel rhythm-specific deep CNN classification model has obtained the average accuracy value of 57.14% using α-rhythm and trial-specific CV using DASPS database. Moreover, for 8-quadrant based emotion classification strategy, the deep CNN based classifier has obtained an overall accuracy value of 24.37% using γ-rhythms of multi-channel EEG signals. Our developed deep CNN model can be used for real-time automated emotion recognition applications.

Automated Classification of Mental Arithmetic Tasks Using Recurrent Neural Network and Entropy Features Obtained from Multi-Channel EEG Signals

The automated classification of cognitive workload tasks based on the analysis of multi-channel EEG signals is vital for human–computer interface (HCI) applications. In this paper, we propose a computerized approach for categorizing mental-arithmetic-based cognitive workload tasks using multi-channel electroencephalogram (EEG) signals. The approach evaluates various entropy features, such as the approximation entropy, sample entropy, permutation entropy, dispersion entropy, and slope entropy, from each channel of the EEG signal. These features were fed to various recurrent neural network (RNN) models, such as long-short term memory (LSTM), bidirectional LSTM (BLSTM), and gated recurrent unit (GRU), for the automated classification of mental-arithmetic-based cognitive workload tasks. Two cognitive workload classification strategies (bad mental arithmetic calculation (BMAC) vs. good mental arithmetic calculation (GMAC); and before mental arithmetic calculation (BFMAC) vs. during mental arithmetic calculation (DMAC)) are considered in this work. The approach was evaluated using the publicly available mental arithmetic task-based EEG database. The results reveal that our proposed approach obtained classification accuracy values of 99.81%, 99.43%, and 99.81%, using the LSTM, BLSTM, and GRU-based RNN classifiers, respectively for the BMAC vs. GMAC cognitive workload classification strategy using all entropy features and a 10-fold cross-validation (CV) technique. The slope entropy features combined with each RNN-based model obtained higher classification accuracy compared with other entropy features for the classification of the BMAC vs. GMAC task. We obtained the average classification accuracy values of 99.39%, 99.44%, and 99.63% for the classification of the BFMAC vs. DMAC tasks, using the LSTM, BLSTM, and GRU classifiers with all entropy features and a hold-out CV scheme. Our developed automated mental arithmetic task system is ready to be tested with more databases for real-world applications.

Detection of ventricular arrhythmia using hybrid time-frequency-based features and deep neural network

Sudden cardiac death (SCD) is a major cause of death among patients with heart diseases. It occurs mainly due to ventricular tachyarrhythmia (VTA) which includes ventricular tachycardia (VT) and ventricular fibrillation (VF) conditions. The main challenging task is to predict the VTA condition at a faster rate and timely application of automatic external defibrillator (AED) for saving lives. In this study, a VF/VT classification scheme has been proposed using a deep neural network (DNN) approach using hybrid time-frequency-based features. Two annotated public domain ECG databases (CUDB and VFDB) were used as training, test, and validation of datasets. The main motivation of this study was to implement a deep learning model for the classification of the VF/VT conditions and compared the results with other standard machine learning algorithms. The signal is decomposed with the wavelet transform, empirical mode decomposition (EMD) and variable mode decomposition (VMD) approaches and twenty-four are extracted to form a hybrid model from a window of length 5 s length. The DNN classifier achieved an accuracy (Acc) of 99.2%, sensitivity (Se) of 98.8%, and specificity (Sp) of 99.3% which is comparatively better than the results of the standard classifier. The proposed algorithm can detect VTA conditions accurately, hence could reduce the rate of misinterpretations by human experts and improves the efficiency of cardiac diagnosis by ECG signal analysis.

Development of Automated Sleep Stage Classification System Using Multivariate Projection-Based Fixed Boundary Empirical Wavelet Transform and Entropy Features Extracted from Multichannel EEG Signals

The categorization of sleep stages helps to diagnose different sleep-related ailments. In this paper, an entropy-based information–theoretic approach is introduced for the automated categorization of sleep stages using multi-channel electroencephalogram (EEG) signals. This approach comprises of three stages. First, the decomposition of multi-channel EEG signals into sub-band signals or modes is performed using a novel multivariate projection-based fixed boundary empirical wavelet transform (MPFBEWT) filter bank. Second, entropy features such as bubble and dispersion entropies are computed from the modes of multi-channel EEG signals. Third, a hybrid learning classifier based on class-specific residuals using sparse representation and distances from nearest neighbors is used to categorize sleep stages automatically using entropy-based features computed from MPFBEWT domain modes of multi-channel EEG signals. The proposed approach is evaluated using the multi-channel EEG signals obtained from the cyclic alternating pattern (CAP) sleep database. Our results reveal that the proposed sleep staging approach has obtained accuracies of 91.77%, 88.14%, 80.13%, and 73.88% for the automated categorization of wake vs. sleep, wake vs. rapid eye movement (REM) vs. Non-REM, wake vs. light sleep vs. deep sleep vs. REM sleep, and wake vs. S1-sleep vs. S2-sleep vs. S3-sleep vs. REM sleep schemes, respectively. The developed method has obtained the highest overall accuracy compared to the state-of-art approaches and is ready to be tested with more subjects before clinical application.