An overview on semi-supervised support vector machine

A Dual-Branch Fusion of a Graph Convolutional Network and a Convolutional Neural Network for Hyperspectral Image Classification

Semi-supervised graph convolutional networks (SSGCNs) have been proven to be effective in hyperspectral image classification (HSIC). However, limited training data and spectral uncertainty restrict the classification performance, and the computational demands of a graph convolution network (GCN) present challenges for real-time applications. To overcome these issues, a dual-branch fusion of a GCN and convolutional neural network (DFGCN) is proposed for HSIC tasks. The GCN branch uses an adaptive multi-scale superpixel segmentation method to build fusion adjacency matrices at various scales, which improves the graph convolution efficiency and node representations. Additionally, a spectral feature enhancement module (SFEM) enhances the transmission of crucial channel information between the two graph convolutions. Meanwhile, the CNN branch uses a convolutional network with an attention mechanism to focus on detailed features of local areas. By combining the multi-scale superpixel features from the GCN branch and the local pixel features from the CNN branch, this method leverages complementary features to fully learn rich spatial-spectral information. Our experimental results demonstrate that the proposed method outperforms existing advanced approaches in terms of classification efficiency and accuracy across three benchmark data sets.

Real-time monitoring and predictive analysis of VOC flux variations in soil vapor: Integrating PID sensing with machine learning for enhanced vapor intrusion forecasts

In the rapidly evolving domain of vapor intrusion (VI) assessments, traditional methodologies encompass detailed groundwater and soil vapor sampling coupled with comprehensive laboratory measurements. These models, blending empirical data, theoretical equations, and site-specific parameters, evaluate VI risks by considering a spectrum of influential factors, from volatile organic compounds (VOC) concentrations in groundwater to nuanced soil attributes. However, the challenge of variability, influenced by dynamic ambient conditions and intricate soil properties, remains. Our study presents an advanced on-site gas sensing station geared towards real-time VOC flux monitoring, enriched with an array of ambient sensors, and spearheaded by the reliable PID sensor for VOC detection. Integrating this dynamic system with machine learning, we developed predictive models, notably the random forest regression, which boasts an R-squared value exceeding 79 % and mean relative error near 0.25, affirming its capability to predict trichloroethylene (TCE) concentrations in soil vapor accurately. By synergizing real-time monitoring and predictive insights, our methodology refines VI risk assessments, equipping communities with proactive, informed decision-making tools and bolstering environmental safety. Implementing these predictive models can simplify monitoring for residents, reducing dependence on specialized systems. Once proven effective, there's potential to repurpose monitoring stations to other VI-prone regions, expanding their reach and benefit. The developed model can leverage weather forecasting data to predict and provide alerts for future VOC events.

Forest fire susceptibility assessment under small sample scenario: A semi-supervised learning approach using transductive support vector machine

Forest fires threaten global ecosystems, socio-economic structures, and public safety. Accurately assessing forest fire susceptibility is critical for effective environmental management. Supervised learning methods dominate this assessment, relying on a substantial dataset of forest fire occurrences for model training. However, obtaining precise forest fire location data remains challenging. To address this issue, semi-supervised learning emerges as a viable solution, leveraging both a limited set of collected samples and unlabeled data containing environmental factors for training. Our study employed the transductive support vector machine (TSVM), a key semi-supervised learning method, to assess forest fire susceptibility in scenarios with limited samples. We conducted a comparative analysis, evaluating its performance against widely used supervised learning methods. The assessment area for forest fire susceptibility lies in Dayu County, Jiangxi Province, China, renowned for its vast forest cover and frequent fire incidents. We analyzed and generated maps depicting forest fire susceptibility, evaluating prediction accuracies for both supervised and semi-supervised learning methods across various small sample scenarios (e.g., 4, 8, 12, 16, 20, 24, 28, and 32 samples). Our findings indicate that TSVM exhibits superior prediction accuracy compared to supervised learning with limited samples, yielding more plausible forest fire susceptibility maps. For instance, at sample sizes of 4, 16, and 28, TSVM achieves prediction accuracies of approximately 0.8037, 0.9257, and 0.9583, respectively. In contrast, random forests, the top performers in supervised learning, demonstrate accuracies of approximately 0.7424, 0.8916, and 0.9431, respectively, for the same small sample sizes. Additionally, we discussed three key aspects: TSVM parameter configuration, the impact of unlabeled sample size, and performance within typical sample sizes. Our findings support semi-supervised learning as a promising approach compared to supervised learning for forest fire susceptibility assessment and mapping, particularly in scenarios with small sample sizes.

Segment alignment based cross-subject motor imagery classification under fading data

Motor imagery (MI) aims to use brain imagination without actual body activities to support motor learning, and machine learning algorithms such as common spatial patterns (CSP) are proven effective in the analysis of MI signals. In the conventional machine learning-based approaches, there are two main difficulties in feature extraction and recognition of MI signals: high personalization and data fading. The high personalization problem is due to the multi-subject nature when collecting MI signals, and the data fading problem as a recurring issue in MI signal quality is first raised by us but is not widely discussed at present. Aiming to solve the above two mentioned problems, a cross-subject fading data classification approach with segment alignment is proposed to classify the fading data of one single target with the model trained with the normal data of multiple sources in this paper. he effectiveness of proposed method is verified via two experiments: a dataset-based experiment with the dataset from BCI Competition and a lab-based experiment designed and conducted by us. The experimental results obtained from both experiments show that the proposed method can obtain optimal classification performance effectively under different fading levels with data from different subjects.

Terahertz spectroscopic detection of antifatigue illegal additives in health care product matrices

Tadalafil is an illegal additive in antifatigue supplements. It is often misused in various plant dietary supplements (BDS), resulting in serious health risks. In this paper, terahertz spectroscopy combined with chemometrics is used to quantitatively analyze the content of tadalafil in nutritional and health products. The absorption coefficient spectrum of tadalafil in the range of 0.1-2.5 THz was obtained, and an obvious characteristic absorption peak appeared at 1.7 THz. To verify the accuracy of this characteristic absorption peak theoretically, tadalafil was simulated by density functional theory, and the calculated terahertz vibration spectrum matched well with the experimental spectrum. Then, the pure fatigue-based nutraceutical matrix and pure tadalafil were mixed in different proportions, and the terahertz absorption coefficient spectra of the mixtures were obtained. Finally, a quantitative analysis model of the tadalafil mixture was developed based on the support vector regression (SVR) algorithm, and the SVR model was optimized using particle swarm optimization (PSO) and genetic algorithm (GA), respectively. Compared with the SVR model, both PSO-SVR and GA-SVR enabled some improvement in their prediction accuracy, but the PSO-SVR model ran faster at 4.85 s, whereas the GA-SVR model had a higher prediction accuracy with a prediction set correlation coefficient (R _P) of 0.9996 and a root mean square error (RMSEP) of 0.011. In summary, this study used terahertz time-domain spectroscopy for the identification and quantification of tadalafil in health product matrices. This study provides a new solution for the nondestructive detection of illegally added tadalafil in antifatigue health products, which is pivotal to the quality control of the health product industry.

Landslide Susceptibility Mapping Based on the Germinal Center Optimization Algorithm and Support Vector Classification

A landslide susceptibility model based on a metaheuristic optimization algorithm (germinal center optimization (GCO)) and support vector classification (SVC) is proposed and applied to landslide susceptibility mapping in the Three Gorges Reservoir area in this paper. The proposed GCO-SVC model was constructed via the following steps: First, data on 11 influencing factors and 292 landslide polygons were collected to establish the spatial database. Then, after the influencing factors were subjected to multicollinearity analysis, the data were randomly divided into training and testing sets at a ratio of 7:3. Next, the SVC model with 5-fold cross-validation was optimized by hyperparameter space search using GCO to obtain the optimal hyperparameters, and then the best model was constructed based on the optimal hyperparameters and training set. Finally, the best model acquired by GCO-SVC was applied for landslide susceptibility mapping (LSM), and its performance was compared with that of 6 popular models. The proposed GCO-SVC model achieved better performance (0.9425) than the genetic algorithm support vector classification (GA-SVC; 0.9371), grid search optimized support vector classification (GRID-SVC; 0.9198), random forest (RF; 0.9085), artificial neural network (ANN; 0.9075), K-nearest neighbor (KNN; 0.8976), and decision tree (DT; 0.8914) models in terms of the area under the receiver operating characteristic curve (AUC), and the trends of the other metrics were consistent with that of the AUC. Therefore, the proposed GCO-SVC model has some advantages in LSM and may be worth promoting for wide use.

Semi-supervised multi-label classification using an extended graph-based manifold regularization

Graph-based algorithms are known to be effective approaches to semi-supervised learning. However, there has been relatively little work on extending these algorithms to the multi-label classification case. We derive an extension of the Manifold Regularization algorithm to multi-label classification, which is significantly simpler than the general Vector Manifold Regularization approach. We then augment our algorithm with a weighting strategy to allow differential influence on a model between instances having ground-truth vs. induced labels. Experiments on four benchmark multi-label data sets show that the resulting algorithm performs better overall compared to the existing semi-supervised multi-label classification algorithms at various levels of label sparsity. Comparisons with state-of-the-art supervised multi-label approaches (which of course are fully labeled) also show that our algorithm outperforms all of them even with a substantial number of unlabeled examples.

MDD-TSVM: A novel semisupervised-based method for major depressive disorder detection using electroencephalogram signals

Major depressive disorder (MDD) is a common mental illness characterized by persistent feeling of depressed mood and loss of interest. It would cause, in a severe case, suicide behaviors. In clinical settings, automatic MDD detection is mainly based on electroencephalogram (EEG) signals with supervised learning techniques. However, supervised-based MDD detection methods encounter two ineviTable bottlenecks: firstly, such methods rely heavily on an EEG training dataset with MDD labels annotated by a physical therapist, leading to subjectivity and high cost; secondly, most of EEG signals are unlabeled in a real scenario. In this paper, a novel semisupervised-based MDD detection method named MDD-TSVM is presented. Specifically, the MDD-TSVM utilizes the semisupervised method of transductive support vector machine (TSVM) as its backbone, further dividing the unlabeled penalty item of the TSVM objective function into two pseudo-labeled penalty items with or without MDD. By such improvement, the MDD-SVM can make full use of labeled and unlabeled datasets as well as alleviate the class imbalance problem. Experiment results showed that our proposed MDD-TSVM achieved F1 score of 0.85 ± 0.05 and accuracy of 0.89 ± 0.03 on identifying MDD patients, which is superior to the state-of-the-art methods.

Optimizing Matching Area for Underwater Gravity-Aided Inertial Navigation Based on the Convolution Slop Parameter-Support Vector Machine Combined Method

This paper focuses on the selection of matching areas in the gravity-aided inertial navigation system. Firstly, the Sobel operator was used in convolution of the gravity anomaly map to obtain the feature map. The convolution slope parameters were constructed by combining the feature map and the gravity anomaly map. The characteristic parameters, such as the difference between convolution rows and columns, convolution variance of the feature map, the pooling difference, and range of the gravity anomaly map, were combined. Based on the support vector machine algorithm, the convolution slope parameter-support vector machine combined method is proposed. Second, we selected the appropriate training sample set and set parameters to verify. The results show that compared with the pre-calibration results, the classification accuracy of the test set is more than 92%, which proves that the convolution slope parameter-support vector machine combined method can effectively distinguish between the suitable and the unsuitable area. Thirdly, we applied this method to another region. The navigation experiment was performed in the split-matching area. The average positioning error was better than 100 m, and the correct rate was more than 90%. The results show that sailing in the selected area can accurately match the trajectory and reduce the positioning error.

A Novel Approach to Oil Layer Recognition Model Using Whale Optimization Algorithm and Semi-Supervised SVM

The dataset distribution of actual logging is asymmetric, as most logging data are unlabeled. With the traditional classification model, it is hard to predict the oil and gas reservoir accurately. Therefore, a novel approach to the oil layer recognition model using the improved whale swarm algorithm (WOA) and semi-supervised support vector machine (S3VM) is proposed in this paper. At first, in order to overcome the shortcomings of the Whale Optimization Algorithm applied in the parameter-optimization of the S3VM model, such as falling into a local optimization and low convergence precision, an improved WOA was proposed according to the adaptive cloud strategy and the catfish effect. Then, the improved WOA was used to optimize the kernel parameters of S3VM for oil layer recognition. In this paper, the improved WOA is used to test 15 benchmark functions of CEC2005 compared with five other algorithms. The IWOA–S3VM model is used to classify the five kinds of UCI datasets compared with the other two algorithms. Finally, the IWOA–S3VM model is used for oil layer recognition. The result shows that (1) the improved WOA has better convergence speed and optimization ability than the other five algorithms, and (2) the IWOA–S3VM model has better recognition precision when the dataset contains a labeled and unlabeled dataset in oil layer recognition.

Estimation of chlorophyll-a Concentration of lakes based on SVM algorithm and Landsat 8 OLI images

Chlorophyll-a (Chl-a) is the main component of phytoplankton and an important index of water quality. Pearson correlation analysis is conducted on measured Chl-a concentration and band reflectance to determine the sensitive bands or multiband combinations of the Chl-a to input to a support vector machine (SVM) model. An indicator β is defined to evaluate the model performance of fitting and prediction. The model performs well with the lowest β (decision coefficient, (R²) = 0.774; root mean square error (RMSE) = 22.636 μg/L) of the validation set. The model test results prove that the model performs well. We analyze the impact factors of the model. The seasonal factor affects the model performance significantly; thus, samples from different seasons should be combined to train the model and inverse the water quality. Noise points reduce the model accuracy significantly; therefore, obvious outliers must be excluded at first. Additionally, the sampling method affects model accuracy, and systematic sampling in the descending order of Chl-a concentration is recommended. The combination of SVM algorithm and remote sensing technology provides a convenient, scientific, and real-time method to monitor and control water quality.

Deep Low-Density Separation for Semi-supervised Classification

Given a small set of labeled data and a large set of unlabeled data, semi-supervised learning (ssl) attempts to leverage the location of the unlabeled datapoints in order to create a better classifier than could be obtained from supervised methods applied to the labeled training set alone. Effective ssl imposes structural assumptions on the data, e.g. that neighbors are more likely to share a classification or that the decision boundary lies in an area of low density. For complex and high-dimensional data, neural networks can learn feature embeddings to which traditional ssl methods can then be applied in what we call hybrid methods.

Previously-developed hybrid methods iterate between refining a latent representation and performing graph-based ssl on this representation. In this paper, we introduce a novel hybrid method that instead applies low-density separation to the embedded features. We describe it in detail and discuss why low-density separation may better suited for ssl on neural network-based embeddings than graph-based algorithms. We validate our method using in-house customer survey data and compare it to other state-of-the-art learning methods. Our approach effectively classifies thousands of unlabeled users from a relatively small number of hand-classified examples.

Artificial Intelligence for Mental Health and Mental Illnesses: an Overview

PURPOSE OF REVIEW

Artificial intelligence (AI) technology holds both great promise to transform mental healthcare and potential pitfalls. This article provides an overview of AI and current applications in healthcare, a review of recent original research on AI specific to mental health, and a discussion of how AI can supplement clinical practice while considering its current limitations, areas needing additional research, and ethical implications regarding AI technology.

RECENT FINDINGS

We reviewed 28 studies of AI and mental health that used electronic health records (EHRs), mood rating scales, brain imaging data, novel monitoring systems (e.g., smartphone, video), and social media platforms to predict, classify, or subgroup mental health illnesses including depression, schizophrenia or other psychiatric illnesses, and suicide ideation and attempts. Collectively, these studies revealed high accuracies and provided excellent examples of AI's potential in mental healthcare, but most should be considered early proof-of-concept works demonstrating the potential of using machine learning (ML) algorithms to address mental health questions, and which types of algorithms yield the best performance. As AI techniques continue to be refined and improved, it will be possible to help mental health practitioners re-define mental illnesses more objectively than currently done in the DSM-5, identify these illnesses at an earlier or prodromal stage when interventions may be more effective, and personalize treatments based on an individual's unique characteristics. However, caution is necessary in order to avoid over-interpreting preliminary results, and more work is required to bridge the gap between AI in mental health research and clinical care.

3D Reconstruction of Slug Flow in Mini-Channels with a Simple and Low-Cost Optical Sensor

The present work provides a new approach for 3D image reconstruction of gas-liquid two-phase flow (GLF) in mini-channels based on a new optical sensor. The sensor consists of a vertical and a horizontal photodiode array. Firstly, with the optical signals obtained by the vertical array, a measurement model developed by Support Vector Regression (SVR) was used to determine the cross-sectional information. The determined information was further used to reconstruct cross-sectional 2D images. Then, the gas velocity was calculated according to the signals obtained by the horizontal array, and the spatial interval of the 2D images was determined. Finally, 3D images were reconstructed by piling up the 2D images. In this work, the cross-sectional gas-liquid interface was considered as circular, and high-speed visualization was utilized to provide the reference values. The image deformation caused by channel wall was also considered. Experiments of slug flow in a channel with an inner diameter of 4.0 mm were carried out. The results verify the feasibility of the proposed 3D reconstruction method. The proposed method has the advantages of simple construct, low cost, and easily multipliable. The reconstructed 3D images can provide detailed and undistorted information of flow structure, which could further improve the measurement accuracy of other important parameters of gas-liquid two-phase flow, such as void fraction, pressure drop, and flow pattern.

EEG-Based Adaptive Driver-Vehicle Interface Using Variational Autoencoder and PI-TSVM

Event-related potential (ERP)-based driver-vehicle interfaces (DVIs) have been developed to provide a communication channel for people with disabilities to drive a vehicle. However, they require a tedious and time-consuming training procedure to build the decoding model, which can translate EEG signals into commands. In this paper, to address this problem, we propose an adaptive DVI by using a new semi-supervised algorithm. The decoding model of the proposed DVI is first built with a small labeled training set, and then gradually improved by updating the proposed semi-supervised decoding model with new collected unlabeled EEG signals. In our semi-supervised algorithm, independent component analysis (ICA) and Kalman smoother are first used to improve the signal-to-noise ratio (SNR). After that, variational autoencoder is applied to provide a robust feature representation of EEG signals. Finally, a prior information-based transductive support vector machine (PI-TSVM) classifier is developed to translate these features into commands. Experimental results show that the proposed DVI can significantly reduce the training effort. After a short updating, its performance can be close to that of the supervised DVI requiring a lengthy training procedure. This work is vital for advancing the application of these DVIs.