A Universal Detection Method for Adversarial Examples and Fake Images

Deep-learning technologies have shown impressive performance on many tasks in recent years. However, there are multiple serious security risks when using deep-learning technologies. For examples, state-of-the-art deep-learning technologies are vulnerable to adversarial examples that make the model's predictions wrong due to some specific subtle perturbation, and these technologies can be abused for the tampering with and forgery of multimedia, i.e., deep forgery. In this paper, we propose a universal detection framework for adversarial examples and fake images. We observe some differences in the distribution of model outputs for normal and adversarial examples (fake images) and train the detector to learn the differences. We perform extensive experiments on the CIFAR10 and CIFAR100 datasets. Experimental results show that the proposed framework has good feasibility and effectiveness in detecting adversarial examples or fake images. Moreover, the proposed framework has good generalizability for the different datasets and model structures.

Application of Multimodal Fusion Technology in Image Analysis of Pretreatment Examination of Patients with Spinal Injury

As one of the most common imaging screening techniques for spinal injuries, MRI is of great significance for the pretreatment examination of patients with spinal injuries. With rapid iterative update of imaging technology, imaging techniques such as diffusion weighted magnetic resonance imaging (DWI), dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI), and magnetic resonance spectroscopy are frequently used in the clinical diagnosis of spinal injuries. Multimodal medical image fusion technology can obtain richer lesion information by combining medical images in multiple modalities. Aiming at the two modalities of DCE-MRI and DWI images under MRI images of spinal injuries, by fusing the image data under the two modalities, more abundant lesion information can be obtained to diagnose spinal injuries. The research content includes the following: (1) A registration study based on DCE-MRI and DWI image data. To improve registration accuracy, a registration method is used, and VGG-16 network structure is selected as the basic registration network structure. An iterative VGG-16 network framework is proposed to realize the registration of DWI and DCE-MRI images. The experimental results show that the iterative VGG-16 network structure is more suitable for the registration of DWI and DCE-MRI image data. (2) Based on the fusion research of DCE-MRI and DWI image data. For the registered DCE-MRI and DWI images, this paper uses a fusion method combining feature level and decision level to classify spine images. The simple classifier decision tree, SVM, and KNN were used to predict the damage diagnosis classification of DCE-MRI and DWI images, respectively. By comparing and analyzing the classification results of the experiments, the performance of multimodal image fusion in the auxiliary diagnosis of spinal injuries was evaluated.

Domain adaptation based on rough adjoint inconsistency and optimal transport for identifying autistic patients

BACKGROUND AND OBJECTIVE

Computer aided diagnosis technology has been widely used to diagnose autism spectrum disorder (ASD) from neural images. The performance of the model usually depends largely on a sufficient number of training samples that reflect the real sample distribution. Due to the lack of labelled neural images data, multisite data are often pooled together to expand the sample size. However, the heterogeneity among sites will inevitably lead to a decline in the generalization of models. To solve this problem, we propose a multisource unsupervised domain adaptation method using rough adjoint inconsistency and optimal transport.

METHODS

First, we define the concept of rough adjoint inconsistency and propose a double quantization method based on rough adjoint inconsistency and Dempster-Shafer (D-S) evidence theory to estimate the weight coefficient of each source domain to accurately describe the importance of each source domain to the target domain. Second, using optimal transport theory, we weaken the data distribution differences between domains and solve the problem of class imbalance by adjusting the sampling weights among classes.

RESULTS

The ASD recognition accuracy of the proposed method is improved on all eight tasks, which are 70.67%, 64.86%, 62.50%, 70.80%, 73.08%, 71.19%, 75.41% and 75.76%, respectively. Our proposed model achieves superior performance compared to traditional machine learning methods and other recently proposed deep learning model.

CONCLUSIONS

Our method demonstrates that the fusion of rough adjoint inconsistency and optimal transport can be a powerful tool for identifying ASD and quantifying the correlations between domains.