Variational-based latent generalized Dirichlet allocation model in the collapsed space and applications

Improving fraud detection with semi-supervised topic modeling and keyword integration

Fraud detection through auditors' manual review of accounting and financial records has traditionally relied on human experience and intuition. However, replicating this task using technological tools has represented a challenge for information security researchers. Natural language processing techniques, such as topic modeling, have been explored to extract information and categorize large sets of documents. Topic modeling, such as latent Dirichlet allocation (LDA) or non-negative matrix factorization (NMF), has recently gained popularity for discovering thematic structures in text collections. However, unsupervised topic modeling may not always produce the best results for specific tasks, such as fraud detection. Therefore, in the present work, we propose to use semi-supervised topic modeling, which allows the incorporation of specific knowledge of the study domain through the use of keywords to learn latent topics related to fraud. By leveraging relevant keywords, our proposed approach aims to identify patterns related to the vertices of the fraud triangle theory, providing more consistent and interpretable results for fraud detection. The model's performance was evaluated by training with several datasets and testing it with another one that did not intervene in its training. The results showed efficient performance averages with a 7% increase in performance compared to a previous job. Overall, the study emphasizes the importance of deepening the analysis of fraud behaviors and proposing strategies to identify them proactively.

Cross-collection latent Beta-Liouville allocation model training with privacy protection and applications

Cross-collection topic models extend previous single-collection topic models, such as Latent Dirichlet Allocation (LDA), to multiple collections. The purpose of cross-collection topic modeling is to model document-topic representations and reveal similarities between each topic and differences among groups. However, the restriction of Dirichlet prior and the significant privacy risk have hampered those models' performance and utility. Training those cross-collection topic models may, in particular, leak sensitive information from the training dataset. To address the two issues mentioned above, we propose a novel model, cross-collection latent Beta-Liouville allocation (ccLBLA), which operates a more powerful prior, Beta-Liouville distribution with a more general covariance structure that enhances topic correlation analysis. To provide privacy protection for the ccLBLA model, we leverage the inherent differential privacy guarantee of the Collapsed Gibbs Sampling (CGS) inference scheme and then propose a hybrid privacy protection algorithm for the ccLBLA model (HPP-ccLBLA) that prevents inferring data from intermediate statistics during the CGS training process without sacrificing its utility. More crucially, our technique is the first attempt to use the cross-collection topic model in image classification applications and investigate the cross-collection topic model's capabilities beyond text analysis. The experimental results for comparative text mining and image classification will show the merits of our proposed approach.

Topic analysis of Road safety inspections using latent dirichlet allocation: A case study of roadside safety in Irish main roads

Under the Safe System framework, Road Authorities have a responsibility to deliver inherently safe roads and streets. Addressing this problem depends on knowledge of the road network safety conditions and the number of funds available for new road safety interventions. It also requires the prioritisation of the various interventions that may generate benefits, increasing safety, while ensuring that reasonable steps are taken to remedy the deficiencies detected within a reasonable timeframe. In this context, Road Safety Inspections (RSI) are a proactive tool for identifying safety issues, consisting of a regular, systematic, on-site inspection of existing roads, covering the whole road network, carried out by trained safety expert teams. This paper aims to describe how topic modelling can be effectively used to identify co-occurrence patterns of attributes related to the run-off-road crashes, as well as the corresponding patterns of road safety interventions, as described in the RSI reports. We apply latent Dirichlet allocation (LDA), a widespread method for fitting a topic model, to analyse the topics mentioned in RSI reports, divided into two groups: problems found; and proposed solutions. For this study, 54 RSI gathered over six years (2012-2017) were analysed, covering 4011 km of Irish roads. The results indicate that important keywords relating to the "forgiving roadside" and "clear zone" concepts, as well as the relevant European technical standards (CEN-EN1317 and EN 12,767), are absent from the extracted latent topics. We also found that the frequency of topics related to roadside safety is higher in the problems record set than in the solutions record set, meaning that problems are more easily identified and related to the roadside area than interventions may be. This paper presents methodological empirical evidence that the LDA is appropriate for identifying the co-occurrence patterns of attributes related to the ROR crashes in road safety inspections' reports, as well as the interventions' patterns associated with these crashes. Also, it provides valuable information aimed to determine the extent to which national road authorities in Europe and their contractors are currently capable of implementing and maintaining compliance with roadside standards and guidelines throughout the life cycle of roads.