Designing a hybrid dimension reduction for improving the performance of Amharic news document classification

Feature selection by integrating document frequency with genetic algorithm for Amharic news document classification

Text classification is the process of categorizing documents based on their content into a predefined set of categories. Text classification algorithms typically represent documents as collections of words and it deals with a large number of features. The selection of appropriate features becomes important when the initial feature set is quite large. In this paper, we present a hybrid of document frequency (DF) and genetic algorithm (GA)-based feature selection method for Amharic text classification. We evaluate this feature selection method on Amharic news documents obtained from the Ethiopian News Agency (ENA). The number of categories used in this study is 13. Our experimental results showed that the proposed feature selection method outperformed other feature selection methods utilized for Amharic news document classification. Combining the proposed feature selection method with Extra Tree Classifier (ETC) improves classification accuracy. It improves classification accuracy up to 1% higher than the hybrid of DF, information gain (IG), chi-square (CHI), and principal component analysis (PCA), 2.47% greater than GA and 3.86% greater than a hybrid of DF, IG, and CHI.

Risk prediction of diabetic nephropathy using machine learning techniques: A pilot study with secondary data

AIMS

This research work presented a comparative study of machine learning (ML), including two objectives: (i) determination of the risk factors of diabetic nephropathy (DN) based on principal component analysis (PCA) via different cutoffs; (ii) prediction of DN patients using ML-based techniques.

METHODS

The combination of PCA and ML-based techniques has been implemented to select the best features at different PCA cutoff values and choose the optimal PCA cutoff in which ML-based techniques give the highest accuracy. These optimum features are fed into six ML-based techniques: linear discriminant analysis, support vector machine (SVM), logistic regression, K-nearest neighborhood, naïve Bayes, and artificial neural network. The leave-one-out cross-validation protocol is executed and compared ML-based techniques performance using accuracy and area under the curve (AUC).

RESULTS

The data utilized in this work consists of 133 respondents having 73 DN patients with an average age of 69.6±10.2 years and 54.2% of DN patients are female. Our findings illustrate that PCA combined with SVM-RBF classifier yields 88.7% accuracy and 0.91 AUC at 0.96 PCA cutoff.

CONCLUSIONS

This study also suggests that PCA combined with SVM-RBF classifier may correctly classify DN patients with the highest accuracy when compared to the models published in the existing research. Prospective studies are warranted to further validate the applicability of our model in clinical settings.