New approach for near-infrared wavelength selection using a combination of MIC and firefly evolution

Full-length spectral data analysis has a big problem that the variables are highly in collinearity and correlation. Spectral wavelength selection is a continuing hot topic in quantitative or qualitative analysis. In this paper, we propose a new approach for near-infrared (NIR) wavelength selection. The novel strategy mainly refers to the modification of maximum information coefficient (MIC) method and an improvement of firefly evolutionary algorithm. We introduce the orthogonal decomposition to modify the MIC method, so as to search the informative signals conceived in projection vectors. We also raise the common firefly algorithm (FA) as in the discretized mode, and design a novel adaptive mapping function to improve its intelligent computing effect. In experiment, the modified MIC (MICm) method and the adaptive discrete FA algorithm (DFAadp) are joint together for combined optimization of the NIR calibration model. The proposed combined modeling strategy is applied for quantitative analysis of the fishmeal samples, in the concern to select their informative variables/wavelengths. Experimental results indicate that the combination of MICm and DFAadp perform better than traditional MIC method and common DFA. We conclude that the proposed combined optimization strategy is beneficial for wavelength selection in NIR spectral analysis. It is anticipated to be validated for further applications in a wide range.

McTwo: a two-step feature selection algorithm based on maximal information coefficient

BACKGROUND

High-throughput bio-OMIC technologies are producing high-dimension data from bio-samples at an ever increasing rate, whereas the training sample number in a traditional experiment remains small due to various difficulties. This "large p, small n" paradigm in the area of biomedical "big data" may be at least partly solved by feature selection algorithms, which select only features significantly associated with phenotypes. Feature selection is an NP-hard problem. Due to the exponentially increased time requirement for finding the globally optimal solution, all the existing feature selection algorithms employ heuristic rules to find locally optimal solutions, and their solutions achieve different performances on different datasets.

RESULTS

This work describes a feature selection algorithm based on a recently published correlation measurement, Maximal Information Coefficient (MIC). The proposed algorithm, McTwo, aims to select features associated with phenotypes, independently of each other, and achieving high classification performance of the nearest neighbor algorithm. Based on the comparative study of 17 datasets, McTwo performs about as well as or better than existing algorithms, with significantly reduced numbers of selected features. The features selected by McTwo also appear to have particular biomedical relevance to the phenotypes from the literature.

CONCLUSION

McTwo selects a feature subset with very good classification performance, as well as a small feature number. So McTwo may represent a complementary feature selection algorithm for the high-dimensional biomedical datasets.