On the utilization of deep and ensemble learning to detect milk adulteration

Spectral Profiling (Fourier Transform Infrared Spectroscopy) and Machine Learning for the Recognition of Milk from Different Bovine Breeds

The Podolica cattle breed is widespread in southern Italy, and its productivity is characterized by low yields and an extraordinary quality of milk and meats. Most of the milk produced is transformed into "Caciocavallo Podolico" cheese, which is made with 100% Podolica milk. Fourier Transform Infrared Spectroscopy (FTIR) is the technique that, in this research work, was applied together with machine learning to discriminate 100% Podolica milk from contamination of other Calabrian cattle breeds. The analysis on the test set produced a misclassification percentage of 6.7%. Among the 15 non-Podolica samples in the test set, 2 were misclassified and recognized as Podolica milk even though the milk was from other species. The correct classification rate improved to 100% when the same method was applied to the recognition of Podolica and Pezzata Rossa milk produced by the same farm. Furthermore, this technique was tested for the recognition of Podolica milk mixed with milk from other bovine species. The multivariate model and the respective confusion matrices obtained showed that all the 14 Podolica samples (test set) mixed with 40% non-Podolica milk were correctly classified. In addition, Pezzata Rossa milk produced by the same farm was detected as a contaminant in Podolica milk from the same farm down to concentrations as little as 5% with a 100% correct classification rate in the test set. The method described yielded higher accuracy values when applied to the discrimination of milks from different breeds belonging to the same farm. One of the reasons for this phenomenon could be linked to the elimination of the environmental variable. However, the results obtained in this work demonstrate the possibility of using FTIR to discriminate between milks from different breeds.

SVR Chemometrics to Quantify β-Lactoglobulin and α-Lactalbumin in Milk Using MIR

Protein content variation in milk can impact the quality and consistency of dairy products, necessitating access to in-line real time monitoring. Here, we present a chemometric approach for the qualitative and quantitative monitoring of β-lactoglobulin and α-lactalbumin, using mid-infrared spectroscopy (MIR). In this study, we employed Hotelling T2 and Q-residual for outlier detection, automated preprocessing using nippy, conducted wavenumber selection with genetic algorithms, and evaluated four chemometric models, including partial least squares, support vector regression (SVR), ridge, and logistic regression to accurately predict the concentrations of β-lactoglobulin and α-lactalbumin in milk. For the quantitative analysis of these two whey proteins, SVR performed the best to interpret protein concentration from 197 MIR spectra originating from 42 Cornell University samples of preserved pasteurized modified milk. The R2 values obtained for β-lactoglobulin and α-lactalbumin using leave one out cross-validation (LOOCV) are 92.8% and 92.7%, respectively, which is the highest correlation reported to date. Our approach introduced a combination of preprocessing automation, genetic algorithm-based wavenumber selection, and used Optuna to optimize the framework for tuning hyperparameters of the chemometric models, resulting in the best chemometric analysis of MIR data to quantitate β-lactoglobulin and α-lactalbumin to date.

Recent Advances in the Determination of Milk Adulterants and Contaminants by Mid-Infrared Spectroscopy

The presence of chemical contaminants, toxins, or veterinary drugs in milk, as well as the adulteration of milk from different species, has driven the development of new tools to ensure safety and quality. Several analytical procedures have been proposed for the rapid screening of hazardous substances or the selective confirmation of the authenticity of milk. Mid-infrared spectroscopy and Fourier-transform infrared have been two of the most relevant technologies conventionally employed in the dairy industry. These fingerprint methodologies can be very powerful in determining the trait of raw material without knowing the identity of each constituent, and several aspects suggest their potential as a screening method to detect adulteration. This paper reviews the latest advances in applying mid-infrared spectroscopy for the detection and quantification of adulterants, milk dilution, the presence of pathogenic bacteria, veterinary drugs, and hazardous substances in milk.

EL V.2 Model for Predicting Food Safety Risks at Taiwan Border Using the Voting-Based Ensemble Method

Border management serves as a crucial control checkpoint for governments to regulate the quality and safety of imported food. In 2020, the first-generation ensemble learning prediction model (EL V.1) was introduced to Taiwan's border food management. This model primarily assesses the risk of imported food by combining five algorithms to determine whether quality sampling should be performed on imported food at the border. In this study, a second-generation ensemble learning prediction model (EL V.2) was developed based on seven algorithms to enhance the "detection rate of unqualified cases" and improve the robustness of the model. In this study, Elastic Net was used to select the characteristic risk factors. Two algorithms were used to construct the new model: The Bagging-Gradient Boosting Machine and Bagging-Elastic Net. In addition, F_β was used to flexibly control the sampling rate, improving the predictive performance and robustness of the model. The chi-square test was employed to compare the efficacy of "pre-launch (2019) random sampling inspection" and "post-launch (2020-2022) model prediction sampling inspection". For cases recommended for inspection by the ensemble learning model and subsequently inspected, the unqualified rates were 5.10%, 6.36%, and 4.39% in 2020, 2021, and 2022, respectively, which were significantly higher (p < 0.001) compared with the random sampling rate of 2.09% in 2019. The prediction indices established by the confusion matrix were used to further evaluate the prediction effects of EL V.1 and EL V.2, and the EL V.2 model exhibited superior predictive performance compared with EL V.1, and both models outperformed random sampling.

Novel prediction models for hyperketonemia using bovine milk Fourier-transform infrared spectroscopy

Metabolic diseases driven by negative energy balance in dairy cattle contribute to reduced milk production, increased disease incidence, culling, and death. Cow side tests for negative energy balance markers are available but are labor-intensive. Milk sample analysis using Fourier transform infrared spectroscopy (FTIR) allows for sampling numerous cows simultaneously. FTIR prediction models have moderate accuracy for hyperketonemia diagnosis (beta-hydroxybutyrate (BHB) ≥ 1.2 mmol/L). Most research using FTIR has focused on homogenous datasets and conventional prediction models, including partial least squares, linear discriminant analysis, and ElasticNet. Our objective was to evaluate more diverse modeling options, such as deep learning, gradient boosting machine models, and model ensembles for hyperketonemia classification. We compiled a sizable, heterogeneous dataset including milk FTIR and concurrent blood samples. Blood samples were tested for blood BHB, and wavenumber data was obtained from milk FTIR analysis. Using this dataset, we trained conventional prediction models and other options listed above. We demonstrate prediction model performance is similar for convolutional neural networks and ensemble models to simpler algorithm options. Results obtained from this study indicate that deep learning and model ensembles are potential algorithm options for predicting hyperketonemia in dairy cattle. Additionally, our results indicate hyperketonemia prediction models can be developed using heterogeneous datasets.

Non-targeted detection of food adulteration using an ensemble machine-learning model

Recurrent incidents of economically motivated adulteration have long-lasting and devastating effects on public health, economy, and society. With the current food authentication methods being target-oriented, the lack of an effective methodology to detect unencountered adulterants can lead to the next melamine-like outbreak. In this study, an ensemble machine-learning model that can help detect unprecedented adulteration without looking for specific substances, that is, in a non-targeted approach, is proposed. Using raw milk as an example, the proposed model achieved an accuracy and F1 score of 0.9924 and 0. 0.9913, respectively, when the same type of adulterants was presented in the training data. Cross-validation with spiked contaminants not routinely tested in the food industry and blinded from the training data provided an F1 score of 0.8657. This is the first study that demonstrates the feasibility of non-targeted detection with no a priori knowledge of the presence of certain adulterants using data from standard industrial testing as input. By uncovering discriminative profiling patterns, the ensemble machine-learning model can monitor and flag suspicious samples; this technique can potentially be extended to other food commodities and thus become an important contributor to public food safety.

Neural network in food analytics

Neural network (i.e. deep learning, NN)-based data analysis techniques have been listed as a pivotal opportunity to protect the integrity and safety of the global food supply chain and forecast $11.2 billion in agriculture markets. As a general-purpose data analytic tool, NN has been applied in several areas of food science, such as food recognition, food supply chain security and omics analysis, and so on. Therefore, given the rapid emergence of NN applications in food safety, this review aims to provide a comprehensive overview of the NN application in food analysis for the first time, focusing on domain-specific applications in food analysis by introducing fundamental methodology, reviewing recent and notable progress, and discussing challenges and potential pitfalls. NN demonstrated that it has a bright future through effective collaboration between food specialist and the broader community in the food field, for example, superiority in food recognition, sensory evaluation, pattern recognition of spectroscopy and chromatography. However, major challenges impeded NN extension including void in the food scientist-friendly interface software package, incomprehensible model behavior, multi-source heterogeneous data, and so on. The breakthrough from other fields proved NN has the potential to offer a revolution in the immediate future.

Over 20 Years of Machine Learning Applications on Dairy Farms: A Comprehensive Mapping Study

Machine learning applications are becoming more ubiquitous in dairy farming decision support applications in areas such as feeding, animal husbandry, healthcare, animal behavior, milking and resource management. Thus, the objective of this mapping study was to collate and assess studies published in journals and conference proceedings between 1999 and 2021, which applied machine learning algorithms to dairy farming-related problems to identify trends in the geographical origins of data, as well as the algorithms, features and evaluation metrics and methods used. This mapping study was carried out in line with PRISMA guidelines, with six pre-defined research questions (RQ) and a broad and unbiased search strategy that explored five databases. In total, 129 publications passed the pre-defined selection criteria, from which relevant data required to answer each RQ were extracted and analyzed. This study found that Europe (43% of studies) produced the largest number of publications (RQ1), while the largest number of articles were published in the Computers and Electronics in Agriculture journal (21%) (RQ2). The largest number of studies addressed problems related to the physiology and health of dairy cows (32%) (RQ3), while the most frequently employed feature data were derived from sensors (48%) (RQ4). The largest number of studies employed tree-based algorithms (54%) (RQ5), while RMSE (56%) (regression) and accuracy (77%) (classification) were the most frequently employed metrics used, and hold-out cross-validation (39%) was the most frequently employed evaluation method (RQ6). Since 2018, there has been more than a sevenfold increase in the number of studies that focused on the physiology and health of dairy cows, compared to almost a threefold increase in the overall number of publications, suggesting an increased focus on this subdomain. In addition, a fivefold increase in the number of publications that employed neural network algorithms was identified since 2018, in comparison to a threefold increase in the use of both tree-based algorithms and statistical regression algorithms, suggesting an increasing utilization of neural network-based algorithms.

Ensemble Learning Models for Food Safety Risk Prediction

Ensemble learning was adopted to design risk prediction models with the aim of improving border inspection methods for food imported into Taiwan. Specifically, we constructed a set of prediction models to enhance the hit rate of non-conforming products, thus strengthening the border control of food products to safeguard public health. Using five algorithms, we developed models to provide recommendations for the risk assessment of each imported food batch. The models were evaluated by constructing a confusion matrix to calculate predictive performance indicators, including the positive prediction value (PPV), recall, harmonic mean of PPV and recall (F1 score), and area under the curve. Our results showed that ensemble learning achieved better and more stable prediction results than any single algorithm. When the results of comparable data periods were examined, the non-conformity hit rate was found to increase significantly after online implementation of the ensemble learning models, indicating that ensemble learning was effective at risk prediction. In addition to enhancing the inspection hit rate of non-conforming food, the results of this study can serve as a reference for the improvement of existing random inspection methods, thus strengthening capabilities in food risk management.

Advances in Atypical FT-IR Milk Screening: Combining Untargeted Spectra Screening and Cluster Algorithms

Fourier-transform mid-infrared spectrometry is an attractive technology for screening adulterated liquid milk products. So far, studies on how infrared spectroscopy can be used to screen spectra for atypical milk composition have either used targeted methods to test for specific adulterants, or have used untargeted screening methods that do not reveal in what way the spectra are atypical. In this study, we evaluate the potential of combining untargeted screening methods with cluster algorithms to indicate in what way a spectrum is atypical and, if possible, why. We found that a combination of untargeted screening methods and cluster algorithms can reveal meaningful and generalizable categories of atypical milk spectra. We demonstrate that spectral information (e.g., the compositional milk profile) and meta-data associated with their acquisition (e.g., at what date and which instrument) can be used to understand in what way the milk is atypical and how it can be used to form hypotheses about the underlying causes. Thereby, it was indicated that atypical milk screening can serve as a valuable complementary quality assurance tool in routine FTIR milk analysis.

Evaluating the performance of machine learning methods and variable selection methods for predicting difficult-to-measure traits in Holstein dairy cattle using milk infrared spectral data

Fourier-transform infrared (FTIR) spectroscopy is a powerful high-throughput phenotyping tool for predicting traits that are expensive and difficult to measure in dairy cattle. Calibration equations are often developed using standard methods, such as partial least squares (PLS) regression. Methods that employ penalization, rank-reduction, and variable selection, as well as being able to model the nonlinear relations between phenotype and FTIR, might offer improvements in predictive ability and model robustness. This study aimed to compare the predictive ability of 2 machine learning methods, namely random forest (RF) and gradient boosting machine (GBM), and penalized regression against PLS regression for predicting 3 phenotypes differing in terms of biological meaning and relationships with milk composition (i.e., phenotypes measurable directly and not directly in milk, reflecting different biological processes which can be captured using milk spectra) in Holstein-Friesian cattle under 2 cross-validation scenarios. The data set comprised phenotypic information from 471 Holstein-Friesian cows, and 3 target phenotypes were evaluated: (1) body condition score (BCS), (2) blood β-hydroxybutyrate (BHB, mmol/L), and (3) κ-casein expressed as a percentage of nitrogen (κ-CN, % N). The data set was split considering 2 cross-validation scenarios: samples-out random in which the population was randomly split into 10-folds (8-folds for training and 1-fold for validation and testing); and herd/date-out in which the population was randomly assigned to training (70% herd), validation (10%), and testing (20% herd) based on the herd and date in which the samples were collected. The random grid search was performed using the training subset for the hyperparameter optimization and the validation set was used for the generalization of prediction error. The trained model was then used to assess the final prediction in the testing subset. The grid search for penalized regression evidenced that the elastic net (EN) was the best regularization with increase in predictive ability of 5%. The performance of PLS (standard model) was compared against 2 machine learning techniques and penalized regression using 2 cross-validation scenarios. Machine learning methods showed a greater predictive ability for BCS (0.63 for GBM and 0.61 for RF), BHB (0.80 for GBM and 0.79 for RF), and κ-CN (0.81 for GBM and 0.80 for RF) in samples-out cross-validation. Considering a herd/date-out cross-validation these values were 0.58 (GBM and RF) for BCS, 0.73 (GBM and RF) for BHB, and 0.77 (GBM and RF) for κ-CN. The GBM model tended to outperform other methods in predictive ability around 4%, 1%, and 7% for EN, RF, and PLS, respectively. The prediction accuracies of the GBM and RF models were similar, and differed statistically from the PLS model in samples-out random cross-validation. Although, machine learning techniques outperformed PLS in herd/date-out cross-validation, no significant differences were observed in terms of predictive ability due to the large standard deviation observed for predictions. Overall, GBM achieved the highest accuracy of FTIR-based prediction of the different phenotypic traits across the cross-validation scenarios. These results indicate that GBM is a promising method for obtaining more accurate FTIR-based predictions for different phenotypes in dairy cattle.

Epistasis Analysis: Classification Through Machine Learning Methods

Complex disease is different from Mendelian disorders. Its development usually involves the interaction of multiple genes or the interaction between genes and the environment (i.e. epistasis). Although the high-throughput sequencing technologies for complex diseases have produced a large amount of data, it is extremely difficult to analyze the data due to the high feature dimension and the combination in the epistasis analysis. In this work, we introduce machine learning methods to effectively reduce the gene dimensionality, retain the key epistatic effects, and effectively characterize the relationship between epistatic effects and complex diseases.

Deep Neural Networks for Epistatic Sequence Analysis

We report a step-by-step protocol to use pysster, a TensorFlow-based package for building deep neural networks on a broad range of epistatic sequences such as DNA, RNA, or annotated secondary structure sequences. Pysster provides users comprehensive supports for developing, training, and evaluating the self-defined deep neural networks on sequence data. Moreover, pysster allows users to easily visualize the resulting perditions, which is helpful to uncover the "black box" of deep neural networks. Here, we describe a step-by-step application of pysster to classify the RNA A-to-I editing regions and interpret the model predictions. To further demonstrate the generalizability of pysster, we utilized it to build and evaluated a new deep neural network on an artificial epistatic sequence dataset.

Advances in infrared spectroscopy combined with artificial neural network for the authentication and traceability of food

The authentication and traceability of food attract more attention due to the increasing consumer awareness regarding nutrition and health, being a new hotspot of food science. Infrared spectroscopy (IRS) combined with shallow neural network has been widely proven to be an effective food analysis technology. As an advanced deep learning technology, deep neural network has also been explored to analyze and solve food-related IRS problems in recent years. The present review begins with brief introductions to IRS and artificial neural network (ANN), including shallow neural network and deep neural network. More notably, it emphasizes the comprehensive overview of the advances of the technology combined IRS with ANN for the authentication and traceability of food, based on relevant literature from 2014 to early 2020. In detail, the types of IRS and ANN, modeling processes, experimental results, and model comparisons in related studies are described to set forth the usage and performance of the combined technology for food analysis. The combined technology shows excellent ability to authenticate food quality and safety, involving chemical components, freshness, microorganisms, damages, toxic substances, and adulteration. As well, it shows excellent performance in the traceability of food variety and origin. The advantages, current limitations, and future trends of the combined technology are further discussed to provide a thoughtful viewpoint on the challenges and expectations of online applications for the authentication and traceability of food.

Application of machine learning to improve dairy farm management: A systematic literature review

In recent years, several researchers and practitioners applied machine learning algorithms in the dairy farm context and discussed several solutions to predict various variables of interest, most of which were related to incipient diseases. The objective of this article is to identify, assess, and synthesize the papers that discuss the application of machine learning in the dairy farm management context. Using a systematic literature review (SLR) protocol, we retrieved 427 papers, of which 38 papers were determined as primary studies and thus were analysed in detail. More than half of the papers (55 %) addressed disease detection. The other two categories of problems addressed were milk production and milk quality. Seventy-one independent variables were identified and grouped into seven categories. The two prominent categories that were used in more than half of the papers were milking parameters and milk properties. The other categories of independent variables were milk content, pregnancy/calving information, cow characteristics, lactation, and farm characteristics. Twenty-three algorithms were identified, which we grouped into four categories. Decision tree-based algorithms are by far the most used followed by artificial neural network-based algorithms. Regression-based algorithms and other algorithms that do not belong to the previous categories were used in 13 papers. Twenty-three evaluation parameters were identified of which 7 were used 3 or more times. The three evaluation parameters that were used by more than half of the papers are sensitivity, specificity, RMSE. The challenges most encountered were feature selection and unbalanced data and together with problem size, overfitting/estimating, and parameter tuning account for three-quarters of the challenges identified. To the best of our knowledge, this is the first SLR study on the use of machine learning to improve dairy farm management, and to this end, this study will be valuable not only for researchers but also practitioners in dairy farms.