Review: Application and Prospective Discussion of Machine Learning for the Management of Dairy Farms

Linking Animal Feed Formulation to Milk Quantity, Quality, and Animal Health Through Data-Driven Decision-Making

The global demand for high-quality animal products, particularly dairy, has intensified the need for more precise and efficient livestock feed formulation. This review connects data-driven decision-making in optimizing feed formulation to enhance milk quantity and quality while addressing animal health implications. Modern feed formulation has evolved into a sophisticated, data-centric process by integrating diverse data sources such as nutritional databases, environmental data, and animal performance metrics. Leveraging advanced analytical techniques, such as machine learning and optimization algorithms, have created highly accurate feed formulations tailored to specific livestock needs. These innovations increase milk yield and contribute to developing dairy products with higher nutritional value. Decision Support Systems play a complementary role by offering real-time decision-making capabilities, enabling farmers to make data-informed adjustments composition based on changing conditions. However, despite its potential, the widespread adoption of data-driven feed formulation faces challenges such as data quality, technological limitations, and industry resistance, mostly disjointed processes. The objectives of this review are: (i) to explore the current advancements and challenges of data-driven decision-making in feed formulation, focusing on its connection to milk quantity and quality, and (ii) to highlight how this optimized feed formulation strategy improves sustainable dairy production.

Graduate Student Literature Review: The use of integrated sensor data for the detection of hyperketonemia in pasture-based dairy systems during the transition period

This review evaluates research regarding the use of sensors to predict and manage hyperketonemia (HYK) in dairy cows during the transition period, with a focus on pasture-based systems. By doing so, we assessed the accuracy of HYK-detection models, noting that no studies thus far have produced models with sufficient accuracy for practical use. Sensors have been validated for their use in dairy farming, proving they produce reliable and useful information. Research is beginning to focus on the analysis of multiple sensors together as a sensor system, discovering the potential for these technologies to be a valuable aid in decision making and farm management. Of the studies that use sensors to predict and manage disease in dairy cows, few studies use data integration (the process of combining data from multiple sensors which in turn improves model accuracy), highlighting a gap in the literature. Recently published research has focused on the detection of mastitis and lameness in pasture-based systems, with less focus toward the detection of metabolic disease. This is reflected in the lack of studies that report the prevalence of metabolic diseases, such as HYK, in pasture-based systems, especially in Australia and New Zealand. It is suggested that further research focuses on (1) determining the prevalence and effect of HYK in pasture-based systems; (2) exploring the use of sensors for HYK detection in pasture-based systems; (3) improving model accuracy with data integration; and (4) confirming the economic benefit of sensors to justify the cost of investing in sensor systems.

Predicting age at first calving of dairy breed calves using whale optimization-based ensemble learning framework

Dairy product requirement and the demand-supply gap of milk in Ethiopia have been increasing at an alarming rate due to various factors such as shortage of animal's feeds, feed staffs, feed costs, and poor genetic merits of the local breeds of the country. This problem can be lessened by selecting best breed and modern animal breeding facilities, which require technologies like big data analysis and machine learning. In this study, a prediction model that can predict age at first calving of weaned calves based on their pre-weaning and weaning parameters, including dam's parity number, season of calving, birth weight, pre-weaning health status, pre-weaning average daily weight gain (ADG), weaning age and weaning weight is developed. Primary data collected by Ardayta Dairy Research Centre; Ethiopia is used for this research. First, different pre-trained models developed using support vector regression (SVR), Linear support vector regression (LSVR) and Nu support vector regression (NuSVR) techniques with their default hyperparameter values in which SVR performed best. Second, a model was developed by tuning hyperparameters of SVR including kernel function, regularization (C-parameter) and gamma parameters, and it resulted in an accuracy of 96.46%. Next, Whale optimization technique is used to select the optimized features of the dataset. Furthermore, an ensemble of SVR, LSVR, NuSVR is designed, and the framework is trained by optimized features of data. The designed model achieved an accuracy of 98.3% superseding the other combinations.

Human-computer interactions with farm animals-enhancing welfare through precision livestock farming and artificial intelligence

While user-centered design approaches stemming from the human-computer interaction (HCI) field have notably improved the welfare of companion, service, and zoo animals, their application in farm animal settings remains limited. This shortfall has catalyzed the emergence of animal-computer interaction (ACI), a discipline extending technology's reach to a multispecies user base involving both animals and humans. Despite significant strides in other sectors, the adaptation of HCI and ACI (collectively HACI) to farm animal welfare-particularly for dairy cows, swine, and poultry-lags behind. Our paper explores the potential of HACI within precision livestock farming (PLF) and artificial intelligence (AI) to enhance individual animal welfare and address the unique challenges within these settings. It underscores the necessity of transitioning from productivity-focused to animal-centered farming methods, advocating for a paradigm shift that emphasizes welfare as integral to sustainable farming practices. Emphasizing the 'One Welfare' approach, this discussion highlights how integrating animal-centered technologies not only benefits farm animal health, productivity, and overall well-being but also aligns with broader societal, environmental, and economic benefits, considering the pressures farmers face. This perspective is based on insights from a one-day workshop held on June 24, 2024, which focused on advancing HACI technologies for farm animal welfare.

Applications of Artificial Intelligence for Heat Stress Management in Ruminant Livestock

Heat stress impacts ruminant livestock production on varied levels in this alarming climate breakdown scenario. The drastic effects of the global climate change-associated heat stress in ruminant livestock demands constructive evaluation of animal performance bordering on effective monitoring systems. In this climate-smart digital age, adoption of advanced and developing Artificial Intelligence (AI) technologies is gaining traction for efficient heat stress management. AI has widely penetrated the climate sensitive ruminant livestock sector due to its promising and plausible scope in assessing production risks and the climate resilience of ruminant livestock. Significant improvement has been achieved alongside the adoption of novel AI algorithms to evaluate the performance of ruminant livestock. These AI-powered tools have the robustness and competence to expand the evaluation of animal performance and help in minimising the production losses associated with heat stress in ruminant livestock. Advanced heat stress management through automated monitoring of heat stress in ruminant livestock based on behaviour, physiology and animal health responses have been widely accepted due to the evolution of technologies like machine learning (ML), neural networks and deep learning (DL). The AI-enabled tools involving automated data collection, pre-processing, data wrangling, development of appropriate algorithms, and deployment of models assist the livestock producers in decision-making based on real-time monitoring and act as early-stage warning systems to forecast disease dynamics based on prediction models. Due to the convincing performance, precision, and accuracy of AI models, the climate-smart livestock production imbibes AI technologies for scaled use in the successful reducing of heat stress in ruminant livestock, thereby ensuring sustainable livestock production and safeguarding the global economy.

Discrete Homogeneous and Non-Homogeneous Markov Chains Enhance Predictive Modelling for Dairy Cow Diseases

Modelling and predicting dairy cow diseases empowers farmers with valuable information for herd health management, thereby decreasing costs and increasing profits. For this purpose, predictive models were developed based on machine learning algorithms. However, machine-learning based approaches require the development of a specific model for each disease, and their consistency is limited by low farm data availability. To overcome this lack of complete and accurate data, we developed a predictive model based on discrete Homogeneous and Non-homogeneous Markov chains. After aggregating data into categories, we developed a method for defining the adequate number of Markov chain states. Subsequently, we selected the best prediction model through Chebyshev distance minimization. For 14 of 19 diseases, less than 15% maximum differences were measured between the last month of actual and predicted disease data. This model can be easily implemented in low-tech dairy farms to project costs with antibiotics and other treatments. Furthermore, the model's adaptability allows it to be extended to other disease types or conditions with minimal adjustments. Therefore, including this predictive model for dairy cow diseases in decision support systems may enhance herd health management and streamline the design of evidence-based farming strategies.

Investigating the use of machine learning algorithms to support risk-based animal welfare inspections of cattle and pig farms

In livestock production, animal-related data are often registered in specialised databases and are usually not interconnected, except for a common identifier. Analysis of combined datasets and the possible inclusion of third-party information can provide a more complete picture or reveal complex relationships. The aim of this study was to develop a risk index to predict farms with an increased likelihood for animal welfare violations, defined as non-compliance during on-farm welfare inspections. A data-driven approach was chosen for this purpose, focusing on the combination of existing Swiss government databases and registers. Individual animal-level data were aggregated at the herd level. Since data collection and availability were best for cattle and pigs, the focus was on these two livestock species. We present machine learning models that can be used as a tool to plan and optimise risk-based on-farm welfare inspections by proposing a consolidated list of priority holdings to be visited. The results of previous on-farm welfare inspections were used to calibrate a binary welfare index, which is the prediction goal. The risk index is based on proxy information, such as the participation in animal welfare programmes with structured housing and outdoor access, herd type and size, or animal movement data. Since transparency of the model is critical both for public acceptance of such a data-driven index and farm control planning, the Random Forest model, for which the decision process can be illustrated, was investigated in depth. Using historical inspection data with an overall low prevalence of violations of approximately 4% for both species, the developed index was able to predict violations with a sensitivity of 81.2 and 79.5% for cattle and pig farms, respectively. The study has shown that combining multiple and heterogeneous data sources improves the quality of the models. Furthermore, privacy-preserving methods are applied to a research environment to explore the available data before restricting the feature space to the most relevant. This study demonstrates that data-driven monitoring of livestock populations is already possible with the existing datasets and the models developed can be a useful tool to plan and conduct risk-based animal welfare inspection.

Machine Learning to Predict Pregnancy in Dairy Cows: An Approach Integrating Automated Activity Monitoring and On-Farm Data

Automated activity monitoring (AAM) systems are critical in the dairy industry for detecting estrus and optimizing the timing of artificial insemination (AI), thus enhancing pregnancy success rates in cows. This study developed a predictive model to improve pregnancy success by integrating AAM data with cow-specific and environmental factors. Utilizing data from 1,054 cows, this study compared the pregnancy outcomes between two AI timings-8 or 10 h post-AAM alarm. Variables such as age, parity, body condition, locomotion, and vaginal discharge scores, peripartum diseases, the breeding program, the bull used for AI, milk production at the time of AI, and environmental conditions (season, relative humidity, and temperature-humidity index) were considered alongside the AAM data on rumination, activity, and estrus intensity. Six predictive models were assessed to determine their efficacy in predicting pregnancy success: logistic regression, Bagged AdaBoost algorithm, linear discriminant, random forest, support vector machine, and Bagged Classification Tree. Integrating the on-farm data with AAM significantly enhanced the pregnancy prediction accuracy at AI compared to using AAM data alone. The random forest models showed a superior performance, with the highest Kappa statistic and lowest false positive rates. The linear discriminant and logistic regression models demonstrated the best accuracy, minimal false negatives, and the highest area under the curve. These findings suggest that combining on-farm and AAM data can significantly improve reproductive management in the dairy industry.

The groundbreaking impact of digitalization and artificial intelligence in sheep farming

The integration of digitalization and Artificial Intelligence (AI) has marked the onset of a new era of efficient sheep farming in multiple aspects ranging from the general well-being of sheep to advanced web-based management applications. The resultant improvement in sheep health and consequently better farming yield has already started to benefit both farmers and veterinarians. The predictive analytical models embedded with machine learning (giving sense to machines) has helped better decision-making and has enabled farmers to derive most out of their farms. This is evident in the ability of farmers to remotely monitor livestock health by wearable devices that keep track of animal vital signs and behaviour. Additionally, veterinarians now employ advanced AI-based diagnostics for efficient parasite detection and control. Overall, digitalization and AI have completely transformed traditional farming practices in livestock animals. However, there is a pressing need to optimize digital sheep farming, allowing sheep farmers to appreciate and adopt these innovative systems. To fill this gap, this review aims to provide available digital and AI-based systems designed to aid precision farming of sheep, offering an up-to-date understanding on the subject. Various contemporary techniques, such as sky shepherding, virtual fencing, advanced parasite detection, automated counting and behaviour tracking, anomaly detection, precision nutrition, breeding support, and several mobile-based management applications are currently being utilized in sheep farms and appear to be promising. Although artificial intelligence and machine learning may represent key features in the sustainable development of sheep farming, they present numerous challenges in application.

From beasts to bytes: Revolutionizing zoological research with artificial intelligence

Since the late 2010s, Artificial Intelligence (AI) including machine learning, boosted through deep learning, has boomed as a vital tool to leverage computer vision, natural language processing and speech recognition in revolutionizing zoological research. This review provides an overview of the primary tasks, core models, datasets, and applications of AI in zoological research, including animal classification, resource conservation, behavior, development, genetics and evolution, breeding and health, disease models, and paleontology. Additionally, we explore the challenges and future directions of integrating AI into this field. Based on numerous case studies, this review outlines various avenues for incorporating AI into zoological research and underscores its potential to enhance our understanding of the intricate relationships that exist within the animal kingdom. As we build a bridge between beast and byte realms, this review serves as a resource for envisioning novel AI applications in zoological research that have not yet been explored.

Daylong acoustic recordings of grazing and rumination activities in dairy cows

Monitoring livestock feeding behavior may help assess animal welfare and nutritional status, and to optimize pasture management. The need for continuous and sustained monitoring requires the use of automatic techniques based on the acquisition and analysis of sensor data. This work describes an open dataset of acoustic recordings of the foraging behavior of dairy cows. The dataset includes 708 h of daily records obtained using unobtrusive and non-invasive instrumentation mounted on five lactating multiparous Holstein cows continuously monitored for six non-consecutive days in pasture and barn. Labeled recordings precisely delimiting grazing and rumination bouts are provided for a total of 392 h and for over 6,200 ingestive and rumination jaw movements. Companion information on the audio recording quality and expert-generated labels is also provided to facilitate data interpretation and analysis. This comprehensive dataset is a useful resource for studies aimed at exploring new tools and solutions for precision livestock farming.

CNN-Bi-LSTM: A Complex Environment-Oriented Cattle Behavior Classification Network Based on the Fusion of CNN and Bi-LSTM

Cattle behavior classification technology holds a crucial position within the realm of smart cattle farming. Addressing the requisites of cattle behavior classification in the agricultural sector, this paper presents a novel cattle behavior classification network tailored for intricate environments. This network amalgamates the capabilities of CNN and Bi-LSTM. Initially, a data collection method is devised within an authentic farm setting, followed by the delineation of eight fundamental cattle behaviors. The foundational step involves utilizing VGG16 as the cornerstone of the CNN network, thereby extracting spatial feature vectors from each video data sequence. Subsequently, these features are channeled into a Bi-LSTM classification model, adept at unearthing semantic insights from temporal data in both directions. This process ensures precise recognition and categorization of cattle behaviors. To validate the model's efficacy, ablation experiments, generalization effect assessments, and comparative analyses under consistent experimental conditions are performed. These investigations, involving module replacements within the classification model and comprehensive analysis of ablation experiments, affirm the model's effectiveness. The self-constructed dataset about cattle is subjected to evaluation using cross-entropy loss, assessing the model's generalization efficacy across diverse subjects and viewing perspectives. Classification performance accuracy is quantified through the application of a confusion matrix. Furthermore, a set of comparison experiments is conducted, involving three pertinent deep learning models: MASK-RCNN, CNN-LSTM, and EfficientNet-LSTM. The outcomes of these experiments unequivocally substantiate the superiority of the proposed model. Empirical results underscore the CNN-Bi-LSTM model's commendable performance metrics: achieving 94.3% accuracy, 94.2% precision, and 93.4% recall while navigating challenges such as varying light conditions, occlusions, and environmental influences. The objective of this study is to employ a fusion of CNN and Bi-LSTM to autonomously extract features from multimodal data, thereby addressing the challenge of classifying cattle behaviors within intricate scenes. By surpassing the constraints imposed by conventional methodologies and the analysis of single-sensor data, this approach seeks to enhance the precision and generalizability of cattle behavior classification. The consequential practical, economic, and societal implications for the agricultural sector are of considerable significance.

Applications of livestock monitoring devices and machine learning algorithms in animal production and reproduction: an overview

Some sectors of animal production and reproduction have shown great technological advances due to the development of research areas such as Precision Livestock Farming (PLF). PLF is an innovative approach that allows animals to be monitored, through the adoption of cutting-edge technologies that continuously collect real-time data by combining the use of sensors with advanced algorithms to provide decision tools for farmers. Artificial Intelligence (AI) is a field that merges computer science and large datasets to create expert systems that are able to generate predictions and classifications similarly to human intelligence. In a simplified manner, Machine Learning (ML) is a branch of AI, and can be considered as a broader field that encompasses Deep Learning (DL, a Neural Network formed by at least three layers), generating a hierarchy of subsets formed by AI, ML and DL, respectively. Both ML and DL provide innovative methods for analyzing data, especially beneficial for large datasets commonly found in livestock-related activities. These approaches enable the extraction of valuable insights to address issues related to behavior, health, reproduction, production, and the environment, facilitating informed decision-making. In order to create the referred technologies, studies generally go through five steps involving data processing: acquisition, transferring, storage, analysis and delivery of results. Although the data collection and analysis steps are usually thoroughly reported by the scientific community, a good execution of each step is essential to achieve good and credible results, which impacts the degree of acceptance of the proposed technologies in real life practical circumstances. In this context, the present work aims to describe an overview of the current implementations of ML/DL in livestock reproduction and production, as well to identify potential challenges and critical points in each of the five steps mentioned, which can affect results and application of AI techniques by farmers in practical situations.

Artificial Intelligence and Sensor Technologies in Dairy Livestock Export: Charting a Digital Transformation

This technical note critically evaluates the transformative potential of Artificial Intelligence (AI) and sensor technologies in the swiftly evolving dairy livestock export industry. We focus on the novel application of the Internet of Things (IoT) in long-distance livestock transportation, particularly in livestock enumeration and identification for precise traceability. Technological advancements in identifying behavioral patterns in 'shy feeder' cows and real-time weight monitoring enhance the accuracy of long-haul livestock transportation. These innovations offer benefits such as improved animal welfare standards, reduced supply chain inaccuracies, and increased operational productivity, expanding market access and enhancing global competitiveness. However, these technologies present challenges, including individual animal customization, economic analysis, data security, privacy, technological adaptability, training, stakeholder engagement, and sustainability concerns. These challenges intertwine with broader ethical considerations around animal treatment, data misuse, and the environmental impacts. By providing a strategic framework for successful technology integration, we emphasize the importance of continuous adaptation and learning. This note underscores the potential of AI, IoT, and sensor technologies to shape the future of the dairy livestock export industry, contributing to a more sustainable and efficient global dairy sector.

A Literature Review of Modeling Approaches Applied to Data Collected in Automatic Milking Systems

Automatic milking systems (AMS) have played a pioneering role in the advancement of Precision Livestock Farming, revolutionizing the dairy farming industry on a global scale. This review specifically targets papers that focus on the use of modeling approaches within the context of AMS. We conducted a thorough review of 60 articles that specifically address the topics of cows' health, production, and behavior/management Machine Learning (ML) emerged as the most widely used method, being present in 63% of the studies, followed by statistical analysis (14%), fuzzy algorithms (9%), deterministic models (7%), and detection algorithms (7%). A significant majority of the reviewed studies (82%) primarily focused on the detection of cows' health, with a specific emphasis on mastitis, while only 11% evaluated milk production. Accurate forecasting of dairy cow milk yield and understanding the deviation between expected and observed milk yields of individual cows can offer significant benefits in dairy cow management. Likewise, the study of cows' behavior and herd management in AMSs is under-explored (7%). Despite the growing utilization of machine learning (ML) techniques in the field of dairy cow management, there remains a lack of a robust methodology for their application. Specifically, we found a substantial disparity in adequately balancing the positive and negative classes within health prediction models.

Using Machine Learning and Behavioral Patterns Observed by Automated Feeders and Accelerometers for the Early Indication of Clinical Bovine Respiratory Disease Status in Preweaned Dairy Calves

The objective of this retrospective cohort study was to evaluate a K-nearest neighbor (KNN) algorithm to classify and indicate bovine respiratory disease (clinical BRD) status using behavioral patterns in preweaned dairy calves. Calves (N=106) were enrolled in this study, which occurred at one facility for the preweaning period. Precision dairy technologies were used to record feeding behavior with an automated feeder and activity behavior with a pedometer (automated features). Daily, calves were manually health-scored for bovine respiratory disease (clinical BRD; Wisconsin scoring system, WI, USA), and weights were taken twice weekly (manual features). All calves were also scored for ultrasonographic lung consolidation twice weekly. A clinical BRD bout (day 0) was defined as 2 scores classified as abnormal on the Wisconsin scoring system and an area of consolidated lung ≥3.0 cm2. There were 54 calves dignosed with a clinical BRD bout. Two scenarios were considered for KNN inference. In the first scenario (diagnosis scenario), the KNN algorithm classified calves as clinical BRD positive or as negative for respiratory infection. For the second scenario (preclinical BRD bout scenario), the 14 days before a clinical BRD bout was evaluated to determine if behavioral changes were indicative of calves destined for disease. Both scenarios investigated the use of automated features or manual features or both. For the diagnosis scenario, manual features had negligible improvements compared to automated features, with an accuracy of 0.95 ± 0.02 and 0.94 ± 0.02, respectively, for classifying calves as negative for respiratory infection. There was an equal accuracy of 0.98 ± 0.01 for classifying calves as sick using automated and manual features. For the preclinical BRD bout scenario, automated features were highly accurate at -6 days prior to diagnosis (0.90 ± 0.02), while manual features had low accuracy at -6 days (0.52 ± 0.03). Automated features were near perfectly accurate at -1 day before clinical BRD diagnosis compared to the high accuracy of manual features (0.86 ± 0.03). This research indicates that machine-learning algorithms accurately predict clinical BRD status at up to -6 days using a myriad of feeding behaviors and activity levels in calves. Precision dairy technologies hold the potential to indicate the BRD status in preweaned calves.

Impact of Climate Change on Dryland Agricultural Systems: A Review of Current Status, Potentials, and Further Work Need

Dryland agricultural system is under threat due to climate extremes and unsustainable management. Understanding of climate change impact is important to design adaptation options for dry land agricultural systems. Thus, the present review was conducted with the objectives to identify gaps and suggest technology-based intervention that can support dry land farming under changing climate. Careful management of the available agricultural resources in the region is a current need, as it will play crucial role in the coming decades to ensure food security, reduce poverty, hunger, and malnutrition. Technology based regional collaborative interventions among Universities, Institutions, Growers, Companies etc. for water conservation, supplemental irrigation, foliar sprays, integrated nutrient management, resilient crops-based cropping systems, artificial intelligence, and precision agriculture (modeling and remote sensing) are needed to support agriculture of the region. Different process-based models have been used in different regions around the world to quantify the impacts of climate change at field, regional, and national scales to design management options for dryland cropping systems. Modeling include water and nutrient management, ideotype designing, modification in tillage practices, application of cover crops, insect, and disease management. However, diversification in the mixed and integrated crop and livestock farming system is needed to have profitable, sustainable business. The main focus in this work is to recommend different agro-adaptation measures to be part of policies for sustainable agricultural production systems in future.

Digital Transformation in Smart Farm and Forest Operations Needs Human-Centered AI: Challenges and Future Directions

The main impetus for the global efforts toward the current digital transformation in almost all areas of our daily lives is due to the great successes of artificial intelligence (AI), and in particular, the workhorse of AI, statistical machine learning (ML). The intelligent analysis, modeling, and management of agricultural and forest ecosystems, and of the use and protection of soils, already play important roles in securing our planet for future generations and will become irreplaceable in the future. Technical solutions must encompass the entire agricultural and forestry value chain. The process of digital transformation is supported by cyber-physical systems enabled by advances in ML, the availability of big data and increasing computing power. For certain tasks, algorithms today achieve performances that exceed human levels. The challenge is to use multimodal information fusion, i.e., to integrate data from different sources (sensor data, images, *omics), and explain to an expert why a certain result was achieved. However, ML models often react to even small changes, and disturbances can have dramatic effects on their results. Therefore, the use of AI in areas that matter to human life (agriculture, forestry, climate, health, etc.) has led to an increased need for trustworthy AI with two main components: explainability and robustness. One step toward making AI more robust is to leverage expert knowledge. For example, a farmer/forester in the loop can often bring in experience and conceptual understanding to the AI pipeline-no AI can do this. Consequently, human-centered AI (HCAI) is a combination of "artificial intelligence" and "natural intelligence" to empower, amplify, and augment human performance, rather than replace people. To achieve practical success of HCAI in agriculture and forestry, this article identifies three important frontier research areas: (1) intelligent information fusion; (2) robotics and embodied intelligence; and (3) augmentation, explanation, and verification for trusted decision support. This goal will also require an agile, human-centered design approach for three generations (G). G1: Enabling easily realizable applications through immediate deployment of existing technology. G2: Medium-term modification of existing technology. G3: Advanced adaptation and evolution beyond state-of-the-art.

Predicting the 305-Day Milk Yield of Holstein-Friesian Cows Depending on the Conformation Traits and Farm Using Simplified Selective Ensembles

In animal husbandry, it is of great interest to determine and control the key factors that affect the production characteristics of animals, such as milk yield. In this study, simplified selective tree-based ensembles were used for modeling and forecasting the 305-day average milk yield of Holstein-Friesian cows, depending on 12 external traits and the farm as an environmental factor. The preprocessing of the initial independent variables included their transformation into rotated principal components. The resulting dataset was divided into learning (75%) and holdout test (25%) subsamples. Initially, three diverse base models were generated using Classifiction and Regression Trees (CART) ensembles and bagging and arcing algorithms. These models were processed using the developed simplified selective algorithm based on the index of agreement. An average reduction of 30% in the number of trees of selective ensembles was obtained. Finally, by separately stacking the predictions from the non-selective and selective base models, two linear hybrid models were built. The hybrid model of the selective ensembles showed a 13.6% reduction in the test set prediction error compared to the hybrid model of the non-selective ensembles. The identified key factors determining milk yield include the farm, udder width, chest width, and stature of the animals. The proposed approach can be applied to improve the management of dairy farms.

Addressing Data Bottlenecks in the Dairy Farm Industry

Simple Summary

A better understanding of the current challenges and opportunities regarding data management and data governance in the dairy industry is key to design and define effective data utilization. Thus, a survey was conducted to understand the attitudes of farmers and non-farmers. Respondents strongly agreed that data sharing is a valuable enterprise. They recognized that raw data collected at the farm should be the property of the farmer, and that incentives could motivate farmers to continue, or increase, their data sharing, but most of them were unfamiliar with data collection protocols. Although most farmers are already sharing data, most of them have not signed a data share agreement and feel they do not have data control, once their data are accessed by others. Most respondents exhibited concern about critical data issues, such as ownership, confidentiality, security, lack of integration, and even lack of awareness of the importance of data integration. Farmers indicated that they would be encouraged to adopt a new technology if it is easy to implement and has the potential to improve herd or farm management and profit, whereas they would be discouraged if the technology is expensive, difficult to use, or they do not have clear information about its use.

Abstract

A survey to explore the challenges and opportunities for dairy farm data management and governance was completed by 73 farmers and 96 non-farmers. Although 91% of them find data sharing beneficial, 69% are unfamiliar with data collection protocols and standards, and 66% of farmers feel powerless over their data chain of custody. Although 58% of farmers share data, only 19% of them recall having signed a data share agreement. Fifty-two percent of respondents agree that data collected on farm belongs only to the farmer, with 25% of farmers believing intellectual property products are being developed with their data, and 90% of all said companies should pay farmers when making money from their data. Farmers and non-farmers are somewhat concerned about data ownership, security, and confidentiality, but non-farmers were more concerned about data collection standards and lack of integration. Sixty-two percent of farmers integrate data from different sources. Farmers’ most used technologies are milk composition (67%) and early disease detection (56%); most desired technologies are body condition score (56%) and automatic milking systems (46%); most abandoned technologies are temperature and activity sensors (14%) and automatic sorting gates (13%). A better understanding of these issues is paramount for the industry’s long-term sustainability.

Evaluation of a Binary Classification Approach to Detect Herbage Scarcity Based on Behavioral Responses of Grazing Dairy Cows

In precision grazing, pasture allocation decisions are made continuously to ensure demand-based feed allowance and efficient grassland utilization. The aim of this study was to evaluate existing prediction models that determine feed scarcity based on changes in dairy cow behavior. During a practice-oriented experiment, two groups of 10 cows each grazed separate paddocks in half-days in six six-day grazing cycles. The allocated grazing areas provided 20% less feed than the total dry matter requirement of the animals for each entire grazing cycle. All cows were equipped with noseband sensors and pedometers to record their head, jaw, and leg activity. Eight behavioral variables were used to classify herbage sufficiency or scarcity using a generalized linear model and a random forest model. Both predictions were compared to two individual-animal and day-specific reference indicators for feed scarcity: reduced milk yields and rumen fill scores that undercut normal variation. The predictive performance of the models was low. The two behavioral variables “daily rumination chews” and “bite frequency” were confirmed as suitable predictors, the latter being particularly sensitive when new feed allocation is present in the grazing set-up within 24 h. Important aspects were identified to be considered if the modeling approach is to be followed up.

Over 20 Years of Machine Learning Applications on Dairy Farms: A Comprehensive Mapping Study

Machine learning applications are becoming more ubiquitous in dairy farming decision support applications in areas such as feeding, animal husbandry, healthcare, animal behavior, milking and resource management. Thus, the objective of this mapping study was to collate and assess studies published in journals and conference proceedings between 1999 and 2021, which applied machine learning algorithms to dairy farming-related problems to identify trends in the geographical origins of data, as well as the algorithms, features and evaluation metrics and methods used. This mapping study was carried out in line with PRISMA guidelines, with six pre-defined research questions (RQ) and a broad and unbiased search strategy that explored five databases. In total, 129 publications passed the pre-defined selection criteria, from which relevant data required to answer each RQ were extracted and analyzed. This study found that Europe (43% of studies) produced the largest number of publications (RQ1), while the largest number of articles were published in the Computers and Electronics in Agriculture journal (21%) (RQ2). The largest number of studies addressed problems related to the physiology and health of dairy cows (32%) (RQ3), while the most frequently employed feature data were derived from sensors (48%) (RQ4). The largest number of studies employed tree-based algorithms (54%) (RQ5), while RMSE (56%) (regression) and accuracy (77%) (classification) were the most frequently employed metrics used, and hold-out cross-validation (39%) was the most frequently employed evaluation method (RQ6). Since 2018, there has been more than a sevenfold increase in the number of studies that focused on the physiology and health of dairy cows, compared to almost a threefold increase in the overall number of publications, suggesting an increased focus on this subdomain. In addition, a fivefold increase in the number of publications that employed neural network algorithms was identified since 2018, in comparison to a threefold increase in the use of both tree-based algorithms and statistical regression algorithms, suggesting an increasing utilization of neural network-based algorithms.

Integrating diverse data sources to predict disease risk in dairy cattle-a machine learning approach

Livestock farming is currently undergoing a digital revolution and becoming increasingly data-driven. Yet, such data often reside in disconnected silos making them impossible to leverage their full potential to improve animal well-being. Here, we introduce a precision livestock farming approach, bringing together information streams from a variety of life domains of dairy cattle to study whether including more and diverse data sources improves the quality of predictions for eight diseases and whether using more complex prediction algorithms can, to some extent, compensate for less diverse data. Using three machine learning approaches of varying complexity (from logistic regression to gradient boosted trees) trained on data from 5,828 animals in 165 herds in Austria, we show that the prediction of lameness, acute and chronic mastitis, anestrus, ovarian cysts, metritis, ketosis (hyperketonemia), and periparturient hypocalcemia (milk fever) from routinely available data gives encouraging results. For example, we can predict lameness with high sensitivity and specificity (F1 = 0.74). An analysis of the importance of individual variables to prediction performance shows that disease in dairy cattle is a product of the complex interplay between a multitude of life domains, such as housing, nutrition, or climate, that including more and diverse data sources increases prediction performance, and that the reuse of existing data can create actionable information for preventive interventions. Our findings pave the way toward data-driven point-of-care interventions and demonstrate the added value of integrating all available data in the dairy industry to improve animal well-being and reduce disease risk.

Identifying Health Status in Grazing Dairy Cows from Milk Mid-Infrared Spectroscopy by Using Machine Learning Methods

Simple Summary

Diseases in dairy livestock farming can lead to important economic losses. Several studies have been conducted to identify illness such as lameness by using MIR spectrometry data and relying on partial least squares discriminant analysis. However, this method suffers some limitations. In this study, random forest, support vector machine, neural network, convolutional neural network and ensemble models were used to test the feasibility of identifying cow sickness among 1909 milk sample MIR spectra from Holstein-Friesian, Jersey and Holstein-Friesian × Jersey crossbreed cows. The results obtained show that it is possible to identify a health problem with a reasonable level of accuracy using a neural network.

Abstract

The early detection of health problems in dairy cattle is crucial to reduce economic losses. Mid-infrared (MIR) spectrometry has been used for identifying the composition of cow milk in routine tests. As such, it is a potential tool to detect diseases at an early stage. Partial least squares discriminant analysis (PLS-DA) has been widely applied to identify illness such as lameness by using MIR spectrometry data. However, this method suffers some limitations. In this study, a series of machine learning techniques—random forest, support vector machine, neural network (NN), convolutional neural network and ensemble models—were used to test the feasibility of identifying cow sickness from 1909 milk sample MIR spectra from Holstein-Friesian, Jersey and crossbreed cows under grazing conditions. PLS-DA was also performed to compare the results. The sick cow records had a time window of 21 days before and 7 days after the milk sample was analysed. NN showed a sensitivity of 61.74%, specificity of 97% and positive predicted value (PPV) of nearly 60%. Although the sensitivity of the PLS-DA was slightly higher than NN (65.6%), the specificity and PPV were lower (79.59% and 15.25%, respectively). This indicates that by using NN, it is possible to identify a health problem with a reasonable level of accuracy.

Comparison of machine learning methods to predict udder health status based on somatic cell counts in dairy cows

Bovine mastitis is one of the most important economic and health issues in dairy farms. Data collection during routine recording procedures and access to large datasets have shed the light on the possibility to use trained machine learning algorithms to predict the udder health status of cows. In this study, we compared eight different machine learning methods (Linear Discriminant Analysis, Generalized Linear Model with logit link function, Naïve Bayes, Classification and Regression Trees, k-Nearest Neighbors, Support Vector Machines, Random Forest and Neural Network) to predict udder health status of cows based on somatic cell counts. Prediction accuracies of all methods were above 75%. According to different metrics, Neural Network, Random Forest and linear methods had the best performance in predicting udder health classes at a given test-day (healthy or mastitic according to somatic cell count below or above a predefined threshold of 200,000 cells/mL) based on the cow’s milk traits recorded at previous test-day. Our findings suggest machine learning algorithms as a promising tool to improve decision making for farmers. Machine learning analysis would improve the surveillance methods and help farmers to identify in advance those cows that would possibly have high somatic cell count in the subsequent test-day.

Rule Discovery in Milk Content towards Mastitis Diagnosis: Dealing with Farm Heterogeneity over Multiple Years through Classification Based on Associations

Simple Summary

Invisible (subclinical) mastitis decreases milk quality and production. Invisible mastitis is linked to an increased use of antimicrobials. The risk of the emergence of antimicrobial-resistant bacteria is a major public health concern worldwide. Therefore, early detection of infected cows is of great importance. Machine learning has opened a new avenue for early mastitis prediction based on simple and accessible milking parameters, such as milk volume, fat, protein, lactose, electrical conductivity (EC), milking time, and milking peak flow. However, farm heterogeneity is a major challenge where multiple patterns can predict mastitis. Here, we employed a classification based on associations and scaling approach for multiple pattern discovery over multiple years. The approach we have developed helps to address farm heterogeneity and generalise machine learning-based diagnosis of mastitis worldwide.

Abstract

Subclinical mastitis, an economically challenging disease of dairy cattle, is associated with an increased use of antimicrobials which reduces milk quantity and quality. It is more common than clinical mastitis and far more difficult to detect. Recently, much attention has been paid to the development of machine-learning expert systems for early detection of subclinical mastitis from milking features. However, differences between animals within a farm as well as between farms, particularly across multiple years, are major obstacles to the generalisation of machine learning models. Here, for the first time, we integrated scaling by quartiling with classification based on associations in a multi-year study to deal with farm heterogeneity by discovery of multiple patterns towards mastitis. The data were obtained from one farm comprising Holstein Friesian cows in Ongaonga, New Zealand, using an electronic automated monitoring system. The data collection was repeated annually over 3 consecutive years. Some discovered rules, such as when the milking peak flow is low, electrical conductivity (EC) of milk is low, milk lactose is low, milk fat is high, and milk volume is low, the cow has subclinical mastitis, reached high confidence (>70%) in multiple years. On averages, over 3 years, low level of milk lactose and high value of milk EC were part of 93% and 83.8% of all subclinical mastitis detecting rules, offering a reproducible pattern of subclinical mastitis detection. The scaled year-independent combinational rules provide an easy-to-apply and cost-effective machine-learning expert system for early detection of hidden mastitis using milking parameters.

Random Forest Modelling of Milk Yield of Dairy Cows under Heat Stress Conditions

Precision Livestock Farming (PLF) relies on several technological approaches to acquire, in the most efficient way, precise and real-time data concerning production and welfare of individual animals. In this regard, in the dairy sector, PLF devices are being increasingly adopted, automatic milking systems (AMSs) are becoming increasingly widespread, and monitoring systems for animals and environmental conditions are becoming common tools in herd management. As a consequence, a great amount of daily recorded data concerning individual animals are available for the farmers and they could be used effectively for the calibration of numerical models to be used for the prediction of future animal production trends. On the other hand, the machine learning approaches in PLF are nowadays considered an extremely promising solution in the research field of livestock farms and the application of these techniques in the dairy cattle farming would increase sustainability and efficiency of the sector. The study aims to define, train, and test a model developed through machine learning techniques, adopting a Random Forest algorithm, having the main goal to assess the trend in daily milk yield of a single cow in relation to environmental conditions. The model has been calibrated and tested on the data collected on 91 lactating cows of a dairy farm, located in northern Italy, and equipped with an AMS and thermo-hygrometric sensors during the years 2016-2017. In the statistical model, having seven predictor features, the daily milk yield is evaluated as a function of the position of the day in the lactation curve and the indoor barn conditions expressed in terms of daily average of the temperature-humidity index (THI) in the same day and its value in each of the five previous days. In this way, extreme hot conditions inducing heat stress effects can be considered in the yield predictions by the model. The average relative prediction error of the milk yield of each cow is about 18% of daily production, and only 2% of the total milk production.

Accelerometer systems as tools for health and welfare assessment in cattle and pigs - A review

Welfare assessment has traditionally been performed by direct observation by humans, providing information at only selected points in time. Recently, this assessment method has been questioned, as 'Precision Livestock Farming' technologies may be able to deliver more valid, reliable and feasible real-time data at the individual level and serve as early monitoring systems for animal welfare. The aim of this paper is to describe how accelerometers can be used for welfare assessment based on the principles of the Welfare Quality assessment protocol. Algorithm development is based mainly on the detection of behavioural traits. So far, high accuracies have been found for movement and resting behaviours in cows and pigs, while algorithm development for feeding and drinking behaviours in pigs lag behind progress in cows where valid algorithms are already available. Welfare studies have used accelerometer technology to address the effects on behaviour of diet, daily cycle, enrichment, housing, social mixing, oestrus, lameness and disease. Additional aspects to consider before a decision is made upon its use in research and in practical applications include battery life and sensor location. While accelerometer systems for cows are already being used by farmers, application in pigs has mainly remained at the research level.