1
|
Mesías-Ruiz GA, Pérez-Ortiz M, Dorado J, de Castro AI, Peña JM. Boosting precision crop protection towards agriculture 5.0 via machine learning and emerging technologies: A contextual review. FRONTIERS IN PLANT SCIENCE 2023; 14:1143326. [PMID: 37056493 PMCID: PMC10088868 DOI: 10.3389/fpls.2023.1143326] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/12/2023] [Accepted: 03/01/2023] [Indexed: 06/19/2023]
Abstract
Crop protection is a key activity for the sustainability and feasibility of agriculture in a current context of climate change, which is causing the destabilization of agricultural practices and an increase in the incidence of current or invasive pests, and a growing world population that requires guaranteeing the food supply chain and ensuring food security. In view of these events, this article provides a contextual review in six sections on the role of artificial intelligence (AI), machine learning (ML) and other emerging technologies to solve current and future challenges of crop protection. Over time, crop protection has progressed from a primitive agriculture 1.0 (Ag1.0) through various technological developments to reach a level of maturity closelyin line with Ag5.0 (section 1), which is characterized by successfully leveraging ML capacity and modern agricultural devices and machines that perceive, analyze and actuate following the main stages of precision crop protection (section 2). Section 3 presents a taxonomy of ML algorithms that support the development and implementation of precision crop protection, while section 4 analyses the scientific impact of ML on the basis of an extensive bibliometric study of >120 algorithms, outlining the most widely used ML and deep learning (DL) techniques currently applied in relevant case studies on the detection and control of crop diseases, weeds and plagues. Section 5 describes 39 emerging technologies in the fields of smart sensors and other advanced hardware devices, telecommunications, proximal and remote sensing, and AI-based robotics that will foreseeably lead the next generation of perception-based, decision-making and actuation systems for digitized, smart and real-time crop protection in a realistic Ag5.0. Finally, section 6 highlights the main conclusions and final remarks.
Collapse
Affiliation(s)
- Gustavo A. Mesías-Ruiz
- Institute of Agricultural Sciences (ICA), Spanish National Research Council (CSIC), Madrid, Spain
- Escuela Técnica Superior de Ingeniería Agronómica, Alimentaria y de Biosistemas (ETSIAAB), Universidad Politécnica de Madrid, Madrid, Spain
| | - María Pérez-Ortiz
- Centre for Artificial Intelligence, University College London, London, United Kingdom
| | - José Dorado
- Institute of Agricultural Sciences (ICA), Spanish National Research Council (CSIC), Madrid, Spain
| | - Ana I. de Castro
- Environment and Agronomy Department, National Institute for Agricultural and Food Research and Technology (INIA), Spanish National Research Council (CSIC), Madrid, Spain
| | - José M. Peña
- Institute of Agricultural Sciences (ICA), Spanish National Research Council (CSIC), Madrid, Spain
| |
Collapse
|
2
|
Huang Y, Zhao X, Pan Z, Reddy KN, Zhang J. Hyperspectral plant sensing for differentiating glyphosate-resistant and glyphosate-susceptible johnsongrass through machine learning algorithms. PEST MANAGEMENT SCIENCE 2022; 78:2370-2377. [PMID: 35254728 DOI: 10.1002/ps.6864] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/14/2021] [Revised: 01/12/2022] [Accepted: 03/07/2022] [Indexed: 06/14/2023]
Abstract
BACKGROUND Johnsongrass (Sorghum halepense) is one of the weeds that evolves resistance to glyphosate [N-(phosphonomethyl)-glycine], the most widely used herbicide, and the weed may cause agronomic troublesome in the southern USA. This paper reports a study on developing a hyperspectral plant sensing approach to explore the spectral features of glyphosate-resistant (GR) and glyphosate-sensitive (GS) plants to evaluate this approach using machine learning algorithms to differentiate between GR and GS plants. RESULTS On average, GR plants have higher spectral reflectance compared with GS plants. The sensitive spectral bands were optimally selected using the successive projections algorithm respectively wrapped with the machine learning algorithms of k-nearest neighbors (KNN), random forest (RF), and support vector machine (SVM) with Fisher linear discriminant analysis (FLDA) to classify between GS and GS plants. At 3 weeks after transplanting (WAT) KNN and SVM could not acceptably classify the GR and GS plants but they improved significantly with the stages to have their overall accuracies reaching 73% and 77%, respectively, at 5 WAT. RF and FLDA had a better ability to classify the plants at 3 WAT but RF was low in accuracy at 2 WAT while FLDA dropped accuracy to 50% at 4 WAT from 57% at 3 WAT and raised it to 73% at 5 WAT. CONCLUSIONS Previous studies were conducted developing the hyperspectral imaging approach to differentiate GR Palmer amaranth from GS Palmer amaranth and GR Italian ryegrass from GS Italian ryegrass with classification accuracies of 90% and 80%, respectively. This study demonstrated that the hyperspectral plant sensing approach could be developed to differentiate GR johnsongrass from glyphosate-sensitive GS johnsongrass with the highest classification accuracy of 77%. The comparison with our previous studies indicated that the similar hyperspectral approach could be used and transferred from classification across different GR and GS weed biotypes, such as Palmer amaranth, Italian ryegrass and johnsongrass, so it is highly possible for classification of more other GR and GS weed biotypes as well. On the basis of classic pattern recognition approaches the process of plant classification can be enhanced by modeling using machine learning algorithms. © 2022 Society of Chemical Industry. This article has been contributed to by U.S. Government employees and their work is in the public domain in the USA.
Collapse
Affiliation(s)
- Yanbo Huang
- US Department of Agriculture, Agricultural Research Service, Genetics and Sustainable Agriculture Research Unit, Mississippi State, MS, USA
| | | | - Zeng Pan
- Hangzhou Dianzi University, Hangzhou, China
| | - Krishna N Reddy
- US Department of Agriculture, Agricultural Research Service, Crop Production Systems Research Unit, Stoneville, MS, USA
| | | |
Collapse
|
3
|
UAV-Assisted Thermal Infrared and Multispectral Imaging of Weed Canopies for Glyphosate Resistance Detection. REMOTE SENSING 2021. [DOI: 10.3390/rs13224606] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
The foundation of contemporary weed management practices in many parts of the world is glyphosate. However, dependency on the effectiveness of herbicide practices has led to overuse through continuous growth of crops resistant to a single mode of action. In order to provide a cost-effective weed management strategy that does not promote glyphosate-resistant weed biotypes, differences between resistant and susceptible biotypes have to be identified accurately in the field conditions. Unmanned Aerial Vehicle (UAV)-assisted thermal and multispectral remote sensing has potential for detecting biophysical characteristics of weed biotypes during the growing season, which includes distinguishing glyphosate-susceptible and glyphosate-resistant weed populations based on canopy temperature and deep learning driven weed identification algorithms. The objective of this study was to identify herbicide resistance after glyphosate application in true field conditions by analyzing the UAV-acquired thermal and multispectral response of kochia, waterhemp, redroot pigweed, and common ragweed. The data were processed in ArcGIS for raster classification as well as spectral comparison of glyphosate-resistant and glyphosate-susceptible weeds. The classification accuracy between the sensors and classification methods of maximum likelihood, random trees, and Support Vector Machine (SVM) were compared. The random trees classifier performed the best at 4 days after application (DAA) for kochia with 62.9% accuracy. The maximum likelihood classifier provided the highest performing result out of all classification methods with an accuracy of 75.2%. A commendable classification was made at 8 DAA where the random trees classifier attained an accuracy of 87.2%. However, thermal reflectance measurements as a predictor for glyphosate resistance within weed populations in field condition was unreliable due to its susceptibility to environmental conditions. Normalized Difference Vegetation Index (NDVI) and a composite reflectance of 842 nm, 705 nm, and 740 nm wavelength managed to provide better classification results than thermal in most cases.
Collapse
|
4
|
Roslim MHM, Juraimi AS, Che’Ya NN, Sulaiman N, Manaf MNHA, Ramli Z, Motmainna M. Using Remote Sensing and an Unmanned Aerial System for Weed Management in Agricultural Crops: A Review. AGRONOMY 2021; 11:1809. [DOI: 10.3390/agronomy11091809] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/02/2023]
Abstract
Weeds are unwanted plants that can reduce crop yields by competing for water, nutrients, light, space, and carbon dioxide, which need to be controlled to meet future food production requirements. The integration of drones, artificial intelligence, and various sensors, which include hyperspectral, multi-spectral, and RGB (red-green-blue), ensure the possibility of a better outcome in managing weed problems. Most of the major or minor challenges caused by weed infestation can be faced by implementing remote sensing systems in various agricultural tasks. It is a multi-disciplinary science that includes spectroscopy, optics, computer, photography, satellite launching, electronics, communication, and several other fields. Future challenges, including food security, sustainability, supply and demand, climate change, and herbicide resistance, can also be overcome by those technologies based on machine learning approaches. This review provides an overview of the potential and practical use of unmanned aerial vehicle and remote sensing techniques in weed management practices and discusses how they overcome future challenges.
Collapse
|
5
|
Squires CC, Coleman GR, Broster JC, Preston C, Boutsalis P, Owen MJ, Jalaludin A, Walsh MJ. Increasing the value and efficiency of herbicide resistance surveys. PEST MANAGEMENT SCIENCE 2021; 77:3881-3889. [PMID: 33650211 DOI: 10.1002/ps.6333] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/18/2020] [Revised: 02/12/2021] [Accepted: 03/01/2021] [Indexed: 06/12/2023]
Abstract
The scale of herbicide resistance within a cropping region can be estimated and monitored using surveys of weed populations. The current approach to herbicide resistance surveys is time-consuming, logistically challenging and costly. Here we review past and current approaches used in herbicide resistance surveys with the aims of (i) defining effective survey methodologies, (ii) highlighting opportunities for improving efficiencies through the use of new technologies and (iii) identifying the value of repeated region-wide herbicide resistance surveys. One of the most extensively surveyed areas of the world's cropping regions is the Australian grain production region, with >2900 fields randomly surveyed in each of three surveys conducted over the past 15 years. Consequently, recommended methodologies are based on what has been learned from the Australian experience. Traditional seedling-based herbicide screening assays remain the most reliable and widely applicable method for characterizing resistance in weed populations. The use of satellite or aerial imagery to plan collections and image analysis to rapidly quantify screening results could complement traditional resistance assays by increasing survey efficiency and sampling accuracy. Global management of herbicide-resistant weeds would benefit from repeated and standardized surveys that track herbicide resistance evolution within and across cropping regions. © 2021 Society of Chemical Industry.
Collapse
Affiliation(s)
- Caleb C Squires
- School of Life and Environmental Science, Sydney Institute of Agriculture, University of Sydney, Camden, Australia
| | - Guy Ry Coleman
- School of Life and Environmental Science, Sydney Institute of Agriculture, University of Sydney, Camden, Australia
| | - John C Broster
- Graham Centre for Agricultural Innovation (Charles Sturt University and NSW Department of Primary Industries), Charles Sturt University, Wagga Wagga, Australia
| | - Christopher Preston
- School of Agriculture Food and Wine, University of Adelaide, Glen Osmond, Australia
| | - Peter Boutsalis
- School of Agriculture Food and Wine, University of Adelaide, Glen Osmond, Australia
| | - Mechelle J Owen
- Australian Herbicide Resistance Initiative, School of Agriculture and Environment, University of Western Australia, Crawley, Australia
| | - Adam Jalaludin
- Queensland Department of Agriculture and Fisheries, Toowoomba, Australia
| | - Michael J Walsh
- School of Life and Environmental Science, Sydney Institute of Agriculture, University of Sydney, Camden, Australia
| |
Collapse
|
6
|
Paulus S, Mahlein AK. Technical workflows for hyperspectral plant image assessment and processing on the greenhouse and laboratory scale. Gigascience 2020; 9:5894826. [PMID: 32815537 PMCID: PMC7439585 DOI: 10.1093/gigascience/giaa090] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2020] [Revised: 06/26/2020] [Accepted: 08/04/2020] [Indexed: 11/13/2022] Open
Abstract
Background The use of hyperspectral cameras is well established in the field of plant phenotyping, especially as a part of high-throughput routines in greenhouses. Nevertheless, the workflows used differ depending on the applied camera, the plants being imaged, the experience of the users, and the measurement set-up. Results This review describes a general workflow for the assessment and processing of hyperspectral plant data at greenhouse and laboratory scale. Aiming at a detailed description of possible error sources, a comprehensive literature review of possibilities to overcome these errors and influences is provided. The processing of hyperspectral data of plants starting from the hardware sensor calibration, the software processing steps to overcome sensor inaccuracies, and the preparation for machine learning is shown and described in detail. Furthermore, plant traits extracted from spectral hypercubes are categorized to standardize the terms used when describing hyperspectral traits in plant phenotyping. A scientific data perspective is introduced covering information for canopy, single organs, plant development, and also combined traits coming from spectral and 3D measuring devices. Conclusions This publication provides a structured overview on implementing hyperspectral imaging into biological studies at greenhouse and laboratory scale. Workflows have been categorized to define a trait-level scale according to their metrological level and the processing complexity. A general workflow is shown to outline procedures and requirements to provide fully calibrated data of the highest quality. This is essential for differentiation of the smallest changes from hyperspectral reflectance of plants, to track and trace hyperspectral development as an answer to biotic or abiotic stresses.
Collapse
Affiliation(s)
- Stefan Paulus
- Institute of Sugar Beet Research, Holtenser Landstr. 77, 37079 Göttingen, Germany
| | - Anne-Katrin Mahlein
- Institute of Sugar Beet Research, Holtenser Landstr. 77, 37079 Göttingen, Germany
| |
Collapse
|
7
|
Behmann J, Acebron K, Emin D, Bennertz S, Matsubara S, Thomas S, Bohnenkamp D, Kuska MT, Jussila J, Salo H, Mahlein AK, Rascher U. Specim IQ: Evaluation of a New, Miniaturized Handheld Hyperspectral Camera and Its Application for Plant Phenotyping and Disease Detection. SENSORS (BASEL, SWITZERLAND) 2018; 18:E441. [PMID: 29393921 PMCID: PMC5855187 DOI: 10.3390/s18020441] [Citation(s) in RCA: 89] [Impact Index Per Article: 14.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/30/2017] [Revised: 01/24/2018] [Accepted: 01/24/2018] [Indexed: 01/08/2023]
Abstract
Hyperspectral imaging sensors are promising tools for monitoring crop plants or vegetation in different environments. Information on physiology, architecture or biochemistry of plants can be assessed non-invasively and on different scales. For instance, hyperspectral sensors are implemented for stress detection in plant phenotyping processes or in precision agriculture. Up to date, a variety of non-imaging and imaging hyperspectral sensors is available. The measuring process and the handling of most of these sensors is rather complex. Thus, during the last years the demand for sensors with easy user operability arose. The present study introduces the novel hyperspectral camera Specim IQ from Specim (Oulu, Finland). The Specim IQ is a handheld push broom system with integrated operating system and controls. Basic data handling and data analysis processes, such as pre-processing and classification routines are implemented within the camera software. This study provides an introduction into the measurement pipeline of the Specim IQ as well as a radiometric performance comparison with a well-established hyperspectral imager. Case studies for the detection of powdery mildew on barley at the canopy scale and the spectral characterization of Arabidopsis thaliana mutants grown under stressed and non-stressed conditions are presented.
Collapse
Affiliation(s)
- Jan Behmann
- INRES-Plant Diseases and Plant Protection, University of Bonn, 53115 Bonn, Germany; (J.B.); (S.T.); (D.B.); (M.T.K.); (A.-K.M.)
| | - Kelvin Acebron
- IBG-2, Forschungszentrum Jülich (FZJ), Jülich, 52428 Germany; (K.A.); (D.E.); (S.B.); (S.M.); (U.R.)
| | - Dzhaner Emin
- IBG-2, Forschungszentrum Jülich (FZJ), Jülich, 52428 Germany; (K.A.); (D.E.); (S.B.); (S.M.); (U.R.)
| | - Simon Bennertz
- IBG-2, Forschungszentrum Jülich (FZJ), Jülich, 52428 Germany; (K.A.); (D.E.); (S.B.); (S.M.); (U.R.)
| | - Shizue Matsubara
- IBG-2, Forschungszentrum Jülich (FZJ), Jülich, 52428 Germany; (K.A.); (D.E.); (S.B.); (S.M.); (U.R.)
| | - Stefan Thomas
- INRES-Plant Diseases and Plant Protection, University of Bonn, 53115 Bonn, Germany; (J.B.); (S.T.); (D.B.); (M.T.K.); (A.-K.M.)
| | - David Bohnenkamp
- INRES-Plant Diseases and Plant Protection, University of Bonn, 53115 Bonn, Germany; (J.B.); (S.T.); (D.B.); (M.T.K.); (A.-K.M.)
| | - Matheus T. Kuska
- INRES-Plant Diseases and Plant Protection, University of Bonn, 53115 Bonn, Germany; (J.B.); (S.T.); (D.B.); (M.T.K.); (A.-K.M.)
| | | | - Harri Salo
- Specim Ltd., FI-90571 Oulu, Finland; (J.J.); (H.S.)
| | - Anne-Katrin Mahlein
- INRES-Plant Diseases and Plant Protection, University of Bonn, 53115 Bonn, Germany; (J.B.); (S.T.); (D.B.); (M.T.K.); (A.-K.M.)
- Institute of Sugar Beet Research (IFZ), 37079 Göttingen, Germany
| | - Uwe Rascher
- IBG-2, Forschungszentrum Jülich (FZJ), Jülich, 52428 Germany; (K.A.); (D.E.); (S.B.); (S.M.); (U.R.)
| |
Collapse
|
8
|
Chauhan BS, Matloob A, Mahajan G, Aslam F, Florentine SK, Jha P. Emerging Challenges and Opportunities for Education and Research in Weed Science. FRONTIERS IN PLANT SCIENCE 2017; 8:1537. [PMID: 28928765 PMCID: PMC5591876 DOI: 10.3389/fpls.2017.01537] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/11/2017] [Accepted: 08/22/2017] [Indexed: 05/23/2023]
Abstract
In modern agriculture, with more emphasis on high input systems, weed problems are likely to increase and become more complex. With heightened awareness of adverse effects of herbicide residues on human health and environment and the evolution of herbicide-resistant weed biotypes, a significant focus within weed science has now shifted to the development of eco-friendly technologies with reduced reliance on herbicides. Further, with the large-scale adoption of herbicide-resistant crops, and uncertain climatic optima under climate change, the problems for weed science have become multi-faceted. To handle these complex weed problems, a holistic line of action with multi-disciplinary approaches is required, including adjustments to technology, management practices, and legislation. Improved knowledge of weed ecology, biology, genetics, and molecular biology is essential for developing sustainable weed control practices. Additionally, judicious use of advanced technologies, such as site-specific weed management systems and decision support modeling, will play a significant role in reducing costs associated with weed control. Further, effective linkages between farmers and weed researchers will be necessary to facilitate the adoption of technological developments. To meet these challenges, priorities in research need to be determined and the education system for weed science needs to be reoriented. In respect of the latter imperative, closer collaboration between weed scientists and other disciplines can help in defining and solving the complex weed management challenges of the 21st century. This consensus will provide more versatile and diverse approaches to innovative teaching and training practices, which will be needed to prepare future weed science graduates who are capable of handling the anticipated challenges of weed science facing in contemporary agriculture. To build this capacity, mobilizing additional funding for both weed research and weed management education is essential.
Collapse
Affiliation(s)
- Bhagirath S. Chauhan
- The Centre for Plant Science, Queensland Alliance for Agriculture and Food Innovation, The University of Queensland, BrisbaneQLD, Australia
| | - Amar Matloob
- The Centre for Plant Science, Queensland Alliance for Agriculture and Food Innovation, The University of Queensland, BrisbaneQLD, Australia
- Department of Agronomy, Muhammad Nawaz Shareef University of AgricultureMultan, Pakistan
| | - Gulshan Mahajan
- The Centre for Plant Science, Queensland Alliance for Agriculture and Food Innovation, The University of Queensland, BrisbaneQLD, Australia
| | - Farhena Aslam
- Department of Agronomy, Bahauddin Zakariya UniversityMultan, Pakistan
| | - Singarayer K. Florentine
- Centre for Environmental Management, Faculty of Science and Technology, Federation University Australia, BallaratVIC, Australia
| | - Prashant Jha
- Southern Agricultural Research Centre, Montana State University, BozemanMT, United States
| |
Collapse
|
9
|
Maroli AS, Nandula VK, Dayan FE, Duke SO, Gerard P, Tharayil N. Metabolic Profiling and Enzyme Analyses Indicate a Potential Role of Antioxidant Systems in Complementing Glyphosate Resistance in an Amaranthus palmeri Biotype. JOURNAL OF AGRICULTURAL AND FOOD CHEMISTRY 2015; 63:9199-209. [PMID: 26329798 DOI: 10.1021/acs.jafc.5b04223] [Citation(s) in RCA: 43] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/21/2023]
Abstract
Metabolomics and biochemical assays were employed to identify physiological perturbations induced by a commercial formulation of glyphosate in susceptible (S) and resistant (R) biotypes of Amaranthus palmeri. At 8 h after treatment (HAT), compared to the respective water-treated control, cellular metabolism of both biotypes were similarly perturbed by glyphosate, resulting in abundance of most metabolites including shikimic acid, amino acids, organic acids and sugars. However, by 80 HAT the metabolite pool of glyphosate-treated R-biotype was similar to that of the control S- and R-biotypes, indicating a potential physiological recovery. Furthermore, the glyphosate-treated R-biotype had lower reactive oxygen species (ROS) damage, higher ROS scavenging activity, and higher levels of potential antioxidant compounds derived from the phenylpropanoid pathway. Thus, metabolomics, in conjunction with biochemical assays, indicate that glyphosate-induced metabolic perturbations are not limited to the shikimate pathway, and the oxidant quenching efficiency could potentially complement the glyphosate resistance in this R-biotype.
Collapse
Affiliation(s)
| | - Vijay K Nandula
- Crop Production Systems Research Unit, United States Department of Agriculture , Stoneville, Mississippi 38776, United States
| | - Franck E Dayan
- Natural Products Utilization Research Unit, United States Department of Agriculture , University, Mississippi 38677, United States
| | - Stephen O Duke
- Natural Products Utilization Research Unit, United States Department of Agriculture , University, Mississippi 38677, United States
| | | | | |
Collapse
|