1
|
Wang H, Li T, Nishida E, Kato Y, Fukano Y, Guo W. Drone-Based Harvest Data Prediction Can Reduce On-Farm Food Loss and Improve Farmer Income. PLANT PHENOMICS (WASHINGTON, D.C.) 2023; 5:0086. [PMID: 37692103 PMCID: PMC10484300 DOI: 10.34133/plantphenomics.0086] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/25/2023] [Accepted: 08/14/2023] [Indexed: 09/12/2023]
Abstract
On-farm food loss (i.e., grade-out vegetables) is a difficult challenge in sustainable agricultural systems. The simplest method to reduce the number of grade-out vegetables is to monitor and predict the size of all individuals in the vegetable field and determine the optimal harvest date with the smallest grade-out number and highest profit, which is not cost-effective by conventional methods. Here, we developed a full pipeline to accurately estimate and predict every broccoli head size (n > 3,000) automatically and nondestructively using drone remote sensing and image analysis. The individual sizes were fed to the temperature-based growth model and predicted the optimal harvesting date. Two years of field experiments revealed that our pipeline successfully estimated and predicted the head size of all broccolis with high accuracy. We also found that a deviation of only 1 to 2 days from the optimal date can considerably increase grade-out and reduce farmer's profits. This is an unequivocal demonstration of the utility of these approaches to economic crop optimization and minimization of food losses.
Collapse
Affiliation(s)
- Haozhou Wang
- Graduate School of Agricultural and Life Sciences,
The University of Tokyo, Tokyo, Japan
| | - Tang Li
- Graduate School of Agricultural and Life Sciences,
The University of Tokyo, Tokyo, Japan
| | - Erika Nishida
- Graduate School of Agricultural and Life Sciences,
The University of Tokyo, Tokyo, Japan
| | - Yoichiro Kato
- Graduate School of Agricultural and Life Sciences,
The University of Tokyo, Tokyo, Japan
| | - Yuya Fukano
- Graduate School of Horticulture,
Chiba University, Chiba, Japan
| | - Wei Guo
- Graduate School of Agricultural and Life Sciences,
The University of Tokyo, Tokyo, Japan
| |
Collapse
|
2
|
Trujillano F, Garay GJ, Alatrista-Salas H, Byrne I, Nunez-del-Prado M, Chan K, Manrique E, Johnson E, Apollinaire N, Kouame Kouakou P, Oumbouke WA, Tiono AB, Guelbeogo MW, Lines J, Carrasco-Escobar G, Fornace K. Mapping Malaria Vector Habitats in West Africa: Drone Imagery and Deep Learning Analysis for Targeted Vector Surveillance. REMOTE SENSING 2023; 15:2775. [PMID: 37324796 PMCID: PMC7614662 DOI: 10.3390/rs15112775] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
Disease control programs are needed to identify the breeding sites of mosquitoes, which transmit malaria and other diseases, in order to target interventions and identify environmental risk factors. The increasing availability of very-high-resolution drone data provides new opportunities to find and characterize these vector breeding sites. Within this study, drone images from two malaria-endemic regions in Burkina Faso and Côte d'Ivoire were assembled and labeled using open-source tools. We developed and applied a workflow using region-of-interest-based and deep learning methods to identify land cover types associated with vector breeding sites from very-high-resolution natural color imagery. Analysis methods were assessed using cross-validation and achieved maximum Dice coefficients of 0.68 and 0.75 for vegetated and non-vegetated water bodies, respectively. This classifier consistently identified the presence of other land cover types associated with the breeding sites, obtaining Dice coefficients of 0.88 for tillage and crops, 0.87 for buildings and 0.71 for roads. This study establishes a framework for developing deep learning approaches to identify vector breeding sites and highlights the need to evaluate how results will be used by control programs.
Collapse
Affiliation(s)
- Fedra Trujillano
- Health Innovation Laboratory, Institute of Tropical Medicine “Alexander von Humboldt”, Universidad Peruana Cayetano Heredia, Lima 15102, Peru
- School of Biodiversity, One Health & Veterinary Medicine, University of Glasgow, Glasgow G12 8QQ, UK
| | - Gabriel Jimenez Garay
- Health Innovation Laboratory, Institute of Tropical Medicine “Alexander von Humboldt”, Universidad Peruana Cayetano Heredia, Lima 15102, Peru
- Department of Engineering and Computer Science, Faculty of Science and Engineering, Sorbonne University, 75005 Paris, France
| | - Hugo Alatrista-Salas
- Escuela de Posgrado Newman, Tacna 23001, Peru
- Science and Engineering School, Pontificia Universidad Católica del Perú (PUCP), Lima 15088, Peru
| | - Isabel Byrne
- Department of Infection Biology, London School of Hygiene & Tropical Medicine, London WC1E 7HT, UK
| | - Miguel Nunez-del-Prado
- Peru Research, Development and Innovation Center (Peru IDI), Lima 15076, Peru
- The World Bank, Washington, DC 20433, USA
| | - Kallista Chan
- Department of Infection Biology, London School of Hygiene & Tropical Medicine, London WC1E 7HT, UK
- Centre on Climate Change and Planetary Health, London School of Hygiene & Tropical Medicine, London WC1E 7HT, UK
| | - Edgar Manrique
- Health Innovation Laboratory, Institute of Tropical Medicine “Alexander von Humboldt”, Universidad Peruana Cayetano Heredia, Lima 15102, Peru
| | - Emilia Johnson
- School of Biodiversity, One Health & Veterinary Medicine, University of Glasgow, Glasgow G12 8QQ, UK
| | - Nombre Apollinaire
- Centre National de Recherche et de Formation sur le Paludisme, Ouagadougou 01 BP 2208, Burkina Faso
| | | | - Welbeck A. Oumbouke
- Department of Infection Biology, London School of Hygiene & Tropical Medicine, London WC1E 7HT, UK
- Innovative Vector Control Consortium, Liverpool School of Tropical Medicine, London L3 5QA, UK
| | - Alfred B. Tiono
- Centre on Climate Change and Planetary Health, London School of Hygiene & Tropical Medicine, London WC1E 7HT, UK
| | - Moussa W. Guelbeogo
- Centre on Climate Change and Planetary Health, London School of Hygiene & Tropical Medicine, London WC1E 7HT, UK
| | - Jo Lines
- Department of Infection Biology, London School of Hygiene & Tropical Medicine, London WC1E 7HT, UK
- Centre on Climate Change and Planetary Health, London School of Hygiene & Tropical Medicine, London WC1E 7HT, UK
| | - Gabriel Carrasco-Escobar
- Health Innovation Laboratory, Institute of Tropical Medicine “Alexander von Humboldt”, Universidad Peruana Cayetano Heredia, Lima 15102, Peru
- Scripps Institution of Oceanography, University of California San Diego, La Jolla, CA 92093, USA
| | - Kimberly Fornace
- School of Biodiversity, One Health & Veterinary Medicine, University of Glasgow, Glasgow G12 8QQ, UK
- Centre on Climate Change and Planetary Health, London School of Hygiene & Tropical Medicine, London WC1E 7HT, UK
- Saw Swee Hock School of Public Health, National University of Singapore and National University Health System, Singapore 119077, Singapore
| |
Collapse
|
3
|
Hu Y, Schmidhalter U. Opportunity and challenges of phenotyping plant salt tolerance. TRENDS IN PLANT SCIENCE 2023; 28:552-566. [PMID: 36628656 DOI: 10.1016/j.tplants.2022.12.010] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/04/2022] [Revised: 12/03/2022] [Accepted: 12/15/2022] [Indexed: 05/22/2023]
Abstract
Salinity is a key factor limiting agricultural production worldwide. Recent advances in field phenotyping have enabled the recording of the environmental history and dynamic response of plants by considering both genotype × environment (G×E) interactions and envirotyping. However, only a few studies have focused on plant salt tolerance phenotyping. Therefore, we analyzed the potential opportunities and major challenges in improving plant salt tolerance using advanced field phenotyping technologies. RGB imaging and spectral and thermal sensors are the most useful and important sensing techniques for assessing key morphological and physiological traits of plant salt tolerance. However, field phenotyping faces challenges owing to its practical applications and high costs, limiting its use in early generation breeding and in developing countries.
Collapse
Affiliation(s)
- Yuncai Hu
- Chair of Plant Nutrition, School of Life Sciences, Technical University of Munich, D-85354 Freising, Germany.
| | - Urs Schmidhalter
- Chair of Plant Nutrition, School of Life Sciences, Technical University of Munich, D-85354 Freising, Germany
| |
Collapse
|
4
|
Solimani F, Cardellicchio A, Nitti M, Lako A, Dimauro G, Renò V. A Systematic Review of Effective Hardware and Software Factors Affecting High-Throughput Plant Phenotyping. INFORMATION 2023. [DOI: 10.3390/info14040214] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/05/2023] Open
Abstract
Plant phenotyping studies the complex characteristics of plants, with the aim of evaluating and assessing their condition and finding better exemplars. Recently, a new branch emerged in the phenotyping field, namely, high-throughput phenotyping (HTP). Specifically, HTP exploits modern data sampling techniques to gather a high amount of data that can be used to improve the effectiveness of phenotyping. Hence, HTP combines the knowledge derived from the phenotyping domain with computer science, engineering, and data analysis techniques. In this scenario, machine learning (ML) and deep learning (DL) algorithms have been successfully integrated with noninvasive imaging techniques, playing a key role in automation, standardization, and quantitative data analysis. This study aims to systematically review two main areas of interest for HTP: hardware and software. For each of these areas, two influential factors were identified: for hardware, platforms and sensing equipment were analyzed; for software, the focus was on algorithms and new trends. The study was conducted following the PRISMA protocol, which allowed the refinement of the research on a wide selection of papers by extracting a meaningful dataset of 32 articles of interest. The analysis highlighted the diffusion of ground platforms, which were used in about 47% of reviewed methods, and RGB sensors, mainly due to their competitive costs, high compatibility, and versatility. Furthermore, DL-based algorithms accounted for the larger share (about 69%) of reviewed approaches, mainly due to their effectiveness and the focus posed by the scientific community over the last few years. Future research will focus on improving DL models to better handle hardware-generated data. The final aim is to create integrated, user-friendly, and scalable tools that can be directly deployed and used on the field to improve the overall crop yield.
Collapse
Affiliation(s)
- Firozeh Solimani
- Institute of Intelligent Industrial Technologies and Systems for Advanced Manufacturing, National Research Council of Italy, Via Amendola 122 D/O, 70126 Bari, Italy
| | - Angelo Cardellicchio
- Institute of Intelligent Industrial Technologies and Systems for Advanced Manufacturing, National Research Council of Italy, Via Amendola 122 D/O, 70126 Bari, Italy
| | - Massimiliano Nitti
- Institute of Intelligent Industrial Technologies and Systems for Advanced Manufacturing, National Research Council of Italy, Via Amendola 122 D/O, 70126 Bari, Italy
| | - Alfred Lako
- Faculty of Civil Engineering, Polytechnic University of Tirana, Bulevardi Dëshmorët e Kombit Nr. 4, 1000 Tiranë, Albania
| | - Giovanni Dimauro
- Department of Computer Science, University of Bari, Via E. Orabona, 4, 70125 Bari, Italy
| | - Vito Renò
- Institute of Intelligent Industrial Technologies and Systems for Advanced Manufacturing, National Research Council of Italy, Via Amendola 122 D/O, 70126 Bari, Italy
| |
Collapse
|
5
|
Estimation of Maize Foliar Temperature and Stomatal Conductance as Indicators of Water Stress Based on Optical and Thermal Imagery Acquired Using an Unmanned Aerial Vehicle (UAV) Platform. DRONES 2022. [DOI: 10.3390/drones6070169] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Climatic variability and extreme weather events impact agricultural production, especially in sub-Saharan smallholder cropping systems, which are commonly rainfed. Hence, the development of early warning systems regarding moisture availability can facilitate planning, mitigate losses and optimise yields through moisture augmentation. Precision agricultural practices, facilitated by unmanned aerial vehicles (UAVs) with very high-resolution cameras, are useful for monitoring farm-scale dynamics at near-real-time and have become an important agricultural management tool. Considering these developments, we evaluated the utility of optical and thermal infrared UAV imagery, in combination with a random forest machine-learning algorithm, to estimate the maize foliar temperature and stomatal conductance as indicators of potential crop water stress and moisture content over the entire phenological cycle. The results illustrated that the thermal infrared waveband was the most influential variable during vegetative growth stages, whereas the red-edge and near-infrared derived vegetation indices were fundamental during the reproductive growth stages for both temperature and stomatal conductance. The results also suggested mild water stress during vegetative growth stages and after a hailstorm during the mid-reproductive stage. Furthermore, the random forest model optimally estimated the maize crop temperature and stomatal conductance over the various phenological stages. Specifically, maize foliar temperature was best predicted during the mid-vegetative growth stage and stomatal conductance was best predicted during the early reproductive growth stage. Resultant maps of the modelled maize growth stages captured the spatial heterogeneity of maize foliar temperature and stomatal conductance within the maize field. Overall, the findings of the study demonstrated that the use of UAV optical and thermal imagery, in concert with prediction-based machine learning, is a useful tool, available to smallholder farmers to help them make informed management decisions that include the optimal implementation of irrigation schedules.
Collapse
|
6
|
Combining Canopy Coverage and Plant Height from UAV-Based RGB Images to Estimate Spraying Volume on Potato. SUSTAINABILITY 2022. [DOI: 10.3390/su14116473] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Canopy coverage and plant height are the main crop canopy parameters, which can obviously reflect the growth status of crops on the field. The ability to identify canopy coverage and plant height quickly is critical for farmers or breeders to arrange their working schedule. In precision agriculture, choosing the opportunity and amount of farm inputs is the critical part, which will improve the yield and decrease the cost. The potato canopy coverage and plant height were quickly extracted, which could be used to estimate the spraying volume using the evaluation model obtained by indoor tests. The vegetation index approach was used to extract potato canopy coverage, and the color point cloud data method at different height rates was formed to estimate the plant height of potato at different growth stages. The original data were collected using a low-cost UAV, which was mounted on a high-resolution RGB camera. Then, the Structure from Motion (SFM) algorithm was used to extract the 3D point cloud from ordered images that could form a digital orthophoto model (DOM) and sparse point cloud. The results show that the vegetation index-based method could accurately estimate canopy coverage. Among EXG, EXR, RGBVI, GLI, and CIVE, EXG achieved the best adaptability in different test plots. Point cloud data could be used to estimate plant height, but when the potato coverage rate was low, potato canopy point cloud data underwent rarefaction; in the vigorous growth period, the estimated value was substantially connected with the measured value (R2 = 0.94). The relationship between the coverage area of spraying on potato canopy and canopy coverage was measured indoors to form the model. The results revealed that the model could estimate the dose accurately (R2 = 0.878). Therefore, combining agronomic factors with data extracted from the UAV RGB image had the ability to predict the field spraying volume.
Collapse
|
7
|
EasyIDP: A Python Package for Intermediate Data Processing in UAV-Based Plant Phenotyping. REMOTE SENSING 2021. [DOI: 10.3390/rs13132622] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Unmanned aerial vehicle (UAV) and structure from motion (SfM) photogrammetry techniques are widely used for field-based, high-throughput plant phenotyping nowadays, but some of the intermediate processes throughout the workflow remain manual. For example, geographic information system (GIS) software is used to manually assess the 2D/3D field reconstruction quality and cropping region of interests (ROIs) from the whole field. In addition, extracting phenotypic traits from raw UAV images is more competitive than directly from the digital orthomosaic (DOM). Currently, no easy-to-use tools are available to implement previous tasks for commonly used commercial SfM software, such as Pix4D and Agisoft Metashape. Hence, an open source software package called easy intermediate data processor (EasyIDP; MIT license) was developed to decrease the workload in intermediate data processing mentioned above. The functions of the proposed package include (1) an ROI cropping module, assisting in reconstruction quality assessment and cropping ROIs from the whole field, and (2) an ROI reversing module, projecting ROIs to relative raw images. The result showed that both cropping and reversing modules work as expected. Moreover, the effects of ROI height selection and reversed ROI position on raw images to reverse calculation were discussed. This tool shows great potential for decreasing workload in data annotation for machine learning applications.
Collapse
|
8
|
Smith DT, Potgieter AB, Chapman SC. Scaling up high-throughput phenotyping for abiotic stress selection in the field. TAG. THEORETICAL AND APPLIED GENETICS. THEORETISCHE UND ANGEWANDTE GENETIK 2021; 134:1845-1866. [PMID: 34076731 DOI: 10.1007/s00122-021-03864-5] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/02/2021] [Accepted: 05/13/2021] [Indexed: 05/18/2023]
Abstract
High-throughput phenotyping (HTP) is in its infancy for deployment in large-scale breeding programmes. With the ability to measure correlated traits associated with physiological ideotypes, in-field phenotyping methods are available for screening of abiotic stress responses. As cropping environments become more hostile and unpredictable due to the effects of climate change, the need to characterise variability across spatial and temporal scales will become increasingly important. The sensor technologies that have enabled HTP from macroscopic through to satellite sensors may also be utilised here to complement spatial characterisation using envirotyping, which can improve estimations of genotypic performance across environments by better accounting for variation at the plot, trial and inter-trial levels. Climate change is leading to increased variation at all physical and temporal scales in the cropping environment. Maintaining yield stability under circumstances with greater levels of abiotic stress while capitalising upon yield potential in good years, requires approaches to plant breeding that target the physiological limitations to crop performance in specific environments. This requires dynamic modelling of conditions within target populations of environments, GxExM predictions, clustering of environments so breeding trajectories can be defined, and the development of screens that enable selection for genetic gain to occur. High-throughput phenotyping (HTP), combined with related technologies used for envirotyping, can help to address these challenges. Non-destructive analysis of the morphological, biochemical and physiological qualities of plant canopies using HTP has great potential to complement whole-genome selection, which is becoming increasingly common in breeding programmes. A range of novel analytic techniques, such as machine learning and deep learning, combined with a widening range of sensors, allow rapid assessment of large breeding populations that are repeatable and objective. Secondary traits underlying radiation use efficiency and water use efficiency can be screened with HTP for selection at the early stages of a breeding programme. HTP and envirotyping technologies can also characterise spatial variability at trial and within-plot levels, which can be used to correct for spatial variations that confound measurements of genotypic values. This review explores HTP for abiotic stress selection through a physiological trait lens and additionally investigates the use of envirotyping and EC to characterise spatial variability at all physical scales in METs.
Collapse
Affiliation(s)
- Daniel T Smith
- The University of Queensland, St Lucia, Brisbane, QLD, 4072, Australia
| | - Andries B Potgieter
- Centre for Crop Science, Queensland Alliance for Agriculture and Food Innovation, University of Queensland, Brisbane, QLD, 4072, Australia
| | - Scott C Chapman
- The University of Queensland, St Lucia, Brisbane, QLD, 4072, Australia.
| |
Collapse
|