1
|
Sarkar S, Ganapathysubramanian B, Singh A, Fotouhi F, Kar S, Nagasubramanian K, Chowdhary G, Das SK, Kantor G, Krishnamurthy A, Merchant N, Singh AK. Cyber-agricultural systems for crop breeding and sustainable production. TRENDS IN PLANT SCIENCE 2024; 29:130-149. [PMID: 37648631 DOI: 10.1016/j.tplants.2023.08.001] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/15/2023] [Revised: 07/19/2023] [Accepted: 08/03/2023] [Indexed: 09/01/2023]
Abstract
The cyber-agricultural system (CAS) represents an overarching framework of agriculture that leverages recent advances in ubiquitous sensing, artificial intelligence, smart actuators, and scalable cyberinfrastructure (CI) in both breeding and production agriculture. We discuss the recent progress and perspective of the three fundamental components of CAS - sensing, modeling, and actuation - and the emerging concept of agricultural digital twins (DTs). We also discuss how scalable CI is becoming a key enabler of smart agriculture. In this review we shed light on the significance of CAS in revolutionizing crop breeding and production by enhancing efficiency, productivity, sustainability, and resilience to changing climate. Finally, we identify underexplored and promising future directions for CAS research and development.
Collapse
Affiliation(s)
- Soumik Sarkar
- Department of Mechanical Engineering, Iowa State University, Ames, IA, USA; Department of Computer Science, Iowa State University, Ames, IA, USA.
| | - Baskar Ganapathysubramanian
- Department of Mechanical Engineering, Iowa State University, Ames, IA, USA; Department of Computer Science, Iowa State University, Ames, IA, USA
| | - Arti Singh
- Department of Agronomy, Iowa State University, Ames, IA, USA
| | - Fateme Fotouhi
- Department of Mechanical Engineering, Iowa State University, Ames, IA, USA; Department of Computer Science, Iowa State University, Ames, IA, USA
| | | | | | - Girish Chowdhary
- Department of Agricultural and Biological Engineering and Department of Computer Science, University of Illinois at Urbana Champaign, Champaign, Urbana, IL, USA
| | - Sajal K Das
- Department of Computer Science, Missouri University of Science and Technology, Rolla, MO, USA
| | - George Kantor
- Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, USA
| | | | - Nirav Merchant
- Data Science Institute, University of Arizona, Tucson, AZ, USA
| | - Asheesh K Singh
- Department of Agronomy, Iowa State University, Ames, IA, USA.
| |
Collapse
|
2
|
Yépez-Ponce DF, Salcedo JV, Rosero-Montalvo PD, Sanchis J. Mobile robotics in smart farming: current trends and applications. Front Artif Intell 2023; 6:1213330. [PMID: 37719082 PMCID: PMC10500442 DOI: 10.3389/frai.2023.1213330] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Accepted: 07/25/2023] [Indexed: 09/19/2023] Open
Abstract
In recent years, precision agriculture and smart farming have been deployed by leaps and bounds as arable land has become increasingly scarce. According to the Food and Agriculture Organization (FAO), by the year 2050, farming in the world should grow by about one-third above current levels. Therefore, farmers have intensively used fertilizers to promote crop growth and yields, which has adversely affected the nutritional improvement of foodstuffs. To address challenges related to productivity, environmental impact, food safety, crop losses, and sustainability, mobile robots in agriculture have proliferated, integrating mainly path planning and crop information gathering processes. Current agricultural robotic systems are large in size and cost because they use a computer as a server and mobile robots as clients. This article reviews the use of mobile robotics in farming to reduce costs, reduce environmental impact, and optimize harvests. The current status of mobile robotics, the technologies employed, the algorithms applied, and the relevant results obtained in smart farming are established. Finally, challenges to be faced in new smart farming techniques are also presented: environmental conditions, implementation costs, technical requirements, process automation, connectivity, and processing potential. As part of the contributions of this article, it was possible to conclude that the leading technologies for the implementation of smart farming are as follows: the Internet of Things (IoT), mobile robotics, artificial intelligence, artificial vision, multi-objective control, and big data. One technological solution that could be implemented is developing a fully autonomous, low-cost agricultural mobile robotic system that does not depend on a server.
Collapse
Affiliation(s)
- Darío Fernando Yépez-Ponce
- Instituto Universitario de Automática e Informática Industrial, Universitat Politècnica de València, Valencia, Spain
- Facultad de Ingeniería en Ciencias Aplicadas, Universidad Técnica del Norte, Ibarra, Ecuador
| | - José Vicente Salcedo
- Instituto Universitario de Automática e Informática Industrial, Universitat Politècnica de València, Valencia, Spain
| | | | - Javier Sanchis
- Instituto Universitario de Automática e Informática Industrial, Universitat Politècnica de València, Valencia, Spain
| |
Collapse
|
3
|
Ma Y, Hu P, Li X, Jin X, Wang H, Zhang C. Effects of Harvesting Grabbing Type on Grabbing Force and Leaf Injury of Lettuce. SENSORS (BASEL, SWITZERLAND) 2023; 23:6047. [PMID: 37447896 PMCID: PMC10346448 DOI: 10.3390/s23136047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Revised: 06/18/2023] [Accepted: 06/28/2023] [Indexed: 07/15/2023]
Abstract
Hydroponic lettuce is the main cultivated leafy vegetable in plant factories, and its scattered leaves are delicate and easily injured. Harvesting is an important process in the production of hydroponic lettuce. To reduce the injury level of hydroponic lettuce during harvesting, the impacts of the flexible finger-grabbing position applied on the grabbing force and the area of the injured leaves were investigated in this study by utilizing thin-film sensors and a high-speed video camera. According to the overlapping structural characteristics of adjacent leaves on lettuce, flexible finger-grabbing positions were divided into areas of the surface of the leaves and the intersections of the leaves. Three grabbing types-which are referred to in this paper as Grabbing Types A, B, and C-were identified according to the number of flexible fingers grabbing the leaf surface and the intersection area of the leaves. The force curves of all the flexible fingers were measured by thin film sensors, and the injury area of the leaves was detected using an image processing method. The results showed the consistency of the grabbing force curves and the motion characteristic parameters of the four flexible fingers. The maximum grabbing force of each flexible finger appeared at the stage of pulling the lettuce. The grabbing force of the flexible fingers acting on the intersection areas of the leaves was less than that acting on the leaf surface. As the number of flexible fingers acting on the intersection areas of the leaves increased, both the injury area of the leaves and the grabbing force decreased gradually. Grabbing Type C had the smallest injury area of the leaves: 120.3 ± 13.6 mm2 with an 11.4% coefficient of variation.
Collapse
Affiliation(s)
- Yidong Ma
- College of Agricultural Equipment Engineering, Henan University of Science and Technology, Luoyang 471003, China; (P.H.); (X.L.); (H.W.); (C.Z.)
| | | | | | | | | | | |
Collapse
|
4
|
Junge K, Pires C, Hughes J. Lab2Field transfer of a robotic raspberry harvester enabled by a soft sensorized physical twin. COMMUNICATIONS ENGINEERING 2023; 2:40. [PMCID: PMC10955996 DOI: 10.1038/s44172-023-00089-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/02/2023] [Accepted: 06/07/2023] [Indexed: 09/29/2024]
Abstract
Robotic fruit harvesting requires dexterity to handle delicate crops and development relying upon field testing possible only during the harvesting season. Here we focus on raspberry crops, and explore how the research methodology of harvesting robots can be accelerated through soft robotic technologies. We propose and demonstrate a physical twin of the harvesting environment: a sensorized physical simulator of a raspberry plant with tunable properties, used to train a robotic harvester in the laboratory regardless of season. The sensors on the twin allow for direct comparison with human demonstrations, used to tune the robot controllers. In early field demonstrations, an 80% harvesting success rate was achieved without any modifications on the lab trained robot. Kai Junge and colleagues designed a soft sensorized physical twin of a raspberry plant which they use to collect force data on fruit picking to train a robotic harvester. Early field demonstrations showed promise in rapid training of a robot for the delicate task of soft fruit picking.
Collapse
Affiliation(s)
- Kai Junge
- CREATE Lab, EPFL, Lausanne, Switzerland
| | - Catarina Pires
- CREATE Lab, EPFL, Lausanne, Switzerland
- Instituto Superior Técnico, Lisbon, Portugal
| | | |
Collapse
|
5
|
Mesías-Ruiz GA, Pérez-Ortiz M, Dorado J, de Castro AI, Peña JM. Boosting precision crop protection towards agriculture 5.0 via machine learning and emerging technologies: A contextual review. FRONTIERS IN PLANT SCIENCE 2023; 14:1143326. [PMID: 37056493 PMCID: PMC10088868 DOI: 10.3389/fpls.2023.1143326] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/12/2023] [Accepted: 03/01/2023] [Indexed: 06/19/2023]
Abstract
Crop protection is a key activity for the sustainability and feasibility of agriculture in a current context of climate change, which is causing the destabilization of agricultural practices and an increase in the incidence of current or invasive pests, and a growing world population that requires guaranteeing the food supply chain and ensuring food security. In view of these events, this article provides a contextual review in six sections on the role of artificial intelligence (AI), machine learning (ML) and other emerging technologies to solve current and future challenges of crop protection. Over time, crop protection has progressed from a primitive agriculture 1.0 (Ag1.0) through various technological developments to reach a level of maturity closelyin line with Ag5.0 (section 1), which is characterized by successfully leveraging ML capacity and modern agricultural devices and machines that perceive, analyze and actuate following the main stages of precision crop protection (section 2). Section 3 presents a taxonomy of ML algorithms that support the development and implementation of precision crop protection, while section 4 analyses the scientific impact of ML on the basis of an extensive bibliometric study of >120 algorithms, outlining the most widely used ML and deep learning (DL) techniques currently applied in relevant case studies on the detection and control of crop diseases, weeds and plagues. Section 5 describes 39 emerging technologies in the fields of smart sensors and other advanced hardware devices, telecommunications, proximal and remote sensing, and AI-based robotics that will foreseeably lead the next generation of perception-based, decision-making and actuation systems for digitized, smart and real-time crop protection in a realistic Ag5.0. Finally, section 6 highlights the main conclusions and final remarks.
Collapse
Affiliation(s)
- Gustavo A. Mesías-Ruiz
- Institute of Agricultural Sciences (ICA), Spanish National Research Council (CSIC), Madrid, Spain
- Escuela Técnica Superior de Ingeniería Agronómica, Alimentaria y de Biosistemas (ETSIAAB), Universidad Politécnica de Madrid, Madrid, Spain
| | - María Pérez-Ortiz
- Centre for Artificial Intelligence, University College London, London, United Kingdom
| | - José Dorado
- Institute of Agricultural Sciences (ICA), Spanish National Research Council (CSIC), Madrid, Spain
| | - Ana I. de Castro
- Environment and Agronomy Department, National Institute for Agricultural and Food Research and Technology (INIA), Spanish National Research Council (CSIC), Madrid, Spain
| | - José M. Peña
- Institute of Agricultural Sciences (ICA), Spanish National Research Council (CSIC), Madrid, Spain
| |
Collapse
|
6
|
Giordano G, Murali Babu SP, Mazzolai B. Soft robotics towards sustainable development goals and climate actions. Front Robot AI 2023; 10:1116005. [PMID: 37008983 PMCID: PMC10064016 DOI: 10.3389/frobt.2023.1116005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2022] [Accepted: 03/06/2023] [Indexed: 03/19/2023] Open
Abstract
Soft robotics technology can aid in achieving United Nations’ Sustainable Development Goals (SDGs) and the Paris Climate Agreement through development of autonomous, environmentally responsible machines powered by renewable energy. By utilizing soft robotics, we can mitigate the detrimental effects of climate change on human society and the natural world through fostering adaptation, restoration, and remediation. Moreover, the implementation of soft robotics can lead to groundbreaking discoveries in material science, biology, control systems, energy efficiency, and sustainable manufacturing processes. However, to achieve these goals, we need further improvements in understanding biological principles at the basis of embodied and physical intelligence, environment-friendly materials, and energy-saving strategies to design and manufacture self-piloting and field-ready soft robots. This paper provides insights on how soft robotics can address the pressing issue of environmental sustainability. Sustainable manufacturing of soft robots at a large scale, exploring the potential of biodegradable and bioinspired materials, and integrating onboard renewable energy sources to promote autonomy and intelligence are some of the urgent challenges of this field that we discuss in this paper. Specifically, we will present field-ready soft robots that address targeted productive applications in urban farming, healthcare, land and ocean preservation, disaster remediation, and clean and affordable energy, thus supporting some of the SDGs. By embracing soft robotics as a solution, we can concretely support economic growth and sustainable industry, drive solutions for environment protection and clean energy, and improve overall health and well-being.
Collapse
Affiliation(s)
- Goffredo Giordano
- Bioinspired Soft Robotics, Istituto Italiano di Tecnologia (IIT), Genova, Italy
- Department of Mechanics Mathematics and Management, Politecnico di Barit, Bari, Italy
- *Correspondence: Goffredo Giordano, , ; Saravana Prashanth Murali Babu, , ; Barbara Mazzolai,
| | - Saravana Prashanth Murali Babu
- SDU Soft Robotics, SDU Biorobotics, The Mærsk McKinney Møller Institute, University of Southern Denmark, Odense, Denmark
- *Correspondence: Goffredo Giordano, , ; Saravana Prashanth Murali Babu, , ; Barbara Mazzolai,
| | - Barbara Mazzolai
- Bioinspired Soft Robotics, Istituto Italiano di Tecnologia (IIT), Genova, Italy
- *Correspondence: Goffredo Giordano, , ; Saravana Prashanth Murali Babu, , ; Barbara Mazzolai,
| |
Collapse
|
7
|
Mahmud MS, Zahid A, Das AK. Sensing and Automation Technologies for Ornamental Nursery Crop Production: Current Status and Future Prospects. SENSORS (BASEL, SWITZERLAND) 2023; 23:1818. [PMID: 36850415 PMCID: PMC9966776 DOI: 10.3390/s23041818] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/26/2022] [Revised: 01/11/2023] [Accepted: 02/01/2023] [Indexed: 06/18/2023]
Abstract
The ornamental crop industry is an important contributor to the economy in the United States. The industry has been facing challenges due to continuously increasing labor and agricultural input costs. Sensing and automation technologies have been introduced to reduce labor requirements and to ensure efficient management operations. This article reviews current sensing and automation technologies used for ornamental nursery crop production and highlights prospective technologies that can be applied for future applications. Applications of sensors, computer vision, artificial intelligence (AI), machine learning (ML), Internet-of-Things (IoT), and robotic technologies are reviewed. Some advanced technologies, including 3D cameras, enhanced deep learning models, edge computing, radio-frequency identification (RFID), and integrated robotics used for other cropping systems, are also discussed as potential prospects. This review concludes that advanced sensing, AI and robotic technologies are critically needed for the nursery crop industry. Adapting these current and future innovative technologies will benefit growers working towards sustainable ornamental nursery crop production.
Collapse
Affiliation(s)
- Md Sultan Mahmud
- Department of Agricultural and Environmental Sciences, Tennessee State University, Nashville, TN 37209, USA
- Otis L. Floyd Nursery Research Center, Tennessee State University, McMinnville, TN 37110, USA
| | - Azlan Zahid
- Department of Biological and Agricultural Engineering, Texas A&M AgriLife Research, Texas A&M University System, Dallas, TX 75252, USA
| | - Anup Kumar Das
- Department of Agricultural and Biosystems Engineering, North Dakota State University, Fargo, ND 58102, USA
| |
Collapse
|
8
|
Yan J, Liu Y, Zheng D, Xue T. Grasping and cutting points detection method for the harvesting of dome-type planted pumpkin using transformer network-based instance segmentation architecture. FRONTIERS IN PLANT SCIENCE 2023; 14:1063996. [PMID: 37143869 PMCID: PMC10151789 DOI: 10.3389/fpls.2023.1063996] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/07/2022] [Accepted: 03/22/2023] [Indexed: 05/06/2023]
Abstract
An accurate and robust keypoint detection method is vital for autonomous harvesting systems. This paper proposed a dome-type planted pumpkin autonomous harvesting framework with keypoint (grasping and cutting points) detection method using instance segmentation architecture. To address the overlapping problem in agricultural environment and improve the segmenting precision, we proposed a pumpkin fruit and stem instance segmentation architecture by fusing transformer and point rendering. A transformer network is utilized as the architecture backbone to achieve a higher segmentation precision and point rendering is applied so that finer masks can be acquired especially at the boundary of overlapping areas. In addition, our keypoint detection algorithm can model the relationships among the fruit and stem instances as well as estimate grasping and cutting keypoints. To validate the effectiveness of our method, we created a pumpkin image dataset with manually annotated labels. Based on the dataset, we have carried out plenty of experiments on instance segmentation and keypoint detection. Pumpkin fruit and stem instance segmentation results show that the proposed method reaches the mask mAP of 70.8% and box mAP of 72.0%, which brings 4.9% and 2.5% gains over the state-of-the-art instance segmentation methods such as Cascade Mask R-CNN. Ablation study proves the effectiveness of each improved module in the instance segmentation architecture. Keypoint estimation results indicate that our method has a promising application prospect in fruit picking tasks.
Collapse
|
9
|
Wang F, Urquizo RC, Roberts P, Mohan V, Newenham C, Ivanov A, Dowling R. Biologically inspired robotic perception-action for soft fruit harvesting in vertical growing environments. PRECISION AGRICULTURE 2023; 24:1072-1096. [PMID: 37152437 PMCID: PMC10010232 DOI: 10.1007/s11119-023-10000-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 02/19/2023] [Indexed: 05/09/2023]
Abstract
Multiple interlinked factors like demographics, migration patterns, and economics are presently leading to the critical shortage of labour available for low-skilled, physically demanding tasks like soft fruit harvesting. This paper presents a biomimetic robotic solution covering the full 'Perception-Action' loop targeting harvesting of strawberries in a state-of-the-art vertical growing environment. The novelty emerges from both dealing with crop/environment variance as well as configuring the robot action system to deal with a range of runtime task constraints. Unlike the commonly used deep neural networks, the proposed perception system uses conditional Generative Adversarial Networks to identify the ripe fruit using synthetic data. The network can effectively train the synthetic data using the image-to-image translation concept, thereby avoiding the tedious work of collecting and labelling the real dataset. Once the harvest-ready fruit is localised using point cloud data generated by a stereo camera, our platform's action system can coordinate the arm to reach/cut the stem using the Passive Motion Paradigm framework inspired by studies on neural control of movement in the brain. Results from field trials for strawberry detection, reaching/cutting the stem of the fruit, and extension to analysing complex canopy structures/bimanual coordination (searching/picking) are presented. While this article focuses on strawberry harvesting, ongoing research towards adaptation of the architecture to other crops such as tomatoes and sweet peppers is briefly described. Supplementary Information The online version contains supplementary material available at 10.1007/s11119-023-10000-4.
Collapse
Affiliation(s)
- Fuli Wang
- School of Computer Science and Electronic Engineering, University of Essex, Colchester, CO4 3SQ UK
| | - Rodolfo Cuan Urquizo
- School of Computer Science and Electronic Engineering, University of Essex, Colchester, CO4 3SQ UK
| | - Penelope Roberts
- School of Computer Science and Electronic Engineering, University of Essex, Colchester, CO4 3SQ UK
| | - Vishwanathan Mohan
- School of Computer Science and Electronic Engineering, University of Essex, Colchester, CO4 3SQ UK
| | - Chris Newenham
- Wilkin & Sons Ltd, Factory Hill, Tiptree, Essex CO5 0RF UK
| | - Andrey Ivanov
- Wilkin & Sons Ltd, Factory Hill, Tiptree, Essex CO5 0RF UK
| | - Robin Dowling
- Wilkin & Sons Ltd, Factory Hill, Tiptree, Essex CO5 0RF UK
| |
Collapse
|
10
|
Majeed Y, Waseem M. Postharvest Handling Systems. ENCYCLOPEDIA OF SMART AGRICULTURE TECHNOLOGIES 2023. [DOI: 10.1007/978-3-030-89123-7_125-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/08/2023]
|
11
|
Al-Khulaidi R, Akmeliawati R, Grainger S, Lu TF. Structural Optimisation and Design of a Cable-Driven Hyper-Redundant Manipulator for Confined Semi-Structured Environments. SENSORS (BASEL, SWITZERLAND) 2022; 22:8632. [PMID: 36433229 PMCID: PMC9694924 DOI: 10.3390/s22228632] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/28/2022] [Revised: 10/22/2022] [Accepted: 11/07/2022] [Indexed: 06/16/2023]
Abstract
Structural optimisation of robotic manipulators is critical for any manipulator used in confined semi-structured environments, such as in agriculture. Many robotic manipulators utilised in semi-structured environments retain the same characteristics and dimensions as those used in fully-structured industrial environments, which have been proven to experience low dexterity and singularity issues in challenging environments due to their structural limitations. When implemented in environments other than fully-structured industrial environments, conventional manipulators are liable to singularity, joint limits and workspace obstacles. This makes them inapplicable in confined semi-structured environments, as they lack the flexibility to operate dexterously in such challenging environments. In this paper, structural optimisation of a hyper-redundant cable-driven manipulator is proposed to improve its performance in semi-structured and challenging confined spaces, such as in agricultural settings. The optimisation of the manipulator design is performed in terms of its manipulability and kinematics. The lengths of the links and the joint angles are optimised to minimise any error between the actual and desired position/orientation of the end-effector in a confined semi-structured task space, as well as to provide optimal flexibility for the manipulators to generate different joint configurations for obstacle avoidance in confined environments. The results of the optimisation suggest that the use of a redundant manipulator with rigid short links can result in performance with higher dexterity in confined, semi-structured environments, such as agricultural greenhouses.
Collapse
|
12
|
Design and Simulation Analysis of a Flexible Clamping and Conveying Device of a Green Leafy Vegetable Cutting and Bundling Integrated Machine. JOURNAL OF ROBOTICS 2022. [DOI: 10.1155/2022/4729480] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
In order to improve the harvesting production efficiency of green leafy vegetables, this paper designs and simulates the flexible clamping and conveying device of the green leafy vegetable cutting and bundling integrated machine. Through theoretical calculation and 3D modeling, the design optimization of key components is carried out in this paper. The cutter head of the guillotine cutting and throwing device is a wheel cutter type. The throwing blades are axially symmetrically distributed on the cutter head, and the movable blades are radially distributed at equal angles and are located in the middle of the two throwing blades. The electronic control system of the wrapping device uses a pressure sensor to cooperate with the baling device to realize automatic wrapping after baling. In addition, the drive chassis of the machine is a hydrostatic drive system, which is convenient for step-less speed change and automatic control within a certain range. Through the simulation study, it can be seen that the flexible clamping and conveying device of the green leafy vegetable cutting and bundling integrated machine proposed in this paper can meet the industrialization needs of green leafy vegetables.
Collapse
|
13
|
Zheng B, Su J, Xie Y, Miles J, Wang H, Gao W, Xin M, Lin J. An autonomous robot for shell and tube heat exchanger inspection. J FIELD ROBOT 2022. [DOI: 10.1002/rob.22102] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Affiliation(s)
- Bujingda Zheng
- Department of Mechanical and Aerospace Engineering University of Missouri Columbia Missouri USA
| | - Jheng‐Wun Su
- Department of Physics and Engineering Slippery Rock University Slippery Rock Pennsylvania USA
| | - Yunchao Xie
- Department of Mechanical and Aerospace Engineering University of Missouri Columbia Missouri USA
| | - Jonathan Miles
- Department of Mechanical and Aerospace Engineering University of Missouri Columbia Missouri USA
| | - Hong Wang
- Department of Mechanical and Aerospace Engineering University of Missouri Columbia Missouri USA
| | - Wenxin Gao
- Department of Mechanical and Aerospace Engineering University of Missouri Columbia Missouri USA
| | - Ming Xin
- Department of Mechanical and Aerospace Engineering University of Missouri Columbia Missouri USA
| | - Jian Lin
- Department of Mechanical and Aerospace Engineering University of Missouri Columbia Missouri USA
- Department of Electrical Engineering and Computer Science University of Missouri Columbia Missouri USA
| |
Collapse
|
14
|
Speth S, Gonçalves A, Rigault B, Suzuki S, Bouazizi M, Matsuo Y, Prendinger H. Deep learning with RGB and thermal images onboard a drone for monitoring operations. J FIELD ROBOT 2022. [DOI: 10.1002/rob.22082] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Affiliation(s)
- Simon Speth
- Department of Informatics Technical University of Munich Munich Germany
| | - Artur Gonçalves
- Digital Content and Media Sciences Research Division National Institute of Informatics Tokyo Japan
| | - Bastien Rigault
- Digital Content and Media Sciences Research Division National Institute of Informatics Tokyo Japan
| | - Satoshi Suzuki
- Graduate School of Engineering Chiba University Chiba Japan
| | - Mondher Bouazizi
- Faculty of Science and Technology Keio University Yokohama Japan
| | - Yutaka Matsuo
- Department of Technology Management for Innovation (TMI), and Program for Social Innovation (PSI), Center for Engineering (RACE), School of Engineering The University of Tokyo Tokyo Japan
| | - Helmut Prendinger
- Digital Content and Media Sciences Research Division National Institute of Informatics Tokyo Japan
| |
Collapse
|
15
|
Tan X, Lyu W, Rosendo A. CircuitBot: Learning to survive with robotic circuit drawing. PLoS One 2022; 17:e0265340. [PMID: 35324930 PMCID: PMC8947128 DOI: 10.1371/journal.pone.0265340] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2021] [Accepted: 03/01/2022] [Indexed: 11/24/2022] Open
Abstract
Robots with the ability to actively acquire power from surroundings will be greatly beneficial for long-term autonomy and to survive in uncertain environments. In this work, a scenario is presented where a robot has limited energy, and the only way to survive is to access the energy from an unregulated power source. With no wires or resistors available, the robot heuristically learns to maximize the input voltage on its system while avoiding potential obstacles during the connection. CircuitBot is a 6 DOF manipulator capable of drawing circuit patterns with graphene-based conductive ink, and it uses a state-of-the-art continuous/categorical Bayesian Optimization to optimize the placement of conductive shapes and maximize the energy it receives. Our comparative results with traditional Bayesian Optimization and Genetic algorithms show that the robot learns to maximize the voltage within the smallest number of trials, even when we introduce obstacles to ground the circuit and steal energy from the robot. As autonomous robots become more present, in our houses and other planets, our proposed method brings a novel way for machines to keep themselves functional by optimizing their own electric circuits.
Collapse
Affiliation(s)
- Xianglong Tan
- Living Machines Laboratory, School of Information Science and Technology, ShanghaiTech University, Shanghai, China
- Hamlyn Centre, Imperial College London, London, United Kingdom
- * E-mail:
| | - Weijie Lyu
- Living Machines Laboratory, School of Information Science and Technology, ShanghaiTech University, Shanghai, China
- Thomas M. Siebel Center for Computer Science, University of Illinois, Urbana-Champaign, Urbana, Illinois, United States of America
| | - Andre Rosendo
- Living Machines Laboratory, School of Information Science and Technology, ShanghaiTech University, Shanghai, China
| |
Collapse
|
16
|
Detecting Crown Rot Disease in Wheat in Controlled Environment Conditions Using Digital Color Imaging and Machine Learning. AGRIENGINEERING 2022. [DOI: 10.3390/agriengineering4010010] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
Crown rot is one of the major stubble soil fungal diseases that bring significant yield loss to the cereal industry. The most effective crown rot management approach is removal of infected crop residue from fields and rotation of nonhost crops. However, disease screening is challenging as there are no clear visible symptoms on upper stems and leaves at early growth stages. The current manual screening method requires experts to observe the crown and roots of plants to detect disease, which is time-consuming, subjective, labor-intensive, and costly. As digital color imaging has the advantages of low cost and easy use, it has a high potential to be an economical solution for crown rot detection. In this research, a crown rot disease detection method was developed using a smartphone camera and machine learning technologies. Four common wheat varieties were grown in greenhouse conditions with a controlled environment, and all infected group plants were infected with crown rot without the presence of other plant diseases. We used a smartphone to take digital color images of the lower stems of plants. Using imaging processing techniques and a support vector machine algorithm, we successfully distinguished infected and healthy plants as early as 14 days after disease infection. The results provide a vital first step toward developing a digital color imaging phenotyping platform for crown rot detection to enable the management of crown rot disease effectively. As an easy-access phenotyping method, this method could provide support for researchers to develop an efficiency and economic disease screening method in field conditions.
Collapse
|
17
|
Assessment of Different Object Detectors for the Maturity Level Classification of Broccoli Crops using UAV Imagery. REMOTE SENSING 2022. [DOI: 10.3390/rs14030731] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
Broccoli is an example of a high-value crop that requires delicate handling throughout the growing season and during its post-harvesting treatment. As broccoli heads can be easily damaged, they are still harvested by hand. Moreover, human scouting is required to initially identify the field segments where several broccoli plants have reached the desired maturity level, such that they can be harvested while they are in the optimal condition. The aim of this study was to automate this process using state-of-the-art Object Detection architectures trained on georeferenced orthomosaic-derived RGB images captured from low-altitude UAV flights, and to assess their capacity to effectively detect and classify broccoli heads based on their maturity level. The results revealed that the object detection approach for automated maturity classification achieved comparable results to physical scouting overall, especially for the two best-performing architectures, namely Faster R-CNN and CenterNet. Their respective performances were consistently over 80% mAP@50 and 70% mAP@75 when using three levels of maturity, and even higher when simplifying the use case into a two-class problem, exceeding 91% and 83%, respectively. At the same time, geometrical transformations for data augmentations reported improvements, while colour distortions were counterproductive. The best-performing architecture and the trained model could be tested as a prototype in real-time UAV detections in order to assist in on-field broccoli maturity detection.
Collapse
|
18
|
Abstract
This paper proposes a novel robotic animal herding system based on a network of autonomous barking drones. The objective of such a system is to replace traditional herding methods (e.g., dogs) so that a large number (e.g., thousands) of farm animals such as sheep can be quickly collected from a sparse status and then driven to a designated location (e.g., a sheepfold). In this paper, we particularly focus on the motion control of the barking drones. To this end, a computationally efficient sliding mode based control algorithm is developed, which navigates the drones to track the moving boundary of the animals’ footprint and enables the drones to avoid collisions with others. Extensive computer simulations, where the dynamics of the animals follow Reynolds’ rules, show the effectiveness of the proposed approach.
Collapse
|
19
|
Li Q, Xu Y. Minimum‐time row transition control of a vision‐guided agricultural robot. J FIELD ROBOT 2021. [DOI: 10.1002/rob.22053] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Affiliation(s)
- Qiang Li
- Department of Mechanical and Aerospace Engineering University of Central Florida Orlando Florida USA
| | - Yunjun Xu
- Department of Mechanical and Aerospace Engineering University of Central Florida Orlando Florida USA
| |
Collapse
|
20
|
Abstract
Robotics navigation and perception for forest management are challenging due to the existence of many obstacles to detect and avoid and the sharp illumination changes. Advanced perception systems are needed because they can enable the development of robotic and machinery solutions to accomplish a smarter, more precise, and sustainable forestry. This article presents a state-of-the-art review about unimodal and multimodal perception in forests, detailing the current developed work about perception using a single type of sensors (unimodal) and by combining data from different kinds of sensors (multimodal). This work also makes a comparison between existing perception datasets in the literature and presents a new multimodal dataset, composed by images and laser scanning data, as a contribution for this research field. Lastly, a critical analysis of the works collected is conducted by identifying strengths and research trends in this domain.
Collapse
|
21
|
Abstract
AbstractFor automating the harvesting of bunches of tomatoes in a greenhouse, the end-effector needs to reach the exact cutting point and adaptively adjust the pose of peduncles. In this paper, a method is proposed for peduncle cutting point localization and pose estimation. Images captured in real time at a fixed long-distance are detected using the YOLOv4-Tiny detector with a precision of 92.7% and a detection speed of 0.0091 s per frame, then the YOLACT + + Network with mAP of 73.1 and a time speed of 0.109 s per frame is used to segment the close-up distance. The segmented peduncle mask is fitted to the curve using least squares and three key points on the curve are found. Finally, a geometric model is established to estimate the pose of the peduncle with an average error of 4.98° in yaw angle and 4.75° in pitch angle over the 30 sets of tests.
Collapse
|
22
|
Ropelewska E, Popińska W, Sabanci K, Aslan MF. Cultivar identification of sweet cherries based on texture parameters determined using image analysis. J FOOD PROCESS ENG 2021. [DOI: 10.1111/jfpe.13724] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Affiliation(s)
- Ewa Ropelewska
- Fruit and Vegetable Storage and Processing Department The National Institute of Horticultural Research Skierniewice Poland
| | - Wioletta Popińska
- Fruit and Vegetable Storage and Processing Department The National Institute of Horticultural Research Skierniewice Poland
| | - Kadir Sabanci
- Electrical and Electronics Engineering Karamanoglu Mehmetbey University Karaman Turkey
| | - Muhammet Fatih Aslan
- Electrical and Electronics Engineering Karamanoglu Mehmetbey University Karaman Turkey
| |
Collapse
|
23
|
Soft Grippers for Automatic Crop Harvesting: A Review. SENSORS 2021; 21:s21082689. [PMID: 33920353 PMCID: PMC8070229 DOI: 10.3390/s21082689] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/10/2021] [Revised: 04/06/2021] [Accepted: 04/09/2021] [Indexed: 02/02/2023]
Abstract
Agriculture 4.0 is transforming farming livelihoods thanks to the development and adoption of technologies such as artificial intelligence, the Internet of Things and robotics, traditionally used in other productive sectors. Soft robotics and soft grippers in particular are promising approaches to lead to new solutions in this field due to the need to meet hygiene and manipulation requirements in unstructured environments and in operation with delicate products. This review aims to provide an in-depth look at soft end-effectors for agricultural applications, with a special emphasis on robotic harvesting. To that end, the current state of automatic picking tasks for several crops is analysed, identifying which of them lack automatic solutions, and which methods are commonly used based on the botanical characteristics of the fruits. The latest advances in the design and implementation of soft grippers are also presented and discussed, studying the properties of their materials, their manufacturing processes, the gripping technologies and the proposed control methods. Finally, the challenges that have to be overcome to boost its definitive implementation in the real world are highlighted. Therefore, this review intends to serve as a guide for those researchers working in the field of soft robotics for Agriculture 4.0, and more specifically, in the design of soft grippers for fruit harvesting robots.
Collapse
|
24
|
Abstract
The constant advances in agricultural robotics aim to overcome the challenges imposed by population growth, accelerated urbanization, high competitiveness of high-quality products, environmental preservation and a lack of qualified labor. In this sense, this review paper surveys the main existing applications of agricultural robotic systems for the execution of land preparation before planting, sowing, planting, plant treatment, harvesting, yield estimation and phenotyping. In general, all robots were evaluated according to the following criteria: its locomotion system, what is the final application, if it has sensors, robotic arm and/or computer vision algorithm, what is its development stage and which country and continent they belong. After evaluating all similar characteristics, to expose the research trends, common pitfalls and the characteristics that hinder commercial development, and discover which countries are investing into Research and Development (R&D) in these technologies for the future, four major areas that need future research work for enhancing the state of the art in smart agriculture were highlighted: locomotion systems, sensors, computer vision algorithms and communication technologies. The results of this research suggest that the investment in agricultural robotic systems allows to achieve short—harvest monitoring—and long-term objectives—yield estimation.
Collapse
|
25
|
A Sample Weight and AdaBoost CNN-Based Coarse to Fine Classification of Fruit and Vegetables at a Supermarket Self-Checkout. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10238667] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/29/2023]
Abstract
The physical features of fruit and vegetables make the task of vision-based classification of fruit and vegetables challenging. The classification of fruit and vegetables at a supermarket self-checkout poses even more challenges due to variable lighting conditions and human factors arising from customer interactions with the system along with the challenges associated with the colour, texture, shape, and size of a fruit or vegetable. Considering this complex application, we have proposed a progressive coarse to fine classification technique to classify fruit and vegetables at supermarket checkouts. The image and weight of fruit and vegetables have been obtained using a prototype designed to simulate the supermarket environment, including the lighting conditions. The weight information is used to change the coarse classification of 15 classes down to three, which are further used in AdaBoost-based Convolutional Neural Network (CNN) optimisation for fine classification. The training samples for each coarse class are weighted based on AdaBoost optimisation, which are updated on each iteration of a training phase. Multi-class likelihood distribution obtained by the fine classification stage is used to estimate a final classification with a softmax classifier. GoogleNet, MobileNet, and a custom CNN have been used for AdaBoost optimisation, with promising classification results.
Collapse
|
26
|
Kurpaska S, Sobol Z, Pedryc N, Hebda T, Nawara P. Analysis of the Pneumatic System Parameters of the Suction Cup Integrated with the Head for Harvesting Strawberry Fruit. SENSORS 2020; 20:s20164389. [PMID: 32781604 PMCID: PMC7472041 DOI: 10.3390/s20164389] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/21/2020] [Revised: 07/21/2020] [Accepted: 07/28/2020] [Indexed: 11/16/2022]
Abstract
Fruit and vegetable harvest efficiency depends on the mechanization and automation of production. The available literature lacks the results of research on the applicability of pneumatic end effectors among grippers for the robotic harvesting of strawberries. To determine their practical applications, a series of tests was performed. They included the determination of the morphological indicators of the strawberry, fruit suction force, the real stress exerted by fruit suckers and the degree of fruit damage. The fruits’ morphological indicators included the relationships between the weight and geometrical dimensions of the tested fruit, the equivalent diameter, and the sphericity coefficient. The fruit suction force was determined on a stand equipped with a vacuum pump, and control and measurement instruments, as well as a MTS 2 testing machine. The necrosis caused by tissue damage to the fruits by suction cup adhesion was assessed by counting the necrosis surface areas using the LabView programme. The assessment of the necrosis was conducted immediately upon the test’s performance, after 24 and after 72h. The stress values were calculated by referring the values of the suction forces obtained to the surface of the suction cup face. The tests were carried out with three constructions of suction cups and three positions of suction cup faces on the fruits’ surface. The research shows that there is a possibility for using pneumatic suction cups in robotic picking heads. The experiments performed indicate that the types of suction cups constructions, and the zones and directions of the suction cups’ application to the fruit significantly affect the values of the suction forces and stresses affecting the fruit. The surface areas of the necrosis formed depend mainly on the time that elapses between the test and their assessment. The weight of strawberry fruit in the conducted experiment constituted from 13.6% to 23.1% of the average suction force.
Collapse
|
27
|
Blok PM, Evert FK, Tielen APM, Henten EJ, Kootstra G. The effect of data augmentation and network simplification on the image‐based detection of broccoli heads with Mask R‐CNN. J FIELD ROBOT 2020. [DOI: 10.1002/rob.21975] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Affiliation(s)
- Pieter M. Blok
- Agrosystems Research Wageningen University & Research Wageningen The Netherlands
- Farm Technology Group Wageningen University & Research Wageningen The Netherlands
| | - Frits K. Evert
- Agrosystems Research Wageningen University & Research Wageningen The Netherlands
| | | | - Eldert J. Henten
- Farm Technology Group Wageningen University & Research Wageningen The Netherlands
| | - Gert Kootstra
- Farm Technology Group Wageningen University & Research Wageningen The Netherlands
| |
Collapse
|
28
|
Tang Y, Chen M, Wang C, Luo L, Li J, Lian G, Zou X. Recognition and Localization Methods for Vision-Based Fruit Picking Robots: A Review. FRONTIERS IN PLANT SCIENCE 2020; 11:510. [PMID: 32508853 PMCID: PMC7250149 DOI: 10.3389/fpls.2020.00510] [Citation(s) in RCA: 83] [Impact Index Per Article: 20.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/14/2019] [Accepted: 04/06/2020] [Indexed: 05/13/2023]
Abstract
The utilization of machine vision and its associated algorithms improves the efficiency, functionality, intelligence, and remote interactivity of harvesting robots in complex agricultural environments. Machine vision and its associated emerging technology promise huge potential in advanced agricultural applications. However, machine vision and its precise positioning still have many technical difficulties, making it difficult for most harvesting robots to achieve true commercial applications. This article reports the application and research progress of harvesting robots and vision technology in fruit picking. The potential applications of vision and quantitative methods of localization, target recognition, 3D reconstruction, and fault tolerance of complex agricultural environment are focused, and fault-tolerant technology designed for utilization with machine vision and robotic systems are also explored. The two main methods used in fruit recognition and localization are reviewed, including digital image processing technology and deep learning-based algorithms. The future challenges brought about by recognition and localization success rates are identified: target recognition in the presence of illumination changes and occlusion environments; target tracking in dynamic interference-laden environments, 3D target reconstruction, and fault tolerance of the vision system for agricultural robots. In the end, several open research problems specific to recognition and localization applications for fruit harvesting robots are mentioned, and the latest development and future development trends of machine vision are described.
Collapse
Affiliation(s)
- Yunchao Tang
- College of Urban and Rural Construction, Zhongkai University of Agriculture and Engineering, Guangzhou, China
| | - Mingyou Chen
- Key Laboratory of Key Technology on Agricultural Machine and Equipment, College of Engineering, South China Agricultural University, Guangzhou, China
| | - Chenglin Wang
- College of Mechanical and Electrical Engineering, Chongqing University of Arts and Sciences, Chongqing, China
| | - Lufeng Luo
- College of Mechanical and Electrical Engineering, Foshan University, Foshan, China
| | - Jinhui Li
- Key Laboratory of Key Technology on Agricultural Machine and Equipment, College of Engineering, South China Agricultural University, Guangzhou, China
| | - Guoping Lian
- Department of Chemical and Process Engineering, University of Surrey, Guildford, United Kingdom
| | - Xiangjun Zou
- Key Laboratory of Key Technology on Agricultural Machine and Equipment, College of Engineering, South China Agricultural University, Guangzhou, China
| |
Collapse
|
29
|
He L, Lu Q, Abad SA, Rojas N, Nanayakkara T. Soft Fingertips With Tactile Sensing and Active Deformation for Robust Grasping of Delicate Objects. IEEE Robot Autom Lett 2020. [DOI: 10.1109/lra.2020.2972851] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
30
|
Zeidler C, Zabel P, Vrakking V, Dorn M, Bamsey M, Schubert D, Ceriello A, Fortezza R, De Simone D, Stanghellini C, Kempkes F, Meinen E, Mencarelli A, Swinkels GJ, Paul AL, Ferl RJ. The Plant Health Monitoring System of the EDEN ISS Space Greenhouse in Antarctica During the 2018 Experiment Phase. FRONTIERS IN PLANT SCIENCE 2019; 10:1457. [PMID: 31824526 PMCID: PMC6883354 DOI: 10.3389/fpls.2019.01457] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/31/2019] [Accepted: 10/18/2019] [Indexed: 05/11/2023]
Abstract
The EDEN ISS project has the objective to test key technologies and processes for higher plant cultivation with a focus on their application to long duration spaceflight. A mobile plant production facility was designed and constructed by an international consortium and deployed to the German Antarctic Neumayer Station III. Future astronaut crews, even if well-trained and provided with detailed procedures, cannot be expected to have the competencies needed to deal with all situations that will arise during a mission. Future space crews, as they are today, will be supported by expert backrooms on the ground. For future space-based greenhouses, monitoring the crops and the plant growth system increases system reliability and decreases the crew time required to maintain them. The EDEN ISS greenhouse incorporates a Plant Health Monitoring System to provide remote support for plant status assessment and early detection of plant stress or disease. The EDEN ISS greenhouse has the capability to automatically capture and distribute images from its suite of 32 high-definition color cameras. Collected images are transferred over a satellite link to the EDEN ISS Mission Control Center in Bremen and to project participants worldwide. Upon reception, automatic processing software analyzes the images for anomalies, evaluates crop performance, and predicts the days remaining until harvest of each crop tray. If anomalies or sub-optimal performance is detected, the image analysis system generates automatic warnings to the agronomist team who then discuss, communicate, or implement countermeasure options. A select number of Dual Wavelength Spectral Imagers have also been integrated into the facility for plant health monitoring to detect potential plant stress before it can be seen on the images taken by the high-definition color cameras. These imagers and processing approaches are derived from traditional space-based imaging techniques but permit new discoveries to be made in a facility like the EDEN ISS greenhouse in which, essentially, every photon of input and output can be controlled and studied. This paper presents a description of the EDEN ISS Plant Health Monitoring System, basic image analyses, and a summary of the results from the initial year of Antarctic operations.
Collapse
Affiliation(s)
- Conrad Zeidler
- EDEN Research Group, Institute of Space Systems, Department of System Analysis Space Segment, German Aerospace Center (DLR), Bremen, Germany
| | - Paul Zabel
- EDEN Research Group, Institute of Space Systems, Department of System Analysis Space Segment, German Aerospace Center (DLR), Bremen, Germany
| | - Vincent Vrakking
- EDEN Research Group, Institute of Space Systems, Department of System Analysis Space Segment, German Aerospace Center (DLR), Bremen, Germany
| | - Markus Dorn
- EDEN Research Group, Institute of Space Systems, Department of System Analysis Space Segment, German Aerospace Center (DLR), Bremen, Germany
| | - Matthew Bamsey
- EDEN Research Group, Institute of Space Systems, Department of System Analysis Space Segment, German Aerospace Center (DLR), Bremen, Germany
| | - Daniel Schubert
- EDEN Research Group, Institute of Space Systems, Department of System Analysis Space Segment, German Aerospace Center (DLR), Bremen, Germany
| | - Antonio Ceriello
- Navigation and Science Organisation Unit, Telespazio S.p.A, Naples, Italy
| | - Raimondo Fortezza
- Navigation and Science Organisation Unit, Telespazio S.p.A, Naples, Italy
| | - Domenico De Simone
- Navigation and Science Organisation Unit, Telespazio S.p.A, Naples, Italy
| | - Cecilia Stanghellini
- Greenhouse Horticulture Unit, Wageningen University & Research, Wageningen, Netherlands
| | - Frank Kempkes
- Greenhouse Horticulture Unit, Wageningen University & Research, Wageningen, Netherlands
| | - Esther Meinen
- Greenhouse Horticulture Unit, Wageningen University & Research, Wageningen, Netherlands
| | - Angelo Mencarelli
- Greenhouse Horticulture Unit, Wageningen University & Research, Wageningen, Netherlands
| | - Gert-Jan Swinkels
- Greenhouse Horticulture Unit, Wageningen University & Research, Wageningen, Netherlands
| | - Anna-Lisa Paul
- UFSpaceplants Lab, Horticultural Sciences Department, University of Florida, Gainesville, FL, United States
| | - Robert J. Ferl
- UFSpaceplants Lab, Horticultural Sciences Department, University of Florida, Gainesville, FL, United States
| |
Collapse
|