Design and development of orchard autonomous navigation spray system

A Comprehensive Review of LiDAR Applications in Crop Management for Precision Agriculture

Precision agriculture has revolutionized crop management and agricultural production, with LiDAR technology attracting significant interest among various technological advancements. This extensive review examines the various applications of LiDAR in precision agriculture, with a particular emphasis on its function in crop cultivation and harvests. The introduction provides an overview of precision agriculture, highlighting the need for effective agricultural management and the growing significance of LiDAR technology. The prospective advantages of LiDAR for increasing productivity, optimizing resource utilization, managing crop diseases and pesticides, and reducing environmental impact are discussed. The introduction comprehensively covers LiDAR technology in precision agriculture, detailing airborne, terrestrial, and mobile systems along with their specialized applications in the field. After that, the paper reviews the several uses of LiDAR in agricultural cultivation, including crop growth and yield estimate, disease detection, weed control, and plant health evaluation. The use of LiDAR for soil analysis and management, including soil mapping and categorization and the measurement of moisture content and nutrient levels, is reviewed. Additionally, the article examines how LiDAR is used for harvesting crops, including its use in autonomous harvesting systems, post-harvest quality evaluation, and the prediction of crop maturity and yield. Future perspectives, emergent trends, and innovative developments in LiDAR technology for precision agriculture are discussed, along with the critical challenges and research gaps that must be filled. The review concludes by emphasizing potential solutions and future directions for maximizing LiDAR's potential in precision agriculture. This in-depth review of the uses of LiDAR gives helpful insights for academics, practitioners, and stakeholders interested in using this technology for effective and environmentally friendly crop management, which will eventually contribute to the development of precision agricultural methods.

Agricultural machinery automatic navigation technology

In this paper, we review, compare, and analyze previous studies on agricultural machinery automatic navigation and path planning technologies. First, the paper introduces the fundamental components of agricultural machinery autonomous driving, including automatic navigation, path planning, control systems, and communication modules. Generally, the methods for automatic navigation technology can be divided into three categories: Global Navigation Satellite System (GNSS), Machine Vision, and Laser Radar. The structures, advantages, and disadvantages of different methods and the technical difficulties of current research are summarized and compared. At present, the more successful way is to use GNSS combined with machine vision to provide guarantee for agricultural machinery to avoid obstacles and generate the optimal path. Then the path planning methods are described, including four path planning algorithms based on graph search, sampling, optimization, and learning. This paper proposes 22 available algorithms according to different application scenarios and summarizes the challenges and difficulties that have not been completely solved in the current research. Finally, some suggestions on the difficulties arising in these studies are proposed for further research.

Intrarow Uncut Weed Detection Using You-Only-Look-Once Instance Segmentation for Orchard Plantations

Mechanical weed management is a drudging task that requires manpower and has risks when conducted within rows of orchards. However, intrarow weeding must still be conducted by manual labor due to the restricted movements of riding mowers within the rows of orchards due to their confined structures with nets and poles. However, autonomous robotic weeders still face challenges identifying uncut weeds due to the obstruction of Global Navigation Satellite System (GNSS) signals caused by poles and tree canopies. A properly designed intelligent vision system would have the potential to achieve the desired outcome by utilizing an autonomous weeder to perform operations in uncut sections. Therefore, the objective of this study is to develop a vision module using a custom-trained dataset on YOLO instance segmentation algorithms to support autonomous robotic weeders in recognizing uncut weeds and obstacles (i.e., fruit tree trunks, fixed poles) within rows. The training dataset was acquired from a pear orchard located at the Tsukuba Plant Innovation Research Center (T-PIRC) at the University of Tsukuba, Japan. In total, 5000 images were preprocessed and labeled for training and testing using YOLO models. Four versions of edge-device-dedicated YOLO instance segmentation were utilized in this research-YOLOv5n-seg, YOLOv5s-seg, YOLOv8n-seg, and YOLOv8s-seg-for real-time application with an autonomous weeder. A comparison study was conducted to evaluate all YOLO models in terms of detection accuracy, model complexity, and inference speed. The smaller YOLOv5-based and YOLOv8-based models were found to be more efficient than the larger models, and YOLOv8n-seg was selected as the vision module for the autonomous weeder. In the evaluation process, YOLOv8n-seg had better segmentation accuracy than YOLOv5n-seg, while the latter had the fastest inference time. The performance of YOLOv8n-seg was also acceptable when it was deployed on a resource-constrained device that is appropriate for robotic weeders. The results indicated that the proposed deep learning-based detection accuracy and inference speed can be used for object recognition via edge devices for robotic operation during intrarow weeding operations in orchards.

Development of Location-Data-Based Orchard Passage Map Generation Method

Currently, pest control work using speed sprayers results in increasing numbers of safety accidents such as worker pesticide poisoning and rollover of vehicles during work. To address this, there is growing interest in autonomous driving technology for speed sprayers. To commercialize and rapidly expand the use of self-driving speed sprayers, an economically efficient self-driving speed sprayer using a minimum number of sensors is essential. This study developed an orchard passage map using location data acquired from positioning sensors to generate autonomous driving paths, without installing additional sensors. The method for creating the orchard passage map presented in this study was to create paths using location data obtained by manually driving the speed sprayer and merging them. In addition, to apply the orchard passage map when operating autonomously, a method is introduced for generating an autonomous driving path for the work start point movement path, work path, and return point movement path.

Research on orchard navigation method based on fusion of 3D SLAM and point cloud positioning

Accurate navigation is crucial in the construction of intelligent orchards, and the need for vehicle navigation accuracy becomes even more important as production is refined. However, traditional navigation methods based on global navigation satellite system (GNSS) and 2D light detection and ranging (LiDAR) can be unreliable in complex scenarios with little sensory information due to tree canopy occlusion. To solve these issues, this paper proposes a 3D LiDAR-based navigation method for trellis orchards. With the use of 3D LiDAR with a 3D simultaneous localization and mapping (SLAM) algorithm, orchard point cloud information is collected and filtered using the Point Cloud Library (PCL) to extract trellis point clouds as matching targets. In terms of positioning, the real-time position is determined through a reliable method of fusing multiple sensors for positioning, which involves transforming the real-time kinematics (RTK) information into the initial position and doing a normal distribution transformation between the current frame point cloud and the scaffold reference point cloud to match the point cloud position. For path planning, the required vector map is manually planned in the orchard point cloud to specify the path of the roadway, and finally, navigation is achieved through pure path tracking. Field tests have shown that the accuracy of the normal distributions transform (NDT) SLAM method can reach 5 cm in each rank with a coefficient of variation that is less than 2%. Additionally, the navigation system has a high positioning heading accuracy with a deviation within 1° and a standard deviation of less than 0.6° when moving along the path point cloud at a speed of 1.0 m/s in a Y-trellis pear orchard. The lateral positioning deviation was also controlled within 5 cm with a standard deviation of less than 2 cm. This navigation system has a high level of accuracy and can be customized to specific tasks, making it widely applicable in trellis orchards with autonomous navigation pesticide sprayers.

Development of a Moving Baseline RTK/Motion Sensor-Integrated Positioning-Based Autonomous Driving Algorithm for a Speed Sprayer

To address problems such as pesticide poisoning and accidents during pest control work and to enable efficient work in this area, the development of a competitively prices speed sprayer with autonomous driving is required. Accordingly, in order to contribute to developing the commercialization of a low-cost autonomous driving speed sprayer, we developed a positioning algorithm and an autonomous driving-based spraying algorithm by using two low-cost global navigation satellite system (GNSS) modules and a low-cost motion sensor. In order to provide stable navigation solutions from the autonomous driving hardware despite disturbances from the electromagnetic field generated by the spraying device, the proposed positioning algorithm, a moving baseline (MB) real-time kinematic (RTK)/motion sensor-integrated positioning algorithm, was developed using a loosely coupled extended Kalman filter. To compare the yaw estimation performance provided by the MB RTK positioning technique, yaw was calculated by post-processing with two types of positioning algorithms: the MB RTK/motion sensor-integrated positioning algorithm and the GNSS RTK/motion sensor-integrated positioning algorithm. In the static test, the precision of the yaw provided by the MB RTK/motion sensor-integrated positioning algorithm was 0.14°, but with the GNSS RTK/motion sensor-integrated positioning algorithm, the precision of the yaw was 4.53°. The static test results confirmed that the proposed positioning algorithm using the yaw provided by the MB RTK positioning technique based on two GNSS modules for measurement, precisely estimated the yaw even when the spray engine was operating. To perform autonomous driving and spraying, an autonomous driving-based spraying algorithm was developed using the MB RTK/motion sensor-integrated positioning algorithm. As a result of two performance tests based on the proposed algorithm in an orchard, autonomous driving and spraying were stably performed according to the set autonomous driving route and spraying method, and the root mean square (RMS) of the path-following error was 0.06 m.