1
|
Matsuura Y, Heming Z, Nakao K, Qiong C, Firmansyah I, Kawai S, Yamaguchi Y, Maruyama T, Hayashi H, Nobuhara H. High-precision plant height measurement by drone with RTK-GNSS and single camera for real-time processing. Sci Rep 2023; 13:6329. [PMID: 37072434 PMCID: PMC10113379 DOI: 10.1038/s41598-023-32167-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2022] [Accepted: 03/23/2023] [Indexed: 05/03/2023] Open
Abstract
Conventional crop height measurements performed using aerial drone images require 3D reconstruction results of several aerial images obtained through structure from motion. Therefore, they require extensive computation time and their measurement accuracy is not high; if the 3D reconstruction result fails, several aerial photos must be captured again. To overcome these challenges, this study proposes a high-precision measurement method that uses a drone equipped with a monocular camera and real-time kinematic global navigation satellite system (RTK-GNSS) for real-time processing. This method performs high-precision stereo matching based on long-baseline lengths (approximately 1 m) during the flight by linking the RTK-GNSS and aerial image capture points. As the baseline length of a typical stereo camera is fixed, once the camera is calibrated on the ground, it does not need to be calibrated again during the flight. However, the proposed system requires quick calibration in flight because the baseline length is not fixed. A new calibration method that is based on zero-mean normalized cross-correlation and two stages least square method, is proposed to further improve the accuracy and stereo matching speed. The proposed method was compared with two conventional methods in natural world environments. It was observed that error rates reduced by 62.2% and 69.4%, for flight altitudes between 10 and 20 m respectively. Moreover, a depth resolution of 1.6 mm and reduction of 44.4% and 63.0% in the error rates were achieved at an altitude of 4.1 m, and the execution time was 88 ms for images with a size of 5472 × 3468 pixels, which is sufficiently fast for real-time measurement.
Collapse
Affiliation(s)
- Yuta Matsuura
- Department of Intelligent and Mechanical Interaction Systems, Graduate School of Science and Technology, University of Tsukuba, Ibaraki, 305-8573, Japan
| | - Zhang Heming
- Department of Intelligent and Mechanical Interaction Systems, Graduate School of Science and Technology, University of Tsukuba, Ibaraki, 305-8573, Japan
| | - Kousuke Nakao
- Department of Intelligent and Mechanical Interaction Systems, Graduate School of Science and Technology, University of Tsukuba, Ibaraki, 305-8573, Japan
| | - Chang Qiong
- School of Computing, Tokyo Institute of Technology, Meguro City, Tokyo, Japan
| | - Iman Firmansyah
- Faculty of Engineering, Information and Systems, University of Tsukuba, Ibaraki, Japan
| | - Shin Kawai
- Department of Intelligent and Mechanical Interaction Systems, Graduate School of Science and Technology, University of Tsukuba, Ibaraki, 305-8573, Japan
| | - Yoshiki Yamaguchi
- Faculty of Engineering, Information and Systems, University of Tsukuba, Ibaraki, Japan
| | - Tsutomu Maruyama
- Department of Intelligent and Mechanical Interaction Systems, Graduate School of Science and Technology, University of Tsukuba, Ibaraki, 305-8573, Japan
| | - Hisayoshi Hayashi
- Faculty of Life and Environmental Sciences, University of Tsukuba, Ibaraki, Japan
| | - Hajime Nobuhara
- Department of Intelligent and Mechanical Interaction Systems, Graduate School of Science and Technology, University of Tsukuba, Ibaraki, 305-8573, Japan.
| |
Collapse
|
2
|
Gonzales D, Hempel de Ibarra N, Anderson K. Remote Sensing of Floral Resources for Pollinators – New Horizons From Satellites to Drones. Front Ecol Evol 2022. [DOI: 10.3389/fevo.2022.869751] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Insect pollinators are affected by the spatio-temporal distribution of floral resources, which are dynamic across time and space, and also influenced heavily by anthropogenic activities. There is a need for spatial data describing the time-varying spatial distribution of flowers, which can be used within behavioral and ecological studies. However, this information is challenging to obtain. Traditional field techniques for mapping flowers are often laborious and limited to relatively small areas, making it difficult to assess how floral resources are perceived by pollinators to guide their behaviors. Conversely, remote sensing of plant traits is a relatively mature technique now, and such technologies have delivered valuable data for identifying and measuring non-floral dynamics in plant systems, particularly leaves, stems and woody biomass in a wide range of ecosystems from local to global scales. However, monitoring the spatial and temporal dynamics of plant floral resources has been notably scarce in remote sensing studies. Recently, lightweight drone technology has been adopted by the ecological community, offering a capability for flexible deployment in the field, and delivery of centimetric resolution data, providing a clear opportunity for capturing fine-grained information on floral resources at key times of the flowering season. In this review, we answer three key questions of relevance to pollination science – can remote sensing deliver information on (a) how isolated are floral resources? (b) What resources are available within a flower patch? And (c) how do floral patches change over time? We explain how such information has potential to deepen ecological understanding of the distribution of floral resources that feed pollinators and the parameters that determine their navigational and foraging choices based on the sensory information they extract at different spatial scales. We provide examples of how such data can be used to generate new insights into pollinator behaviors in distinct landscape types and their resilience to environmental change.
Collapse
|
3
|
Shirai H, Kageyama Y, Nagamoto D, Kanamori Y, Tokunaga N, Kojima T, Akisawa M. Detection method for Convallaria keiskei colonies in Hokkaido, Japan, by combining CNN and FCM using UAV-based remote sensing data. ECOL INFORM 2022. [DOI: 10.1016/j.ecoinf.2022.101649] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|