High-precision plant height measurement by drone with RTK-GNSS and single camera for real-time processing

• Published in: Scientific reports Vol. 13; no. 1; pp. 6329 - 15
• Main Authors: Matsuura, Yuta, Heming, Zhang, Nakao, Kousuke, Qiong, Chang, Firmansyah, Iman, Kawai, Shin, Yamaguchi, Yoshiki, Maruyama, Tsutomu, Hayashi, Hisayoshi, Nobuhara, Hajime
• Format: Journal Article
• Language: English
• Published: London Nature Publishing Group UK 18.04.2023; Nature Publishing Group; Nature Portfolio
• Subjects: 631/114; 639/166; 639/624; Altitude; Calibration; Cameras; Flight; Humanities and Social Sciences; multidisciplinary; Science; Science (multidisciplinary)
• ISSN: 2045-2322; 2045-2322
• DOI: 10.1038/s41598-023-32167-6

Conventional crop height measurements performed using aerial drone images require 3D reconstruction results of several aerial images obtained through structure from motion. Therefore, they require extensive computation time and their measurement accuracy is not high; if the 3D reconstruction result fails, several aerial photos must be captured again. To overcome these challenges, this study proposes a high-precision measurement method that uses a drone equipped with a monocular camera and real-time kinematic global navigation satellite system (RTK-GNSS) for real-time processing. This method performs high-precision stereo matching based on long-baseline lengths (approximately 1 m) during the flight by linking the RTK-GNSS and aerial image capture points. As the baseline length of a typical stereo camera is fixed, once the camera is calibrated on the ground, it does not need to be calibrated again during the flight. However, the proposed system requires quick calibration in flight because the baseline length is not fixed. A new calibration method that is based on zero-mean normalized cross-correlation and two stages least square method, is proposed to further improve the accuracy and stereo matching speed. The proposed method was compared with two conventional methods in natural world environments. It was observed that error rates reduced by 62.2% and 69.4%, for flight altitudes between 10 and 20 m respectively. Moreover, a depth resolution of 1.6 mm and reduction of 44.4% and 63.0% in the error rates were achieved at an altitude of 4.1 m, and the execution time was 88 ms for images with a size of 5472 × 3468 pixels, which is sufficiently fast for real-time measurement.