Vision-Based Aircraft Marshalling Recognition and UAM Control Command Generation

• Published in: International journal of aeronautical and space sciences Vol. 26; no. 4; pp. 1732 - 1750
• Main Authors: Lee, Jeonghun, Cho, Sungwook, Jung, Yeondeuk
• Format: Journal Article
• Language: English
• Published: Seoul The Korean Society for Aeronautical & Space Sciences (KSAS) 01.07.2025; 한국항공우주학회
• Subjects: Aerospace Technology and Astronautics; Engineering; Fluid- and Aerodynamics; Original Paper; 항공우주공학; Aircraft marshalling; Human pose estimation; Urban air mobility; Object detection
• ISSN: 2093-274X; 2093-2480
• DOI: 10.1007/s42405-024-00840-3

Urban air mobility (UAM) represents a burgeoning mode of air transportation, presently in its nascent operational phase with manned aircraft that necessitate pilot assistance. The ultimate objective for UAMs is the development of unmanned aircraft capable of autonomous flight. Ongoing research and development efforts aim to realize this objective. This thesis proposes a vision-based software framework to control UAMs by recognizing aircraft marshalling during takeoff and landing at vertiports. Specifically, this paper introduces an image processing algorithm employing deep learning-based human pose estimators and object detection to identify aircraft marshallers, ascertain the marshalling actions they perform, and translate these actions into control commands that are transmitted to the UAM. The algorithm’s validation involves experiments conducted using System in the loop (SITL) simulation, with the results subsequently analyzed. The findings indicate that the proposed software framework performs effectively in a real-time image processing environment.