Design and Verification of Spacecraft Pose Estimation Algorithm using Deep Learning

• Published in: Journal of astronomy and space sciences Vol. 41; no. 2; pp. 61 - 78
• Main Authors: Shinhye Moon, Sang-Young Park, Seunggwon Jeon, Dae-Eun Kang
• Format: Journal Article
• Language: Korean
• Published: 2024
• Subjects: hardware experiment; deep learning; landmark estimation; pose estimation; spacecraft relative position and attitude
• ISSN: 2093-5587; 2093-1409

This study developed a real-time spacecraft pose estimation algorithm that combined a deep learning model and the least-squares method. Pose estimation in space is crucial for automatic rendezvous docking and inter-spacecraft communication. Owing to the difficulty in training deep learning models in space, we showed that actual experimental results could be predicted through software simulations on the ground. We integrated deep learning with nonlinear least squares (NLS) to predict the pose from a single spacecraft image in real time. We constructed a virtual environment capable of mass-producing synthetic images to train a deep learning model. This study proposed a method for training a deep learning model using pure synthetic images. Further, a visual-based real-time estimation system suitable for use in a flight testbed was constructed. Consequently, it was verified that the hardware experimental results could be predicted from software simulations with the same environment and relative distance. This study showed that a deep learning model trained using only synthetic images can be sufficiently applied to real images. Thus, this study proposed a real-time pose estimation software for automatic docking and demonstrated that the method constructed with only synthetic data was applicable in space.