A Multi-Sensor Fusion MAV State Estimation from Long-Range Stereo, IMU, GPS and Barometric Sensors

• Published in: Sensors (Basel, Switzerland) Vol. 17; no. 1; p. 11
• Main Authors: Song, Yu, Nuske, Stephen, Scherer, Sebastian
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 01.01.2017; MDPI
• Subjects: absolute and relative state measurements; Altitude; Barometers; Cameras; Degrees of freedom; Energy consumption; Global Positioning System; Global positioning systems; GPS; GPS-denied state estimation; High altitude; long-range stereo visual odometry; Micro air vehicles (MAV); multi-sensor fusion; Odometers; Robots; Sensors; State estimation; stochastic cloning EKF; Beijing China; China; GPS-denied state estimation; long-range stereo visual odometry; stochastic cloning EKF; absolute and relative state measurements; multi-sensor fusion
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s17010011

State estimation is the most critical capability for MAV (Micro-Aerial Vehicle) localization, autonomous obstacle avoidance, robust flight control and 3D environmental mapping. There are three main challenges for MAV state estimation: (1) it can deal with aggressive 6 DOF (Degree Of Freedom) motion; (2) it should be robust to intermittent GPS (Global Positioning System) (even GPS-denied) situations; (3) it should work well both for low- and high-altitude flight. In this paper, we present a state estimation technique by fusing long-range stereo visual odometry, GPS, barometric and IMU (Inertial Measurement Unit) measurements. The new estimation system has two main parts, a stochastic cloning EKF (Extended Kalman Filter) estimator that loosely fuses both absolute state measurements (GPS, barometer) and the relative state measurements (IMU, visual odometry), and is derived and discussed in detail. A long-range stereo visual odometry is proposed for high-altitude MAV odometry calculation by using both multi-view stereo triangulation and a multi-view stereo inverse depth filter. The odometry takes the EKF information (IMU integral) for robust camera pose tracking and image feature matching, and the stereo odometry output serves as the relative measurements for the update of the state estimation. Experimental results on a benchmark dataset and our real flight dataset show the effectiveness of the proposed state estimation system, especially for the aggressive, intermittent GPS and high-altitude MAV flight.