MAVNet: an Effective Semantic Segmentation Micro-Network for MAV-based Tasks

• Main Authors: Nguyen, Ty, Shivakumar, Shreyas S, Miller, Ian D, Keller, James, Lee, Elijah S, Zhou, Alex, Ozaslan, Tolga, Loianno, Giuseppe, Harwood, Joseph H, Wozencraft, Jennifer, Taylor, Camillo J, Kumar, Vijay
• Format: Journal Article
• Language: English
• Published: 03.04.2019
• Subjects: Computer Science - Computer Vision and Pattern Recognition
• DOI: 10.48550/arxiv.1904.01795

Real-time semantic image segmentation on platforms subject to size, weight and power (SWaP) constraints is a key area of interest for air surveillance and inspection. In this work, we propose MAVNet: a small, light-weight, deep neural network for real-time semantic segmentation on micro Aerial Vehicles (MAVs). MAVNet, inspired by ERFNet, features 400 times fewer parameters and achieves comparable performance with some reference models in empirical experiments. Our model achieves a trade-off between speed and accuracy, achieving up to 48 FPS on an NVIDIA 1080Ti and 9 FPS on the NVIDIA Jetson Xavier when processing high resolution imagery. Additionally, we provide two novel datasets that represent challenges in semantic segmentation for real-time MAV tracking and infrastructure inspection tasks and verify MAVNet on these datasets. Our algorithm and datasets are made publicly available.