RTSeg: Real-Time Semantic Segmentation Comparative Study

• Published in: Proceedings - International Conference on Image Processing pp. 1603 - 1607
• Main Authors: Siam, Mennatullah, Gamal, Mostafa, Abdel-Razek, Moemen, Yogamani, Senthil, Jagersand, Martin
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.10.2018
• Subjects: Benchmark testing; benchmarking framework; Computer architecture; Convolution; Decoding; Feature extraction; Real-time systems; realtime; semantic segmentation; Semantics
• ISSN: 2381-8549
• DOI: 10.1109/ICIP.2018.8451495

Semantic segmentation benefits robotics related applications, especially autonomous driving. Most of the research on semantic segmentation only focuses on increasing the accuracy of segmentation models with little attention to computationally efficient solutions. The few work conducted in this direction does not provide principled methods to evaluate the different design choices for segmentation. In this paper, we address this gap by presenting a real-time semantic segmentation benchmarking framework with a decoupled design for feature extraction and decoding methods. The framework is comprised of different network architectures for feature extraction such as VGG16, Resnet18, MobileNet, and ShuffleNet. It is also comprised of multiple meta-architectures for segmentation that define the decoding methodology. These include SkipNet, UNet, and Dilation Frontend. Experimental results are presented on the Cityscapes dataset for urban scenes. The modular design allows novel architectures to emerge, that lead to 143x GFLOPs reduction in comparison to SegNet. This benchmarking framework is publicly available at 1 1 https://github.com/MSiam/TFSegmentation.