MobileDets: Searching for Object Detection Architectures for Mobile Accelerators

• Published in: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) pp. 3824 - 3833
• Main Authors: Xiong, Yunyang, Liu, Hanxiao, Gupta, Suyog, Akin, Berkin, Bender, Gabriel, Wang, Yongzhe, Kindermans, Pieter-Jan, Tan, Mingxing, Singh, Vikas, Chen, Bo
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.06.2021
• Subjects: Computer architecture; Convolutional codes; Image edge detection; Network architecture; Neural networks; Object detection; Search problems
• ISSN: 2575-7075
• DOI: 10.1109/CVPR46437.2021.00382

Inverted bottleneck layers, which are built upon depth-wise convolutions, have been the predominant building blocks in state-of-the-art object detection models on mobile devices. In this work, we investigate the optimality of this design pattern over a broad range of mobile accelerators by revisiting the usefulness of regular convolutions. We discover that regular convolutions are a potent component to boost the latency-accuracy trade-off for object detection on accelerators, provided that they are placed strategically in the network via neural architecture search. By incorporating regular convolutions in the search space and directly optimizing the network architectures for object detection, we obtain a family of object detection models, MobileDets, that achieve state-of-the-art results across mobile accelerators. On the COCO object detection task, MobileDets outperform MobileNetV3+SSDLite by 1.7 mAP at comparable mobile CPU inference latencies. MobileDets also outperform MobileNetV2+SSDLite by 1.9 mAP on mobile CPUs, 3.7 mAP on Google EdgeTPU, 3.4 mAP on Qualcomm Hexagon DSP and 2.7 mAP on Nvidia Jetson GPU without increasing latency. Moreover, MobileDets are comparable with the state-of-the-art MnasFPN on mobile CPUs even without using the feature pyramid, and achieve better mAP scores on both EdgeTPUs and DSPs with up to 2× speedup. Code and models are available in the TensorFlow Object Detection API [16]: https://github.com/tensorflow/models/tree/master/research/object_detection.