YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design
DOI:
https://doi.org/10.1609/aaai.v35i2.16179Keywords:
Object Detection & Categorization, Learning on the Edge & Model CompressionAbstract
The rapid development and wide utilization of object detection techniques have aroused attention on both accuracy and speed of object detectors. However, the current state-of-the-art object detection works are either accuracy-oriented using a large model but leading to high latency or speed-oriented using a lightweight model but sacrificing accuracy. In this work, we propose YOLObile framework, a real-time object detection on mobile devices via compression-compilation co-design. A novel block-punched pruning scheme is proposed for any kernel size. To improve computational efficiency on mobile devices, a GPU-CPU collaborative scheme is adopted along with advanced compiler-assisted optimizations. Experimental results indicate that our pruning scheme achieves 14x compression rate of YOLOv4 with 49.0 mAP. Under our YOLObile framework, we achieve 17 FPS inference speed using GPU on Samsung Galaxy S20. By incorporating our proposed GPU-CPU collaborative scheme, the inference speed is increased to 19.1 FPS, and outperforms the original YOLOv4 by 5x speedup. Source code is at: https://github.com/nightsnack/YOLObile.Downloads
Published
2021-05-18
How to Cite
Cai, Y., Li, H., Yuan, G., Niu, W., Li, Y., Tang, X., Ren, B., & Wang, Y. (2021). YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design. Proceedings of the AAAI Conference on Artificial Intelligence, 35(2), 955-963. https://doi.org/10.1609/aaai.v35i2.16179
Issue
Section
AAAI Technical Track on Computer Vision I