Real-Time Underwater Image Recognition with FPGA Embedded System for Convolutional Neural Network

• Published in: Sensors (Basel, Switzerland) Vol. 19; no. 2; p. 350
• Main Authors: Zhao, Minghao, Hu, Chengquan, Wei, Fenglin, Wang, Kai, Wang, Chong, Jiang, Yu
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI 16.01.2019; MDPI AG
• Subjects: CNN; FPGA; image recognition; underwater smart device; CNN; FPGA; underwater smart device; image recognition
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s19020350

The underwater environment is still unknown for humans, so the high definition camera is an important tool for data acquisition at short distances underwater. Due to insufficient power, the image data collected by underwater submersible devices cannot be analyzed in real time. Based on the characteristics of Field-Programmable Gate Array (FPGA), low power consumption, strong computing capability, and high flexibility, we design an embedded FPGA image recognition system on Convolutional Neural Network (CNN). By using two technologies of FPGA, parallelism and pipeline, the parallelization of multi-depth convolution operations is realized. In the experimental phase, we collect and segment the images from underwater video recorded by the submersible. Next, we join the tags with the images to build the training set. The test results show that the proposed FPGA system achieves the same accuracy as the workstation, and we get a frame rate at 25 FPS with the resolution of 1920 × 1080. This meets our needs for underwater identification tasks.