End-to-End Deep Learning by MCU Implementation: An Intelligent Gripper for Shape Identification

• Published in: Sensors (Basel, Switzerland) Vol. 21; no. 3; p. 891
• Main Authors: Hung, Chung-Wen, Zeng, Shi-Xuan, Lee, Ching-Hung, Li, Wei-Ting
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI 28.01.2021; MDPI AG
• Subjects: Communication; convolutional neural network; MCU; shape identification; short time Fourier transform; vibration signal; vibration signal; shape identification; convolutional neural network; MCU; short time Fourier transform
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s21030891

This paper introduces a real-time processing and classification of raw sensor data using a convolutional neural network (CNN). The established system is a microcontroller-unit (MCU) implementation of an intelligent gripper for shape identification of grasped objects. The pneumatic gripper has two embedded accelerometers to sense acceleration (in the form of vibration signals) on the jaws for identification. The raw data is firstly transferred into images by short-time Fourier transform (STFT), and then the CNN algorithm is adopted to extract features for classifying objects. In addition, the hyperparameters of the CNN are optimized to ensure hardware implementation. Finally, the proposed artificial intelligent model is implemented on a MCU (Renesas RX65N) from raw data to classification. Experimental results and discussions are introduced to show the performance and effectiveness of our proposed approach.