Nondestructive identification of softness via bioinspired multisensory electronic skins integrated on a robotic hand

• Published in: Npj flexible electronics Vol. 6; no. 1; pp. 1 - 10
• Main Authors: Qiu, Ye, Sun, Shenshen, Wang, Xueer, Shi, Kuanqiang, Wang, Zhiqiang, Ma, Xiaolong, Zhang, Wenan, Bao, Guanjun, Tian, Ye, Zhang, Zheng, Ding, Hao, Chai, Hao, Liu, Aiping, Wu, Huaping
• Format: Journal Article
• Language: English
• Published: London Nature Publishing Group UK 15.06.2022; Nature Publishing Group; Nature Portfolio
• Subjects: 639/301/1005; 639/301/923/1028; Algorithms; Biomimetics; Chemistry and Materials Science; Contact force; Electronics and Microelectronics; End effectors; Grasping; Instrumentation; Machine learning; Man-machine interfaces; Manipulators; Materials Science; Object recognition; Optical and Electronic Materials; Piezoelectricity; Polymer Sciences; Prostheses; Robot arms; Robotics; Softness; Tactile sensors (robotics)
• ISSN: 2397-4621; 2397-4621
• DOI: 10.1038/s41528-022-00181-9

Tactile sensing is essentially required for dexterous manipulation in robotic applications. Mimicking human perception of softness identification in a non-invasive fashion, thus achieving satisfactory interaction with fragile objects remains a grand challenge. Here, a scatheless measuring methodology based on the multisensory electronic skins to quantify the elastic coefficient of soft materials is reported. This recognition approach lies in the preliminary classification of softness by piezoelectric signals with a modified machine learning algorithm, contributing to an appropriate contact force assignment for subsequent quantitative measurements via strain sensing feedback. The integration of multifunctional sensing system allows the manipulator to hold capabilities of self-sensing and adaptive grasping motility in response to objects with the various softness (i.e., kPa-MPa). As a proof-of-concept demonstration, the biomimetic manipulator cooperates with the robotic arm to realize the intelligent sorting of oranges varying in freshness, paving the way for the development of microsurgery robots, human-machine interfacing, and advanced prosthetics.