Method and device for real-time translation of sign language

• Main Authors: LI YUANXIN, GUO XIAODONG, LIU DAN, QIN WEI, MA HUANCHANG, LIU ZHIWEN, HE JINXU, LIU LU, NIU DONG
• Format: Patent
• Language: Chinese; English
• Published: 21.11.2023
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; ELECTRIC DIGITAL DATA PROCESSING; PHYSICS

The invention relates to a method and a device for real-time translation of sign language, which are characterized in that firstly, a millimeter-wave radar is used for collecting sign language finger actions of both hands, an action capture sensor is used for collecting main sign language wrist actions, and then a data processing module combines collected sign language gesture features of fingers and wrists and translates the sign language gesture features of the fingers and the wrists. Constructing a sign language gesture data set, training the deep neural network model by using the sign language gesture data set, storing the sign language translation model obtained by training, calling the sign language translation model, completing sign language action recognition and translation, and outputting a result. The sign language acquisition precision can be improved, the sign language identification speed is high, the sign language identification precision is high, the equipment cost is low, the size is small, t