SPEECH RECOGNITION USING DEPTH INFORMATION

• Main Authors: Camacho Perez, Jose R, Ibarra Von Borstel, Alejandro, Cordourier Maruri, Hector A, Tickoo, Omesh, Zamora Esquivel, Julio C, Lopez Meyer, Paulo, Beltman, Willem M
• Format: Patent
• Language: English
• Published: 21.06.2018
• Subjects: ACOUSTICS; CALCULATING; COMPUTING; COUNTING; MUSICAL INSTRUMENTS; PHYSICS; SPEECH ANALYSIS OR SYNTHESIS; SPEECH OR AUDIO CODING OR DECODING; SPEECH OR VOICE PROCESSING; SPEECH RECOGNITION

An example apparatus for detecting speech includes an image receiver to receive depth information corresponding to a face. The apparatus also includes a landmark detector to detect the face comprising lips and track a plurality of descriptor points comprising lip descriptor points located around the lips. The apparatus further includes a descriptor computer to calculate a plurality of descriptor features based on the tracked descriptor points. The apparatus includes a pattern generator to generate a visual pattern of the descriptor features over time. The apparatus also further includes a speech recognition engine to detect speech based on the generated visual pattern.