MACHINE-LEARNING BASED GESTURE RECOGNITION

• Main Authors: WESTING, Brandt M, AVERY, Keith P, DHANANI, Jamil, MAUDGALYA, Varun, JEONG, Minwoo, RUDCHENKO, Dmytro, KAUR, Harveen, PAEK, Timothy S
• Format: Patent
• Language: English
• Published: 14.12.2023
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; DEAF-AID SETS; ELECTRIC COMMUNICATION TECHNIQUE; ELECTRIC DIGITAL DATA PROCESSING; ELECTRICITY; LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKEACOUSTIC ELECTROMECHANICAL TRANSDUCERS; PHYSICS; PUBLIC ADDRESS SYSTEMS

The subject technology receives, from a first sensor of a device, first sensor output of a first type. The subject technology receives, from a second sensor of the device, second sensor output of a second type, the first and second sensors being non-touch sensors. The subject technology provides the first sensor output and the second sensor output as inputs to a machine learning model, the machine learning model having been trained to output a predicted touch-based gesture based on sensor output of the first type and sensor output of the second type. The subject technology provides a predicted touch-based gesture based on output from the machine learning model. Further, the subject technology adjusts an audio output level of the device based on the predicted gesture, and where the device is an audio output device.