Integrated local and cloud based speech recognition

• Main Authors: HAWKINS DAX H, SOEMO THOMAS M, SOONG LEO, HEINEMANN CHAD R, KIM MICHAEL H
• Format: Patent
• Language: Chinese; English
• Published: 30.01.2013
• Subjects: ACOUSTICS; ELECTRIC COMMUNICATION TECHNIQUE; ELECTRICITY; MUSICAL INSTRUMENTS; PHYSICS; SPEECH ANALYSIS OR SYNTHESIS; SPEECH OR AUDIO CODING OR DECODING; SPEECH OR VOICE PROCESSING; SPEECH RECOGNITION; TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHICCOMMUNICATION

The invention describes integrated local and cloud based speech recognition, and specifically describes a system for integrating local speech recognition with cloud-based speech recognition in order to provide an efficient natural user interface. In some embodiments, a computing device determines a direction associated with a particular person within an environment and generates an audio recording associated with the direction. The computing device then performs local speech recognition on the audio recording in order to detect a first utterance spoken by the particular person and to detect one or more keywords within the first utterance. The first utterance may be detected by applying voice activity detection techniques to the audio recording. The first utterance and the one or more keywords are subsequently transferred to a server which may identify speech sounds within the first utterance associated with the one or more keywords and adapt one or more speech recognition techniques based on the identified sp