Word stream annotation

• Main Authors: DEVINE JENNIFER MELISSA ROSS, SECK, JOSEPH, W, KAEHLER ADRIAN, SOMMERS JEFFREY
• Format: Patent
• Language: Chinese; English
• Published: 08.12.2023
• Subjects: ACOUSTICS; CALCULATING; COMPUTING; COUNTING; ELECTRIC COMMUNICATION TECHNIQUE; ELECTRIC DIGITAL DATA PROCESSING; ELECTRICITY; MUSICAL INSTRUMENTS; PHYSICS; PICTORIAL COMMUNICATION, e.g. TELEVISION; SPEECH ANALYSIS OR SYNTHESIS; SPEECH OR AUDIO CODING OR DECODING; SPEECH OR VOICE PROCESSING; SPEECH RECOGNITION

An augmented reality (AR) device may be configured to monitor background audio data. The AR device may detect speech in the background audio data, convert the detected speech to text, or detect keywords in the speech, such as rare words. When a rare word is detected, the AR device may retrieve auxiliary information (e.g., definitions) related to the rare word from a public or personal source. The AR device may display auxiliary information to the user to help the user better understand the speech. The AR device may perform translation of the foreign language, may display text (or translation) of the speaker's speech to the user, or display statistics or other information associated with the speech. 一种增强现实AR设备可以被配置为监视背景音频数据。该AR设备可以检测背景音频数据中的话音，将所检测到的话音转换为文本，或者检测该话音中诸如稀有词之类的关键字。当检测到稀有词时，该AR设备可以从公共或个人源中取得与该稀有词相关的辅助信息(例如，定义)。该AR设备可以向用户显示辅助信息以帮助该用户更好地理解话音。该AR设备可以执行外语的翻译，可以向用户显示讲话者的话音的文本(或翻译)，或者显示与该话音相关联的统计数据或其它信息。