METHOD AND DEVICE FOR PROCESSING SPEECH BY DISTINGUISHING SPEAKERS

• Main Authors: JO, Nammin, PARK, Minjung, YU, Juyoung, KIM, Chulkwi
• Format: Patent
• Language: English; French; German
• Published: 14.08.2024
• Subjects: ACOUSTICS; CALCULATING; COMPUTING; COUNTING; DEAF-AID SETS; ELECTRIC COMMUNICATION TECHNIQUE; ELECTRIC DIGITAL DATA PROCESSING; ELECTRICITY; LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKEACOUSTIC ELECTROMECHANICAL TRANSDUCERS; MUSICAL INSTRUMENTS; PHYSICS; PICTORIAL COMMUNICATION, e.g. TELEVISION; PUBLIC ADDRESS SYSTEMS; SPEECH ANALYSIS OR SYNTHESIS; SPEECH OR AUDIO CODING OR DECODING; SPEECH OR VOICE PROCESSING; SPEECH RECOGNITION

Various embodiments of the disclosure provide a method and a device which includes multiple cameras arranged at different positions, multiple microphones arranged at different positions, a memory, and a processor operatively connected to at least one of the multiple cameras, the multiple microphones, and the memory, wherein the processor is configured to determine, by using at least one of the multiple cameras, whether at least one of a user wearing the electronic device or a counterpart having a conversation with the user makes an utterance, configure directivity of at least one of the multiple microphones based on the determination result, obtain an audio from at least one of the multiple microphones based on the configured directivity, obtain an image including a mouth shape of the user or the counterpart from at least one of the multiple cameras, and process speech of an utterance target in a different manner based on the obtained audio and the image. Various other embodiments are also possible.