GENERATING AUDIO WAVEFORMS USING ENCODER AND DECODER NEURAL NETWORKS

• Main Authors: Tagliasacchi, Marco, Rybakov, Oleg, Misiunas, Karolis, Roblek, Dominik, Ungureanu, Victor, de Chaumont Quitry, Félix, Muckenhirn, Hannah Raphaelle, Li, Yunpeng, Gfeller, Beat, Borsos, Zalán
• Format: Patent
• Language: English
• Published: 19.01.2023
• Subjects: ACOUSTICS; CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; MUSICAL INSTRUMENTS; PHYSICS; SPEECH ANALYSIS OR SYNTHESIS; SPEECH OR AUDIO CODING OR DECODING; SPEECH OR VOICE PROCESSING; SPEECH RECOGNITION

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for processing an input audio waveform using a generator neural network to generate an output audio waveform. In one aspect, a method comprises: receiving an input audio waveform; processing the input audio waveform using an encoder neural network to generate a set of feature vectors representing the input audio waveform; and processing the set of feature vectors representing the input audio waveform using a decoder neural network to generate an output audio waveform that comprises a respective output audio sample for each of a plurality of output time steps.