GENERATING AUDIO USING AUTO-REGRESSIVE GENERATIVE NEURAL NETWORKS

• Main Authors: TAGLIASACCHI, Marco, DENK, Timo Immanuel, ZEGHIDOUR, Neil, ENGEL, Jesse, BORSOS, Zalán, AGOSTINELLI, Andrea, SHARIFI, Matthew, GRANGIER, David, MARINIER, Raphaël, TEBOUL, Olivier, CAILLON, Antoine, FRANK, Christian, VERZETTI, Mauro, ROBERTS, Adam Joseph
• Format: Patent
• Language: English
• Published: 20.06.2024
• Subjects: ACOUSTICS; CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; MUSICAL INSTRUMENTS; PHYSICS; SPEECH ANALYSIS OR SYNTHESIS; SPEECH OR AUDIO CODING OR DECODING; SPEECH OR VOICE PROCESSING; SPEECH RECOGNITION

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating a prediction of an audio signal. One of the methods includes receiving a request to generate an audio signal; obtaining a semantic representation of the audio signal; generating, using one or more generative neural networks and conditioned on at least the semantic representation, an acoustic representation of the audio signal; and processing at least the acoustic representation using a decoder neural network to generate the prediction of the audio signal.