Generating neural network outputs using insertion commands

• Main Authors: Gu, Kelvin, Stern, Mitchell Thomas, Chan, William, Kitaev, Nikita, Uszkoreit, Jakob D
• Format: Patent
• Language: English
• Published: 10.09.2024
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; ELECTRIC DIGITAL DATA PROCESSING; PHYSICS

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for performing sequence modeling tasks using insertions. One of the methods includes receiving a system input that includes one or more source elements from a source sequence and zero or more target eleme...