UNIVERSAL TRANSFORMERS

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for implementing a sequence-to-sequence model that is recurrent in depth while employing self-attention to combine information from different parts of sequences.

Saved in:
Bibliographic Details
Main Authors GOUWS, Stephan, DEGHANI, Mostafa, VINYALS, Oriol, KAISER, Lukasz Mieczyslaw, USZKOREIT, Jakob D
Format Patent
LanguageEnglish
French
German
Published 04.11.2020
Subjects
CALCULATING
COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
COMPUTING
COUNTING
PHYSICS
Online AccessGet full text

Cover

More Information
Summary:Methods, systems, and apparatus, including computer programs encoded on computer storage media, for implementing a sequence-to-sequence model that is recurrent in depth while employing self-attention to combine information from different parts of sequences.
Bibliography:Application Number: EP20190728839