ORGANIZING SEQUENCES FOR TRANSFORMER COMPUTE

A computer-implemented method according to one embodiment includes determining a threshold sequence-size for a transformer; organizing a batch of sequences according to the threshold sequence-size; and inputting the organized batch of sequences into the transformer.

Saved in:
Bibliographic Details
Main Authors Burr, Geoffrey, Tsai, HsinYu, Jain, Shubham
Format Patent
LanguageEnglish
Published 01.06.2023
Subjects
CALCULATING
COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
PHYSICS
Online AccessGet full text

Cover

More Information
Summary:A computer-implemented method according to one embodiment includes determining a threshold sequence-size for a transformer; organizing a batch of sequences according to the threshold sequence-size; and inputting the organized batch of sequences into the transformer.
Bibliography:Application Number: US202117538989