DFX: A Low-latency Multi-FPGA Appliance for Accelerating Transformer-based Text Generation - Hong, Seongmin; Moon, Seungjae; Kim, Junsoo; Lee, Sungjae; Kim, Minsub; Lee, Dongsoo; Kim, Joo-Young (2022 55th IEEE/ACM International Symposium on Microarchitecture (MICRO), 2022)
Keywords: Computational modeling; Datacenter; GPT; Graphics processing units; Hardware; Model Parallelism; Multi-FPGA Acceleration; Natural language processing; Parallel processing; Text Generation; Throughput; Transformers