INSTRUCTIONS AND LOGIC TO PERFORM FLOATING POINT AND INTEGER OPERATIONS FOR MACHINE LEARNING

One embodiment provides a graphics processor comprising a memory controller and a graphics processing resource coupled with the memory controller. The graphics processing resource includes circuitry configured to execute an instruction to perform a matrix operation on first input including weight da...

Full description

Saved in:
Bibliographic Details
Main Authors Chen, Xiaoming, Kaul, Himanshu, Yao, Anbang, Ranganathan, Vasanth, Galoppo Von Borries, Nicolas C, Nurvitadhi, Eriko, Appu, Abhishek R, Mathew, Sanu K, Tang, Ping T, Lin, Tsung-Han, Koker, Altug, Jahagirdar, Sanjeev, Ray, Joydeep, Sinha, Kamal, Vembu, Balaji, Anders, Mark A, Barik, Rajkishore, Strickland, Michael S, Shpeisman, Tatiana
Format Patent
LanguageEnglish
Published 10.11.2022
Subjects
Online AccessGet full text

Cover

Loading…
More Information
Summary:One embodiment provides a graphics processor comprising a memory controller and a graphics processing resource coupled with the memory controller. The graphics processing resource includes circuitry configured to execute an instruction to perform a matrix operation on first input including weight data and second input including input activation data, generate intermediate data based on a result of the matrix operation, quantize the intermediate data to a floating-point format determined based on a statistical distribution of first output data, and output, as second output data, quantized intermediate data in a determined floating-point format.
Bibliography:Application Number: US202217834482