DYNAMIC ACTIVATION SPARSITY IN NEURAL NETWORKS

A method of inducing sparsity for outputs of neural network layer may include receiving outputs from a layer of a neural network; partitioning the outputs into a plurality of partitions; identifying first partitions in the plurality of partitions that can be treated as having zero values; generating...

Full description

Saved in:
Bibliographic Details
Main Authors Zaman, Naveed, Hanmante, Udaykumar Diliprao, Juang, Bor-Chau, Suri, Tameesh, Sheikh, Bilal Shafi, See, Nathaniel, Shak, Myron, Dangayach, Sachin
Format Patent
LanguageEnglish
Published 01.12.2022
Subjects
CALCULATING
COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
COMPUTING
COUNTING
PHYSICS
Online AccessGet full text

Cover

More Information
Summary:A method of inducing sparsity for outputs of neural network layer may include receiving outputs from a layer of a neural network; partitioning the outputs into a plurality of partitions; identifying first partitions in the plurality of partitions that can be treated as having zero values; generating an encoding that identifies locations of the first partitions among remaining second partitions in the plurality of partitions; and sending the encoding and the second partitions to a subsequent layer in the neural network.
Bibliography:Application Number: US202117330096