Technologies for shifted neural networks
Technologies for using a shifted neural network include a compute device to determine a shift-based activation function of the shifted neural network. The shift-based activation function is a piecewise linear approximation of a transcendental activation function and is defined by a plurality of line...
Saved in:
Main Authors | , , , , |
---|---|
Format | Patent |
Language | English |
Published |
04.08.2020
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Summary: | Technologies for using a shifted neural network include a compute device to determine a shift-based activation function of the shifted neural network. The shift-based activation function is a piecewise linear approximation of a transcendental activation function and is defined by a plurality of line segments such that a corresponding slope of each line segment is a power of two. The compute device further trains the shifted neural network based on shift-based input weights and the determined shift-based activation function. |
---|---|
Bibliography: | Application Number: US201615046894 |