Non-uniform piecewise linearization activation function hardware implementation method

• Main Authors: CHEN JIAXUAN, YANG QINHUI, WANG HAI
• Format: Patent
• Language: Chinese; English
• Published: 04.07.2023
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; PHYSICS

The invention belongs to the technical field of hardware implementation of function calculation, and discloses a non-uniform piecewise linearization activation function hardware implementation method, compared with a traditional non-linear function hardware implementation method, the non-uniform piecewise linearization activation function hardware implementation method considers the curvature factor of a non-linear function, more piecewise points are arranged at the position with the large curvature, and therefore the non-uniform piecewise linearization activation function hardware implementation method is achieved. According to the non-uniform segmentation method, few segmentation points are arranged at the positions with small curvatures, and compared with a traditional uniform segmentation method, the non-uniform segmentation method has the advantages that the number of the segmentation points can be reduced under the condition of the same precision, and resources can be saved during hardware implementatio