Design and Analysis of Energy-Efficient Dynamic Range Approximate Logarithmic Multipliers for Machine Learning

• Published in: IEEE transactions on sustainable computing Vol. 6; no. 4; pp. 612 - 625
• Main Authors: Yin, Peipei, Wang, Chenghua, Waris, Haroon, Liu, Weiqiang, Han, Yinhe, Lombardi, Fabrizio
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.10.2021; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Adders; Approximate computing; Back propagation; Circuit design; Cluster analysis; Clustering; Datasets; Dynamic range; Handwriting recognition; Heuristic algorithms; logarithmic multiplier; low power; Machine learning; Multiplication; Multipliers; operand truncation; Power demand; Vector quantization
• ISSN: 2377-3782; 2377-3782; 2377-3790
• DOI: 10.1109/TSUSC.2020.3004980

Approximate computing provides an emerging approach to design high performance and low power arithmetic circuits. The logarithmic multiplier (LM) converts multiplication into addition and has inherent approximate characteristics. In this article, dynamic range approximate LMs (DR-ALMs) for machine learning applications are proposed; they use Mitchell's approximation and a dynamic range operand truncation scheme. The worst case (absolute and relative) errors for the proposed DR-ALMs are analyzed. The accuracy and the hardware overhead of these designs are provided to select the best approximate scheme according to different metrics. The proposed DR-ALMs are compared with the conventional LM with exact operands and previous approximate multipliers; the results show that the power-delay product (PDP) of the best proposed DR-ALM (DR-ALM-6) are decreased by up to 54.07 percent with the mean relative error distance (MRED) decreasing by 21.30 percent compared with 16-bit conventional design. Case studies for three machine learning applications show the viability of the proposed DR-ALMs. Compared with the exact multiplier and its conventional counterpart, the back-propagation classifier with DR-ALMs with a truncation length larger than 4 has a similar classification result for the three datasets; the K-means clustering application with all DR-ALMs has a similar clustering result for four datasets; and the handwritten digit recognition application with DR-ALM-5 or DR-ALM-6 for LeNet-5 achieves similar or even slightly higher recognition rate.