Estimation of energy consumption in machine learning

• Published in: Journal of parallel and distributed computing Vol. 134; pp. 75 - 88
• Main Authors: García-Martín, Eva, Rodrigues, Crefeda Faviola, Riley, Graham, Grahn, Håkan
• Format: Journal Article
• Language: English
• Published: Elsevier Inc 01.12.2019
• Subjects: Deep learning; Energy consumption; Green AI; GreenAI; High performance computing; Machine learning; Deep learning; Energy consumption; GreenAI; High performance computing; Machine learning
• ISSN: 0743-7315; 1096-0848; 1096-0848
• DOI: 10.1016/j.jpdc.2019.07.007

Energy consumption has been widely studied in the computer architecture field for decades. While the adoption of energy as a metric in machine learning is emerging, the majority of research is still primarily focused on obtaining high levels of accuracy without any computational constraint. We believe that one of the reasons for this lack of interest is due to their lack of familiarity with approaches to evaluate energy consumption. To address this challenge, we present a review of the different approaches to estimate energy consumption in general and machine learning applications in particular. Our goal is to provide useful guidelines to the machine learning community giving them the fundamental knowledge to use and build specific energy estimation methods for machine learning algorithms. We also present the latest software tools that give energy estimation values, together with two use cases that enhance the study of energy consumption in machine learning. •Literature review of energy estimation methods from computer architecture for machine learning applications.•State-of-the-art approaches to estimate energy consumption in machine learning.•Software tools from the power and performance monitoring field and their applicability to machine learning.•Two use cases to estimate energy consumption for deep learning and data mining.