Trends in AI inference energy consumption: Beyond the performance-vs-parameter laws of deep learning

• Published in: Sustainable computing informatics and systems Vol. 38; p. 100857
• Main Authors: Desislavov, Radosvet, Martínez-Plumed, Fernando, Hernández-Orallo, José
• Format: Journal Article
• Language: English
• Published: Elsevier Inc 01.04.2023
• Subjects: AI progress; Artificial Intelligence; Deep learning; Energy consumption; Inference; Performance analysis; Performance evaluation; Deep learning; Performance evaluation; AI progress; Energy consumption; Artificial Intelligence; Inference; Performance analysis

The progress of some AI paradigms such as deep learning is said to be linked to an exponential growth in the number of parameters. There are many studies corroborating these trends, but does this translate into an exponential increase in energy consumption? In order to answer this question we focus...