UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Enhancing Energy-Awareness in Deep Learning through Fine-Grained Energy Measurement

Rajput, Saurabhsingh; Widmayer, Tim; Shang, Ziyuan; Kechagia, Maria; Sarro, Federica; Sharma, Tushar; (2024) Enhancing Energy-Awareness in Deep Learning through Fine-Grained Energy Measurement. ACM Transactions on Software Engineering and Methodology 10.1145/3680470. (In press). Green open access

[thumbnail of 3680470 (1).pdf]
Preview
Text
3680470 (1).pdf - Accepted Version

Download (52MB) | Preview

Abstract

With the increasing usage, scale, and complexity of Deep Learning (DL) models, their rapidly growing energy consumption has become a critical concern. Promoting green development and energy awareness at different granularities is the need of the hour to limit carbon emissions of dl systems. However, the lack of standard and repeatable tools to accurately measure and optimize energy consumption at fine granularity (e.g., at the API level) hinders progress in this area. This paper introduces FECoM (Fine-grained Energy Consumption Meter), a framework for fine-grained DL energy consumption measurement. FECoM enables researchers and developers to profile DL APIS from energy perspective. FECoM addresses the challenges of fine-grained energy measurement using static instrumentation while considering factors such as computational load and temperature stability. We assess FECoM’s capability for fine-grained energy measurement for one of the most popular open-source DL frameworks, namely TENSORFLOW. Using FECoM, we also investigate the impact of parameter size and execution time on energy consumption, enriching our understanding of TENSORFLOW APIS’ energy profiles. Furthermore, we elaborate on the considerations and challenges while designing and implementing a fine-grained energy measurement tool. This work will facilitate further advances in dl energy measurement and the development of energy-aware practices for DL systems.

Type: Article
Title: Enhancing Energy-Awareness in Deep Learning through Fine-Grained Energy Measurement
Open access status: An open access version is available from UCL Discovery
DOI: 10.1145/3680470
Publisher version: https://doi.org/10.1145/3680470
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Energy measurement, Green Artificial Intelligence, Fine-grained energy measurement
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10195363
Downloads since deposit
Loading...
13Downloads
Download activity - last month
Loading...
Download activity - last 12 months
Loading...
Downloads by country - last 12 months
1.United States
3
2.United Kingdom
2
3.India
2
4.China
2
5.Pakistan
1
6.Finland
1
7.Germany
1
8.Singapore
1

Archive Staff Only

View Item View Item