UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Improving Performance Estimation for Design Space Exploration for Convolutional Neural Network Accelerators

Ferianc, Martin; Fan, Hongxiang; Manocha, Divyansh; Zhou, Hongyu; Liu, Shuanglong; Niu, Xinyu; Luk, Wayne; (2021) Improving Performance Estimation for Design Space Exploration for Convolutional Neural Network Accelerators. Electronics , 10 (4) , Article 520. 10.3390/electronics10040520. Green open access

[thumbnail of electronics-10-00520-v4.pdf]
Preview
Text
electronics-10-00520-v4.pdf - Published Version

Download (481kB) | Preview

Abstract

Contemporary advances in neural networks (NNs) have demonstrated their potential in different applications such as in image classification, object detection or natural language processing. In particular, reconfigurable accelerators have been widely used for the acceleration of NNs due to their reconfigurability and efficiency in specific application instances. To determine the configuration of the accelerator, it is necessary to conduct design space exploration to optimize the performance. However, the process of design space exploration is time consuming because of the slow performance evaluation for different configurations. Therefore, there is a demand for an accurate and fast performance prediction method to speed up design space exploration. This work introduces a novel method for fast and accurate estimation of different metrics that are of importance when performing design space exploration. The method is based on a Gaussian process regression model parametrised by the features of the accelerator and the target NN to be accelerated. We evaluate the proposed method together with other popular machine learning based methods in estimating the latency and energy consumption of our implemented accelerator on two different hardware platforms targeting convolutional neural networks. We demonstrate improvements in estimation accuracy, without the need for significant implementation effort or tuning.

Type: Article
Title: Improving Performance Estimation for Design Space Exploration for Convolutional Neural Network Accelerators
Open access status: An open access version is available from UCL Discovery
DOI: 10.3390/electronics10040520
Publisher version: https://doi.org/10.3390/electronics10040520
Language: English
Additional information: Copyright: © 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https:// creativecommons.org/licenses/by/ 4.0/).
Keywords: field-programmable gate array; deep learning; neural network; performance estimation; Gaussian process
UCL classification: UCL > Provost and Vice Provost Offices > UCL SLASH > Faculty of Arts and Humanities
UCL > Provost and Vice Provost Offices > UCL SLASH > Faculty of Arts and Humanities > Dept of Information Studies
UCL > Provost and Vice Provost Offices > UCL SLASH
UCL
URI: https://discovery.ucl.ac.uk/id/eprint/10150068
Downloads since deposit
25Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item