Ferianc, Martin;
Fan, Hongxiang;
Manocha, Divyansh;
Zhou, Hongyu;
Liu, Shuanglong;
Niu, Xinyu;
Luk, Wayne;
(2021)
Improving Performance Estimation for Design Space Exploration for Convolutional Neural Network Accelerators.
Electronics
, 10
(4)
, Article 520. 10.3390/electronics10040520.
Preview |
Text
electronics-10-00520-v4.pdf - Published Version Download (481kB) | Preview |
Abstract
Contemporary advances in neural networks (NNs) have demonstrated their potential in different applications such as in image classification, object detection or natural language processing. In particular, reconfigurable accelerators have been widely used for the acceleration of NNs due to their reconfigurability and efficiency in specific application instances. To determine the configuration of the accelerator, it is necessary to conduct design space exploration to optimize the performance. However, the process of design space exploration is time consuming because of the slow performance evaluation for different configurations. Therefore, there is a demand for an accurate and fast performance prediction method to speed up design space exploration. This work introduces a novel method for fast and accurate estimation of different metrics that are of importance when performing design space exploration. The method is based on a Gaussian process regression model parametrised by the features of the accelerator and the target NN to be accelerated. We evaluate the proposed method together with other popular machine learning based methods in estimating the latency and energy consumption of our implemented accelerator on two different hardware platforms targeting convolutional neural networks. We demonstrate improvements in estimation accuracy, without the need for significant implementation effort or tuning.
Type: | Article |
---|---|
Title: | Improving Performance Estimation for Design Space Exploration for Convolutional Neural Network Accelerators |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.3390/electronics10040520 |
Publisher version: | https://doi.org/10.3390/electronics10040520 |
Language: | English |
Additional information: | Copyright: © 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https:// creativecommons.org/licenses/by/ 4.0/). |
Keywords: | field-programmable gate array; deep learning; neural network; performance estimation; Gaussian process |
UCL classification: | UCL > Provost and Vice Provost Offices > UCL SLASH > Faculty of Arts and Humanities UCL > Provost and Vice Provost Offices > UCL SLASH > Faculty of Arts and Humanities > Dept of Information Studies UCL > Provost and Vice Provost Offices > UCL SLASH UCL |
URI: | https://discovery.ucl.ac.uk/id/eprint/10150068 |
Archive Staff Only
View Item |