UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Dithen: A Computation-as-a-Service Cloud Platform For Large-Scale Multimedia Processing

Doyle, J; Giotsas, V; Anam, MA; Andreopoulos, Y; (2016) Dithen: A Computation-as-a-Service Cloud Platform For Large-Scale Multimedia Processing. IEEE Transactions on Cloud Computing 10.1109/TCC.2016.2617363. (In press). Green open access

[thumbnail of Dithen_accepted_v24.pdf]
Preview
Text
Dithen_accepted_v24.pdf - Accepted Version

Download (1MB) | Preview

Abstract

We present Dithen, a novel computation-as-a-service (CaaS) cloud platform specifically tailored to the parallel execution of large-scale multimedia tasks. Dithen handles the upload/download of both multimedia data and executable items, the assignment of compute units to multimedia workloads, and the reactive control of the available compute units to minimize the cloud infrastructure cost under deadline-abiding execution. Dithen combines three key properties: (i) the reactive assignment of individual multimedia tasks to available computing units according to availability and predetermined time-to-completion constraints; (ii) optimal resource estimation based on Kalmanfilter estimates; (iii) the use of additive increase multiplicative decrease (AIMD) algorithms (famous for being the resource management in the transport control protocol) for the control of the number of units servicing workloads. The deployment of Dithen over Amazon EC2 spot instances is shown to be capable of processing more than 80,000 video transcoding, face detection and image processing tasks (equivalent to the processing of more than 116 GB of compressed data) for less than $1 in billing cost from EC2. Moreover, the proposed AIMD-based control mechanism, in conjunction with the Kalman estimates, is shown to provide for more than 27% reduction in EC2 spot instance cost against methods based on reactive resource estimation. Finally, Dithen is shown to offer a 38% to 500% reduction of the billing cost against the current state-of-the-art in CaaS platforms on Amazon EC2 (Amazon Lambda and Amazon Autoscale). A baseline version of Dithen is currently available at dithen.com under the “AutoScale” option.

Type: Article
Title: Dithen: A Computation-as-a-Service Cloud Platform For Large-Scale Multimedia Processing
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/TCC.2016.2617363
Publisher version: http://doi.org/10.1109/TCC.2016.2617363
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Cloud computing, Copper, Multimedia communication, Multimedia computing, Estimation, Resource management, Software as a service, computation-as-a-service, big data, multimedia computing, Amazon EC2, spot instances
UCL classification: UCL
UCL > Provost and Vice Provost Offices
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Electronic and Electrical Eng
URI: https://discovery.ucl.ac.uk/id/eprint/1546432
Downloads since deposit
104Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item