Langdon, WB;
Dolado, J;
Sarro, F;
Harman, M;
(2016)
Exact Mean Absolute Error of Baseline Predictor, MARP0.
Information and Software Technology
, 73
pp. 16-18.
10.1016/j.infsof.2016.01.003.
![[thumbnail of 1-s2.0-S0950584916000057-main.pdf]](https://discovery.ucl.ac.uk/style/images/fileicons/text.png) |
Text
1-s2.0-S0950584916000057-main.pdf - Published Version Access restricted to UCL open access staff Download (274kB) |
Abstract
Shepperd and MacDonell ’Evaluating prediction systems in software project estimation’. Information and Software Technology 54 (8), 820–827, 2012, doi:10.1016/j.infsof.2011.12.008, proposed an improved measure of the effectiveness of predictors based on comparing them with random guessing. They suggest estimating the performance of random guessing using a Monte Carlo scheme which unfortunately excludes some correct guesses. This biases their MARP0 to be slightly too big, which in turn causes their standardised accuracy measure SA to over estimate slightly. In commonly used software engineering datasets it is practical to calculate an unbiased MARP0 exactly.
| Type: | Article |
|---|---|
| Title: | Exact Mean Absolute Error of Baseline Predictor, MARP0 |
| DOI: | 10.1016/j.infsof.2016.01.003 |
| Publisher version: | http://dx.doi.org/10.1016/j.infsof.2016.01.003 |
| Language: | English |
| Additional information: | Copyright © 2016 Elsevier B.V. All rights reserved. |
| Keywords: | Software Engineering, prediction systems, empirical validation, randomisation techniques, Search Based Software Engineering |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/1476203 |
Archive Staff Only
 |
View Item |
