Sarro, F;
Moussa, R;
Petrozziello, A;
Harman, M;
(2020)
Learning From Mistakes: Machine Learning Enhanced Human Expert Effort Estimates.
IEEE Transaction of Software Engineering
10.1109/TSE.2020.3040793.
(In press).
Preview |
Text
TSE2020_LFM.pdf - Accepted Version Download (4MB) | Preview |
Abstract
In this paper, we introduce a novel approach to predictive modeling for software engineering, named Learning From Mistakes (LFM). The core idea underlying our proposal is to automatically learn from past estimation errors made by human experts, in order to predict the characteristics of their future misestimates, therefore resulting in improved future estimates. We show the feasibility of LFM by investigating whether it is possible to predict the type, severity and magnitude of errors made by human experts when estimating the development effort of software projects, and whether it is possible to use these predictions to enhance future estimations. To this end we conduct a thorough empirical study investigating 402 maintenance and new development industrial software projects. The results of our study reveal that the type, severity and magnitude of errors are all, indeed, predictable. Moreover, we find that by exploiting these predictions, we can obtain significantly better estimates than those provided by random guessing, human experts and traditional machine learners in 31 out of the 36 cases considered (86%), with large and very large effect sizes in the majority of these cases (81%). This empirical evidence opens the door to the development of techniques that use the power of machine learning, coupled with the observation that human errors are predictable, to support engineers in estimation tasks rather than replacing them with machine-provided estimates.
| Type: | Article |
|---|---|
| Title: | Learning From Mistakes: Machine Learning Enhanced Human Expert Effort Estimates |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/TSE.2020.3040793 |
| Publisher version: | https://doi.org/10.1109/TSE.2020.3040793 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10115618 |
Loading...
Loading...Loading...Loading...Archive Staff Only
 |
View Item |
