Jahangirova, G; Clark, D; Harman, M; Tonella, P; (2016) Test oracle assessment and improvement. In: Zeller, A and Roychoudhury, A, (eds.) ISSTA 2016: Proceedings of the 25th International Symposium on Software Testing and Analysis. (pp. pp. 247-258). Association for Computing Machinery (ACM): New York, NY, USA.

Preview

Text main.pdf - Published Version Download (400kB) | Preview

Abstract

We introduce a technique for assessing and improving test oracles by reducing the incidence of both false positives and false negatives. We prove that our approach can always result in an increase in the mutual information between the actual and perfect oracles. Our technique combines test case generation to reveal false positives and mutation testing to reveal false negatives. We applied the decision support tool that implements our oracle improvement technique to five real-world subjects. The experimental results show that the fault detection rate of the oracles after improvement increases, on average, by 48.6% (86% over the implicit oracle). Three actual, exposed faults in the studied systems were subsequently confirmed and fixed by the developers.

Download activity - last month

Export as XMLJSONCSV

Download activity - last 12 months

Export as JSONXMLCSV

Downloads by country - last 12 months

Export as CSVJSONXML

Archive Staff Only

View Item