UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

The Oracle Problem in Software Testing: A Survey

Barr, ET; Harman, M; McMinn, P; Shahbaz, M; Yoo, S; (2015) The Oracle Problem in Software Testing: A Survey. IEEE TRANSACTIONS ON SOFTWARE ENGINEERING , 41 (5) pp. 507-525. 10.1109/TSE.2014.2372785. Green open access

[thumbnail of 06963470.pdf]
Preview
Text
06963470.pdf

Download (1MB) | Preview

Abstract

Testing involves examining the behaviour of a system in order to discover potential faults. Given an input for a system, the challenge of distinguishing the corresponding desired, correct behaviour from potentially incorrect behavior is called the “test oracle problem”. Test oracle automation is important to remove a current bottleneck that inhibits greater overall test automation. Without test oracle automation, the human has to determine whether observed behaviour is correct. The literature on test oracles has introduced techniques for oracle automation, including modelling, specifications, contract-driven development and metamorphic testing. When none of these is completely adequate, the final source of test oracle information remains the human, who may be aware of informal specifications, expectations, norms and domain specific information that provide informal oracle guidance. All forms of test oracles, even the humble human, involve challenges of reducing cost and increasing benefit. This paper provides a comprehensive survey of current approaches to the test oracle problem and an analysis of trends in this important area of software testing research and practice.

Type: Article
Title: The Oracle Problem in Software Testing: A Survey
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/TSE.2014.2372785
Publisher version: http://dx.doi.org/10.1109/TSE.2014.2372785
Additional information: This work is licensed under a Creative Commons Attribution 3.0 License. For more information, see http://creativecommons.org/licenses/by/3.0/
Keywords: Test oracle, automatic testing, testing formalism
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/1471263
Downloads since deposit
1,219Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item