UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Codeflaws: A Programming Competition Benchmark for Evaluating Automated Program Repair Tools

Tan, Shin Hwei; Yi, Jooyong; Yulis; Mechtaev, Sergey; Roychoudhury, Abhik; (2017) Codeflaws: A Programming Competition Benchmark for Evaluating Automated Program Repair Tools. In: Uchitel, Sebastián and Orso, Alessandro and Robillard, Martin P, (eds.) Proceedings of the 2017 IEEE-ACM 39th International Conference on Software Engineering Companion (ICSE-C 2017). (pp. pp. 180-182). IEEE: Buenos Aires, Argentina. Green open access

[thumbnail of postercameraready.pdf]
Preview
Text
postercameraready.pdf - Accepted Version

Download (65kB) | Preview

Abstract

Several automated program repair techniques have been proposed to reduce the time and effort spent in bug-fixing. While these repair tools are designed to be generic such that they could address many software faults, different repair tools may fix certain types of faults more effectively than other tools. Therefore, it is important to compare more objectively the effectiveness of different repair tools on various fault types. However, existing benchmarks on automated program repairs do not allow thorough investigation of the relationship between fault types and the effectiveness of repair tools. We present Codeflaws, a set of 3902 defects from 7436 programs automatically classified across 39 defect classes (we refer to different types of fault as defect classes derived from the syntactic differences between a buggy program and a patched program).

Type: Proceedings paper
Title: Codeflaws: A Programming Competition Benchmark for Evaluating Automated Program Repair Tools
Event: IEEE/ACM 39th International Conference on Software Engineering Companion (ICSE-C)
Location: Buenos Aires, ARGENTINA
Dates: 20 May 2017 - 28 May 2017
ISBN-13: 9781538615898
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/ICSE-C.2017.76
Publisher version: https://doi.org/10.1109/ICSE-C.2017.76
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Science & Technology, Technology, Computer Science, Software Engineering, Engineering, Electrical & Electronic, Computer Science, Engineering, automated program repair, defect classes, empirical evaluation, benchmark
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10184115
Downloads since deposit
104Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item