Liu, Kaibo;
Han, Yudong;
Liu, Yiyang;
Zhang, Jie M;
Chen, Zhenpeng;
Sarro, Federica;
Huang, Gang;
(2024)
TrickyBugs: A Dataset of Corner-case Bugs in Plausible Programs.
In:
MSR '24: Proceedings of the 21st International Conference on Mining Software Repositories.
(pp. pp. 113-117).
ACM
Preview |
Text
Sarro_3643991.3644870.pdf Download (541kB) | Preview |
Abstract
We call a program that passes existing tests but still contains bugs as a buggy plausible program. Bugs in such a program can bypass the testing environment and enter the production environment, causing unpredictable consequences. Therefore, discovering and fixing such bugs is a fundamental and critical problem. However, no existing bug dataset is purposed to collect this kind of bug, posing significant obstacles to relevant research. To address this gap, we introduce TrickyBugs, a bug dataset with 3,043 buggy plausible programs sourced from human-written submissions of 324 real-world competition coding tasks. We identified the buggy plausible programs from approximately 400,000 submissions, and all the bugs in TrickyBugs were not previously detected. We hope that TrickyBugs can effectively facilitate research in the fields of automated program repair, fault localization, test generation, and test adequacy.CCS CONCEPTS•Software and its engineering → Software testing and debugging.
| Type: | Proceedings paper |
|---|---|
| Title: | TrickyBugs: A Dataset of Corner-case Bugs in Plausible Programs |
| Event: | IEEE/ACM 21st International Conference on Mining Software Repositories (MSR) |
| Location: | PORTUGAL, Lisbon |
| Dates: | 15 Apr 2024 - 16 Apr 2024 |
| ISBN-13: | 979-8-3503-6398-2 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1145/3643991.3644870 |
| Publisher version: | https://doi.org/10.1145/3643991.3644870 |
| Language: | English |
| Additional information: | This work is licensed under a Creative Commons Attribution International 4.0 License. |
| Keywords: | Science & Technology, Technology, Computer Science, Artificial Intelligence, Computer Science, Software Engineering, Computer Science, Theory & Methods, Computer Science, software testing, test generation, test adequacy, program repair, benchmark |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10205139 |
Loading...
Loading...Loading...Loading...Archive Staff Only
 |
View Item |
