Ye, He;
(2025)
AdverIntent-Agent: Adversarial Reasoning for Repair Based on Inferred Program Intent.
In:
Proceedings of the ACM on Software Engineering, Volume 2, Issue ISSTA.
(pp. pp. 1398-1420).
ACM
Preview |
PDF
3728939.pdf - Published Version Download (916kB) | Preview |
Abstract
Automated program repair (APR) has shown promising results, particularly with the use of neural networks. Currently, most APR tools focus on code transformations specified by test suites, rather than reasoning about the program’s intent and the high-level bug specification. Without a proper understanding of program intent, these tools tend to generate patches that overfit incomplete test suites and fail to reflect the developer’s intentions. However, reasoning about program intent is challenging. In our work, we propose an approach called AdverIntent-Agent, based on critique and adversarial reasoning. Our approach is novel to shift the focus from generating multiple APR patches to inferring multiple potential program intents. Ideally, we aim to infer intents that are, to some extent, adversarial to each other, maximizing the probability that at least one aligns closely with the developer’s original intent. AdverIntent-Agent is a multi-agent approach consisting of three agents: a reasoning agent, a test agent, and a repair agent. First, the reasoning agent generates adversarial program intents along with the corresponding faulty statements. Next, the test agent produces adversarial test cases that align with each inferred intent, constructing oracles that use the same inputs but have different expected outputs. Finally, the repair agent uses dynamic and precise LLM prompts to generate patches that satisfy both the inferred program intent and the generated tests. AdverIntent-Agent was evaluated on two benchmarks: Defects4J 2.0 and HumanEval-Java. AdverIntentAgent correctly repaired 77 and 105 bugs in both benchmarks, respectively. Our work helps reduce the effort required to review patches by enabling developers to assess program intent in natural language, rather than reviewing code patches.
| Type: | Proceedings paper |
|---|---|
| Title: | AdverIntent-Agent: Adversarial Reasoning for Repair Based on Inferred Program Intent |
| Event: | The ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1145/3728939 |
| Publisher version: | https://doi.org/10.1145/3728939 |
| Language: | English |
| Additional information: | This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10216689 |
Archive Staff Only
 |
View Item |
