Alshahwan, Nadia;
Harman, Mark;
Marginean, Alexandru;
Tal, Rotem;
Wang, Eddy;
(2024)
Observation-Based Unit Test Generation at Meta.
In: D'Amorim, M, (ed.)
Companion Proceedings of the 32nd ACM International Conference on the Foundations of Software Engineering.
(pp. pp. 173-184).
ACM
Preview |
Text
RPS2.pdf - Accepted Version Download (992kB) | Preview |
Abstract
TestGen automatically generates unit tests, carved from serialized observations of complex objects, observed during app execution. We describe the development and deployment of TestGen at Meta. In particular, we focus on the scalability challenges overcome during development in order to deploy observation-based test carving at scale in industry. So far, TestGen has landed 518 tests into production, which have been executed 9,617,349 times in continuous integration, finding 5,702 faults. Meta is currently in the process of more widespread deployment. Our evaluation reveals that, when carving its observations from 4,361 reliable end-to-end tests, TestGen was able to generate tests for at least 86% of the classes covered by end-to-end tests. Testing on 16 Kotlin Instagram app-launch-blocking tasks demonstrated that the TestGen tests would have trapped 13 of these before they became launch blocking.
| Type: | Proceedings paper |
|---|---|
| Title: | Observation-Based Unit Test Generation at Meta |
| Event: | 32nd ACM International Conference on the Foundations of Software Engineering (FSE) |
| Location: | BRAZIL, Porto de Galinhas |
| Dates: | 15 Jul 2024 - 19 Jul 2024 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1145/3663529.3663838 |
| Publisher version: | https://doi.org/10.1145/3663529.3663838 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Automated test generation, unit testing, test carving |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10199774 |
Loading...
Loading...Loading...Loading...Archive Staff Only
 |
View Item |
