Ahlgren, J;
Berezin, M;
Bojarczuk, K;
Dulskyte, E;
Dvortsova, I;
George, J;
Gucevska, N;
... Spahr-Summers, J; + view all
(2021)
Testing web enabled simulation at scale using metamorphic testing.
In:
Proceedings of the IEEE/ACM 43rd International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) 2021.
(pp. pp. 140-149).
The Institute of Electrical and Electronics Engineers (IEEE)
Preview |
Text
SEIP21.pdf - Accepted Version Download (1MB) | Preview |
Abstract
We report on Facebook's deployment of MIA (Metamorphic Interaction Automaton). MIA is used to test Facebook's Web Enabled Simulation, built on a web infrastructure of hundreds of millions of lines of code. MIA tackles the twin problems of test flakiness and the unknowable oracle problem. It uses metamorphic testing to automate continuous integration and regression test execution. MIA also plays the role of a test bot, automatically commenting on all relevant changes submitted for code review. It currently uses a suite of over 40 metamorphic test cases. Even at this extreme scale, a non-trivial metamorphic test suite subset yields outcomes within 20 minutes (sufficient for continuous integration and review processes). Furthermore, our offline mode simulation reduces test flakiness from approximately 50% (of all online tests) to 0% (offline). Metamorphic testing has been widely-studied for 22 years. This paper is the first reported deployment into an industrial continuous integration system.
| Type: | Proceedings paper |
|---|---|
| Title: | Testing web enabled simulation at scale using metamorphic testing |
| Event: | The 43rd International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) |
| ISBN-13: | 978-1-6654-3869-8 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/ICSE-SEIP52600.2021.00023 |
| Publisher version: | https://doi.org/10.1109/ICSE-SEIP52600.2021.00023 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher's terms and conditions. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10139790 |
Archive Staff Only
 |
View Item |
