Blackwell, Dan;
Petke, Justyna;
Cao, Yazhuo;
Bensoussan, Avner;
(2024)
Fuzzing-Based Differential Testing For Quantum Simulators.
In: Jahangirova, Gunel and Khomh, Foutse, (eds.)
International Symposium on Search Based Software Engineering.
(pp. pp. 63-69).
Springer Cham: Porto de Galinhas, Brazil, Brazil.
![[thumbnail of main.pdf]](https://discovery.ucl.ac.uk/style/images/fileicons/text.png) |
Text
main.pdf - Accepted Version Access restricted to UCL open access staff until 3 July 2025. Download (308kB) |
Abstract
Quantum programs are hard to develop and test due to their probabilistic nature and the restricted availability of quantum computers. Quantum simulators have thus been introduced to help software developers. There are, however, no formal proofs that these simulators behave in exactly the way that real quantum hardware does, which could lead to errors in their implementation. Here we propose to use a search-based technique, grammar-based fuzzing, to generate syntactically valid quantum programs, and use differential testing to search for inconsistent behaviour between selected quantum simulators. We tested our approach on three simulators: Braket, Quantastica, and Qiskit. Overall, we generated and ran over 400k testcases, 2,327 of which found new coverage, and 292 of which caused crashes, hangs or divergent behaviour. Our analysis revealed 4 classes of bugs, including a bug in the OpenQASM 3 stdgates.inc standard gates library, affecting all the simulators. All but one of the bugs reported to the developers have been already fixed by them, while the remaining bug has been acknowledged as a true bug.
| Type: | Proceedings paper |
|---|---|
| Title: | Fuzzing-Based Differential Testing For Quantum Simulators |
| Event: | SSBSE 2024: Symposium on Search-Based Software Engineering - Challenge Track |
| Location: | Porto de Galinhas, Brazil, Brazil |
| ISBN-13: | 978-3-031-64572-3 |
| DOI: | 10.1007/978-3-031-64573-0_6 |
| Publisher version: | https://doi.org/10.1007/978-3-031-64573-0_6 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Differential Testing, Fuzzing, Quantum Simulators |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10192701 |
Loading...
Loading...Loading...Loading...Archive Staff Only
 |
View Item |
