Property-Based Mutation Testing

Ezio Bartocci, Leonardo Mariani, Dejan Nickovic, Drishti Yadav (Speaker)

Research output: Chapter in Book or Conference ProceedingsConference Proceedings with Oral Presentationpeer-review


Mutation testing is an established software quality assurance technique for the assessment of test suites. While it is well-suited to estimate the general fault-revealing capability of a test suite, it is not practical and informative when the software under test must be validated against specific requirements. This is often the case for embedded software, where the software is typically validated against rigorously-specified safety properties. In such a scenario (i) a mutant is relevant only if it can impact the satisfaction of the tested properties, and (ii) a mutant is meaningfully-killed with respect to a property only if it causes the violation of that property. To address these limitations of mutation testing, we introduce property-based mutation testing, a method for assessing the capability of a test suite to exercise the software with respect to a given property. We evaluate our property-based mutation testing framework on Simulink models of safety-critical Cyber-Physical Systems (CPS) from the automotive and avionic domains and demonstrate how property-based mutation testing is more informative than regular mutation testing. These results open new perspectives in both mutation testing and test case generation of CPS.
Original languageEnglish
Title of host publicationIEEE Conference on Software Testing, Verification and Validation, ICST 2023, Dublin, Ireland, April 16-20, 2023
ISBN (Electronic)978-1-6654-5667-8
Publication statusPublished - 30 Apr 2023
Event2023 IEEE Conference on Software Testing, Verification and Validation (ICST) - Dublin, Dublin, Ireland
Duration: 16 Apr 202320 Apr 2023


Conference2023 IEEE Conference on Software Testing, Verification and Validation (ICST)

Research Field

  • Dependable Systems Engineering


Dive into the research topics of 'Property-Based Mutation Testing'. Together they form a unique fingerprint.

Cite this