Correctness attraction: a study of stability of software behavior under runtime perturbation
2018 (English)In: Empirical Software Engineering, ISSN 1382-3256, E-ISSN 1573-7616, Vol. 23, no 4, p. 2086-2119Article in journal (Refereed) Published
Abstract [en]
Can the execution of software be perturbed without breaking the correctness of the output? In this paper, we devise a protocol to answer this question from a novel perspective. In an experimental study, we observe that many perturbations do not break the correctness in ten subject programs. We call this phenomenon “correctness attraction”. The uniqueness of this protocol is that it considers a systematic exploration of the perturbation space as well as perfect oracles to determine the correctness of the output. To this extent, our findings on the stability of software under execution perturbations have a level of validity that has never been reported before in the scarce related work. A qualitative manual analysis enables us to set up the first taxonomy ever of the reasons behind correctness attraction.
Place, publisher, year, edition, pages
Springer, 2018. Vol. 23, no 4, p. 2086-2119
Keywords [en]
Perturbation analysis; Software correctness; Empirical study
National Category
Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
URN: urn:nbn:se:kth:diva-240079DOI: 10.1007/s10664-017-9571-8ISI: 000435804100008Scopus ID: 2-s2.0-85038623794OAI: oai:DiVA.org:kth-240079DiVA, id: diva2:1269676
Funder
Wallenberg AI, Autonomous Systems and Software Program (WASP)Swedish Foundation for Strategic Research , Trustfull
Note
QC 20181211
2018-12-112018-12-112022-12-07Bibliographically approved