On the Effectiveness of Contracts as Test Oracles in the Detection and Diagnosis of Functional Faults in Concurrent Object-Oriented Software

Design by contract (DbC) is a software development methodology that focuses on clearly defining the interfaces between components to produce better quality object-oriented software. Though there exists ample support for DbC for sequential programs, applying DbC to concurrent programs presents severa...

Full description

Saved in:
Bibliographic Details
Published inIEEE transactions on software engineering Vol. 40; no. 10; pp. 971 - 992
Main Authors Araujo, Wladimir, Briand, Lionel C., Labiche, Yvan
Format Journal Article
LanguageEnglish
Published New York IEEE 01.10.2014
IEEE Computer Society
Subjects
Concurrent computing
Concurrent engineering
Contracts
Effectiveness studies
Fault diagnosis
Interference
Java
Message systems
Object oriented programming
Programming
Software
Software engineering
Software Quality/SQA¿Measurement applied to SQA and V&V
object-oriented programming
Software/Program Verification¿Programming by contract
Concurrent programming
Online AccessGet full text

Cover

More Information
Summary:Design by contract (DbC) is a software development methodology that focuses on clearly defining the interfaces between components to produce better quality object-oriented software. Though there exists ample support for DbC for sequential programs, applying DbC to concurrent programs presents several challenges. Using Java as the target programming language, we tackle such challenges by augmenting the Java Modelling Language (JML) and modifying the JML compiler (jmlc) to generate runtime assertion checking code to support DbC in concurrent programs. We applied our solution in a carefully designed case study on a highly concurrent industrial software system from the telecommunications domain to assess the effectiveness of contracts as test oracles in detecting and diagnosing functional faults in concurrent software. Based on these results, clear and objective requirements are defined for contracts to be effective test oracles for concurrent programs whilst balancing the effort to design them. Effort is measured indirectly through the contract complexity measure (CCM), a measure we define. Main results include that contracts of a realistic level of completeness and complexity can detect around 76 percent of faults and reduce the diagnosis effort for such faults tenfold. We, therefore, show that DbC can be applied to concurrent software and can be a valuable tool to improve the economics of software engineering.
ISSN:0098-5589
1939-3520
DOI:10.1109/TSE.2014.2339829