TerzoN: Human-in-the-Loop Software Testing with a Composite Oracle

• Published in: Proceedings of the ACM on software engineering Vol. 2; no. FSE; pp. 1983 - 2005
• Main Authors: Davis, Matthew C., Wei, Amy, Myers, Brad A., Sunshine, Joshua
• Format: Journal Article
• Language: English
• Published: New York, NY, USA ACM 19.06.2025
• Subjects: Human-centered computing; Software and its engineering; Software testing and debugging; User studies; Empirical software engineering; software testing; usable testing; user study; experiments; automatic test generation; composite oracle; human subjects

Software testing is difficult, tedious, and may consume 28%–50% of software engineering labor. Automatic test generators aim to ease this burden but have important trade-offs. Fuzzers use an implicit oracle that can detect obviously invalid results, but the oracle problem has no general solution, an...