The Fault in our Stars: Quality Assessment of Code Generation Benchmarks - Siddiq, Mohammed Latif; Dristi, Simantika; Saha, Joy; Santos, Joanna C. S. (Proceedings / IEEE International Working Conference on Source Code Analysis and Manipulation, 2024)
Keywords: Benchmark testing; benchmarks; code generation; Codes; Contamination; data contamination; data quality; Documentation; Java; Large language models; Python; Quality assessment; Software; Source coding