Integrating Extractive and Abstractive Models for Code Comment Generation

• Published in: 2023 IEEE 23rd International Conference on Software Quality, Reliability, and Security (QRS) pp. 184 - 195
• Main Authors: Sun, Weisong, Hu, Yuling, Xu, Yingfei, Chen, Yuchen, Fang, Chunrong
• Format: Conference Proceeding
• Language: English
• Published: IEEE 22.10.2023
• Subjects: Analytical models; Code Comment Generation; Code Summarization; Codes; Computer languages; Deep Learning; Latent Semantic Analysis; Semantics; Software quality; Source coding; Text Summarization; Writing
• ISSN: 2693-9177
• DOI: 10.1109/QRS60937.2023.00027

Code comments play an essential role in aiding developers understand and maintain source code. Current code comment generation techniques can be classified into categories: extractive methods and abstractive methods. Extractive methods use text retrieval techniques to extract important code tokens to constitute comments. Such comments contain important factual details articulated explicitly in code tokens, but are poor in naturalness. Abstractive methods usually regard code comment generation as a neural machine translation task. By leveraging powerful deep learning-based language models, abstractive methods can generate comments that resemble human writing. However, compared with natural language, programming language code is more complex. Comments generated by abstractive methods often leave out important factual details. In this paper, we propose a novel method for code comment generation by integrating extractive and abstractive models. Our extractive model is built on the Latent Semantic Analysis (LSA) model, effectively extracting important factual details in code snippets. Meanwhile, our abstractive model is built on a deep learning-based encoder-decoder model, enabling it to generate concise and human-written-like comments. We evaluate the effectiveness of our method, called ICS, by conducting extensive experiments on the CodeSearchNet dataset involving six programming languages. The results demonstrate that ICS outperforms state-of-the-art techniques in three widely used metrics: BLEU, METEOR, and ROUGE-L. Moreover, the outcomes of the human evaluation indicate that the comments generated by ICS exhibit superior naturalness and informativeness, and closely align with the provided code snippets.