CD-VulD: Cross-Domain Vulnerability Discovery Based on Deep Domain Adaptation

• Published in: IEEE transactions on dependable and secure computing Vol. 19; no. 1; pp. 438 - 451
• Main Authors: Liu, Shigang, Lin, Guanjun, Qu, Lizhen, Zhang, Jun, De Vel, Olivier, Montague, Paul, Xiang, Yang
• Format: Journal Article
• Language: English
• Published: Washington IEEE 01.01.2022; IEEE Computer Society
• Subjects: Adaptation; Cross-domain; Cybersecurity; Data models; Deep learning; domain adaptation; Domains; Machine learning; Prediction models; Predictive models; Representations; Security; Software; Training; Training data; vulnerability detection/discovery
• ISSN: 1545-5971; 1941-0018
• DOI: 10.1109/TDSC.2020.2984505

A major cause of security incidents such as cyber attacks is rooted in software vulnerabilities. These vulnerabilities should ideally be found and fixed before the code gets deployed. Machine learning-based approaches achieve state-of-the-art performance in capturing vulnerabilities. These methods are predominantly supervised. Their prediction models are trained on a set of ground truth data where the training data and test data are assumed to be drawn from the same probability distribution. However, in practice, the test data often differs from the training data in terms of distribution because they are from different projects or they differ in the types of vulnerability. In this article, we present a new system for C ross D omain Software Vul nerability D iscovery ( CD-VulD ) using deep learning (DL) and domain adaptation (DA). We employ DL because it has the capacity of automatically constructing high-level abstract feature representations of programs, which are likely of more cross-domain useful than the handcrafted features driven by domain knowledge. The divergence between distributions is reduced by learning cross-domain representations. First, given software program representations, CD-VulD converts them into token sequences and learns the token embeddings for generalization across tokens. Next, CD-VulD employs a deep feature model to build abstract high-level presentations based on those sequences. Then, the metric transfer learning framework (MTLF) technique is employed to learn cross-domain representations by minimizing the distribution divergence between the source domain and the target domain. Finally, the cross-domain representations are used to build a classifier for vulnerability detection. Experimental results show that CD-VulD outperforms the state-of-the-art vulnerability detection approaches by a wide margin. We make the new datasets publicly available so that our work is replicable and can be further improved.