Reducing calculation requirements in FPGA implementation of deep learning algorithms for online anomaly intrusion detection

Deep learning algorithms produced impressive results in the image and voice recognition fields. Machine learning approach can be implemented to improve anomaly detection method to detect novel attacks. We use dynamic fixed-point arithmetic to reduce Deep Belief Network (DBN) calculations in an FPGA....

Full description

Saved in:
Bibliographic Details
Published in2017 IEEE National Aerospace and Electronics Conference (NAECON) pp. 57 - 62
Main Authors Alrawashdeh, Khaled, Purdy, Carla
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.06.2017
Subjects
Activation Function
Cyber Security
Data Mining
DBN
Face recognition
FPGA
Google
Intrusion Detection
Machine Learning
Neural Network
Physiology
Psychology
RBM
Sensors
Skin
Stress
Online AccessGet full text

Cover

More Information
Summary:Deep learning algorithms produced impressive results in the image and voice recognition fields. Machine learning approach can be implemented to improve anomaly detection method to detect novel attacks. We use dynamic fixed-point arithmetic to reduce Deep Belief Network (DBN) calculations in an FPGA. We trained a three-layer DBN using contrastive divergence with pipeline structure, fine-tuning the network using a softmax function. Our work using dynamic fixed-point arithmetic and pipeline structure reduced the calculation requirement of the DBN more than 30% compare to the 16-bit implementation. We used the MNIST dataset for evaluation before testing online intrusion detection and achieved accuracy of 94.6% on the NSL-KDD dataset and 95.1% on the HTTP CSIC 2010 dataset. We produced efficient resource utilization and detection speed of .008ms. Our design can be further improved to decrease deep learning resources during training and testing for online intrusion detection in low powered devices.
ISSN:2379-2027
DOI:10.1109/NAECON.2017.8268745