Activation-Based Pruning of Neural Networks

• Published in: Algorithms Vol. 17; no. 1; p. 48
• Main Authors: Ganguli, Tushar, Chong, Edwin K. P.
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01.01.2024
• Subjects: Accuracy; Approximation; Artificial neural networks; computer vision; Decomposition; dimensionality reduction; Empirical analysis; machine learning; Methods; network pruning; Neural networks; Neurons; Principal components analysis; Pruning; Reduction; Regularization; Sparsity

We present a novel technique for pruning called activation-based pruning to effectively prune fully connected feedforward neural networks for multi-object classification. Our technique is based on the number of times each neuron is activated during model training. We compare the performance of activ...