E-DARTS: Enhanced Differentiable Architecture Search for Acoustic Scene Classification

• Published in: 2021 16th International Conference on Computer Engineering and Systems (ICCES) pp. 1 - 6
• Main Authors: Hasan, Noha W., Saudi, Ali S., Khalil, Mahmoud I., Abbas, Hazem M.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 15.12.2021
• Subjects: Acoustic scene classification (ASC); Acoustics; Computer architecture; convolutional neural networks (CNNs); Costs; Differentiable Neural Architecture Search (DNAS); DNA; Graphics processing units; Machine learning; Neural networks
• DOI: 10.1109/ICCES54031.2021.9686092

Neural architecture search (NAS) has attracted a lot of attention in recent years due to the growing interest in automating the neural architecture design. Recently, Differentiable Architecture Search (DARTS) has achieved promising results on the image classification task with a significantly reduced search cost to only a few GPU days. Specifically, DARTS relaxed the search space to be continuous and thus allowing the architecture to be optimized with gradient descent, where a set of simple candidate operations were used to construct the searched network. However, in our experiments, original DARTS achieved a limited classification accuracy of 50.45 ± 2.34% on the acoustic scene classification (ASC) dataset of DCASE2020 Task lA. In this work, we propose an enhanced version of DARTS, namely Enhanced-DARTS (E-DARTS), which uses residual and squeeze-excitation blocks to build more complex networks with DARTS. The aforementioned blocks were used as candidate operations for the super-network in addition to the convolutional and pooling layers used in original DARTS. The proposed approach has achieved a significantly improved classification accuracy of 64.57 ± 0.87% on the same dataset.