Scalable Reinforcement Learning-based Neural Architecture Search

In this publication, we assess the ability of a novel Reinforcement Learning-based solution to the problem of Neural Architecture Search, where a Reinforcement Learning (RL) agent learns to search for good architectures, rather than to return a single optimal architecture. We consider both the NAS-B...

Full description

Saved in:
Bibliographic Details
Main Authors Cassimon, Amber, Mercelis, Siegfried, Mets, Kevin
Format Journal Article
LanguageEnglish
Published 02.10.2024
Subjects
Computer Science - Learning
Online AccessGet full text

Cover

More Information
Summary:In this publication, we assess the ability of a novel Reinforcement Learning-based solution to the problem of Neural Architecture Search, where a Reinforcement Learning (RL) agent learns to search for good architectures, rather than to return a single optimal architecture. We consider both the NAS-Bench-101 and NAS- Bench-301 settings, and compare against various known strong baselines, such as local search and random search. We conclude that our Reinforcement Learning agent displays strong scalability with regards to the size of the search space, but limited robustness to hyperparameter changes.
DOI:10.48550/arxiv.2410.01431