On hyperparameter optimization of machine learning algorithms: Theory and practice

• Published in: Neurocomputing (Amsterdam) Vol. 415; pp. 295 - 316
• Main Authors: Yang, Li, Shami, Abdallah
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 20.11.2020
• Subjects: Bayesian optimization; Genetic algorithm; Grid search; Hyper-parameter optimization; Machine learning; Particle swarm optimization; Grid search; Hyper-parameter optimization; Bayesian optimization; Genetic algorithm; Particle swarm optimization; Machine learning

Machine learning algorithms have been used widely in various applications and areas. To fit a machine learning model into different problems, its hyper-parameters must be tuned. Selecting the best hyper-parameter configuration for machine learning models has a direct impact on the model’s performanc...