Assessing Hyper Parameter Optimization and Speedup for Convolutional Neural Networks

Shushma Patel

Research output: Contribution to journalArticlepeer-review

Abstract

The increased processing power of graphical processing units (GPUs) and the availability of large image datasets has fostered a renewed interest in extracting semantic information from images. Promising results for complex image categorization problems have been achieved using deep learning, with neural networks comprised of many layers. Convolutional neural networks (CNN) are one such architecture which provides more opportunities for image classification. Advances in CNN enable the development of training models using large labelled image datasets, but the hyper parameters need to be specified, which is challenging and complex due to the large number of parameters. A substantial amount of computational power and processing time is required to determine the optimal hyper parameters to define a model yielding good results. This article provides a survey of the hyper parameter search and optimization methods for CNN architectures.
Original languageEnglish
Pages (from-to)1-17
JournalInternational Journal of Artificial Intelligence and Machine Learning
DOIs
Publication statusPublished - 16 Jul 2020
Externally publishedYes

Keywords

  • autoencoders
  • intrusion detection
  • clustering
  • machine learning
  • SCADA
  • anomaly detection
  • IoT
  • neural networks
  • classification

Fingerprint

Dive into the research topics of 'Assessing Hyper Parameter Optimization and Speedup for Convolutional Neural Networks'. Together they form a unique fingerprint.

Cite this