Open Peer Review. Open Publishing. Open Access. Open Discussion. Open Directory. Open Recommendations. Open API. Open Source.
Exploring the Application of Deep Learning for Supervised Learning Problems
Jose Rozanec, Gilad Katz, Eui Chul Richard Shin, Dawn Song
Nov 05, 2016 (modified: Dec 16, 2016)ICLR 2017 conference submissionreaders: everyone
Abstract:One of the main difficulties in applying deep neural nets (DNNs) to new domains is the need to explore multiple architectures in order to discover ones that perform well. We analyze a large set of DNNs across multiple domains and derive insights regarding their effectiveness. We also analyze the characteristics of various DNNs and the general effect they may have on performance. Finally, we explore the application of meta-learning to the problem of architecture ranking. We demonstrate that by using topological features and modeling the changes in its weights, biases and activation functions layers of the initial training steps, we are able to rank architectures based on their predicted performance. We consider this work to be a first step in the important and challenging direction of exploring the space of different neural network architectures.
TL;DR:We explore the multiple DNN architectures on a large set of general supervised datasets. We also propose a meta-learning approach for DNN performance prediciton and ranking
Keywords:Deep learning, Supervised Learning
Enter your feedback below and we'll get back to you as soon as possible.