Difference between revisions of "Automatic Machine Learning (AUTO-AUTO-ENCODER!)"

From ISLAB/CAISR
 
Line 2: Line 2:
 
|Summary=Automatic configuration algorithm for autoencoders
 
|Summary=Automatic configuration algorithm for autoencoders
 
|Keywords=Deep learning, autoencoder, meta learning, AutoML
 
|Keywords=Deep learning, autoencoder, meta learning, AutoML
|TimeFrame=Winter 2016 - Spring 2017
+
|TimeFrame=Fall 2018
 
|References=The following paper summarises the algorithm configuration in the different domain :
 
|References=The following paper summarises the algorithm configuration in the different domain :
 
http://aad.informatik.uni-freiburg.de/papers/16-AUTOML-AutoNet.pdf
 
http://aad.informatik.uni-freiburg.de/papers/16-AUTOML-AutoNet.pdf
Line 11: Line 11:
 
Previous master thesis on applying autoencoder for histogram data:
 
Previous master thesis on applying autoencoder for histogram data:
 
Robin Ng, “Efficient Implementation of Histogram Dimension Reduction using Deep Learning”, 2017.
 
Robin Ng, “Efficient Implementation of Histogram Dimension Reduction using Deep Learning”, 2017.
 
+
|Prerequisites=Artificial Intelligence and Learning Systems courses,
|Prerequisites=Artificial Intelligence and Learning Systems courses,  
+
|Supervisor=Sławomir Nowaczyk, Sepideh Pashami,
|Supervisor=Sławomir Nowaczyk, Sepideh Pashami,  
+
 
|Level=Master
 
|Level=Master
 
|Status=Open
 
|Status=Open

Latest revision as of 19:55, 14 October 2018

Title Automatic Machine Learning (AUTO-AUTO-ENCODER!)
Summary Automatic configuration algorithm for autoencoders
Keywords Deep learning, autoencoder, meta learning, AutoML
TimeFrame Fall 2018
References The following paper summarises the algorithm configuration in the different domain :

http://aad.informatik.uni-freiburg.de/papers/16-AUTOML-AutoNet.pdf

This paper presents the initial idea behind Bayesian optimization for estimating parameter: https://www.cs.ubc.ca/~hutter/papers/10-TR-SMAC.pdf

Previous master thesis on applying autoencoder for histogram data: Robin Ng, “Efficient Implementation of Histogram Dimension Reduction using Deep Learning”, 2017.

Prerequisites Artificial Intelligence and Learning Systems courses,
Author
Supervisor Sławomir Nowaczyk, Sepideh Pashami
Level Master
Status Open


For anyone who is tired of machine learning algorithm’s configuration.

Algorithm configuration plays an important role in the performance of machine learning methods. In addition, data scientists every day spend a lot of time with a little guidance to choose the parameters of the algorithm. Further, learning the parameter of the algorithm as automatic as possible enables the use of machine learning for a wider range of science and technology.

Usually, state of the art methods target supervised classification machine learning tasks. This project focuses on parameter configurations of autoencoders for variously available datasets. Autoencoder is unsupervised feature extraction technique based on the neural network which trains in a supervised fashion. Following explains the necessary steps toward achieving an automatic autoencoder during this project.

- Studying recent advances in meta-learning, transfer learning, algorithm selection, and algorithm configuration.
- Studying and implementing autoencoder 
- Adapting existing algorithm configurations for autoencoder and comparing their performance