WARNING! Login sessions are currently short-lived. Please backup comments before submitting to avoid accidental loss of work.

# ICLR 2014

## International Conference on Learning Representations

### Apr 14 - 16, 2014, Banff, Canada

Please see the venue website for more information.

Submission deadline:
**27 Dec 2013**

Open for public discussion

ICLR 2014 operates on an open reviewing model. Please feel free to engage in public discussion of the submitted papers during and after the review period.

## Workshop Track

#### Submitted Papers

Stochastic Gradient Estimate Variance in Contrastive Divergence and Persistent Contrastive Divergence

Mathias Berglund, Tapani Raiko

23 Dec 2013
arXiv
4 Comments
Unsupervised feature learning by augmenting single images

Alexey Dosovitskiy, Jost Tobias Springenberg, Thomas Brox

19 Dec 2013
arXiv
4 Comments
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps

Karen Simonyan, Andrea Vedaldi, Andrew Zisserman

22 Dec 2013
arXiv
3 Comments
Learning States Representations in POMDP

Gabriella Contardo, Ludovic Denoyer, Thierry Artieres, Patrick Gallinari

23 Dec 2013
arXiv
2 Comments
Learning Factored Representations in a Deep Mixture of Experts

David Eigen, Marc'Aurelio Ranzato, Ilya Sutskever

19 Dec 2013
arXiv
8 Comments
Learning Semantic Script Knowledge with Event Embeddings

Ashutosh Modi, Ivan Titov

19 Dec 2013
arXiv
7 Comments
Learning Information Spread in Content Networks

Sylvain Lamprier, Simon Bourigault, Ludovic Denoyer, Patrick Gallinari, Cédric Lagnier

23 Dec 2013
arXiv
4 Comments
Relaxations for inference in restricted Boltzmann machines

Sida I. Wang, Roy Frostig, Percy Liang, Christopher D. Manning

23 Dec 2013
arXiv
3 Comments
Distributional Models and Deep Learning Embeddings: Combining the Best of Both Worlds

Irina Sergienya, Hinrich Schütze

20 Dec 2013
arXiv
7 Comments
Unsupervised Feature Learning by Deep Sparse Coding

Yun Wang, Yanjun Qi, Arthur Szlam, Yunlong He, Koray Kavukcuoglu

22 Dec 2013
arXiv
7 Comments
Deep Learning Embeddings for Discontinuous Linguistic Units

Wenpeng Yin, Hinrich Schütze

19 Dec 2013
arXiv
4 Comments
Deep learning for class-generic object detection

Brody Huval, Adam Coates, Andrew Ng

24 Dec 2013
arXiv
2 Comments
Generic Deep Networks with Wavelet Scattering

Edouard Oyallon, Stéphane Mallat, Laurent Sifre

23 Dec 2013
arXiv
4 Comments
GPU Asynchronous Stochastic Gradient Descent to Speed Up Neural Network Training

Thomas Huang, Zhe Lin, Hailin Jin, Jianchao Yang, Thomas Paine

24 Dec 2013
arXiv
11 Comments
Competitive Learning with Feedforward Supervisory Signal for Pre-trained Multilayered Networks

Takashi Shinozaki, Yasushi Naruse

23 Dec 2013
arXiv
5 Comments
Multi-GPU Training of ConvNets

Omry Yadan, Keith Adams, Yaniv Taigman, Marc'Aurelio Ranzato

25 Dec 2013
arXiv
6 Comments
End-to-End Text Recognition with Hybrid HMM Maxout Models

Ouais Alsharif, Joelle Pineau

20 Dec 2013
arXiv
5 Comments
Occupancy Detection in Vehicles Using Fisher Vector Image Representation

Yusuf Artan, Peter Paul

23 Dec 2013
arXiv
2 Comments
## Conference Track

#### Submitted Papers

Exact solutions to the nonlinear dynamics of learning in deep linear neural networks

Andrew M. Saxe, James L. McClelland, Surya Ganguli

24 Dec 2013
arXiv
6 Comments
An Empirical Investigation of Catastrophic Forgeting in Gradient-Based Neural Networks

Ian J. Goodfellow, Mehdi Mirza, Da Xiao, Aaron Courville, Yoshua Bengio

23 Dec 2013
arXiv
19 Comments
Learned versus Hand-Designed Feature Representations for 3d Agglomeration

John A. Bogovic, Gary B. Huang, Viren Jain

23 Dec 2013
arXiv
6 Comments
Multi-View Priors for Learning Detectors from Sparse Viewpoint Data

Bojan Pepik, Michael Stark, Peter Gehler, Bernt Schiele

23 Dec 2013
arXiv
6 Comments
Efficient Visual Coding: From Retina To V2

Honghao Shan, Garrison Cottrell

25 Dec 2013
arXiv
3 Comments
Learning Type-Driven Tensor-Based Meaning Representations

Tamara Polajnar, Luana Fagarasan, Stephen Clark

23 Dec 2013
arXiv
6 Comments
A Simple Model for Learning Multilingual Compositional Semantics

Karl Moritz Hermann, Phil Blunsom

24 Dec 2013
arXiv
7 Comments
Deep Belief Networks for Image Denoising

Mohammad Ali Keyvanrad, Mohammad Pezeshki, Mohammad Mehdi Homayounpour

25 Dec 2013
arXiv
3 Comments
Spectral Networks and Locally Connected Networks on Graphs

Joan Bruna, Wojciech Zaremba, Arthur Szlam, Yann LeCun

24 Dec 2013
arXiv
8 Comments
Understanding Deep Architectures using a Recursive Convolutional Network

David Eigen, Jason Rolfe, Rob Fergus, Yann LeCun

17 Dec 2013
arXiv
13 Comments
Distinction between features extracted using deep belief networks

Mohammad Pezeshki, Sajjad Gholami, Ahmad Nickabadi

25 Dec 2013
arXiv
4 Comments
Why does the unsupervised pretraining encourage moderate-sparseness?

Jun Li, Wei Luo, Jian Yang, Xiaotong Yuan

22 Dec 2013
arXiv
6 Comments
A Primal-Dual Method for Training Recurrent Neural Networks Constrained by the Echo-State Property

Jianshu Chen, Li Deng

19 Dec 2013
arXiv
14 Comments
Learning Paired-associate Images with An Unsupervised Deep Learning Architecture

Ti Wang, Daniel L. Silver

24 Dec 2013
arXiv
8 Comments
Stopping Criteria in Contrastive Divergence: Alternatives to the Reconstruction Error

David Buchaca, Enrique Romero, Ferran Mazzanti, Jordi Delgado

23 Dec 2013
arXiv
10 Comments
Learning Transformations for Classification Forests

Qiang Qiu, Guillermo Sapiro

19 Dec 2013
arXiv
4 Comments
Rate-Distortion Auto-Encoders

Luis G. Sanchez Giraldo, Jose C. Principe

30 Dec 2013
arXiv
3 Comments
Group-sparse Embeddings in Collective Matrix Factorization

Arto Klami, Guillaume Bouchard, Abhishek Tripathi

24 Dec 2013
arXiv
4 Comments
Semistochastic Quadratic Bound Methods

Aleksandr Y. Aravkin, Anna Choromanska, Tony Jebara, Dimitri Kanevsky

24 Dec 2013
arXiv
6 Comments
Generative NeuroEvolution for Deep Learning

Phillip Verbancsics, Josh Harguess

20 Dec 2013
arXiv
5 Comments
Sparse similarity-preserving hashing

Alex M. Bronstein, Pablo Sprechmann, Michael M. Bronstein, Jonathan Masci, Guillermo Sapiro

20 Dec 2013
arXiv
9 Comments
Learning High-level Image Representation for Image Retrieval via Multi-Task DNN using Clickthrough Data

Wei Yu, Tiejun Zhao, Yalong Bai, Wei-Ying Ma, Kuiyuan Yang

20 Dec 2013
arXiv
6 Comments
Neuronal Synchrony in Complex-Valued Deep Networks

David P. Reichert, Thomas Serre

23 Dec 2013
arXiv
9 Comments
Sparse, complex-valued representations of natural sounds learned with phase and amplitude continuity priors

Wiktor Mlynarski

18 Dec 2013
arXiv
6 Comments
Learning Human Pose Estimation Features with Convolutional Networks

Ajrun Jain, Graham W. Taylor, Christoph Bregler, Mykhaylo Andriluka, Jonathan Tompson

29 Dec 2013
arXiv
9 Comments
Zero-Shot Learning by Convex Combination of Semantic Embeddings

Mohammad Norouzi, Tomas Mikolov, Samy Bengio, Yoram Singer, Jonathon Shlens, Andrea Frome, Greg S. Corrado, Jeffrey Dean

23 Dec 2013
arXiv
5 Comments
Correlation-based construction of neighborhood and edge features

Balázs Kégl

31 Dec 2013
arXiv
6 Comments
EXMOVES: Classifier-based Features for Scalable Action Recognition

Du Tran, Lorenzo Torresani

22 Dec 2013
arXiv
6 Comments
Deep Convolutional Ranking for Multilabel Image Annotation

Yunchao Gong, Yangqing Jia, Sergey Ioffe, Alexander Toshev, Thomas Leung

17 Dec 2013
arXiv
7 Comments
On Fast Dropout and its Applicability to Recurrent Networks

Patrick van der Smagt, Christian Osendorfer, Nutan Chen, Daniela Korhammer, Sebastian Urban, Justin Bayer

18 Dec 2013
arXiv
12 Comments
A Generative Product-of-Filters Model of Audio

Dawen Liang, Mathew D. Hoffman, Gautham Mysore

22 Dec 2013
arXiv
7 Comments
OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks

Pierre Sermanet, David Eigen, Xiang Zhang, Michael Mathieu, Rob Fergus, Yann LeCun

23 Dec 2013
arXiv
5 Comments
Learning generative models with visual attention

Yichuan Tang, Nitish Srivastava, Ruslan Salakhutdinov

23 Dec 2013
arXiv
7 Comments
Learning to encode motion using spatio-temporal synchrony

Kishore Reddy Konda, Roland Memisevic, Vincent Michalski

18 Dec 2013
arXiv
7 Comments
Factorial Hidden Markov Models for Learning Representations of Natural Language

Anjan Nepal, Alexander Yates

23 Dec 2013
arXiv
7 Comments
Multi-digit Number Recognition from Street View Imagery using Deep Convolutional Neural Networks

Ian J. Goodfellow, Yaroslav Bulatov, Julian Ibarz, Sacha Arnoud, Vinay Shet

23 Dec 2013
arXiv
5 Comments
Low-Rank Approximations for Conditional Feedforward Computation in Deep Neural Networks

Andrew Davis, Itamar Arel

18 Dec 2013
arXiv
5 Comments
Unit Tests for Stochastic Optimization

Tom Schaul, Ioannis Antonoglou, David Silver

23 Dec 2013
arXiv
6 Comments
An Architecture for Distinguishing between Predictors and Inhibitors in Reinforcement Learning

Patrick C. Connor, Thomas P. Trappenberg

20 Dec 2013
arXiv
10 Comments
Deep and Wide Multiscale Recursive Networks for Robust Image Labeling

Gary B. Huang, Viren Jain

17 Dec 2013
arXiv
6 Comments
Approximated Infomax Early Stopping: Revisiting Gaussian RBMs on Natural Images

Taichi Kiwaki, Takaki Makino, Kazuyuki Aihara

19 Dec 2013
arXiv
8 Comments
Some Improvements on Deep Convolutional Neural Network Based Image Classification

Andrew G. Howard

19 Dec 2013
arXiv
3 Comments
One-Shot Adaptation of Supervised Deep Convolutional Models

Judy Hoffman, Eric Tzeng, Jeff Donahue, Yangqing Jia, Kate Saenko, Trevor Darrell

23 Dec 2013
arXiv
11 Comments
How to Construct Deep Recurrent Neural Networks

Razvan Pascanu, Caglar Gulcehre, Kyunghyun Cho, Yoshua Bengio

22 Dec 2013
arXiv
16 Comments
On the number of inference regions of deep feed forward networks with piece-wise linear activations

Razvan Pascanu, Guido Montufar, Yoshua Bengio

22 Dec 2013
arXiv
12 Comments
Revisiting Natural Gradient for Deep Networks

Razvan Pascanu, Yoshua Bengio

20 Dec 2013
arXiv
9 Comments
Image Representation Learning Using Graph Regularized Auto-Encoders

Yiyi Liao, Yue Wang, Yong Liu

17 Dec 2013
arXiv
6 Comments
Fast Training of Convolutional Networks through FFTs

Michael Mathieu, Mikael Henaff, Yann LeCun

23 Dec 2013
arXiv
12 Comments
Improving Deep Neural Networks with Probabilistic Maxout Units

Jost Tobias Springenberg, Martin Riedmiller

23 Dec 2013
arXiv
12 Comments
Multimodal Transitions for Generative Stochastic Networks

Sherjil Ozair, Li Yao, Yoshua Bengio

20 Dec 2013
arXiv
5 Comments
Modeling correlations in spontaneous activity of visual cortex with centered Gaussian-binary deep Boltzmann machines

Nan Wang, Laurenz Wiskott, Dirk Jancke

22 Dec 2013
arXiv
9 Comments
An empirical analysis of dropout in piecewise linear networks

David Warde-Farley, Ian J. Goodfellow, Aaron Courville, Yoshua Bengio

26 Dec 2013
arXiv
7 Comments
Large-scale Multi-label Text Classification - Revisiting Neural Networks

Jinseok Nam, Jungi Kim, Iryna Gurevych, Johannes Fürnkranz

22 Dec 2013
arXiv
4 Comments
Sequentially Generated Instance-Dependent Image Representations for Classification

Ludovic Denoyer, Matthieu Cord, Patrick Gallinari, Nicolas Thome, Gabriel Dulac-Arnold

24 Dec 2013
arXiv
6 Comments
Deep learning for neuroimaging: a validation study

Sergey M. Plis, Devon R. Hjelm, Ruslan Salakhutdinov, Vince D. Calhoun

23 Dec 2013
arXiv
9 Comments
Bounding the Test Log-Likelihood of Generative Models

Yoshua Bengio, Li Yao, Kyunghyun Cho

18 Dec 2013
arXiv
7 Comments
Continuous Learning: Engineering Super Features With Feature Algebras

Michael Tetelman

19 Dec 2013
arXiv
11 Comments
Learning Non-Linear Feature Maps, With An Application To Representation Learning

Dimitrios Athanasakis, John Shawe-Taylor, Delmiro Fernandez-Reyes

22 Dec 2013
arXiv
5 Comments
Zero-Shot Learning and Clustering for Semantic Utterance Classification

Yann N. Dauphin, Gokhan Tur, Dilek Hakkani-Tur, Larry Heck

03 Jan 2014
arXiv
8 Comments
Intriguing properties of neural networks

Christian Szegedy, Wojciech Zaremba, Ilya Sutskever, Joan Bruna, Dumitru Erhan, Ian Goodfellow, Rob Fergus

23 Dec 2013
arXiv
21 Comments
Nonparametric Weight Initialization of Neural Networks via Integral Representation

Sho Sonoda, Noboru Murata

23 Dec 2013
arXiv
7 Comments
Can recursive neural tensor networks learn logical reasoning?

Samuel R. Bowman

23 Dec 2013
arXiv
9 Comments