Readings
|
A Few Useful Things to Know about Machine Learning |
the whole paper is a warmly recommended reading |
Recognizing and Learning Object Categories |
a short course of object categorization at ICCV 2005 |
Convex Optimization |
stanford convex optimization |
Vectorized Backpropagation |
Vector, Matrix, and Tensor Derivatives |
deeplearning net tutorial with theano |
|
ConvNetJS |
|
What Every Computer Scientist Should Know About Floating-Point Arithmetic |
numerical issues |
Ilya Sutskever's thesis |
Nesterov Momentum |
Bayesian Hyperparameter Optimization |
|
Model Ensembles Dark Knowledge from Geoff Hinton |
|
SGD tips and tricks |
|
local response normalization layer |
|
Net Surgery |
apply ConvNet sliding windowns over the large-image but at a smaller stride |
Deep Learning school |
train a ConvNet from scratch |
ImageNet ILSVRC challenge |
|
ResNet Video |
Kaiming's presentation video |
ResNet Slides |
Kaiming's presentation slides |
benchmarks for CONV performance |
|
State of the art ResNets in Torch7 |
|
ConvNetJS CIFAR-10 demo |
|