Deep Learning

**Lesson 1: From Machine Learning to Deep Learning** - Understand the historical context and motivation for Deep Learning. - Set up a basic supervised classification task and train a black box classifier on it. - Train a logistic classifier “by hand”Optimize a logistic classifier using gradient descent, SGD, Momentum and AdaGrad. **Lesson 2: Deep Neural Networks** - Train a simple deep network. - Effectively regularize a simple deep network. - Train a competitive deep network via model exploration and hyperparameter tuning. **Lesson 3: Convolutional Neural Networks** - Train a simple convolutional neural net. - Explore the design space for convolutional nets. **Lesson 4: Deep Models for Text and Sequences** - Train a text embedding model. - Train a LSTM model.