Lazy Programmer

Your source for the latest in deep learning, big data, data science, and artificial intelligence. Sign up now

NEW Deep Learning Course: Advanced NLP and RNNs

May 1, 2018

nlp3

Over the past year, many of you have been asking for a followup on my RNN and Deep NLP courses. I am glad to announce that today, that course is here.

Deep Learning: Advanced NLP and RNNs

I decided to combine both NLP (natural language processing) and RNNs (recurrent neural networks) because these topics are so intertwined it’s almost impossible to talk about one without the other.

In recent years, a few ideas have started to bubble up and have shown themselves to be truly useful, and in this course, I bring those ideas to you.

Let’s start with the applications:

1. I’ve been asked quite a few times about how to do classification when each input can have multiple labels assigned to it. We will do a text classification problem that has data exactly like this.

2. Neural machine translation. One of the most popular applications of Deep NLP. We can’t not do this.

3. Question answering. You can think of this as “reading comprehension”. Can an AI read a story and answer a question about it? Facebook Research made this popular with their bAbI dataset.

4. Speech recognition (see below).

 
As you know I like to take an abstract view of machine learning. We know that all of the techniques for these applications can be used for yet more applications without any change in code because the “data is the same”. For example, a spam detection dataset looks no different than a sentiment analysis dataset.

In the same vein, neural machine translation is no different from simple versions of question answering and chatbots. So you are really learning how to do all of these things at the same time.

We will of course get a chance to review basics such as LSTMs, GRUs, language modeling, word embeddings, and so forth.

What techniques will we cover? These techniques are what have helped RNNs really work well for NLP in the recent past:

1. Bidirectional RNNs

bidirectional
2. Sequence-to-sequence models (seq2seq)

seq2seq
3. Attention

attn
4. Memory networks

memnet

So, if you’ve already heard about these and you wanted to learn about them – I hope you are excited!

 

 

THERE’S MORE:

This course is NOT just about RNNs but CNNs (convolutional neural networks) as well. This is an advanced course – ALL deep learning is fair game.

Early in the course, you’ll see how we can apply CNNs to text.

You will see that we get results on-par with LSTMs and GRUs.

That’s already pretty neat.

But there’s still more.

If you’re reading this, you automatically get access to the VIP version of the course, which contains EVEN MORE material.

For the first time, I’m releasing a course exclusively on https://deeplearningcourses.com

This course will appear on other sites in the future but you will NOT get the VIP version from those sites.

What’s in the VIP bonus?

It’s basically like an entirely new section of the course.

We will be looking at a topic I’ve wanted to cover for a long time: speech recognition.

audio

Unlike the usual type of NLP stuff which focuses on text, speech recognition focuses on audio.

Text is neat and formatted. When you type the word “the” it’s the same as if I type the word “the”.

The same cannot be said for audio. When you say “the” it sounds different from when I say “the”.

Audio is a real-world, physical signal like images are.

In that sense, speech recognition is more like computer vision.

In fact, you’ll see how we can apply CNNs to this task as well.

I love this section of the course because we get to dive into some very cool, never-before-seen material in order to do speech processing – namely time-series techniques such as the Fourier transform.

Screen Shot 2018-05-01 at 1.19.20 AM

You’ll even get a brief glimpse into how the Fourier transform is related to quantum mechanics and Heisenberg’s uncertainty principle!

Enough talk. Get the course here:

Deep Learning: Advanced NLP and RNNs
https://deeplearningcourses.com/c/deep-learning-advanced-nlp

NOTES:

1. As usual, if you purchase the course on deeplearningcourses.com and you’d like access on Udemy as well, I will do that for you once the course is released there.

2. I’ve made a lot of updates to deeplearningcourses.com recently, so hopefully you find them useful! Always happy to consider feature requests.

3. I recently moved deeplearningcourses.com to a shiny new server, so if you have any problems, please let me know. Everything seems to be running smoothly so far!

Go to comments


Deep Learning Spring Sale! Udemy Coupons $10.99

April 11, 2018

ALL Courses on Udemy $10.99

April 2018

Grab these courses before these sales go away

I’m hard at work at my next course, so guess what that means? Everything on sale!

For the next 5 days, ALL courses on Udemy (not just mine) are available for just $10.99!

For my courses, please use the coupons below (included in the links), or if you want, enter the coupon code: APR2018.

For prerequisite courses (math, stats, Python programming) and all other courses, follow the links at the bottom.

linear

https://www.udemy.com/data-science-linear-regression-in-python/?couponCode=APR2018

log

https://www.udemy.com/data-science-logistic-regression-in-python/?couponCode=APR2018

deep1

https://www.udemy.com/data-science-deep-learning-in-python/?couponCode=APR2018

nlp

https://www.udemy.com/data-science-natural-language-processing-in-python/?couponCode=APR2018

deep2
https://www.udemy.com/data-science-deep-learning-in-theano-tensorflow/?couponCode=APR2018

sql

https://www.udemy.com/sql-for-marketers-data-analytics-data-science-big-data/?couponCode=APR2018

cnn

https://www.udemy.com/deep-learning-convolutional-neural-networks-theano-tensorflow/?couponCode=APR2018

cluster

https://www.udemy.com/cluster-analysis-unsupervised-machine-learning-python/?couponCode=APR2018

udeep

https://www.udemy.com/unsupervised-deep-learning-in-python/?couponCode=APR2018

hmm

https://www.udemy.com/unsupervised-machine-learning-hidden-markov-models-in-python/?couponCode=APR2018

rnn

https://www.udemy.com/deep-learning-recurrent-neural-networks-in-python/?couponCode=APR2018

deepnlp

https://www.udemy.com/natural-language-processing-with-deep-learning-in-python/?couponCode=APR2018

super

https://www.udemy.com/data-science-supervised-machine-learning-in-python/?couponCode=APR2018

bayes

https://www.udemy.com/bayesian-machine-learning-in-python-ab-testing/?couponCode=APR2018

ensemble

https://www.udemy.com/machine-learning-in-python-random-forest-adaboost/?couponCode=APR2018

rl

https://www.udemy.com/artificial-intelligence-reinforcement-learning-in-python/?couponCode=APR2018

deeprl

https://www.udemy.com/deep-reinforcement-learning-in-python/?couponCode=APR2018

gan

https://www.udemy.com/deep-learning-gans-and-variational-autoencoders/?couponCode=APR2018

cvhttps://www.udemy.com/advanced-computer-vision/?couponCode=APR2018

 

PREREQUISITE COURSE COUPONS

And just as important, $10.99 coupons for some helpful prerequisite courses. You NEED to know this stuff to understand machine learning in-depth:

General (site-wide): http://bit.ly/2oCY14Z
Python http://bit.ly/2pbXxXz
Calc 1 http://bit.ly/2okPUib
Calc 2 http://bit.ly/2oXnhpX
Calc 3 http://bit.ly/2pVU0gQ
Linalg 1 http://bit.ly/2oBBir1
Linalg 2 http://bit.ly/2q5SGEE
Probability (option 1) http://bit.ly/2prFQ7o
Probability (option 2) http://bit.ly/2p8kcC0
Probability (option 3) http://bit.ly/2oXa2pb
Probability (option 4) http://bit.ly/2oXbZSK

 

OTHER UDEMY COURSE COUPONS

As you know, I’m the “Lazy Programmer”, not just the “Lazy Data Scientist” – I love all kinds of programming!

iOS courses:
https://lazyprogrammer.me/ios

Android courses:
https://lazyprogrammer.me/android

Ruby on Rails courses:
https://lazyprogrammer.me/ruby-on-rails

Python courses:
https://lazyprogrammer.me/python

Big Data (Spark + Hadoop) courses:
https://lazyprogrammer.me/big-data-hadoop-spark-sql

Javascript, ReactJS, AngularJS courses:
https://lazyprogrammer.me/js

 

EVEN MORE COOL STUFF

Into Yoga in your spare time? Photography? Painting? There are courses, and I’ve got coupons! If you find a course on Udemy that you’d like a coupon for, just let me know and I’ll hook you up!

Go to comments


Linear Regression in the Wild – AV1: Next Generation Video Codec

April 10, 2018

A lot of students come up to me and ask about when they’re going to learn the latest and greatest new deep learning algorithm.

Sometimes, it’s easy to forget how applicable even the most basic of tools are.

As you know, I consider Linear Regression to be the best starting point for deep learning and machine learning in general.

And wouldn’t you know, here it is being used in the most advanced, state-of-the-art video codec we have today:

next generation video: Introducing AV1

Check it out!

snowbird2

This new state-of-the-art video codec is based on research done by multiple big companies, such as Google, Cisco, and Mozilla.

As you can see, the final equation is just a line (\( y = mx + b \)).

$$ CfL(\alpha) = \alpha L^{AC} + DC $$

Go to comments


Google Introduces TensorFlow Hub: A Library for Reusable Machine Learning Modules in TensorFlow

April 9, 2018

https://medium.com/tensorflow/introducing-tensorflow-hub-a-library-for-reusable-machine-learning-modules-in-tensorflow-cdee41fa18f9

Go to comments


Deep Learning St. Patrick’s Day Sale! All Udemy Courses 90% OFF

March 17, 2018

stpatricks

ALL Courses on Udemy $10.99

St. Patrick’s Day 2018

Who needs luck when you have machine learning?

I’m hard at work at my next course, so guess what that means? Everything on sale!

For the next 3 days, ALL courses on Udemy (not just mine) are available for just $10.99!

For my courses, please use the coupons below (included in the links), or if you want, enter the coupon code: MAR2018.

For prerequisite courses (math, stats, Python programming) and all other courses, follow the links at the bottom.

linear

https://www.udemy.com/data-science-linear-regression-in-python/?couponCode=MAR2018

log

https://www.udemy.com/data-science-logistic-regression-in-python/?couponCode=MAR2018

deep1

https://www.udemy.com/data-science-deep-learning-in-python/?couponCode=MAR2018

nlp

https://www.udemy.com/data-science-natural-language-processing-in-python/?couponCode=MAR2018

deep2
https://www.udemy.com/data-science-deep-learning-in-theano-tensorflow/?couponCode=MAR2018

sql

https://www.udemy.com/sql-for-marketers-data-analytics-data-science-big-data/?couponCode=MAR2018

cnn

https://www.udemy.com/deep-learning-convolutional-neural-networks-theano-tensorflow/?couponCode=MAR2018

cluster

https://www.udemy.com/cluster-analysis-unsupervised-machine-learning-python/?couponCode=MAR2018

udeep

https://www.udemy.com/unsupervised-deep-learning-in-python/?couponCode=MAR2018

hmm

https://www.udemy.com/unsupervised-machine-learning-hidden-markov-models-in-python/?couponCode=MAR2018

rnn

https://www.udemy.com/deep-learning-recurrent-neural-networks-in-python/?couponCode=MAR2018

deepnlp

https://www.udemy.com/natural-language-processing-with-deep-learning-in-python/?couponCode=MAR2018

super

https://www.udemy.com/data-science-supervised-machine-learning-in-python/?couponCode=MAR2018

bayes

https://www.udemy.com/bayesian-machine-learning-in-python-ab-testing/?couponCode=MAR2018

ensemble

https://www.udemy.com/machine-learning-in-python-random-forest-adaboost/?couponCode=MAR2018

rl

https://www.udemy.com/artificial-intelligence-reinforcement-learning-in-python/?couponCode=MAR2018

deeprl

https://www.udemy.com/deep-reinforcement-learning-in-python/?couponCode=MAR2018

gan

https://www.udemy.com/deep-learning-gans-and-variational-autoencoders/?couponCode=MAR2018

cv
https://www.udemy.com/advanced-computer-vision/?couponCode=MAR2018

 

PREREQUISITE COURSE COUPONS

And just as important, $10.99 coupons for some helpful prerequisite courses. You NEED to know this stuff to understand machine learning in-depth:

General (site-wide): http://bit.ly/2oCY14Z
Python http://bit.ly/2pbXxXz
Calc 1 http://bit.ly/2okPUib
Calc 2 http://bit.ly/2oXnhpX
Calc 3 http://bit.ly/2pVU0gQ
Linalg 1 http://bit.ly/2oBBir1
Linalg 2 http://bit.ly/2q5SGEE
Probability (option 1) http://bit.ly/2prFQ7o
Probability (option 2) http://bit.ly/2p8kcC0
Probability (option 3) http://bit.ly/2oXa2pb
Probability (option 4) http://bit.ly/2oXbZSK

 

OTHER UDEMY COURSE COUPONS

As you know, I’m the “Lazy Programmer”, not just the “Lazy Data Scientist” – I love all kinds of programming!

iOS courses:
https://lazyprogrammer.me/ios

Android courses:
https://lazyprogrammer.me/android

Ruby on Rails courses:
https://lazyprogrammer.me/ruby-on-rails

Python courses:
https://lazyprogrammer.me/python

Big Data (Spark + Hadoop) courses:
https://lazyprogrammer.me/big-data-hadoop-spark-sql

Javascript, ReactJS, AngularJS courses:
https://lazyprogrammer.me/js

 

EVEN MORE COOL STUFF

Into Yoga in your spare time? Photography? Painting? There are courses, and I’ve got coupons! If you find a course on Udemy that you’d like a coupon for, just let me know and I’ll hook you up!

Go to comments