March 13, 2019
Go to comments
January 22, 2019
|
January 1, 2019
|
|
|
|
|
|
|
|
November 14, 2018
|
|
|
|
|
|
|
|
|
September 13, 2018
|
September 12, 2018
|
||||||||||||||
|
July 15, 2018
|
|
|
|
|
|
|
|
|
July 15, 2018
You may have noticed that my course Natural Language Processing with Deep Learning in Python has gotten a lot longer recently!
As part of my course revitalization process, I’ve added a significant number of updates to this course.
All students are receiving this announcement because no matter what skill-level you’re currently at, you will get a lot of value from this update.
What has changed?
UPDATES FOR BEGINNERS:
A brand new section called “Beginner’s Corner”. This section requires only basic machine learning knowledge. Know what a feature vector is, and know how to use the SciKit-Learn API.
You will get a taste of what word2vec and GloVe vectors can do.
You can still get a good understanding of what the course is about even if you’re not (yet!) ready to tackle the rest of the course.
UPDATES FOR INTERMEDIATE STUDENTS:
A brand new “Review” section has been added. This section focuses on the bigram model, and several ways to implement it.
1) Just counting. For example, p(heads) = # heads / # total.
2) A single neuron (logistic model). We show how this is equivalent to #1.
3) A neural network model. We show how this actually makes #2 more efficient.
Crucially, this section provides you with all the techniques you need to tackle the next section on word2vec.
The word2vec section has also been completely re-done in order to take advantage of the concepts learned in the Review, making the transition seamless.
Finally, a brand new section on word vectors unifies the word2vec and GloVe sections, giving you a totally new (and in my opinion, better) way of training word2vec.
UPDATES FOR EXPERTS:
Additional theory lectures and Tensorflow code have been added to the RNN and Recursive Neural Network sections. Recall: the latter is a neural network structured like a tree.
Yes, Tensorflow’s capabilities have caught up! We can now do everything in Tensorflow that we’d previously done in Theano.
So if you’ve been avoiding these sections because you didn’t know Theano, now you have no excuse. =)
Click HERE to get the course if you don’t have it yet.
Hope you enjoy the updates, happy learning!
Go to commentsMay 21, 2018
This is a great video that explains a lot of what I’ve observed from students trying to machine learning, but put more eloquently than I could have said myself. =)
I’m always having to contend against students who have taken a super easy-peasy course, actually learned nothing, but believe they know everything. Then, when they come up against the real content, they believe it’s because the instructor is trying to make the course really “elite” or trying to make them feel “dumb” by including lots of math and/or programming that they can’t understand.
But realize:
- I (or any other instructor) did not invent these subjects
- If the subject requires math, that’s because it does
- If the subject requires programming, that’s because it does
We didn’t put math in there just to torture you. If you’re taking a math course, it’s probably going to have math in it.
A student gets frustrated because they don’t understand the real subject, but really they should be frustrated with the instructor who gave them the empty course that provided them with no skill and too much confidence.
This video is about software developers, but if you view it from the perspective of machine learning, everything still applies. Watch the video!
Go to commentsMay 1, 2018
Over the past year, many of you have been asking for a followup on my RNN and Deep NLP courses. I am glad to announce that today, that course is here.
Deep Learning: Advanced NLP and RNNs
I decided to combine both NLP (natural language processing) and RNNs (recurrent neural networks) because these topics are so intertwined it’s almost impossible to talk about one without the other.
In recent years, a few ideas have started to bubble up and have shown themselves to be truly useful, and in this course, I bring those ideas to you.
Let’s start with the applications:
1. I’ve been asked quite a few times about how to do classification when each input can have multiple labels assigned to it. We will do a text classification problem that has data exactly like this.
2. Neural machine translation. One of the most popular applications of Deep NLP. We can’t not do this.
3. Question answering. You can think of this as “reading comprehension”. Can an AI read a story and answer a question about it? Facebook Research made this popular with their bAbI dataset.
4. Speech recognition (see below).
As you know I like to take an abstract view of machine learning. We know that all of the techniques for these applications can be used for yet more applications without any change in code because the “data is the same”. For example, a spam detection dataset looks no different than a sentiment analysis dataset.
In the same vein, neural machine translation is no different from simple versions of question answering and chatbots. So you are really learning how to do all of these things at the same time.
We will of course get a chance to review basics such as LSTMs, GRUs, language modeling, word embeddings, and so forth.
What techniques will we cover? These techniques are what have helped RNNs really work well for NLP in the recent past:
1. Bidirectional RNNs
2. Sequence-to-sequence models (seq2seq)
3. Attention
4. Memory networks
So, if you’ve already heard about these and you wanted to learn about them – I hope you are excited!
THERE’S MORE:
This course is NOT just about RNNs but CNNs (convolutional neural networks) as well. This is an advanced course – ALL deep learning is fair game.
Early in the course, you’ll see how we can apply CNNs to text.
You will see that we get results on-par with LSTMs and GRUs.
That’s already pretty neat.
But there’s still more.
If you’re reading this, you automatically get access to the VIP version of the course, which contains EVEN MORE material.
For the first time, I’m releasing a course exclusively on https://deeplearningcourses.com
This course will appear on other sites in the future but you will NOT get the VIP version from those sites.
What’s in the VIP bonus?
It’s basically like an entirely new section of the course.
We will be looking at a topic I’ve wanted to cover for a long time: speech recognition.
Unlike the usual type of NLP stuff which focuses on text, speech recognition focuses on audio.
Text is neat and formatted. When you type the word “the” it’s the same as if I type the word “the”.
The same cannot be said for audio. When you say “the” it sounds different from when I say “the”.
Audio is a real-world, physical signal like images are.
In that sense, speech recognition is more like computer vision.
In fact, you’ll see how we can apply CNNs to this task as well.
I love this section of the course because we get to dive into some very cool, never-before-seen material in order to do speech processing – namely time-series techniques such as the Fourier transform.
You’ll even get a brief glimpse into how the Fourier transform is related to quantum mechanics and Heisenberg’s uncertainty principle!
Enough talk. Get the course here:
Deep Learning: Advanced NLP and RNNs
https://deeplearningcourses.com/c/deep-learning-advanced-nlp
NOTES:
1. As usual, if you purchase the course on deeplearningcourses.com and you’d like access on Udemy as well, I will do that for you once the course is released there.
2. I’ve made a lot of updates to deeplearningcourses.com recently, so hopefully you find them useful! Always happy to consider feature requests.
3. I recently moved deeplearningcourses.com to a shiny new server, so if you have any problems, please let me know. Everything seems to be running smoothly so far!
Go to comments