Deep Learning Resources for 201921 Jan 2019
First of all I recommend the excellent course by Jeremy Howard at San Francisco University which is free to follow online on their website. This is the new course in 2019:
There is a courses in progress and it will be uploaded to the website as it finishes.
I watched all their 2018 videos and they are fantastic and still worth to watch:
- Practical Deep Learning For Coders, Part 1
- Cutting Edge Deep Learning For Coders, Part 2
- Introduction to Machine Learning for Coders
Visit kaggle.com and get a feeling for competition and what will be expected from ML and DL practitioners.
You can learn Pandas on Kaggle with interactive jupyter notebooks. They have quite a number of very interesting tutorials.
Andrew Ng on Coursera
Both courses can be watched free if you enroll as auditor. Please see my article about “How to audit courses on Coursera” and how to benefit of the MOOC offering. The oldest of his courses,
has been my introduction to Machine Learning. When I first watched this I felt like superman. I used to think ML was beyond my reach (and it still is) but I could develop an intuition for it and I got greatly inspired. Terrific course but now outdated. I believe it has been made around 2012 and they still use octave software for assignments. I would still watch the courses but would recommend to start with:
In this specialisation in 5 in 5 coursecourses he uses Python and Jupyter notebooks for the assignments and it goes really indeep about forward and back-propagation. Great for your intuition. Not always easy. Some assignments are available for auditors. Probably pay for the course is good value for money, even if you are not interested in the certificates, the assignments are great value to learn. As a curiosity the seminal course by Geoffrey Hinton, “Neural Networks for Machine Learning” on Coursera is not offered anymore but still to watch on youtube.
The CS231n: Convolutional Neural Networks for Visual Recognition course at Stanford is quite popular. The 2017 videos are on youtube.
It is good to watch but assignments and resource websites are already a bit outdated. Great material though, waiting to watch the 2018 videos when they become available.
A course in Algebra
taught by Rachel Thomas (one of the co-founder of fastai) at the university of San Francisco is a series of videos about that math knowledge you migt need for deep learning. The Python notebooks are on her GitHub
A very practical hands-on tutorials
He has a very practical blog with lots of tips. The good part is that many of the articles get you up and running in a minimal amount of time. He has written three books on the subject and they are quite expensive. The website and blogs are really promotion for his books but I like his approach and he really always replies to comments ad questions.
It is better not to spend too much time on the theory, the practical side of AI should be prioritise, Jeremy Howard talks of a top-down approach and many agree with him. Spend time coding and getting the knowledge you need when you need it. However as a reference I found these books to be a good companion to your journey.
- Introduction to Machine Learning with Python: A Guide for Data Scientists by Andreas C. Müller, Sarah Guido
- Python Machine Learning: Machine Learning and Deep Learning with Python, scikit-learn, and TensorFlow by Sebastian Raschka, Vahid Mirjalili
- Hands-On Machine Learning with Scikit-Learn and TensorFlow by Aurélien Géron
- Deep Learning by Ian Goodfellow Very math centric, a copy is in html version on the website. Would not recommend unless you have very solid basis in math.
- An important report about ethics and AI
- A free online book :Neural networks and deep learning This book:
- Wes McKinney’s Python for Data Analysis, 2nd ed. is also great for learning about data analysis with Python and Pandas and is a recommended reading from Jeremy Howard.
Read some good blogs
- The Sara Hooker’s blog and this article for Medium
- This blog by Christine mcleavey is quite impressive
- Michael Nielsen
- Approximately Correct
- This is impressive and a very good post about ciber-security: Splunk
- I quite like the Notebooks of Peter Norvig and like this one
- In her blog Hiromi Suenaga wrote down notes from Fastai machine learning lessons. Good if you are starting from the old course of 2018.
- Olah’s Blog and distill.pub
And if this was not enough for you, head to another incredibly detailed list published on Kaggle :Awesome Deep Learning Basics and Resources by Arunkumar V Ramanan
That’s it for now. If I missed something let me know in the comments!If you liked this post, you can share it with your followers or follow me on Twitter!