What is backpropagation really doing? | Chapter 3, deep learning – YouTube

Spread the love

What is backpropagation really doing? | Chapter 3, deep learning

What’s actually happening to a neural network as it learns?

Training data generation + T-shirt at http://3b1b.co/crowdflower
Crowdflower does some cool work and addresses a meaningful need in machine learning, so I was pretty excited that they agreed to sponsor this video.

Find the full playlist at http://3b1b.co/neural-networks
The following video is sort of an appendix to this one. The main goal with the follow-on video is to show the connection between the visual walkthrough here, and the representation of these “nudges” in terms of partial derivatives that you will find when reading about backpropagation in other resources, like Michael Nielsen’s book or Chis Olah’s blog.

Thanks to everyone supporting on Patreon.
http://3b1b.co/nn3-thanks
http://3b1b.co/support

For more on backpropagation:
http://neuralnetworksanddeeplearning.com/chap2.html
https://github.com/mnielsen/neural-networks-and-deep-learning
http://colah.github.io/posts/2015-08-Backprop/

Music by Vincent Rubinetti: https://soundcloud.com/vincerubinetti/

——————

3blue1brown is a channel about animating math, in all senses of the word animate. And you know the drill with YouTube, if you want to stay posted on new videos, subscribe, and click the bell to receive notifications (if you’re into that).

If you are new to this channel and want to see more, a good place to start is this playlist: http://3b1b.co/recommended

Various social media stuffs:
Website: https://www.3blue1brown.com
Twitter: https://twitter.com/3Blue1Brown
Patreon: https://patreon.com/3blue1brown
Facebook: https://www.facebook.com/3blue1brown
Reddit: https://www.reddit.com/r/3Blue1Brown

Copyright © 2018 NEURALSCULPT