What’s actually happening to a neural network as it learns?
Training data generation + T-shirt at http://3b1b.co/crowdflower
Crowdflower does some cool work and addresses a meaningful need in machine learning, so I was pretty excited that they agreed to sponsor this video.
Find the full playlist at http://3b1b.co/neural-networks
The following video is sort of an appendix to this one. The main goal with the follow-on video is to show the connection between the visual walkthrough here, and the representation of these “nudges” in terms of partial derivatives that you will find when reading about backpropagation in other resources, like Michael Nielsen’s book or Chis Olah’s blog.
Thanks to everyone supporting on Patreon.
For more on backpropagation:
Music by Vincent Rubinetti: https://soundcloud.com/vincerubinetti/
3blue1brown is a channel about animating math, in all senses of the word animate. And you know the drill with YouTube, if you want to stay posted on new videos, subscribe, and click the bell to receive notifications (if you’re into that).
If you are new to this channel and want to see more, a good place to start is this playlist: http://3b1b.co/recommended
Various social media stuffs: