Backpropagation calculus | Deep Learning Chapter 4

What people said

melvinroest · 2020-06 · Recommendation

I'm just an enthusiast. With that said, I think the author's first image image really captures the core of forward propagation and back propagation. For people who want to get more of a feel on autodiffing, I find these 2 sources amazing [1, 2]. They don't use the word autodiffing, but looking at it, I can see it's the same thing. I once made an attempt at animating feed forward propagation [3]. If I'd animate back propagation, I'd probably make an animation on autodiffing as well as that is the most intuitive way I know on how to explain back propagation right now. It's still on my big to do list ;-) [1] [LINK] [2] 3Blue1Brown does in episode 4 of his Deep Learning series: [VIDEO] [3] [LINK]

Read the original HN comment ↗

nouveaux · 2017-11 · Recommendation

This was very timely for me and for anyone else learning, here are the first few videos of the series: [LINK] [LINK] [LINK] (Original video) [VIDEO]

Read the original HN comment ↗

hal9000xp · 2017-11 · Recommendation

I'm in the same boat. For long time, I was interested in AI but at the same time intimidated by math. I'm relatively comfortable with discrete mathematics and classical algorithms and at the same time calculus and linear algebra is completely foreign to me. Also, I do not accept way to learn ML without good understanding of core principles behind it. So math is a must. A few months ago, I stumbled upon very amazing YouTube Channel 3Blue1Brown which explains math in very accessible way and at the same time I got feeling that I finally started understanding core ideas behind linear algebra and calculus. Just recently he published 4 videos about deep neural networks: [LINK] [LINK] [LINK] [VIDEO] So my fear of ML was gone away and I'm very excited to explore whole new world for neural networks and other things like support vector machines etc

Read the original HN comment ↗