Categories backpropagation

7 posts

Auto Added by WPeMatico

Only Numpy: Decoupled Convolutional LSTM to classify Puppy GIFs and Baby GIFs with Interactive…

Only Numpy: Decoupled Convolutional LSTM to classify Puppy GIFs and Baby GIFs with Interactive Code. Before reading on, please note that this is experimental model, I just wanted to challenge myself to build this model. So there are some high possibilities that there are some errors in the back propagation […]

Only Numpy: Implementing Simple ResNet ( Deep Networks with Stochastic Depth) for MNIST…

Only Numpy: Implementing Simple ResNet ( Deep Networks with Stochastic Depth) for MNIST Classification with Interactive Code Image from Pixel Bay So I was reading this article “Stochastic Depth Networks will Become the New Normal” and there I saw the paper “Deep Networks with Stochastic Depth”. Upon reading that paper I […]

Only Numpy: Implementing Mini VGG (VGG 7) and SoftMax Layer with Interactive Code

Picture from Pixel Bay I wanted to practice my Back Propagation skills on Convolutional Neural Network. And I wanted to implement my own VGG net (from original paper “Very Deep Convolutional Networks for Large-Scale Image Recognition”) for sometime now, so today I decided to combine those two needs. If you are not […]

Manual Back Prop with TensorFlow: Decoupled Recurrent Neural Network, modified NN from Google…

Manual Back Prop with TensorFlow: Decoupled Recurrent Neural Network, modified NN from Google Brain, Implementation with Interactive Code. Photo from Pixel Bay I love Tensorflow and it’s ability to perform auto differentiation, however that does not mean we cannot perform manual back propagation even in Tensorflow. Also for me, building an […]

Only Numpy: Decoupled Recurrent Neural Network, modified NN from Google Brain, Implementation with…

Only Numpy: Decoupled Recurrent Neural Network, modified NN from Google Brain, Implementation with Interactive Code So I was talking to one of my friend Michael, who is also very interested in Machine Learning as well, about Google Brain’s Decoupled Neural Interfaces Using Synthetic Gradients. And he inspired me this idea, […]

Only Numpy: Implementing and Comparing Gradient Descent Optimization Algorithms + Google Brain’s…

Only Numpy: Implementing and Comparing Gradient Descent Optimization Algorithms + Google Brain’s Adding Gradient Noise with Interactive Code Ever since I saw this ‘Over View of Gradient Descent Algo’ from Sebastian Ruder. I wanted to make this post for a long time, since not only I wanted to implement different […]

Only Numpy: Deriving Forward feed and Back Propagation in Synthetic Gradient (Decoupled Neural…

Only Numpy: Deriving Forward feed and Back Propagation in Synthetic Gradient (Decoupled Neural Interfaces) with Interactive Code feat. iamtrask So first thing! Merry Christmas Eve, and happy holidays. I hope everyone is have a lovely holiday. Anyways lets get right into it, and before reading there are 2 very important things […]