A quick look at the gist of the backpropagation idea to calculate the gradients of neural networks, which go into the stochastic gradient descent algorithm. Check it out! Video. Notes.
Category Archives: Machine learning
Machine learning and stochastic gradient descent
I very briefly describe gradient descent (GD) and how it is used in the context of machine learning: the stochastic gradient descent algorithm (SGD). The idea is simple: divide your data into randomly chosen mini-batches and use a mini-batch to estimate the gradient of your cost function. Use that to do GD iterations at fixed …
Continue reading “Machine learning and stochastic gradient descent”
Machine learning and linear algebra
A first look at how linear algebra shows up in elementary machine learning. If you are new to linear algebra, you may find this interesting! Check it out! Video. Notes.